Transformer: the 3rd generation neural network acoustic models for ASR and its application at Facebook

Please note change of time from original post to 3-4pm

Yongqiang Wang, Facebook.

Zoom: https://zoom.us/j/94591123432?pwd=bUJObFZ3UnFYLy9pWENDcS9aYUZqUT09.

Monday 30 November 2020, 15:00-16:00

Information Engineering Distinguished Lecture Series

Speech Recognition: What’s Left?

This talk is organised in conjunction with the IEEE Signal Processing Society for which Dr Michael Picheny is a Distinguished Industry Speaker

Dr Michael Picheny.

Department of Engineering - LT1.

Tuesday 12 November 2019, 12:00-13:00

Robust speech processing on multi-talker mixed speech

Yanmin Qian, Shanghai Jiao Tong University.

Department of Engineering - James Dyson Building Seminar Room.

Friday 10 May 2019, 11:00-12:00

How can speech technologies support learners to improve their skills of speaking, listen-ing, conversation and more?

Nobuaki MINEMATSU .

Department of Engineering - Lecture Theater 6.

Tuesday 19 March 2019, 14:00-15:30

Kōrero Māori - indigenous language revitalisation powered by machine learning

Keoni Mahelona & Peter-Lucas Jones.

Department of Engineering - Lecture Room 12.

Tuesday 30 October 2018, 12:00-13:00

General teacher-student learning for automatic speech recognition

Jeremy Wong, University of Cambridge.

Department of Engineering - James Dyson Building Seminar Room.

Tuesday 31 July 2018, 12:00-13:00

Predictive Uncertainty in Deep Learning

Andrey Malinin (University of Cambridge).

Department of Engineering - LR5 Lecture Room.

Thursday 03 May 2018, 12:00-13:00

Structured Deep Learning for Dialogue Management

Kai Yu, Shanghai Jiao Tong University.

Department of Engineering - LR3B Lecture Room.

Monday 19 February 2018, 12:00-13:00

Situated Intelligent Interactive Systems

Zhou Yu, CMU, US.

Department of Engineering - James Dyson Building Seminar Room.

Thursday 27 April 2017, 15:00-16:00

Statistical Spoken Dialogue Systems and the Challenges for Machine Learning

Professor Steve Young, Cambridge University Engineering Department.

Department of Engineering - Lecture Theater 2 (Inglis Building).

Monday 27 February 2017, 12:00-13:00

Investigating the interdependencies between DNN architectures and optimisation methods for Large Vocabulary Speech Continuous Speech Recognition

Adnan Haider, University of Cambridge.

Department of Engineering - LR3A.

Monday 31 October 2016, 12:00-13:00

Very deep convolutional neural networks for speech recognition

Tom Sercu, IBM Watson, USA.

Department of Engineering - LR5.

Friday 19 August 2016, 12:00-13:00

Don't multiply lightly: exploring how DNN depth interacts with HMM independence assumptions in hybrid HMM/DNN's used for ASR

Steven Wegmann, Semantic Machines and International Computer Science Institute (ICSI).

James Dyson Building Seminar Room - Department of Engineering.

Monday 04 July 2016, 12:00-13:00

Towards Advanced Conversational Systems

G. Wu, Maluuba.

Department of Engineering - LR11.

Wednesday 11 November 2015, 12:00-13:00

What the DNN heard? Dissecting the machine brain for a better insight.

Khe Chai Sim, National University of Singapore.

Department of Engineering - LR5.

Wednesday 04 November 2015, 12:00-13:00

Interspeech presentations

Sandwiches will be provided at 12:00

Various (University of Cambridge).

Department of Engineering - LR5.

Wednesday 02 September 2015, 11:00-13:00

ICASSP presentations

A sandwich lunch will be provided

Various.

Department of Engineering - LR4.

Thursday 09 April 2015, 12:00-14:00

Dynamic Topic Adaptation for Statistical Machine Translation

Sandwich lunch from 13:00

Eva Hasler (University of Cambridge).

Department of Engineering - LR5.

Friday 06 March 2015, 13:30-14:30

Human-like singing and talking machines: flexible speech synthesis in karaoke, anime, smart phones, video games, digital signage, TV and radio programs, etc.

Sandwich lunch from 13:00

Keiichi Tokuda (Nagoya Institute of Technology / Google).

Department of Engineering - LR6.

Friday 06 February 2015, 13:30-14:30

The Geometry of Machine Translation

Sandwich lunch from 13:00

Rory Waite (University of Cambridge).

Department of Engineering - LR6.

Friday 16 January 2015, 13:30-14:30

Cluster Adaptive Training for Deep Neural Networks

Sandwiches will be provided

Tian Tan (visitor at CUED).

Department of Engineering - LR10.

Friday 28 November 2014, 12:00-13:00

Syllable based keyword search: transducing syllable lattices to word lattices

Sandwiches will be provided at 13:00

Jim Hieronymus, ICSI (US).

Department of Engineering - LT2.

Friday 21 November 2014, 13:30-14:30

Modulation spectrum-based approach to high-quality statistical parametric speech synthesis

Sandwiches will be provided

Shinnosuke Takamichi (NAIST, Japan).

Department of Engineering - Oatley 1 Meeting Room.

Monday 17 November 2014, 12:00-13:00

Interspeech presentations

Various.

Department of Engineering - LR6.

Wednesday 10 September 2014, 12:00-13:30

ICASSP presentations

Various.

Department of Engineering - LR6.

Friday 25 April 2014, 12:00-13:00

Investigation of multilingual speech-to-text systems for use in spoken term detection

Kate Knill (University of Cambridge) .

Department of Engineering - LR12.

Thursday 03 April 2014, 12:00-13:00

Efficient Lattice Rescoring Using Recurrent Neural Network Language Models

Xunying (Andrew) Liu (University of Cambridge).

Department of Engineering - LR6.

Friday 07 March 2014, 13:00-13:30

Will recurrent neural network language models scale?

Tony Robinson (Cantab Research).

Department of Engineering - LR6.

Friday 07 March 2014, 12:00-13:00

Refinements in Hierarchical Phrase-Based Translation

Juan Pino (University of Cambridge).

Department of Engineering - LR6.

Friday 07 February 2014, 12:00-13:00

Inverse reinforcement learning for modeling micro-turn taking

Dongho Kim.

Department of Engineering - LR6.

Friday 10 January 2014, 12:00-13:00

Physically Situated Spoken Language Interaction: Opportunities and Challenges

Dan Bohus (Microsoft Research, Redmond).

Department of Engineering - LR12.

Wednesday 30 October 2013, 12:30-13:30

Speech & NLP at Amazon — Unique Challenges, Unique Resources

Jeff Adams (Amazon).

Department of Engineering - LR3B.

Monday 28 October 2013, 10:00-11:00

Recurrent Continuous Translation Models

Nal Kalchbrenner (University of Oxford).

Department of Engineering - LR12.

Monday 07 October 2013, 12:00-13:00

POMDP-based dialogue manager adaptation to extended domains

Milica Gasic (University of Cambridge).

Department of Engineering - LR6.

Friday 06 September 2013, 12:00-13:00

Interspeech practice session

Various.

Department of Engineering - LR6.

Friday 02 August 2013, 12:00-13:30

Recent Work in Acoustic Modelling at Google

Dr Andrew Senior, Google, New York.

Department of Engineering - LR6.

Thursday 11 July 2013, 11:30-12:30

Dialog state tracking: Open problems, challenge task, and recent work

Jason D. Williams, Microsoft Research.

Department of Engineering - LR12.

Tuesday 11 June 2013, 12:00-13:00

ICASSP poster practice session

Various.

Department of Engineering - LR6.

Friday 03 May 2013, 12:00-13:00

Robust speech recognition / Towards better probabilistic models of speech - a discussion

Speaker to be confirmed.

Department of Engineering - LR6.

Friday 05 April 2013, 12:00-13:30

Introduction to Dialogue Systems

Blaise Thomson (University of Cambridge).

Department of Engineering - LR6.

Friday 15 March 2013, 11:30-13:00

Paraphrastic Language Models / Structured SVMs for ASR

Andrew Liu, Austin Zhang.

Department of Engineering - LR12.

Friday 01 February 2013, 13:00-14:00

Acoustic Factorisation for Robust Speech Recognition

Eric(Yongqiang) Wang (University of Cambridge).

Department of Engineering - LR6.

Friday 11 January 2013, 12:30-13:30

Efficient Decoding with Generative Score-Spaces Using the Expectation Semiring

Rogier van Dalen (University of Cambridge).

Department of Engineering - LR6.

Friday 30 November 2012, 12:30-13:30

Overview of Speech Technology Research at CUED

Speaker to be confirmed.

Department of Engineering - LR6.

Friday 02 November 2012, 12:00-13:30

Speech Seminars

Learning Hierarchical Translation Structure with Linguistic Annotations

Sandwiches will be provided.

Markos Mylonakis, University of Amsterdam.

Cambridge University Engineering Department, Room LR10.

Tuesday 11 October 2011, 13:00-14:30

Speech Seminars

Applications of Lexicographic Semirings in Speech and Language Processing

Sandwiches will be provided.

Brian Roark, Oregon Health & Science University (OHSU).

Cambridge University Engineering Department, Room LR10.

Monday 03 October 2011, 13:00-14:30

Machine Intelligence Lab Seminar

Some new approaches to speech recognition and language modelling

Geoffrey Hinton (University of Toronto).

Cambridge University Engineering Department, Lecture Room 2.

Wednesday 22 June 2011, 14:00-15:00

speech synthesis seminar series

Statistical Parametric Speech Synthesis Based on Speaker and Language Factorization

Heiga Zen (Toshiba Research Europe Ltd.).

Cambridge University Engineering Department, Lecture Room 11.

Tuesday 21 June 2011, 13:00-14:30

Speech Seminars

Lagrangian relaxation for inference in natural language processing

There will be sandwiches.

Michael Collins, Columbia University.

Cambridge University Engineering Department, Lecture Room 6.

Monday 13 June 2011, 13:00-14:30

Machine Intelligence Lab Seminar

Spectral Moment Features for Robust Speech Recognition

Pirros Tsiakoulis (Institute for Language and Speech Processing (ILSP)).

Cambridge University Engineering Department, Lecture Room 6.

Tuesday 31 May 2011, 13:00-14:00

Machine Intelligence Lab Seminar

Incremental adaptation of speech recognition based on macroscopic time evolution system

Shinji Watanabe (NTT Communication Science Laboratories, Japan).

Cambridge University Engineering Department, Lecture Room 6.

Monday 30 May 2011, 13:00-14:00

speech synthesis seminar series

Text analysis for speech synthesis

Sabine Buchholz (Toshiba Research Europe Ltd.).

Cambridge University Engineering Department, Language Unit Meeting Room.

Wednesday 13 April 2011, 13:00-15:00

Speech Seminars

Engineering Advances in Measuring and Using Speech Production Information

There will be sandwiches

Shrikanth Narayanan, University of Southern California.

Cambridge University Engineering Department, Lecture Room 6.

Monday 11 April 2011, 13:00-14:30

speech synthesis seminar series

Context modelling in HMM based speech synthesis

Kai Yu (Cambridge University).

Cambridge University Engineering Department, Lecture Room 4.

Wednesday 16 March 2011, 12:30-14:00

speech synthesis seminar series

Speech Production Mechanism And Vocoding Technique In Statistical Parametric Speech Synthesis

Sandwich will be provided.

Ranniery (Toshiba Research Europe Ltd.) and Yannis (Google).

Cambridge University Engineering Department, Lecture Room 2.

Wednesday 02 March 2011, 13:00-15:00

speech synthesis seminar series

New and emerging applications of 'adaptive' speech synthesis'

Sandwich will be provided.

Junichi Yamagishi, Centre for Speech Technology Research (CSTR) at the University of Edinburgh.

Cambridge University Engineering Department, Lecture Room 4.

Wednesday 09 February 2011, 13:00-15:00

speech synthesis seminar series

Modelling trajectories in statistical speech synthesis

This is the second talk of the speech synthesis seminar series.

Matt Shannon (Cambridge) and Heiga Zen (Toshiba Research Europe Ltd.).

Cambridge University Engineering Department, Lecture Room 2.

Wednesday 26 January 2011, 13:00-15:00

speech synthesis seminar series

STATISTICAL SPEECH SYNTHESIS

Heiga Zen (Toshiba Research Europe Ltd.).

Cambridge University Engineering Department, Lecture Room 4.

Tuesday 11 January 2011, 13:00-15:00

Machine Intelligence Laboratory Speech Seminars

Towards Tree-to-Tree Translation

David Chiang (University of Southern California).

LR5, Engineering Department, Baker Building.

Monday 01 February 2010, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

Multi-view Learning of Speech Feature Spaces

Karen Livescu (TTI-Chicago).

LR4, Engineering Department, Baker Building.

Tuesday 15 September 2009, 16:00-17:00

Machine Intelligence Laboratory Speech Seminars

Bayesian Learning Approaches for Speech Recognition

Professor Jen-Tzung Chien (National Cheng Kung University, Taiwan).

LR5, Engineering Department, Baker Building.

Friday 04 September 2009, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

Factors Affecting ASR Model Self-Training

Scott Novotney (HLTCOE and BBN Technologies).

LR5, Engineering Department, Baker Building.

Tuesday 01 September 2009, 11:00-12:00

Machine Intelligence Laboratory Speech Seminars

Statistical Parametric Speech Synthesis

Heiga Zen (Toshiba).

LR5, Engineering Department, Baker Building.

Monday 26 January 2009, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

A tractable hybrid DDN-POMDP approach to affective dialogue modeling for probabilistic frame-based dialogue systems

Trung Bui (Twente).

LR5, Engineering Department, Baker Building.

Monday 20 October 2008, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

Error Approximation and Minimum Bayes Risk Acoustic Model Estimation

Matt Gibson (University of Sheffield).

LR5, Engineering Department, Baker Building.

Thursday 10 July 2008, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

A Comparison of VTLN and Gender-Dependent Models

Thomas Schaaf (Multimodal Technologies, Inc).

LR4, Engineering Department, Baker Building.

Thursday 26 June 2008, 12:00-13:00

Machine Intelligence Laboratory Speech Seminars

Extended HVS Parser

Filip Jurcicek (Pilsen).

LR12, Engineering Department, Baker Building.

Monday 02 June 2008, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

Spoken Dialogue Systems for Space and Lunar Exploration

Jim Hieronymus (NASA Ames Research Center).

LR5, Engineering Department, Baker Building.

Tuesday 27 May 2008, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

Vocal Tract Transfer Function Estimation Using Factor Analyzed Trajectory Hidden Markov Model

Tomoki Toda (Nara Institute of Science and Technology).

LR5, Engineering Department, Baker Building.

Monday 19 May 2008, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

Recent work on POMDP-based dialog systems at AT&T

Jason Williams (At&T).

LR5, Engineering Department, Baker Building.

Monday 12 May 2008, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

Inducing Meaning from Text

Dan Jurafsky (Stanford University).

LR5, Engineering Department, Baker Building.

Tuesday 06 May 2008, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

Uncertainty and Learning in Spoken Human-Computer Dialogue

Blaise Thomson, CUED MIL.

LR5, Engineering Department, Baker Building.

Monday 10 March 2008, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

Dialectal Chinese Speech Recognition

Thomas Fang Zheng (Tsinghua University, Beijing).

LR5, Engineering Department, Baker Building.

Friday 24 August 2007, 11:30-12:30

Machine Intelligence Laboratory Speech Seminars

Multidimensional Dialogue Management and Dialogue Act Recognition using Bayesian Networks

Simon Keizer (University of Tilburg).

LR5, Engineering Department, Baker Building.

Tuesday 14 August 2007, 11:30-12:30

Machine Intelligence Laboratory Speech Seminars

Can Robots Learn Language the Way Children Do?

Stephen E. Levinson (University of Illinois).

LR4, Engineering Department, Baker Building.

Tuesday 10 July 2007, 11:30-12:30

Machine Intelligence Laboratory Speech Seminars

Interpreting Multimodal Communication Scenes

Steve Renals (Edinburgh).

LR3, Engineering Department, Baker Building.

Tuesday 16 January 2007, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

Tracheoesophageal Speech Repair

Arantza Del Pozo, CUED Machine Intelligence Laboratory.

LR6, Engineering Department, Baker Building.

Monday 20 November 2006, 13:00-14:00

Machine Intelligence Laboratory Speech Seminars

Use of Linguistic Information and Reordering Strategies for Ngram- based Statistical Machine Translation

Adria de Gispert, TALP Research Centre – Univ. Politecnica de Catalunya (UPC), Barcelona, Spain.

LR5, Engineering Department, Baker Building.

Tuesday 31 October 2006, 13:00-14:00