PhD degree successfully defended by Nicolai Pedersen

Monday 07 Mar 22
|
by Eva Helena Andersen

Contact

Contact

Jens Hjortkjær
Associate Professor
DTU Health Tech
+45 30 29 16 90

Contact

Torsten Dau
Head of Sections, Professor
DTU Health Tech
+45 45 25 39 77

Contact

Lars Kai Hansen
Professor, head of section
DTU Compute
+45 45 25 38 89

On February 22, Nicolai Fernández Pedersen successfully defended his thesis "Audiovisual speech analysis with deep learning".

In his PhD project, Nicolai analyzed audio and visual features in natural speech signals and investigated how such features can be exploited by a speech separation system. The thesis contained a coherent set of three studies that focused on (1) a large-scale analysis of audiovisual features in natural speech using canonical correlation analysis (CCA), (2) non-linear neural networks to learn correlated audiovisual features, (3) audiovisual speech separation using three different fusion strategies. Nicolai’s work consolidated and extended our understanding of the key features and their relation in audiovisual speech. He contributed to solving the permutation problem in source separation, which is one of the long-standing goals in hearing science.

The defence took place on February 22nd at the Technical University of Denmark where Nicolai gave a 45-minute lecture about his work. The two external examiners participated online. After the lecture, the examiners and supervisors asked a wide range of both general and specific questions related to audiovisual speech production and perception, extraction of audiovisual features and their application in speech separation systems. Nicolai demonstrated a solid understanding of the respective topics and the assessment committee unanimously agreed that the PhD degree should be conferred to Nicolai Pedersen.

Caption (leftmost): Chairperson at defence Associate Professor Finn Agerkvist, Principal supervisor Associate Professor Jens Hjortkjær, PhD Nicolai Pedersen,Co-supervisor Professor Torsten Dau, Examiner Associate Professor Tobias May, DTU Health Tech. Photo: Henrik Hvidberg.

Supervisors:
Principal supervisor: Associate Professor Jens Hjortkjær
Co-supervisor: Professor Torsten Dau

Co-supervisor: Professor Lars Kai Hansen

Examiners:
Associate Professor Tobias May, DTU Health Tech

Professor Zheng-Hua Tan, Aalborg University
Professor Hani Camille Yehia, Federal University of Minas Gerais

Chairperson at defence:
Associate Professor Finn Agerkvist