UnivIS
Information system of Friedrich-Alexander-University Erlangen-Nuremberg © Config eG 
FAU Logo
  Collection/class schedule    module collection Home  |  Legal Matters  |  Contact  |  Help    
search:      semester:   
 
 Layout
 
printable version

 
 
 Also in UnivIS
 
course list

lecture directory

 
 
events calendar

job offers

furniture and equipment offers

 
 

  Selected Topics in Deep Learning for Audio, Speech, and Music Processing (DLA)

Lecturers
Prof. Dr. ir. Emanuël A. P. Habets, Prof. Dr. Meinard Müller

Details
Vorlesung
Online
2 cred.h, ECTS studies, ECTS credits: 2,5, Sprache Englisch
Zeit: Mon 16:00 - 18:00, Zoom-Meeting, 3R4.04

Fields of study
WF EEI-MA ab 1
WF INF-MA ab 1
WF CME-MA ab 1
WF ASC-MA ab 1
WF ICT-MA ab 1

Prerequisites / Organisational information
In this course, we require a good knowledge of deep learning techniques, machine learning, and pattern recognition as well as a strong mathematical background. Furthermore, we require a solid background in general digital signal processing and some experience with audio, image, or video processing.

It is recommended to finish the following modules (or having equivalent knowledge) before starting this module:

  • Lecture Deep Learning

  • Digitale Signalverarbeitung

  • Statistische Signalverarbeitung

  • Sprach- und Audiosignalverarbeitung

Contents
Many recent advances in audio, speech, and music processing have been driven by techniques based on deep learning (DL). For example, DL-based techniques have led to significant improvements in, for example, speaker separation, speech synthesis, acoustic scene analysis, audio retrieval, chord recognition, melody estimation, and beat tracking. Considering specific audio, speech, and music processing tasks, we study various DL-based approaches and their capability to extract complex features and make predictions based on hidden structures and relations. Rather than giving a comprehensive overview, we will study selected and generally applicable DL-based techniques. Furthermore, in the context of challenging application scenarios, we will critically review the potential and limitations of recent deep learning techniques. As one main general objective of the lecture, we want to discuss how you can integrate domain knowledge into neural network architectures to obtain explainable models that are less vulnerable to data biases and confounding factors.

The course consists of two overview-like lectures, where we introduce current research problems in audio, speech, and music processing. We will then continue with 6 to 8 lectures on selected audio processing topics and DL-based techniques. Being based on articles from the research literature, we will provide detailed explanations covered in mathematical depth; we may also try to attract some of the original authors to serve as guest lecturers. Finally, we round off the course by a concluding lecture covering practical aspects (e.g., hardware, software, version control, reproducibility, datasets) that are relevant when working with DL-based techniques.

ECTS information:
Title:
Selected Topics of Deep Learning for Audio, Speech, and Music Processing

Credits: 2,5

Prerequisites
In this course, we require a good knowledge of deep learning techniques, machine learning, and pattern recognition as well as a strong mathematical background. Furthermore, we require a solid background in general digital signal processing and some experience with audio, image, or video processing.

It is recommended to finish the following modules (or having equivalent knowledge) before starting this module:

  • Lecture Deep Learning

  • Digitale Signalverarbeitung

  • Statistische Signalverarbeitung

  • Sprach- und Audiosignalverarbeitung

Contents
Many recent advances in audio, speech, and music processing have been driven by techniques based on deep learning (DL). For example, DL-based techniques have led to significant improvements in, for example, speaker separation, speech synthesis, acoustic scene analysis, audio retrieval, chord recognition, melody estimation, and beat tracking. Considering specific audio, speech, and music processing tasks, we study various DL-based approaches and their capability to extract complex features and make predictions based on hidden structures and relations. Rather than giving a comprehensive overview, we will study selected and generally applicable DL-based techniques. Furthermore, in the context of challenging application scenarios, we will critically review the potential and limitations of recent deep learning techniques. As one main general objective of the lecture, we want to discuss how you can integrate domain knowledge into neural network architectures to obtain explainable models that are less vulnerable to data biases and confounding factors.

The course consists of two overview-like lectures, where we introduce current research problems in audio, speech, and music processing. We will then continue with 6 to 8 lectures on selected audio processing topics and DL-based techniques. Being based on articles from the research literature, we will provide detailed explanations covered in mathematical depth; we may also try to attract some of the original authors to serve as guest lecturers. Finally, we round off the course by a concluding lecture covering practical aspects (e.g., hardware, software, version control, reproducibility, datasets) that are relevant when working with DL-based techniques.

Additional information
Keywords: AudioLabs Deep Learning Audio Speech Music
Expected participants: 10
www: https://www.audiolabs-erlangen.de/fau/professor/mueller/teaching/2021s_dla
Registration is required for this lecture.
Registration starts on Monday, 22.2.2021, 14:55 and lasts till Monday, 19.4.2021, 15:00 über: StudOn.

Verwendung in folgenden UnivIS-Modulen
Startsemester SS 2021:
Selected Topics of Deep Learning for Audio, Speech, and Music Processing (DLA)

Department: International Audio Laboratories Erlangen (AudioLabs)
UnivIS is a product of Config eG, Buckenhof