Seminar Meta Learning (SemMeL)5 ECTS
(englische Bezeichnung: Seminar Meta Learning)
(Prüfungsordnungsmodul: Seminar Meta Learning)

Lehrveranstaltungen:

• • Seminar Meta Learning
    (Seminar, 2 SWS, Andreas Maier et al., Mo, 8:15 - 9:45, KH 1.021)

Inhalt:

Meta-learning refers to algorithms which aim to learn an aspect of a learning algorithm from data. Examples of meta-learning methods include algorithms which design neural network architectures based on data, optimize the performance of a learning algorithm or exploit commonalities between tasks to enable learning from few samples on unseen tasks. These methods hold the promise to automate machine learning even further than learning good representations from data by learning algorithms to learn even better representations.
The seminar will cover the most important works which provide the cornerstone knowledge to understand cutting edge research in the field of meta-learning.
Applications will include:

• Learning from few samples
  

• Automatically tuning neural network architectures
  

• Determining appropriate equivariances
  

• Disentangling causal mechanisms
  

Lernziele und Kompetenzen:

Students will be able to

• perform their own literature research on a given subject
  

• independently research this subject
  

• present and introduce the subject to their student peers
  

• give a scientific talk in English according to international conference standards

Literatur:

Finn et al., "Model-agnostic meta-learning for fast adaptation of deep networks", ICML 2017
Zhou et al., "Meta-learning symmetries by reparameterization", Arxiv
Snell et al., "Prototypical networks for few-shot learning", Neurips 2017
Triantafillou et al., "Meta-dataset: A dataset of datasets for learning to learn from few examples", ICLR 2020
Vinyals et al., "Matching networks for one shot learning. ", Neurips 2016
Zoph et al. "Neural Architecture Search with Reinforcement Learning", Journal of Machine Learning Research 20 (2019)
Bengio et al., "A meta-transfer objective for learning to disentangle causal mechanisms", ICLR 2020
Santoro et al., "Meta-Learning with Memory-Augmented Neural Networks", ICML 2016
Ravi et al., "Optimization as a model for few-shot learning", ICLR 2016 Munkhdalai et al., "Meta Networks", ICML 2017
Sung et al. "Learning to Compare: Relation Network for Few-Shot Learning", CVPR 2018
Nichol et al. "On First-Order Meta-Learning Algorithms", Arxiv

Weitere Informationen:

Verwendbarkeit des Moduls / Einpassung in den Musterstudienplan:

1. Computational Engineering (Rechnergestütztes Ingenieurwesen) (Master of Science)
   (Po-Vers. 2013 | TechFak | Computational Engineering (Rechnergestütztes Ingenieurwesen) (Master of Science) | Gesamtkonto | Seminar, Masterarbeit | Seminar im Masterstudium | Seminar Meta Learning)

Studien-/Prüfungsleistungen:

Seminar Meta Learning (Prüfungsnummer: 76751)

Prüfungsleistung, Seminarleistung, Dauer (in Minuten): 30, benotet, 5 ECTS

Anteil an der Berechnung der Modulnote: 100.0 %

weitere Erläuterungen:
scientific talk in English

Prüfungssprache: Englisch

Erstablegung: WS 2020/2021, 1. Wdh.: SS 2021

1. Prüfer:

Andreas Maier