Unlike traditional transfer or multi-task methods, meta-learning with MAML can learn an inductive bias to quickly adapt to new and unseen tasks. But at what cost? With Shariq Iqbal and Fei Sha, we took a closer look at the requirements for MAML to succeed in learning this inductive bias. This led to our AISTATS’21 paper where we discussed some of our findings.
[at AISTATS, website, code]
Implicit Gradient Transport
In the Summer of 2018, I had the good fortune of visiting Mila, hosted by Ioannis Mitliagkas. Together with Nicolas Le Roux, Pierre-Antoine Manzagol, and Reza Babanezhad, we devised a simple yet effective algorithm for variance reduction in gradient-based optimization. The result, IGT, was accepted as a spotlight contribution at NeurIPS 2019.
[at NeurIPS, website, code, on twitter]
Kleo the Cat
In the Summer of 2017, Théo Denisart and I spent some time designing and programming a 3D-printed robotic cat for reinforcement learning, while at the ValeroLab. What makes Kleo special is that its limbs are actuated via tendons – making it robust to failures but difficult to control. Matt Simon brilliantly covered our work in his WIRED article.
[on WIRED, video, website]
learn2learn is a meta-learning framework built on top of PyTorch. It provides practitioners with high-level meta-learning implementations, and researchers with low-level utilities to develop new meta-learning algorithms for the supervised and reinforcement learning settings. It is in active development, and was the (lucky) winner of the PyTorch Summer Hackathon. You can install it with
pip install learn2learn.
[code, learn2learn.net, preprint, presentation]
Cherry is a reinforcement learning framework built on top of PyTorch. What differentiates cherry from other RL frameworks is that it does not provide any algorithm implementation! Instead, it provides utilities to make it easy for researchers to implement their own algorithms. It has been used in many settings (optimization, meta-learning, variance reduction) and is under active development. You can install it with
pip install cherry-rl.
Randopt is a Python package for machine learning experiment management, hyper-parameter optimization, and results visualization. It is in active development and I – as well as others – have been using it for every machine learning project since November 2016. You can install it with
pip install randopt.
Tooski is the largest francophone website dedicated to the Ski World Cup. On it, you’ll find news and blogs related to the Swiss Ski Team, the FIS World Cup circuit, as well as some younger skiers. Tooski began as an adventure in merging two of my passions: computers and skiing.