Lessons learned from the NeurIPS 2021 MetaDL challenge: Backbone fine-tuning without episodic meta-learning dominates for few-shot learning image classification

by   Adrian El Baz, et al.

Although deep neural networks are capable of achieving performance superior to humans on various tasks, they are notorious for requiring large amounts of data and computing resources, restricting their success to domains where such resources are available. Metalearning methods can address this problem by transferring knowledge from related tasks, thus reducing the amount of data and computing resources needed to learn new tasks. We organize the MetaDL competition series, which provide opportunities for research groups all over the world to create and experimentally assess new meta-(deep)learning solutions for real problems. In this paper, authored collaboratively between the competition organizers and the top-ranked participants, we describe the design of the competition, the datasets, the best experimental results, as well as the top-ranked methods in the NeurIPS 2021 challenge, which attracted 15 active teams who made it to the final phase (by outperforming the baseline), making over 100 code submissions during the feedback phase. The solutions of the top participants have been open-sourced. The lessons learned include that learning good representations is essential for effective transfer learning.


NeurIPS'22 Cross-Domain MetaDL competition: Design and baseline results

We present the design and baseline results for a new challenge in the Ch...

Few-Shot Learning for Image Classification of Common Flora

The use of meta-learning and transfer learning in the task of few-shot i...

Meta-Album: Multi-domain Meta-Dataset for Few-Shot Image Classification

We introduce Meta-Album, an image classification meta-dataset designed t...

Towards Solving Fuzzy Tasks with Human Feedback: A Retrospective of the MineRL BASALT 2022 Competition

To facilitate research in the direction of fine-tuning foundation models...

Meta-learning from Learning Curves Challenge: Lessons learned from the First Round and Design of the Second Round

Meta-learning from learning curves is an important yet often neglected r...

OpenKBP: The open-access knowledge-based planning grand challenge

The purpose of this work is to advance fair and consistent comparisons o...

Synergy of Machine and Deep Learning Models for Multi-Painter Recognition

The growing availability of digitized art collections has created the ne...

Please sign up or login with your details

Forgot password? Click here to reset