Home/Image Deformation Meta-Networks for One-Shot Learning

Image Deformation Meta-Networks for One-Shot Learning

Zitian Chen, Yanwei Fu, Yuxiong Wang, Lin Ma, Wei Liu and Martial Hebert
Conference Paper, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2019), June, 2019

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Humans can robustly learn novel visual concepts even when images undergo various deformations and lose certain information. Mimicking the same behavior and synthesizing deformed instances of new concepts may help visual recognition systems perform better one-shot learning, i.e., learning concepts from one or few examples. Our key insight is that, while the deformed images may not be visually realistic, they still maintain critical semantic information and contribute significantly to formulating classifier decision boundaries. Inspired by the recent progress of meta-learning, we combine a meta-learner with an image deformation sub-network that produces additional training examples, and optimize both models in an end-to-end manner. The deformation sub-network learns to deform images by fusing a pair of images — a probe image that keeps the visual content and a gallery image that diversifies the deformations. We demonstrate results on the widely used one-shot learning benchmarks (miniImageNet and ImageNet 1K Challenge datasets), which significantly outperform state-of-the-art approaches. Code is available at https://github.com/tankche1/IDeMe-Net.

@conference{Chen, Fu, Wang, Ma, Liu, Hebert-2019-116648,
author = {Zitian Chen and Yanwei Fu and Yuxiong Wang and Lin Ma and Wei Liu and Martial Hebert},
title = {Image Deformation Meta-Networks for One-Shot Learning},
booktitle = {Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2019)},
year = {2019},
month = {June},
} 2019-08-15T15:54:43-04:00