Training CNNs for Image Registration from Few Samples with Model-based Data Augmentation

(MICCAI 2017)

Hristina Uzunova, Matthias Wilms, Heinz Handels, Jan Ehrhardt



Abstract. Convolutional neural networks (CNNs) have been successfully used for fast and accurate estimation of dense correspondences between images in computer vision applications. However, much of their success is based on the availability of large training datasets with dense ground truth correspondences, which are only rarely available in medical applications. In this paper, we, therefore, address the problem of CNNs learning from few training data for medical image registration. Our contributions are threefold: (1) We present a novel approach for learning highly expressive appearance models from few training samples, (2) we show that this approach can be used to synthesize huge amounts of realistic ground truth training data for CNN-based medical image registration, and (3) we adapt the FlowNet architecture for CNN-based optical flow estimation to the medical image registration problem. This pipeline is applied to two medical data sets with less than 40 training images. We show that CNNs learned from the proposed generative model outperform those trained on random deformations or displacement fields estimated via classical image registration.

Download: Caffe models and trained weights for brain registration (you will need FlowNet to run the code, see Readme)

Related project: Multi-resolution multi-object statistical shape models

Erstellt am 24. Mai 2017 - 11:21 von Ehrhardt. Zuletzt geändert am 27. Juni 2017 - 10:30 von Ehrhardt.


Susanne Petersen

Neue Rufnummer:
Tel+49 451 3101 5601
Fax+49 451 3101 5604

Gebäude 64 (Informatik)

Ratzeburger Allee 160
23538 Lübeck