VehicleNet: Learning Robust Visual Representation for Vehicle Re-identification

Authors: Zhedong Zheng, Tao Ruan, Yunchao Wei, Yi Yang, Tao Mei

Published in IEEE Transactions on Multimedia (TMM), 2020

Recommended citation: Zhedong Zheng, Tao Ruan, Yunchao Wei, Yi Yang, Tao Mei, "VehicleNet: Learning Robust Visual Representation for Vehicle Re-identification." IEEE Transactions on Multimedia (TMM), 2020. DOI: 10.1109/TMM.2020.3014488
Download PDF: https://zdzheng.xyz/files/2020/TMM20.pdf
中文解读: https://zhuanlan.zhihu.com/p/186905783

Code is available at: https://github.com/layumi/AICIty-reID-2020

Abstract: One fundamental challenge of vehicle re-identification (re-id) is to learn robust and discriminative visual representation, given the significant intra-class vehicle variations across different camera views. As the existing vehicle datasets are limited in terms of training images and viewpoints, we propose to build a unique large-scale vehicle dataset (called VehicleNet) by harnessing four public vehicle datasets, and design a simple yet effective two-stage progressive approach to learning more robust visual representation from VehicleNet. The first stage of our approach is to learn the generic representation for all domains (i.e., source vehicle datasets) by training with the conventional classification loss. This stage relaxes the full alignment between the training and testing domains, as it is agnostic to the target vehicle domain. The second stage is to fine-tune the trained model purely based on the target vehicle set, by minimizing the distribution discrepancy between our VehicleNet and any target domain. We discuss our proposed multi-source dataset VehicleNet and evaluate the effectiveness of the two-stage progressive representation learning through extensive experiments. We achieve the state-of-art accuracy of 86.07\% mAP on the private test set of AICity Challenge, and competitive results on two other public vehicle re-id datasets, i.e., VeRi-776 and VehicleID. We hope this new VehicleNet dataset and the learned robust representations can pave the way for vehicle re-id in the real-world environments.

@article{zheng2020vehiclenet,
author = "Zheng, Zhedong and Ruan, Tao and Wei, Yunchao and Yang, Yi and Mei, Tao",
doi = "10.1109/TMM.2020.3014488",
title = "VehicleNet: Learning Robust Visual Representation for Vehicle Re-identification",
abstract = "One fundamental challenge of vehicle re-identification (re-id) is to learn robust and discriminative visual representation, given the significant intra-class vehicle variations across different camera views. As the existing vehicle datasets are limited in terms of training images and viewpoints, we propose to build a unique large-scale vehicle dataset (called VehicleNet) by harnessing four public vehicle datasets, and design a simple yet effective two-stage progressive approach to learning more robust visual representation from VehicleNet. The first stage of our approach is to learn the generic representation for all domains (i.e., source vehicle datasets) by training with the conventional classification loss. This stage relaxes the full alignment between the training and testing domains, as it is agnostic to the target vehicle domain. The second stage is to fine-tune the trained model purely based on the target vehicle set, by minimizing the distribution discrepancy between our VehicleNet and any target domain. We discuss our proposed multi-source dataset VehicleNet and evaluate the effectiveness of the two-stage progressive representation learning through extensive experiments. We achieve the state-of-art accuracy of 86.07\\% mAP on the private test set of AICity Challenge, and competitive results on two other public vehicle re-id datasets, i.e., VeRi-776 and VehicleID. We hope this new VehicleNet dataset and the learned robust representations can pave the way for vehicle re-id in the real-world environments.",
journal = "IEEE Transactions on Multimedia (TMM)",
blog = "https://zhuanlan.zhihu.com/p/186905783",
year = "2020",
code = "https://github.com/layumi/AICIty-reID-2020",
url = "https://zdzheng.xyz/files/2020/TMM20.pdf" }