Zhiqiang Shen, Eric Xing.
A Fast Knowledge Distillation Framework for Visual Recognition
Technical report.
Project Page  |  Code & Models  |  arXiv Paper

Zhiqiang Shen, Zechun Liu, Eric Xing.
Sliced Recursive Transformer
Technical report.
Code & Models  |  arXiv Paper

Zhiqiang Shen, Zechun Liu, Zhuang Liu, Marios Savvides, Trevor Darrell, Eric Xing.
Un-Mix: Rethinking Image Mixtures for Unsupervised Visual Representation Learning
Association for the Advancement of Artificial Intelligence (AAAI), 2022.
Code & Demo  |  arXiv Paper  |  机器之心 (in Chinese)

Shichao Li, Zechun Liu, Zhiqiang Shen, Kwang-Ting Cheng.
Stereo Neural Vernier Caliper
Association for the Advancement of Artificial Intelligence (AAAI), 2022.
Paper and Code (available soon)

Zechun Liu*,✝, Zhiqiang Shen*,✝, Shichao Li, Koen Helwegen, Dong Huang, Kwang-Ting Cheng. (*: equal contribution; ✝: corresponding author)
How Do Adam and Training Strategies Help BNNs Optimization
International Conference on Machine Learning (ICML), 2021.
Code & Models  |  Paper

Kai Hu, Jie Shao, Yuan Liu, Bhiksha Raj, Marios Savvides, Zhiqiang Shen.
Contrast and Order Representations for Video Self-Supervised Learning
International Conference on Computer Vision (ICCV) 2021.
Paper

Zechun Liu, Xiangyu Zhang, Zhiqiang Shen✝, Yichen Wei, Kwang-Ting Cheng, Jian Sun.
Joint Multi-Dimension Pruning via Numerical Gradient Update
IEEE Transactions on Image Processing (TIP) 2021.
Paper

Mengshi Qi, Jie Qin, Di Huang, Zhiqiang Shen, Yi Yang, Jiebo Luo.
Latent Memory-augmented Graph Transformer for Visual Storytelling
ACM International Conference on Multimedia (ACM MM) 2021. (Oral)
Paper

Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang.
"BNN-BN=?": Training Binary Neural Networks without Batch Normalization
Technical report. To appear in CVPR 2021 BNNs workshop as a spotlight.
Code & Models  |  arXiv Paper

Zhiqiang Shen, Zechun Liu, Dejia Xu, Zitian Chen, Kwang-Ting Cheng, Marios Savvides.
Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study
International Conference on Learning Representations (ICLR), 2021.
OpenReview (Rating: 8 6 6 6)  |  Project Page  |  Paper  |  Zhihu (in Chinese)
A new perspective on the relationship between knowledge distillation and label smoothing.

Zhiqiang Shen*, Zechun Liu*, Jie Qin, Marios Savvides, Kwang-Ting Cheng.
Partial Is Better Than All: Revisiting Fine-tuning Strategy for Few-shot Learning
Association for the Advancement of Artificial Intelligence (AAAI), 2021.
arXiv Paper (Code of evolutionary searching can be referred here.)
A searching based fine-tuning strategy for few-shot learning.

Zhiqiang Shen, Marios Savvides.
MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks
Technical report. Short version has been accepted in NeurIPS 2020 Beyond BackPropagation: Novel Ideas for Training Neural Architectures workshop.
Code & Models  |  arXiv Paper
We achieve 80.67% top-1 accuracy using a single crop-size of 224×224 on the vanilla ResNet-50, the first work that is able to boost vanilla ResNet-50 to surpass 80% on ImageNet without architecture modification or additional training data. Our result can be regarded as a new strong baseline on ResNet-50 using knowledge distillation.

Zhiqiang Shen, Zechun Liu, Jie Qin, Lei Huang, Kwang-Ting Cheng, Marios Savvides.
S²-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Self-supervised BNNs using distillation loss (5.5~15% improvement over contrastive baseline).
Code & Models  |  arXiv Paper

Yutong Zheng, Yu-Kai Huang, Ran Tao, Zhiqiang Shen, Marios Savvides.
Unsupervised Disentanglement of Linear-Encoded Facial Semantics
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Paper

Chenchen Zhu, Fangyi Chen, Uzair Ahmed, Zhiqiang Shen, Marios Savvides.
Semantic Relation Reasoning for Shot-Stable Few-Shot Object Detection
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Paper

Ellen Yi-Ge, Rui Fan, Zechun Liu, Zhiqiang Shen.
Conditional Link Prediction of Category-Implicit Keypoint Detection
Winter Conference on Applications of Computer Vision (WACV), 2021.
Paper

Zhiqiang Shen, Mingyang Huang, Jianping Shi, Zechun Liu, Harsh Maheshwari, Yutong Zheng, Xiangyang Xue, Marios Savvides, Thomas S. Huang.
CDTD: A Large-Scale Cross-Domain Benchmark for Instance-Level Image-to-Image Translation and Domain Adaptive Object Detection
International Journal of Computer Vision (IJCV), 2020.
Code & Models  |  Paper

Zechun Liu, Zhiqiang Shen(✝), Marios Savvides, Kwang-Ting Cheng. (✝: Corresponding Author)
ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functions
European Conference on Computer Vision (ECCV), 2020.
Code & Models  |  Paper
We achieve 65.9% (ResNet-based) and 69.5% (MobileNet-based) top-1 accuracy on ImageNet (the new results are slightly higher than those in our original paper after fixing a small loading bug), for the first time, exceeding benchmarking ResNet-level accuracy (69.3%), meanwhile, achieving more than 22× reduction in computational complexity.

Chenchen Zhu, Fangyi Chen, Zhiqiang Shen, Marios Savvides.
Soft anchor-point object detection
European Conference on Computer Vision (ECCV), 2020.
Paper

Devesh Walawalkar, Zhiqiang Shen, Marios Savvides.
Online Ensemble Model Compression using Knowledge Distillation
European Conference on Computer Vision (ECCV), 2020.
Paper

Hai Phan*, Zechun Liu*, Dang Huynh, Marios Savvides, Kwang-Ting Cheng, Zhiqiang Shen.
Binarizing MobileNet via Evolution-based Searching
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
Paper

Hai Phan, Dang Huynh, Yihui He, Marios Savvides, Zhiqiang Shen.
MoBiNet: A Mobile Binary Network for Image Classification
IEEE Winter Conference on Applications of Computer Vision (WACV), 2020. (Oral)
Paper

Zhuang Liu, Tinghui Zhou, Zhiqiang Shen, Bingyi Kang, Trevor Darrell.
Transferable Recognition-Aware Image Processing
arXiv preprint arXiv:1910.09185 (2019).
arXiv Paper

Zhiqiang Shen, Zhankui He, Wanyun Cui, Jiahui Yu, Yutong Zheng, Chenchen Zhu, Marios Savvides.
Adversarial-Based Knowledge Distillation for Multi-Model Ensemble and Noisy Data Refinement
Extended version of our MEAL. arXiv preprint arXiv:1908.08520 (2019).
arXiv Paper

Zhiqiang Shen, Zhuang Liu, Jianguo Li, Yu-Gang Jiang, Yurong Chen, Xiangyang Xue.
Object Detection from Scratch with Deep Supervision
IEEE transactions on pattern analysis and machine intelligence (T-PAMI), 2019.
Code & Models  |  arXiv Paper

Zhiqiang Shen, Mingyang Huang, Jianping Shi, Xiangyang Xue, Thomas S. Huang.
Towards Instance-level Image-to-Image Translation
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Project  |  Paper  |  Dataset

Zhiqiang Shen*, Zhankui He*, Xiangyang Xue.
MEAL: Multi-Model Ensemble via Adversarial Learning
33rd AAAI Conference on Artificial Intelligence (AAAI), 2019. (Oral)
Code & Models  |  Our ResNet-50 (Top-1/5: 21.70%/5.99%)   [PyTorch Model (102.5M)]

Wanyun Cui, Guangyu Zheng, Zhiqiang Shen, Sihang Jiang, Wei Wang.
Transfer Learning for Sequences via Learning to Collocate
International Conference on Learning Representations (ICLR), 2019.
OpenReview  |  arXiv Paper

Zhiqiang Shen, Honghui Shi, Jiahui Yu, Hai Phan, Rogerio Feris, Liangliang Cao, Ding Liu, Xinchao Wang, Thomas Huang, Marios Savvides.
Improving Object Detection from Scratch via Gated Feature Reuse
30th British Machine Vision Conference (BMVC), 2019.

Yunchao Wei, Zhiqiang Shen*, Bowen Cheng*, Honghui Shi, Jinjun Xiong, Jiashi Feng, Thomas Huang.
TS2C: Tight Box Mining with Surrounding Segmentation Context for Weakly Supervised Object Detection
European Conference on Computer Vision (ECCV), 2018. (* indicates equal contribution)
arXiv Paper

Zhuang Liu, Jianguo Li, Zhiqiang Shen, Gao Huang, Shoumeng Yan, Changshui Zhang.
Learning Efficient Convolutional Networks through Network Slimming
Proceedings of 16th IEEE International Conference on Computer Vision (ICCV2017).
Code & Models  |  Paper

Zhiqiang Shen*, Zhuang Liu*, Jianguo Li, Yu-Gang Jiang, Yurong Chen, Xiangyang Xue.
DSOD: Learning Deeply Supervised Object Detectors from Scratch
Proceedings of 16th IEEE International Conference on Computer Vision (ICCV2017).
(* indicates equal contribution)
Code & Models  |  Paper

Zhiqiang Shen, Jianguo Li, Zhou Su, Minjun Li, Yurong Chen, Yu-Gang Jiang, Xiangyang Xue.
Weakly Supervised Dense Video Captioning
Proceedings of 30th IEEE Conference on Computer Vision and Pattern Recognition (CVPR2017).
Project  |  Paper

Zhiqiang Shen, Yu-Gang Jiang, Dequan Wang, Xiangyang Xue.
Iterative Object and Part Transfer for Fine-Grained Recognition
Proceedings of 18th IEEE Conference on Multimedia & Expo (ICME2017). (Oral)
Paper

Dequan Wang, Zhiqiang Shen, Jie Shao, Wei Zhang, Xiangyang Xue, Zheng Zhang.
Multiple granularity descriptors for fine-grained categorization
Proceedings of 15th IEEE International Conference on Computer Vision (ICCV2015).