Embedded Files
I am currently a Research Scientist and Tech Lead in the Seed-Research team at ByteDance Inc. in San Jose, CA. Before that, I was a Research Scientist at Snap Research during 2016 - 2018. I obtained my PhD degree in the department of Information Engineering, Chinese University of Hong Kong in July 2016. I was supervised by Prof. Xiaoou Tang and Prof. Jianzhuang Liu. I also worked closely with Prof. Chen Change Loy and Ping Luo. I obtained my bachelor's degree from the department of Electronic Engineering, Tsinghua University in 2012. I worked as a research intern in Microsoft Research Asia from November 2011 to April 2012. My research interests include computer vision and machine learning, especially visual understanding with deep learning.
We are actively looking for full-time research scientists / engineers as well as research interns on computer vision and deep learning, especially on VLMs and generative modeling. Drop me an email if you are interested!
Recent Activities
Recent Activities
One paper on joint diffusion modeling for image understanding and generation accepted by CVPR 2025!
Two papers accepted by ICLR 2025!
I am serving as an Area Chair for CVPR 2025.
Shot2Story benchmark has been augmented with more data (134k videos in total!) and a brand new settings of multi-shot video question answering. Check out here.
Our work on PortraitMode video dataset is accepted by CVPR 2024!
Publications
Publications
2025
2025
Dual Diffusion for Unified Image Generation and Understanding
Zijie Li, Henry Li, Yichun Shi, Amir Barati Farimani, Yuval Kluger, Linjie Yang, Peng Wang
Autoregressive Pretraining with Mamba in Vision
Sucheng Ren, Xianhang Li, Haoqin Tu, Feng Wang, Fangxun Shu, Lei Zhang, Jieru Mei, Linjie Yang, Peng Wang, Heng Wang, Alan Yuille, Cihang Xie
ICLR 2025. arXiv
Shot2Story: A New Benchmark for Comprehensive Understanding of Multi-shot Videos
Mingfei Han*, Linjie Yang*, Xiaojun Chang, Lina Yao, Heng Wang
VMAS: Video-to-Music Generation via Semantic Alignment in Web Music Videos.
Yan-Bo Lin, Yu Tian, Linjie Yang, Gedas Bertasius, Heng Wang
2024
2024
Video Recognition in Portrait Mode.
Mingfei Han, Linjie Yang, Xiaojie Jin, Jiashi Feng, Xiaojun Chang, Heng Wang
2023
2023
Why Is Prompt Tuning for Vision-Language Models Robust to Noisy Labels?
Cheng-En Wu, Yu Tian, Haichao Yu, Heng Wang, Pedro Morgado, Yu Hen Hu, Linjie Yang
ICCV 2023. arXiv
Learning Dynamic Query Combinations for Transformer-based Object Detection and Segmentation
Yiming Cui, Linjie Yang, Haichao Yu
ICML 2023. arXiv
FAQ: Feature Aggregated Queries for Transformer-based Video Object Detectors.
Yiming Cui, Linjie Yang
CVPR 2023. arXiv
R^2Former: Unified Retrieval and Reranking Transformer for Place Recognition
Sijie Zhu, Linjie Yang, Chen Chen, Mubarak Shah, Xiaohui Shen, Heng Wang
CVPR 2023 (Highlight). arXiv code
Revisiting Training-free NAS Metrics: An Efficient Training-based Method
Taojiannan Yang, Linjie Yang, Xiaojie Jin, Chen Chen
WACV 2023. arXiv
2022
2022
Token Selection is a Simple Booster for Vision Transformers
Daquan Zhou, Qibin Hou, Linjie Yang, Xiaojie Jin, Jiashi Feng
T-PAMI 2022. Paper
Learning Versatile Neural Architectures by Propagating Network Codes
Mingyu Ding, Yuqi Huo, Haoyu Lu, Linjie Yang, Zhe Wang, Zhiwu Lu, Jingdong Wang, Ping Luo
ICLR 2022. arXiv OpenReview Code
Robust High-Resolution Video Matting with Temporal Guidance
Shanchuan Lin, Linjie Yang, Imran Saleemi, Soumyadip Sengupta
WACV 2022. arXiv Project Code YouTubeVideo YouTubeVideo@bycloud
2021
2021
AutoSpace: Neural Architecture Search with Less Human Interference
Daquan Zhou, Xiaojie Jin, Xiaochen Lian, Linjie Yang, Yujing Xue, Qibin Hou, Jiashi Feng
ICCV 2021. arXiv
Progressive Temporal Feature Alignment Network for Video Inpainting
Xueyan Zou, Linjie Yang, Ding Liu, Yong Jae Lee
HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformers
Mingyu Ding, Xiaochen Lian, Linjie Yang, Peng Wang, Xiaojie Jin, Zhiwu Lu, Ping Luo
CVPR 2021 (Oral).
CompFeat: Comprehensive Feature Aggregation for Video Instance Segmentation
Yang Fu, Linjie Yang, Ding Liu, Thomas S. Huang, Humphrey Shi
AAAI 2021. arXiv
FracBits: Mixed Precision Quantization via Fractional Bit-Widths
Linjie Yang*, Qing Jin*
AAAI 2021. arXiv
2020
2020
Neural Network Quantization with Scale-Adjusted Training
Qing Jin, Linjie Yang, Zhenyu Liao, Xiaoning Qian
BMVC 2020. arXiv Version Conference Version Supplementary Code
Neural Architecture Search for Lightweight Non-local Networks
Yingwei Li, Xiaojie Jin, Jieru Mei, Xiaochen Lian, Linjie Yang, Cihang Xie, Qihang Yu, Yuyin Zhou, Song Ba, Alan Yuille.
CVPR 2020. arXiv Version. Code
AdaBits: Neural Network Quantization with Adaptive Bit-Widths
Qing Jin*, Linjie Yang*, Zhenyu Liao
CVPR 2020. arXiv Version Code
AtomNAS: Fine-Grained End-to-End Neural Architecture Search
Jieru Mei, Yingwei Li, Xiaochen Lian, Xiaojie Jin, Linjie Yang, Alan Yuille, Jianchao Yang
ICLR 2020. Open Review. Code
Context-Aware Zero-Shot Recognition
Ruotian Luo, Ning Zhang, Bohyung Han, Linjie Yang
AAAI 2020. arXiv Version. Code
2019
2019
Video Instance Segmentation
Linjie Yang, Yuchen Fan, Ning Xu.
ICCV 2019. arXiv Version Code Dataset
Streamlined Dense Video Captioning
Jonghwan Mun, Linjie Yang, Zhou Ren, Ning Xu, Bohyung Han.
CVPR 2019 (Oral). arXiv Version
Slimmable Neural Networks.
Jiahui Yu, Linjie Yang, Ning Xu, Jianchao Yang, Thomas Huang.
ICLR 2019. OpenReview Code
2018
2018
Youtube-VOS: Sequence-to-Sequence Video Object Segmentation.
Ning Xu, Linjie Yang, Yuchen Fan, Jianchao Yang, Dingcheng Yue, Yuchen Liang, Brian Price, Scott Cohen, Thomas Huang.
ECCV 2018. arXiv Version Dataset
Efficient Video Object Segmentation via Network Modulation
Linjie Yang, Yanran Wang, Xuehan Xiong, Jianchao Yang, Aggelos K. Katsaggelos.
CVPR 2018. arXiv Version Code
Before 2018
Before 2018
Dense Captioning with Joint Inference and Visual Context.
Linjie Yang, Kevin Tang, Jianchao Yang, Li-Jia Li.
CVPR 2017. arXiv Version Code
A Large-Scale Car Dataset for Fine-Grained Categorization and Verification
Linjie Yang, Ping Luo, Chen Change Loy, Xiaoou Tang.
CVPR 2015. PDF Dataset extended work on arXiv Code
Depth from Water Reflection
Linjie Yang, Jianzhuang Liu, and Xiaoou Tang
IEEE Transactions on Image Processing, 24(4), 1235-1243. PDF
Object Detection and Viewpoint Estimation with Auto-masking Neural Network
Linjie Yang, Jianzhuang Liu, and Xiaoou Tang
ECCV 2014. PDF
Complex 3D General Object Reconstruction from Line Drawings
Linjie Yang, Jianzhuang Liu, and Xiaoou Tang
ICCV 2013. PDF
Invited Talks
Invited Talks
"A Large-Scale Car Dataset for Fine-Grained Categorization and Verification", In 3rd Workshop on Vehicle Retrieval in Surveillance (VRS 2015), Karlsruhe, Germany, August 2015.
"Introduction to Neural Architecture Search for Computer Vision", In ECCV 2020 Tutorial on From HPO to NAS: Automated Deep Learning, August 2020.
Workshop Organizers
Workshop Organizers
Large-Scale Video Object Segmentation Challenge in conjunction with ECCV 2018 / ICCV 2019 / CVPR 2021 / CVPR 2022 / ICCV 2023
Tutorial on From HPO to NAS: Automated Deep Learning in conjunction with ECCV 2020
Robust Video Scene Understanding: Tracking and Video Segmentation in conjunction with CVPR 2021
Multiple Object Tracking and Segmentation in Complex Environments in conjunction with ECCV 2022
Academic Service
Academic Service
Reviewer Services:
Journals: TPAMI, IJCV, IEEE Transactions on Intelligent Transportation Systems, IEEE Transactions on Image Processing, Image and Vision Computing
Conferences:
WACV 2017, 2018, 2022
ACM Multimedia 2017
IJCAI 2017, 2018
CVPR 2018, 2019, 2020, 2021, 2022, 2023
ECCV 2018, 2020, 2022
ICCV 2019, 2023
NeurIPS 2021, 2022, 2023
ICLR 2022, 2024
Area Chair Services:
WACV 2023, CVPR 2024, ECCV 2024, CVPR 2025
Contact
Contact
Page updated
Google Sites
Report abuse