Shuchen Weng - BAAI

🔥 News

[2026.09] 1 paper accepted by IJCV!
[2026.09] 1 paper accepted by TPAMI!
[2026.08] 1 papers accepted by SIGGRAPH Asia 2026!
[2026.04] 5 papers accepted by ECCV 2026!
[2026.04] 1 papers accepted by ACL 2026 (Main)!
[2026.02] 3 papers accepted by CVPR 2026!
[2026.02] 1 paper accepted by IJCV!
[2025.12] 1 paper accepted by TPAMI!

Education

PhD at Peking University, Beijing, China
Advisors: Prof. Boxin Shi
Sep. 2019 ~ Jun. 2024, in NELVT, Dept. of Computer Science
Bachelor of Engineering at Tianjin University, Tianjin, China
Sep. 2015 ~ Jul. 2019, in College of Intelligence and Computing

Professional Experiences

Jul. 2024 ~ Present, technical staff at Beijing Academy of Artificial Intelligence (BAAI).
Jan. 2023 ~ Jun. 2024, research intern at Beijing Academy of Artificial Intelligence (BAAI).
Feb. 2019 ~ Aug. 2019, research intern at Peng Cheng Lab.
Aug. 2018 ~ Nov. 2018, research intern at Tencent AI Lab.

📝 Publications

TPAMI x 4, IJCV x 3, CVPR x 9, ECCV x 10, ICCV x 1, NeurIPS x 4, SIGGRAPH Asia x 1, ACL x 1, AAAI x 2
† equal contribution, corresponding author)

Multimodality

LLaCO: Continuous Diffusion for Large Language Models with Competition-Aware Semantic SchedulingNEW Zijian Jia, Peixuan Zhang, Genying Li, Di Wu, Yujie Fu, Si Li, Boxin Shi, Shuchen Weng arXiv

[PDF] [Code]

Video Generation/Editing

InstructAV2AV: Instruction-Guided Audio-Video Joint EditingNEW Haojie Zheng, Yixin Yang, Siqi Yang, Shuchen Weng, Boxin Shi SIGGRAPH Asia 2026

[PDF] [Code]

MAVIN: Multi-Shot Audio-Visual Generation with Customized Narrative ControlNEW Kaiqi Liu, Yunyao Mao, Ziqi Cai, Zheng Geng, Jing Wang, Qiulin Wang, Xintao Wang, Pengfei Wan, Kun Gai, Shuchen Weng, Boxin Shi ECCV 2026 (Spotlight)

[PDF] [Code]

Video Generation Models Are Inherent Lighting EstimatorsNEW Ziqi Cai, Shuchen Weng, Kaiqi Liu, Zifeng Wang, Zhiquan Zhang, Minggui Teng, Han Jiang, Boxin Shi ECCV 2026

[PDF] [Code]

A Benchmark and Multi-Agent System for Instruction-driven Cinematic Video CompilationNEW Peixuan Zhang, Chang Zhou, Ziyuan Zhang, Hualuo Liu, Chunjie Zhang, Jingqi Liu, Xiaohui Zhou, Xi Chen, Shuchen Weng, Si Li, Boxin Shi ECCV 2026

[PDF]

Audio-sync Video Instance Editing with Granularity-Aware Mask RefinerNEW Haojie Zheng^†, Shuchen Weng^†, Jingqi Liu, Siqi Yang, Boxin Shi, Xinlong Wang CVPR 2026

[PDF] [Code]

STAGE: Storyboard-Anchored Generation for Cinematic Multi-shot NarrativeNEW Peixuan Zhang, Zijian Jia, Kaiqi Liu, Shuchen Weng, Si Li, Boxin Shi CVPR 2026

Lighting-grounded Video Generation with Renderer-based Agent ReasoningNEW Ziqi Cai, Taoyu Yang, Zheng Chang, Si Li, Han Jiang, Shuchen Weng, Boxin Shi CVPR 2026

L-VOCAL: Language-based Video Colorization with Audio AlignmentNEW Zheng Chang^†, Shuchen Weng^†, Huan Ouyang^†, Yuchen Hong, Lihan Lin, Si Li, and Boxin Shi IJCV 2026

Audio-Sync Video Generation with Multi-Stream Temporal Control Shuchen Weng^†, Haojie Zheng^†, Zheng Chang, Si Li, Boxin Shi, Xinlong Wang NeurIPS 2025

[PDF] [Code]

PanoWan: Lifting Diffusion Video Generation Models to 360 with Latitude/Longitude-aware Mechanisms Yifei Xia^†, Shuchen Weng^†, Siqi Yang, Jingqi Liu, Chengxuan Zhu, Minggui Teng, Zijian Jia, Han Jiang, Boxin Shi NeurIPS 2025

[PDF] [Code]

VIRES: Video Instance Repainting with Sketch and Text Guidance Shuchen Weng^†, Haojie Zheng^†, Peixuan Zhan, Yuchen Hong, Han Jiang, Si Li, Boxin Shi CVPR 2025

[PDF] [Code]

L-C4: Language-Based Video Colorization for Creative and Consistent Color Zheng Chang^†, Shuchen Weng^†, Huan Ouyang, Yu Li, Si Li, Boxin Shi Neurocomputing 2025

Image Semantic Editing

Enlightening Photographic Style Transfer with a Self-Supervised Photographic EmbeddingNEW Chengxuan Zhu, Jiacong Fang, Shuchen Weng, Youwei Lyu, Jiajun Tang, Qingnan Fan, Chao Xu, Boxin Shi ECCV 2026

[Coming Soon]

ReContraster: Making Your Posters Stand Out with Regional ContrastNEW Peixuan Zhang, Zijian Jia, Ziqi Cai, Shuchen Weng, Si Li, Boxin Shi ACL 2026 (Main)

Towards Deeper Emotional Reflection: Crafting Affective Image Filters with Generative PriorsNEW Peixuan Zhang^†, Shuchen Weng^†, Jiajun Tang, Si Li, Boxin Shi TPAMI 2025

Affective Image Editing: Shaping Emotional Factors via Text DescriptionsNEW Peixuan Zhang^†, Shuchen Weng^†, Chengxuan Zhu, Binghao Tang, Zijian Jia, Si Li, Boxin Shi IJCV 2025

PhyS-EdiT: Physics-aware Semantic Image Editing with Text Description Ziqi Cai, Shuchen Weng, Yifei Xia, Boxin Shi CVPR 2025

Affective Image Filter: Reflecting Emotions from Text to Images Shuchen Weng^†, Peixuan Zhang^†, Zheng Chang, Xinlong Wang, Si Li, Boxin Shi ICCV 2023

[PDF] [Code]

Instance Contour Adjustment via Structure-driven CNN Shuchen Weng, Yi Wei, Ming-Ching Chang, Boxin Shi ECCV 2022

Low-level Vision

Diffusion-based dual-view reflection removalNEW Tianyi Xu, Zifeng Wang, Boyang Lv, Shuchen Weng, Boxin Shi ECCV 2026

[Coming Soon]

L-DiffER: Single image reflection removal with language-based diffusion model Yuchen Hong^†, Haofeng Zhong^†, Shuchen Weng, Jinxiu Liang, Boxin Shi ECCV 2024

Language-guided Image Reflection Separation Haofeng Zhong^†, Yuchen Hong^†, Shuchen Weng, Jinxiu Liang, Boxin Shi CVPR 2024

L-CAD: Language-based Colorization with Any-level Descriptions Zheng Chang^†, Shuchen Weng^†, Peixuan Zhang, Yu Li, Si Li, Boxin Shi NeurIPS 2023 (Spotlight)

[PDF] [Code]

L-CoIns: Language-based Colorization with Instance Awareness Zheng Chang^†, Shuchen Weng^†, Peixuan Zhang, Yu Li, Si Li, Boxin Shi CVPR 2023

[PDF] [Code]

CT²: Colorization Transformer via Color Tokens Shuchen Weng^†, Jimeng Sun^†, Yu Li, Si Li, Boxin Shi ECCV 2022 (Oral)

[PDF] [Code]

L-CoDer: Language-based Colorization with Color-object Decoupling Transformer Zheng Chang^†, Shuchen Weng^†, Yu Li, Si Li, Boxin Shi ECCV 2022

[PDF] [Code]

L-CoDe: Language-based Colorization using Color-object Decoupled Conditions Shuchen Weng^†, Hao Wu^†, Zheng Chang, Jiajun Tang, Si Li, Boxin Shi AAAI 2022

[PDF] [Code]

Image Repainting

OpenCIR: Conditional Image Repainting with Open Condition Mixture Shuchen Weng^†, Xiaocheng Gong^†, Haojie Zheng^†, Xinlong Wang, Si Li, Boxin Shi TPAMI 2025

Conditional Image Repainting Shuchen Weng, Boxin Shi TPAMI 2023

LuminAIRe: Illumination-Aware Conditional Image Repainting for Lighting-Realistic Generation Jiajun Tang, Haofeng Zhong, Shuchen Weng, Boxin Shi NeurIPS 2023

UniCoRN: A Unified Conditional Image Repainting Network Jimeng Sun^†, Shuchen Weng^†, Zheng Chang, Si Li, Boxin Shi CVPR 2022

[PDF] [Code]

Conditional Image Repainting via Semantic Bridging and Piecewise Value Function Shuchen Weng, Wenbo Li, Dawei Li, Hongxia Jin, Boxin Shi ECCV 2020

[PDF] [Code]

MISC: Multi-condition Injection and Spatially-adaptive Compositing for Conditional Person Image Synthesis Shuchen Weng^†, Wenbo Li^†, Dawei Li, Hongxia Jin, Boxin Shi CVPR 2020

[PDF] [Code]

Others

Colorizing Monochromatic Radiance Fields Yean Cheng, Renjie Wan, Shuchen Weng, Chengxuan Zhu, Yakun Chang, Boxin Shi AAAI 2024 (Oral)

Dual-stream CNN for Structured Time Series Classification Shuchen Weng^†, Wenbo Li^†, Yi Zhang, Siwei Lyu ICASSP 2019

🏆 Awards

Huawei TopMinds Program (华为天才少年), 2024
Alibaba Taotian Group T-star Program (阿里淘天T-Star), 2024
National Scholarship for Graduate Student of Peking University (北京大学博士生国家奖学金, Top 2%), 2023
Exceptional award for Academic Innovation Award (北京大学学术创新奖, Top 1%), 2022

Last updated: Jan. 2026