Publication

Project Code

MSR3D: Multi-modal Situated Reasoning in 3D Scenes

Xiongkun Linghu* , Jiangyong Huang* , Xuesong Niu* , Xiaojian Ma , Baoxiong Jia# , Siyuan Huang# .

Advances in Neural Information Processing Systems (NeurIPS) 2024
(* indicates equal contribution. # indicates corresponding author.)

Project Code Supp Paper

SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding

Baoxiong Jia* , Yixin Chen* , Huangyue Yu , Yan Wang , Xuesong Niu , Tengyu Liu , Qing Li , Siyuan Huang .

European Conference on Computer Vision (ECCV) 2024
OpenSUN3D @ ECCV 2024 (* indicates equal contribution)

Project Paper

SlotLifter: Slot-guided Feature Lifting for Learning Object-centric Radiance Fields

Yu Liu* , Baoxiong Jia* , Yixin Chen , Siyuan Huang .

European Conference on Computer Vision (ECCV) 2024
Wild3D @ ECCV 2024 (* indicates equal contribution.)

Project Code Paper

Unifying 3D Vision-Language Understanding via Promptable Queries

Ziyu Zhu , Zhuofan Zhang , Xiaojian Ma , Xuesong Niu , Yixin Chen , Baoxiong Jia , Zhidong Deng , Siyuan Huang , Qing Li .

European Conference on Computer Vision (ECCV) 2024
OpenSUN3D @ ECCV 2024

Project Code Paper

An Embodied Generalist Agent in 3D World

Jiangyong Huang* , Silong Yong* , Xiaojian Ma* , Xiongkun Linghu , Puhao Li , Yan Wang , Qing Li , Song-Chun Zhu , Baoxiong Jia , Siyuan Huang .

International Conference on Machine Learning (ICML) 2024
GenAI4DM & AGI @ ICLR 2024 (* indicates equal contribution.)

Paper

Human-level Few-shot Concept Induction through Minimax Entropy Learning

Chi Zhang , Baoxiong Jia , Yixin Zhu , Song-Chun Zhu .

Science Advances (SciAdv) 2024

Project Code Paper

PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI

Yandan Yang* , Baoxiong Jia* , Peiyuan Zhi , Siyuan Huang .

Conference on Computer Vision and Pattern Recognition (CVPR) 2024 (Highlight)
AI3DG @ CVPR 2024 (* indicates equal contribution.)

Project Code Paper

Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance

Zan Wang , Yixin Chen , Baoxiong Jia , Puhao Li , Jinlu Zhang , Jingze Zhang , Tengyu Liu , Yixin Zhu , Wei Liang , Siyuan Huang .

Conference on Computer Vision and Pattern Recognition (CVPR) 2024 (Highlight)
HuMoGen @ CVPR 2024

Project Code Paper

ProBio: A Protocol-guided Multimodal Dataset for Molecular Biology Lab

Jieming Cui* , Ziren Gong* , Baoxiong Jia* , Siyuan Huang , Zilong Zheng , Jianzhu Ma , Yixin Zhu .

Advances in Neural Information Processing System (NeurIPS) 2023 (Track on Datasets and Benchmarks)
(* indicates equal contribution.)

Project Code Paper

X-VoE: Measuring eXplanatory Violation of Expectation in Physical Events

Bo Dai , Linge Wang , Baoxiong Jia , Zeyu Zhang , Chi Zhang , Yixin Zhu , Song-Chun Zhu .

International Conference on Computer Vision (ICCV) 2023 (Oral)

Project Code Paper

ARNOLD: A Benchmark for Language-Grounded Task Learning with Continuous States in Realistic Scenes

Ran Gong* , Jiangyong Huang* , Yizhou Zhao , Haoran Geng , Xiaofeng Gao , Qingyang Wu , Wensi Ai , Ziheng Zhou , Demetri Terzopoulos , Song-Chun Zhu , Baoxiong Jia# , Siyuan Huang# .

International Conference on Computer Vision (ICCV) 2023
LangRob @ CoRL 2022 (* indicates equal contribution. # indicates corresponding author.)

Paper

Learning a Causal Transition Model for Object Cutting

Zeyu Zhang* , Muzhi Han* , Baoxiong Jia , Ziyuan Jiao , Yixin Zhu , Song-Chun Zhu , Hangxin Liu .

International Conference on Intelligent Robots and Systems (IROS) 2023
(* indicates equal contribution.)

Project Code Paper

Diffusion-based Generation, Optimization, and Planning in 3D Scenes

Siyuan Huang* , Zan Wang* , Puhao Li , Baoxiong Jia , Tengyu Liu , Yixin Zhu , Wei Liang , Song-Chun Zhu .

Conference on Computer Vision and Pattern Recognition (CVPR) 2023
(* indicates equal contribution.)

Project Code Paper

Improving Unsupervised Object-centric Learning with Query Optimization

Baoxiong Jia* , Yu Liu* , Siyuan Huang .

International Conference on Learning Represetnations (ICLR) 2023
(* indicates equal contribution.)

Project Code Paper

EgoTaskQA: Understanding Human Tasks in Egocentric Videos

Baoxiong Jia , Ting Lei , Song-Chun Zhu , Siyuan Huang .

Advances in Neural Information Processing System (NeurIPS) 2022 (Track on Datasets and Benchmarks)

Project Code Supp Paper

Learning Algebraic Representation for Systematic Generalization in Contextual Decision Processes

Chi Zhang* , Sirui Xie* , Baoxiong Jia* , Yixin Zhu , Song-Chun Zhu , Ying Nian Wu .

European Conference on Computer Vision (ECCV) 2022
(* indicates equal contribution.)

Code Paper

Latent Diffusion Energy-Based Model for Interpretable Text Modeling

Peiyu Yu , Sirui Xie , Xiaojian Ma , Baoxiong Jia , Bo Pang , Ruiqi Gao , Yixin Zhu , Song-Chun Zhu , Ying Nian Wu .

International Conference on Machine Learning (ICML) 2022

Project Code Supp Paper

ACRE: Abstract Causal REasoning Beyond Covariation

Chi Zhang , Baoxiong Jia , Mark Edmonds , Song-Chun Zhu , Yixin Zhu .

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021
(* indicates equal contribution.)

Project Code Supp Paper

Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and Execution

Chi Zhang* , Baoxiong Jia* , Song-Chun Zhu , Yixin Zhu .

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021
(* indicates equal contribution.)

Project Code Paper

LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities

Baoxiong Jia , Yixin Chen , Siyuan Huang , Yixin Zhu , Song-Chun Zhu .

European Conference on Computer Vision (ECCV) 2020

Code Paper

A Generalized Earley Parser for Human Activity Parsing and Prediction

Siyuan Qi , Baoxiong Jia , Siyuan Huang , Ping Wei , Song-Chun Zhu .

Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2020

Project Code Paper

Learning Perceptual Inference by Contrasting

Chi Zhang* , Baoxiong Jia* , Feng Gao , Yixin Zhu , Hongjing lu , Song-Chun Zhu .

Conference on Neural Information Processing Systems (NeurIPS) 2019 (Spotlight)
(* indicates equal contribution.)

Project Code Supp Paper

RAVEN: A Dataset for Relational and Analogical Visual rEasoNing

Chi Zhang* , Feng Gao* , Baoxiong Jia , Yixin Zhu , Song-Chun Zhu .

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019
(* indicates equal contribution.)

Code Paper

Learning Human-Object Interactions by Graph Parsing Neural Networks

Siyuan Qi* , Wenguan Wang* , Baoxiong Jia , Jianbin Shen , Song-Chun Zhu .

European Conference on Computer Vision (ECCV) 2018
(* indicates equal contribution.)

Project Code Supp Paper

Generalized Earley Parser: Bridging Symbolic Grammars and Sequence Data for Future Prediction

Siyuan Qi , Baoxiong Jia , Song-Chun Zhu .

International Conference on Machine Learning (ICML) 2018

Project Paper

Mining User Reviews for Mobile App Comparison

Yuanchun Li , Baoxiong Jia , Yao Guo , Xiangqun Chen .

ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) 2017