Paper-Conference

Multi-speaker Attention Alignment for Multimodal Social Interaction
Understanding social interaction in video requires reasoning over a dynamic interplay of verbal and non-verbal cues: who is speaking, …
PDF Cite
Multi-speaker Attention Alignment for Multimodal Social Interaction
Physically Plausible Human-Object Interaction Generation via Attribute Classifier Guidance
Human motion during daily interactions is inherently shaped by physical attributes such as mass, friction, and fragility. While the …
PDF Cite
Physically Plausible Human-Object Interaction Generation via Attribute Classifier Guidance
Exploring a Collaborative Gamified Approach to Vision-Language Model Evaluation
Vision-language models demonstrate impressive capabilities, yet constructing evaluation datasets that capture their failure cases still …
PDF Cite DOI
Exploring a Collaborative Gamified Approach to Vision-Language Model Evaluation
EgoBrain: Synergizing Minds and Eyes For Human Action Understanding
The integration of brain-computer interfaces (BCIs), in particular electroencephalography (EEG), with artificial intelligence (AI) has …
PDF Cite
EgoBrain: Synergizing Minds and Eyes For Human Action Understanding
UniGaze: Towards Universal Gaze Estimation via Large-scale Pre-Training
Despite decades of research on data collection and model architectures, current gaze estimation models encounter significant challenges …
PDF Cite Code
UniGaze: Towards Universal Gaze Estimation via Large-scale Pre-Training
Robust Long-term Test-Time Adaptation for 3D Human Pose Estimation through Motion Discretization
Online test-time adaptation addresses the train-test domain gap by adapting the model on unlabeled streaming test inputs before making …
PDF Cite DOI
Robust Long-term Test-Time Adaptation for 3D Human Pose Estimation through Motion Discretization
Generative Modeling of Shape-Dependent Self-Contact Human Poses
One can hardly model self-contact of human poses without considering underlying body shapes. For example, the pose of rubbing a belly …
PDF Cite Code
Generative Modeling of Shape-Dependent Self-Contact Human Poses
AssemblyHands-X: Modeling 3D Hand-Body Coordination for Understanding Bimanual Human Activities
Bimanual human activities inherently involve coordinated movements of both hands and body. However, the impact of this coordination in …
PDF Cite DOI
AssemblyHands-X: Modeling 3D Hand-Body Coordination for Understanding Bimanual Human Activities
EgoInstruct: An Egocentric Video Dataset of Face-to-face Instructional Interactions with Multi-modal LLM Benchmarking
Analyzing instructional interactions between an instructor and a learner who are co-present in the same physical space is a critical …
PDF Cite
EgoInstruct: An Egocentric Video Dataset of Face-to-face Instructional Interactions with Multi-modal LLM Benchmarking
Can MLLMs Read the Room? A Multimodal Benchmark for Verifying Truthfulness in Multi-Party Social Interactions
As AI systems become increasingly integrated into human lives, endowing them with robust social intelligence has emerged as a critical …
PDF Cite DOI
Can MLLMs Read the Room? A Multimodal Benchmark for Verifying Truthfulness in Multi-Party Social Interactions