Mission
MultiComp Lab’s mission is to build the algorithms and computational foundation to understand the interdependence between human verbal, visual, and vocal behaviors expressed during social communicative interactions.
Artificial Social Intelligence
- Visual, vocal and verbal behaviors
- Dyadic and group interactions
- Learning and children behaviors
We build the computational foundations to enable computers with the abilities to analyze, recognize, and predict subtle human communicative dynamics (behavioral, multimodal, interpersonal and societal dynamics) during social interactions.
Multimodal Machine Learning
- Multimodal representation learning
- Temporal sequential models
- Deep neural architectures
We create algorithms, probabilistic models, and neural architectures to better understand the interdependence and complementarity present in heterogeneous data originating from multiple modalities (language, speech, and vision).
Health Behavior Informatics
- Behavior markers of mental health
- Depression, PTSD, psychosis, suicide
- Tele-medicine and clinical interviews
We create decision support tool technologies for clinicians and healthcare providers to help during diagnosis and treatment of mental health illnesses by automatically identifying behavior markers based on the patient’s verbal and nonverbal behaviors.
