News

• 01/2026: Pre-trained multimodal models are increasingly being used in many practical applications involving language generation from temporally-ordered events. But do they have the fundamental ability to recognize salient sub-events in such events? We investigate this and discuss the findings in our latest preprint!
• 06/2025: What reasoning skills are needed to understand long videos? Can multimodal AI models comprehend movies like humans do? Or are they biased toward one modality? We explore these questions and release a new benchmark: MF²!
• 05/2025: Our work "LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks" is accepted to the ACL 2025 main conference (more details)!
• 03/2025: Our work discussing the challenges in evaluating visually-grounded stories is accepted to the Text2Story workshop collocated with ECIR 2025!
• 01/2025: New preprint discussing the challenges and future directions regarding "Natural Language Generation from Visual Sequences"!
• 11/2024: Here's the poster I used for presenting our work at EMNLP!
• 09/2024: Paper accepted to EMNLP 2024 Findings!
• 07/2024: Two new preprints!
• 06/2024: Presented work at NLG in the Lowlands workshop in Bielefeld, Germany. Discussed several challenges w.r.t grounding natural language in other modalities and received feedback from amazing researchers!
• 03/2024: Attended the ELLIS NLP workshop at the Research Institute for Mathematics (MFO) in Oberwolfach, Germany. Discussed the future directions of LLMs and multimodality with amazing researchers!
• 12/2023: Here's the poster I used to present our work at EMNLP!
• 10/2023: Paper accepted to EMNLP 2023 main conference!, presented work at ELLIS, AI4media, and AIDA symposium on large language/foundation models!
• 07/2023: Attended the REST-CL retreat in Barcelona, Spain with amazing researchers working on NLP, multimodality, and cognitive science!