Cordelia Schmid

Instruction-driven history-aware policies for robotic manipulations

Pierre-Louis Guhur, Shizhe Chen, Ricardo Garcia, Makarand Tapaswi, Ivan Laptev, Cordelia Schmid

Comments Accepted in CoRL 2022 (oral); project page at https://guhur.github.io/hiveformer/

Attention Bottlenecks for Multimodal Fusion

Arsha Nagrani, Shan Yang, Anurag Arnab, Aren Jansen, Cordelia Schmid, Chen Sun

Comments Published at NeurIPS 2021. Note this version updates numbers due to a bug in the AudioSet mAP calculation in Table 1 (last row)

AVATAR submission to the Ego4D AV Transcription Challenge

Paul Hongsuck Seo, Arsha Nagrani, Cordelia Schmid

Language Conditioned Spatial Relation Reasoning for 3D Object Grounding

Shizhe Chen, Pierre-Louis Guhur, Makarand Tapaswi, Cordelia Schmid, Ivan Laptev

Comments Accepted in NeurIPS 2022; Project website: https://cshizhe.github.io/projects/vil3dref.html

Assembly Planning from Observations under Physical Constraints

Thomas Chabal, Robin Strudel, Etienne Arlaud, Jean Ponce, Cordelia Schmid

Comments IROS 2022. See the project webpage at https://www.di.ens.fr/willow/research/assembly-planning/

A Memory Transformer Network for Incremental Learning

Ahmet Iscen, Thomas Bird, Mathilde Caron, Alireza Fathi, Cordelia Schmid

Zero-Shot Video Question Answering via Frozen Bidirectional Language Models

Antoine Yang, Antoine Miech, Josef Sivic, Ivan Laptev, Cordelia Schmid

Comments NeurIPS 2022 Camera-Ready; Project Webpage: https://antoyang.github.io/frozenbilm.html; 25 pages; 5 figures

Learning from Unlabeled 3D Environments for Vision-and-Language Navigation

Shizhe Chen, Pierre-Louis Guhur, Makarand Tapaswi, Cordelia Schmid, Ivan Laptev

Comments ECCV 2022

TL;DW? Summarizing Instructional Videos with Task Relevance & Cross-Modal Saliency

Medhini Narasimhan, Arsha Nagrani, Chen Sun, Michael Rubinstein, Trevor Darrell, Anna Rohrbach, Cordelia Schmid

Comments Accepted to ECCV 2022. Website: https://medhini.github.io/ivsum/

AlignSDF: Pose-Aligned Signed Distance Fields for Hand-Object Reconstruction

Zerui Chen, Yana Hasson, Cordelia Schmid, Ivan Laptev

Comments Accepted by ECCV 2022. Project Page: https://zerchen.github.io/projects/alignsdf.html

Beyond Transfer Learning: Co-finetuning for Action Localisation

Anurag Arnab, Xuehan Xiong, Alexey Gritsenko, Rob Romijnders, Josip Djolonga, Mostafa Dehghani, Chen Sun, Mario Lučić, Cordelia Schmid

Learning with Neighbor Consistency for Noisy Labels

Ahmet Iscen, Jack Valmadre, Anurag Arnab, Cordelia Schmid

Comments The code is available at https://github.com/google-research/scenic/tree/main/scenic/projects/ncr

Augmenting differentiable physics with randomized smoothing

Quentin Le Lidec, Louis Montaut, Cordelia Schmid, Ivan Laptev, Justin Carpentier

M&M Mix: A Multimodal Multiview Transformer Ensemble

Xuehan Xiong, Anurag Arnab, Arsha Nagrani, Cordelia Schmid

Comments Technical report for Epic-Kitchens challenge 2022

AVATAR: Unconstrained Audiovisual Speech Recognition

Valentin Gabeur, Paul Hongsuck Seo, Arsha Nagrani, Chen Sun, Karteek Alahari, Cordelia Schmid

TubeDETR: Spatio-Temporal Video Grounding with Transformers

Antoine Yang, Antoine Miech, Josef Sivic, Ivan Laptev, Cordelia Schmid

Comments Updated vIoU results compared to the CVPR'22 camera-ready version; 17 pages; 8 figures

Multiview Transformers for Video Recognition

Shen Yan, Xuehan Xiong, Anurag Arnab, Zhichao Lu, Mi Zhang, Chen Sun, Cordelia Schmid

Comments CVPR 2022; arXiv v4: update results on Epic-Kitchens-100

Weakly-supervised segmentation of referring expressions

Robin Strudel, Ivan Laptev, Cordelia Schmid

Learning to Answer Visual Questions from Web Videos

Antoine Yang, Antoine Miech, Josef Sivic, Ivan Laptev, Cordelia Schmid

Comments Accepted at the TPAMI Special Issue on the Best Papers of ICCV 2021. Journal extension of the conference paper arXiv:2012.00451. 16 pages, 13 figures

End-to-end Generative Pretraining for Multimodal Video Captioning

Paul Hongsuck Seo, Arsha Nagrani, Anurag Arnab, Cordelia Schmid

Journal ref Proceedings of Conference on Computer Vision and Pattern Recognition (CVPR) 2022

Learning Audio-Video Modalities from Image Captions

Arsha Nagrani, Paul Hongsuck Seo, Bryan Seybold, Anja Hauth, Santiago Manen, Chen Sun, Cordelia Schmid

Towards unconstrained joint hand-object reconstruction from RGB videos

Yana Hasson, Gül Varol, Ivan Laptev, Cordelia Schmid

Comments Project website: https://hassony2.github.io/homan.html

The Right Spin: Learning Object Motion from Rotation-Compensated Flow Fields

Pia Bideau, Erik Learned-Miller, Cordelia Schmid, Karteek Alahari

Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigation

Shizhe Chen, Pierre-Louis Guhur, Makarand Tapaswi, Cordelia Schmid, Ivan Laptev

Class-Balanced Distillation for Long-Tailed Visual Recognition

Ahmet Iscen, André Araujo, Boqing Gong, Cordelia Schmid

Comments The code is available at https://github.com/google-research/google-research/tree/master/class_balanced_distillation

Large-Scale Unsupervised Object Discovery

Huy V. Vo, Elena Sizikova, Cordelia Schmid, Patrick Pérez, Jean Ponce

Comments Accepted to NeurIPS 2021, 19 pages with supplemental materials

Masking Modalities for Cross-modal Video Retrieval

Valentin Gabeur, Arsha Nagrani, Chen Sun, Karteek Alahari, Cordelia Schmid

Comments Accepted at WACV 2022

ViViT: A Video Vision Transformer

Anurag Arnab, Mostafa Dehghani, Georg Heigold, Chen Sun, Mario Lučić, Cordelia Schmid

Comments ICCV 2021. Code at https://github.com/google-research/scenic/tree/main/scenic/projects/vivit

CCVS: Context-aware Controllable Video Synthesis

Guillaume Le Moing, Jean Ponce, Cordelia Schmid

Comments Accepted to NeurIPS 2021

Differentiable Rendering with Perturbed Optimizers

Quentin Le Lidec, Ivan Laptev, Cordelia Schmid, Justin Carpentier