illustration of zoomed in eye on top of a computer screen on green gradient background

Computer Vision

Enabling computers and devices to understand what they see.

Microsoft at CVPR 2024: Innovations in computer vision and AI research

DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models

Exploring how context, culture, and character matter in avatar research

FeatUp: A Model-Agnostic Framework for Features at Any Resolution

Current selections

Sort by: Most recent

Clear selections

Search within these results

Content Types

People

Stephen Lin (202)

Antonio Criminisi (171)

Rick Szeliski (102)

Baining Guo (83)

Jianfeng Gao (71)

Neel Joshi (68)

Andrew D. Wilson (65)

Jianlong Fu (60)

Cha Zhang (56)

Lijuan Wang (54)

Dong Chen (51)

Dongdong Chen (50)

Cuiling Lan (43)

Caleb Robinson (43)

Harry Shum (41)

Yang Liu (40)

John Snyder (39)

Yan Lu (37)

Linjie Li (34)

John Winn (33)

Andrew Blake (31)

Chong Luo (31)

Juan M. Lavista Ferres (31)

Abigail Sellen (30)

Cecily Morrison (28)

Nebojsa Jojic (27)

Qi Dai (26)

Dinei Florencio (24)

Furu Wei (23)

Jiaolong Yang (23)

Vibhav Vineet (22)

Anthony Ortiz (22)

Xiyang Dai (22)

Kevin Lin (20)

Rahul Dodhia (20)

Ganesh Ananthanarayanan (19)

Tadas Baltrusaitis (19)

Ed Cutrell (18)

Bei Liu (18)

Yasuyuki Matsushita (17)

Yue Dong (16)

Jiahao Li (16)

Zinan Lin (16)

Matthew Johnson (15)

Shital Shah (15)

Zhirong Wu (15)

Fangyun Wei (15)

Yifan Yang (15)

Noel Codella (15)

Victor Bahl (14)

Bin Li (14)

Shikhar Sharma (14)

Hannes Schulz (14)

Ross Cutler (14)

Lei Cui (13)

Martin Grayson (13)

Spencer Fowers (13)

Dongsheng Li (13)

Hoifung Poon (12)

Eric Horvitz (12)

Manik Varma (12)

Wenxuan Xie (12)

Ishani Chakraborty (12)

Qiang Huo (11)

Akshay Nambi (11)

Tengchao Lv (11)

Yuqing Yang (11)

Chung-Ching Lin (11)

Anton Schwaighofer (10)

Ran Gal (10)

Jeffrey Delmerico (10)

Naoto Usuyama (10)

Li Dong (10)

Sheng Zhang (10)

Daniel Coelho de Castro (10)

Aditya Nori (9)

Ann Paradiso (9)

Jonathan M. Carlson (9)

Matthai Philipose (9)

Sumit Basu (9)

Hongzhi Li (9)

Tristan Naumann (9)

Shruthi Bannur (9)

Xinyang Jiang (9)

David Sweeney (8)

Michel Galley (8)

Tom Minka (8)

Xun Guo (8)

Jinglu Wang (8)

Luming Liang (8)

Shuohang Wang (8)

Will Guyman (8)

Reuben Tan (8)

Smitha Saligrama (8)

Cameron Runde (8)

Vineeth N Balasubramanian (8)

Nicolas Villar (7)

Venkat Padmanabhan (7)

Anja Thieme (7)

Chris Lovett (7)

Camilla Longden (7)

Stephanie Hyland (7)

Oscar Koller (7)

Ondrej Miksik (7)

Silvano Galliani (7)

Mohit Jain (7)

Simone Fobi Nsutezo (7)

Thiago V. Spina (7)

Andrea Britto Mattos Lima (7)

Gilles Quentin Hacheme (7)

Girmaw Abebe Tadesse (7)

Sicheng Xu (7)

Fatemeh Saleh (7)

Chin-Yew Lin (6)

Dongmei Zhang (6)

Lars Liden (6)

Peter Lee (6)

Richard Banks (6)

Javier Hernandez (6)

Cliff Wong (6)

Tanuja Ganu (6)

Kai Qiu (6)

Shaohan Huang (6)

Yizhong Zhang (6)

Fernando Pérez-García (6)

Asma Ben Abacha (6)

Remi Pautrat (6)

A.J. Brush (5)

Andrey Kolobov (5)

Aviv Hurvitz (5)

Dan Bohus (5)

Ece Kamar (5)

Ivan Tashev (5)

Lei Ji (5)

Xiaodong Liu (5)

Sean Andrist (5)

Nipun Kwatra (5)

Amber Hoak (5)

David Tittsworth (5)

Swadheen Shukla (5)

Christoph Vogel (5)

Danqing Huang (5)

Xiao Li (5)

Yixi Xu (5)

Lei Chu (5)

Prof. Darren Cosker (5)

Harkirat Behl (5)

Harshita Sharma (5)

Amrita Gupta (5)

Whitney Hudson (5)

Akram Zaytar (5)

Christopher O'Dowd (5)

Lohit Petikam (5)

Gabriele Goletto (5)

Rita Faia Marques (5)

Ashley Feniello (4)

Katja Hofmann (4)

Mike Shepperd (4)

Sanjeev Mehrotra (4)

Sriram Rajamani (4)

Weizhu Chen (4)

Xiulian Peng (4)

Yao Qian (4)

Yifan Gong (4)

Guoxin Wang (4)

Hannah Richardson (nee Murfet) (4)

Nikolaos Karianakis (4)

Yu Shi (4)

Victor Fragoso (4)

Kevin Hsieh (4)

Yang Liu (4)

Shahrzad Gholami (4)

Fanny Nina Paravecino (4)

Hao Cheng (4)

Rui Wang (4)

Andrea Tupini (4)

Anthony Cintron Roman (4)

Xiaoyi Zhang (4)

Qianhui Wu (4)

Maximilian Ilse (4)

Yangyu Huang (4)

Yifei Shen (4)

Saksham Singhal (4)

Tianyu Ding (4)

Kenza Bouzid (4)

Bodhi Priyantha (3)

Christopher Bishop (3)

Emre Kiciman (3)

Fan Yang (3)

Nicolo Fusi (3)

David Heckerman (3)

John Langford (3)

Kenji Takeda (3)

Kori Inkpen (3)

Henrique S. Malvar (3)

Michel Naim Gerguis (3)

Peter Bodík (3)

Qingwei Lin 林庆维 (3)

Ricardo Gutierrez (3)

Shi Han (3)

Shujie Liu (3)

Siân Lindley (3)

Scott Saponas (3)

Surajit Chaudhuri (3)

Yaobo Liang (3)

Harsha Simhadri (3)

Lester Mackey (3)

Pat Sweeney (3)

Luiz Belussi (3)

Andromachi Chatzieleftheriou (3)

P. Anandan (3)

Patrick Misteli (3)

Johnny Johnson (3)

Xiang Ming (3)

Shiqi Jiang (3)

Michael Hansen (3)

Yu Wang (3)

John Stairs (3)

Sheng Zhao (3)

Caihua Shan (3)

Zhongqi Miao (3)

Wen-wai Yim (3)

Pashmina Cameron (3)

Ren Yang (3)

Sam Bond-Taylor (3)

Zhengyuan Yang (3)

Alec Wolman (2)

Amit Sharma (2)

Christian Borgs (2)

Bozidar Radunovic (2)

Darren Gehring (2)

Jim Gray (2)

Hitesh Ballani (2)

John Helmes (2)

Jinyu Li (2)

Kalika Bali (2)

Karin Strauss (2)

Margus Veanes (2)

Muscle Wu (2)

Vishnu Navda (2)

Qiufeng Yin (2)

Ranveer Chandra (2)

Sarangarajan Parthasarathy (2)

Sean Rintel (2)

Shamsi Iqbal (2)

Shuvendu Lahiri (2)

Vassily Lyutsarev (2)

Sergey Yekhanin (2)

Moshe Lutz (2)

Bichlien Nguyen (2)

Li Zhao (2)

Chinmay Singh (2)

Mihaela Vorvoreanu (2)

Scarlett Li (2)

Qianxi Zhang (2)

Jimmy Hall (2)

Pratik Ghosh (2)

Neil Tenenholtz (2)

Robert Gmyr (2)

Xiaofei Wang (2)

Ran Gilad-Bachrach (2)

Xiubo Geng (2)

Kevin Kaichuang Yang (2)

Barun Patra (2)

Xia Song (2)

Bill Weeks (2)

Meghana Kshirsagar (2)

Rui Wang (2)

Felipe Oviedo (2)

Ashley J. Llorens (2)

Weiwei Yang (2)

Kristen Severson (2)

Ava P. Amini (2)

Robin Abraham (2)

Jayashree Mohan (2)

Victor Ruehle (2)

Alex Lu (2)

Saravan Rajmohan (2)

Jue Zhang (2)

Yansen Wang (2)

Rogerio Bonatti (2)

Shideh Rezaeifar (2)

Donglin Bai (2)

Scott Freitas (2)

Mahdi Rad (2)

Allen Kim (2)

Jaspreet Bagga (2)

Matheus R. F. Mendonça (2)

Judith Amores (2)

Chandan Singh (2)

Dongqi Han (2)

Ade Famoti (2)

Mansi Khemka (2)

Amit Misra (2)

Flora Liu (2)

Guanghui Qin (2)

Juan Manuel Zambrano Chaves (2)

Hui Xue (2)

Baolin Peng (2)

Yuhang He (2)

Thomas Lin (2)

Fabian Falck (2)

Anoop Gupta (1)

Josh Benaloh (1)

Brendan Lucier (1)

Chris Hawblitzel (1)

Chris Quirk (1)

Chris Sienkiewicz (1)

Chuck Needham (1)

Chris White (1)

Scott Counts (1)

Christian Paquin (1)

Chuck Thacker (1)

Daniel Cletheroe (1)

Darren Edge (1)

Dany Rouhana (1)

David Johnston (1)

Doug Burger (1)

Dongdong Zhang (1)

Ethan Jackson (1)

Gabe Cohn (1)

Gordon Bell (1)

E. Glen Weyl (1)

G. Ramalingam (1)

Hannes Gamper (1)

Hsiao-Wuen Hon (1)

Hugh Williams (1)

Íñigo Goiri (1)

Jaron Lanier (1)

Jacki O'Neill (1)

Jennifer Chayes (1)

Jennifer Wortman Vaughan (1)

Jonathan Lester (1)

Jake Hofman (1)

Johannes Gehrke (1)

John Tang (1)

Jonathan Larson (1)

Jack W. Stokes (1)

Karen Easterbrook (1)

Krishna Chintalapudi (1)

Ken Woodberry (1)

Leslie Lamport (1)

Lily Sun (1)

Mark Encarnación (1)

Miro Dudík (1)

Jeremiah (Miah) Wander (1)

Michel Pahud (1)

Nishanth Chandran (1)

Nicole Immorlica (1)

Nikhil Swamy (1)

Pallavi Choudhury (1)

Bo-June (Paul) Hsu (1)

Paolo Costa (1)

Patrick Longa (1)

Rick Rashid (1)

Reuben Olinsky (1)

Ricardo Bianchini (1)

Rich Draves (1)

Robert Gruen (1)

Rick Rogahn (1)

Ryen W. White (1)

Ryota Tomioka (1)

Sharad Agarwal (1)

Santiago Zanella-Béguelin (1)

Sasa Junuzovic (1)

Shobana Balakrishnan (1)

Shuo Chen (1)

Siddhartha Sen (1)

Srinath Setty (1)

Sumit Gulwani (1)

Thomas Karagiannis (1)

ThuVan Pham (1)

Ramarathnam Venkatesan (1)

Vivek Narasayya (1)

Hanna Wallach (1)

Xing Xie (1)

Xin Ma (1)

Yan Huang (1)

Yan Xia (1)

Ben Zorn (1)

Swami Manohar (1)

Stavros Volos (1)

Solon Barocas (1)

Vageesh D C (1)

Paul Smolensky (1)

Matthias Troyer (1)

Nathan Evans (1)

Irene Zhang (1)

Adam Atkinson (1)

Haoyu Dong (1)

Advait Sarkar (1)

Matthew Dixon (1)

Xingdi Yuan (1)

Ted Meeds (1)

Marc-Alexandre Côté (1)

Sunayana Sitaram (1)

Dan R. K. Ports (1)

Dimitra Emmanouilidou (1)

Landon Cox (1)

Karthik Ramachandra (1)

Sebastian Braun (1)

Francesca Parmigiani (1)

James Clegg (1)

Bo Qiao (1)

Boris Köpf (1)

Andrew Paverd (1)

Dr Kiran Muthabatulla (1)

Tal Zaccai (1)

Kate Lytvynets (1)

Sudha Rao (1)

Eduardo Salinas (1)

Lukas Gruber (1)

Lukas Wutschitz (1)

Denny Sun (1)

Shruti Tople (1)

Jiaqi Chu (1)

Mike Walker (1)

Vu Le (1)

Huaying Xue (1)

Xenofon Foukas (1)

Kenichi Kumatani (1)

Brian Caswell (1)

Yiwen Zhu (1)

Rohit Pillai (1)

Yoganand Rajasekaran (1)

Lorin Crawford (1)

Madeleine Daepp (1)

Anna Pavlenko (1)

Joyce Cahoon (1)

Brian Kroth (1)

Amanda K. Hall (1)

Samuel Chege Maina (1)

Kevin Larson (1)

Iker Llorens (1)

Luis França (1)

Esha Choukse (1)

Gabriela Martinez Sanchez (1)

Mattan Serry (1)

Mario Gini (1)

Vanessa Rodrigues (1)

Harsh Vijay (1)

Millicent Ochieng (1)

Jesús Camacho-Rodríguez (1)

Douglas J. Kelly (1)

Rianne van den Berg (1)

Sameer Segal (1)

Jake Smith (1)

Chang Xu (1)

Serena Hillman (1)

Srinivasan Iyengar (1)

Chenglong Wang (1)

Kali Frost (1)

Jyoti Aneja (1)

Javier Zazo (1)

Luna K. Qiu (1)

Darren Tanner (1)

Giovanni Cherubin (1)

Thomas Roca, PhD (1)

Gust Verbruggen (1)

Srikant Bharadwaj (1)

Yuge Zhang (1)

Tammy Glazer (1)

Lucas A. Meyer (1)

Xiao Liu (1)

Morris Sharp (1)

Burcu Canakci (1)

Menglin Xia (1)

Xin Jin (1)

Chris Parnin (1)

Corby Rosset (1)

Si Qin (1)

Mukul Singh (1)

Nicholas Jing Yuan (1)

Sarah Fakhoury (1)

Andres Codas (1)

Saikat Chakraborty (1)

Sarah Smith (1)

Shweti Mahajan (1)

Suraj Jog (1)

Chaojie Zhang (1)

Ursula Hardy (1)

Lucia Ronchi Darre (1)

Stephen Schneider (1)

Xiaoting Qin (1)

Aashaka Shah (1)

Renee St. Amant (1)

Kirill Kalinin (1)

Lev Tankelevitch (1)

Weijian Xu (1)

Andrzej Banburski-Fahey (1)

Arman Salimi (1)

Yupan Huang (1)

Jennifer Marsman (1)

Vivan Amin (1)

Sarah Alamdari (1)

Zongyu Guo (1)

Vidhisha Balachandran (1)

Carles Domingo-Enrich (1)

Sushrut Karmalkar (1)

Meygha Machado (1)

Varun Jain (1)

Henrik Turbell (1)

Amey Varhade (1)

Hamna . (1)

Galen Mullins (1)

Juheon (1)

Wenhui Wang (1)

Zhiliang Peng (1)

Yaoyao Chang (1)

Jianwei Yu (1)

Waqas Zamir (1)

Wassim Hamidouche (1)

Carl Chalmers (1)

Maia Stiber (1)

Payod Panda (1)

Rachel Lawrence (1)

Published Date

Publication

Satellite images reveal untracked human activity on the oceans

Konstantin Klemmer, Esther Rolf

Nature | December 2023, Vol 625: pp. 31-32

Microsoft Research Blog

Research at Microsoft 2023: A year of groundbreaking AI advances and discoveries

December 22, 2023

AI saw unparalleled growth in 2023, reaching millions daily. This progress owes much to the extensive work of Microsoft researchers and collaborators. In this review, learn about the advances in 2023, which set the stage…

Publication

RadEdit: Stress-Testing Biomedical Vision Models via Diffusion Image Editing

Fernando Pérez-García, Sam Bond-Taylor, Pedro P. Sanchez, Boris van Breugel, Daniel Coelho de Castro, Harshita Sharma, Valentina Salvatelli, Maria T. A. Wetscherek, Hannah Richardson (nee Murfet), Matthew P Lungren, Aditya Nori, Javier Alvarez-Valle, Ozan Oktay, Maximilian Ilse

ECCV 2024 | December 2023

Access Project

Publication

VCoder: Versatile Vision Encoders for Multimodal Large Language Models

Jitesh Jain, Jianwei Yang, Humphrey Shi

CVPR 2024 | December 2023

Publication

ASSISTGUI: Task-Oriented Desktop Graphical User Interface Automation

Difei Gao, Lei Ji, Zechen Bai, Mingyu Ouyang, Peiran Li, Dongxing Mao, Qinchen Wu, Weichen Zhang, Peiyi Wang, Xiangwu Guo, Hengxu Wang, Luowei Zhou, Mike Zheng Shou

CVPR 2024 | December 2023

Tool

LLMR

This repo contains the code described in LLMR (opens in new tab), implementing the Large Language Model for Mixed Reality framework. This package serves as a prototype for “Speaking the world into existence”, which allows the…

GitHub

Publication

Osprey: Pixel Understanding with Visual Instruction Tuning

Yuqian Yuan, Wentong Li, Jian Liu, Dongqi Tang, Xinjie Luo, Chi Qin, Lei Zhang, Jianke Zhu

CVPR 2024 | December 2023

Microsoft Research Blog

NeurIPS 2023 highlights breadth of Microsoft’s machine learning innovation

December 11, 2023

We’re proud to have 100+ accepted papers At NeurIPS 2023, plus 18 workshops. Several submissions were chosen as oral presentations and spotlight posters, reflecting groundbreaking concepts, methods, or applications. Here’s an overview of those submissions.

Publication

PEEKABOO: Interactive Video Generation via Masked-Diffusion

Yash Jain, Anshul Nasery, Vibhav Vineet, Harkirat Behl

CVPR 2024 | December 2023

Invited Talk at Holistic Video Understanding Workshop, CVPR 2024

Publication

Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs

Sung‐Jin Hong, Jaewoo Jung, Heeseong Shin, Jiaolong Yang, Seungryong Kim, Chong Luo

CVPR 2024 | December 2023

Computer Vision

Highlights