Abhishek Kar

Building the technology to capture, create and consume rich visual media.

I’m an AI Research Scientist at Meta Reality Labs, building the future of social connection through photorealistic telepresence with the Codec Avatars team, from large-scale avatar models to hologram calling on Meta’s glasses.

My work spans smartphone photography and mixed reality. At Google I took research into products used at scale: ML depth for photography and AR on 1B+ Android devices (ARCore Depth API, Cinematic photos, Pixel portrait mode); the mixed reality passthrough stack on Samsung Galaxy XR, as its architect; and photo and video spatialization in Google Photos, which I founded.

Earlier, I founded the ML team at Fyusion, whose AI-driven damage detection drove its acquisition by Cox Automotive, and did my PhD at UC Berkeley with Jitendra Malik.

Portrait of Abhishek Kar

Shipped work

Research is most fun when it leaves the lab. Products and features I've built or led.

Hologram calling

Meta2026

Hologram calling

Photoreal holograms of you in calls on Meta VR Glasses and Meta Ray-Ban Display, shown at Connect 2026 — years of telepresence research packaged into a seamless calling experience.

Meta2026

Large-scale Codec Avatars

Photoreal full-body avatars from a quick phone scan, trained on internet-scale data — bringing the LLM pre/post-training recipe to digital humans.

Spatial photos & videos

Google Photos · Android XR2025

Spatial photos & videos

Founded and led early development of spatialization — turning everyday 2D photos and videos into immersive ones. Now central to Google Photos on XR.

ARCore Depth API

Google2020

ARCore Depth API

Real-time depth from a single moving phone camera, bringing occlusion and physics to AR on everyday Android phones.

Fyusion2019

Casual light field capture

Phone-captured, photorealistic 3D product views — the production system behind Local Light Field Fusion (SIGGRAPH 2019).

Selected research

3D vision, neural rendering, generative models and computational photography — 26 papers with wonderful collaborators.

All publications

2026

Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretraining

Junxuan Li, Rawal Khirodkar, Chengan He, … Abhishek Kar, … Shunsuke Saito +35 moreJunxuan Li, Rawal Khirodkar, Chengan He, Zhongshi Jiang, Giljoo Nam, Lingchen Yang, Jihyun Lee, Egor Zakharov, Zhaoen Su, Rinat Abdrashitov, Yuan Dong, Julieta Martinez, Kai Li, Qingyang Tan, Takaaki Shiratori, Matthew Hu, Peihong Guo, Xuhua Huang, Ariyan Zarei, Marco Pesavento, Yichen Xu, He Wen, Teng Deng, Wyatt Borsos, Anjali Thakrar, Jean-Charles Bazin, Carsten Stoll, Ginés Hidalgo, James Booth, Lucy Wang, Xiaowen Ma, Yu Rong, Sairanjith Thalanki, Chen Cao, Christian Häne, Abhishek Kar, Sofien Bouaziz, Jason Saragih, Yaser Sheikh, Shunsuke Saito
CVPR 2026

2024

3D Gaussian Splatting as Markov Chain Monte Carlo

Shakiba Kheradmand, Daniel Rebain, Gopal Sharma, Weiwei Sun, Yang-Che Tseng, Hossam Isack, Abhishek Kar, Andrea Tagliasacchi, Kwang Moo Yi
NeurIPS 2024Spotlight

NeRFiller: Completing Scenes via Generative 3D Inpainting

Ethan Weber, Aleksander Hołyński, Varun Jampani, Saurabh Saxena, Noah Snavely, Abhishek Kar, Angjoo Kanazawa
CVPR 2024

Probing the 3D Awareness of Visual Foundation Models

Mohamed El Banani, Amit Raj, Kevis-Kokitsi Maninis, Abhishek Kar, Yuanzhen Li, Michael Rubinstein, Deqing Sun, Leonidas Guibas, Justin Johnson, Varun Jampani
CVPR 2024

SHINOBI: Shape and Illumination using Neural Object Decomposition via BRDF Optimization In-the-wild

Andreas Engelhardt, Amit Raj, Mark Boss, Yunzhi Zhang, Abhishek Kar, Yuanzhen Li, Deqing Sun, Ricardo Martin Brualla, Jonathan T. Barron, Hendrik P. A. Lensch, Varun Jampani
CVPR 2024

Accelerating Neural Field Training via Soft Mining

Shakiba Kheradmand, Daniel Rebain, Gopal Sharma, Hossam Isack, Abhishek Kar, Andrea Tagliasacchi, Kwang Moo Yi
CVPR 2024

Unsupervised Keypoints from Pretrained Diffusion Models

Eric Hedlin, Gopal Sharma, Shweta Mahajan, Xingzhe He, Hossam Isack, Abhishek Kar, Helge Rhodin, Andrea Tagliasacchi, Kwang Moo Yi
CVPR 2024

2023

Unsupervised Semantic Correspondence Using Stable Diffusion

Eric Hedlin, Gopal Sharma, Shweta Mahajan, Hossam Isack, Abhishek Kar, Andrea Tagliasacchi, Kwang Moo Yi
NeurIPS 2023

The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation

Saurabh Saxena, Charles Herrmann, Junhwa Hur, Abhishek Kar, Mohammad Norouzi, Deqing Sun, David J. Fleet
NeurIPS 2023

ASIC: Aligning Sparse in-the-wild Image Collections

Kamal Gupta, Varun Jampani, Carlos Esteves, Abhinav Shrivastava, Ameesh Makadia, Noah Snavely, Abhishek Kar
ICCV 2023

LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFs

Zezhou Cheng, Carlos Esteves, Varun Jampani, Abhishek Kar, Subhransu Maji, Ameesh Makadia
ICCV 2023

DC²: Dual-Camera Defocus Control by Learning to Refocus

Hadi Alzayer, Abdullah Abuolaim, Leung Chun Chan, Yang Yang, Ying Chen Lou, Jia-Bin Huang, Abhishek Kar
CVPR 2023

Rapsai: Accelerating Machine Learning Prototyping of Multimedia Applications Through Visual Programming

Ruofei Du, Na Li, Jing Jin, … Abhishek Kar, … Alex Olwal +12 moreRuofei Du, Na Li, Jing Jin, Michelle Carney, Scott Miles, Maria Kleiner, Xiuxiu Yuan, Yinda Zhang, Anuva Kulkarni, Xingyu "Bruce" Liu, Ahmed Sabie, Sergio Escolano, Abhishek Kar, Ping Yu, Ram Iyengar, Adarsh Kowdle, Alex Olwal
CHI 2023Best Paper Honorable Mention

2022

SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections

Mark Boss, Andreas Engelhardt, Abhishek Kar, Yuanzhen Li, Deqing Sun, Jonathan T. Barron, Hendrik P. A. Lensch, Varun Jampani
NeurIPS 2022

Learned Monocular Depth Priors in Visual-Inertial Initialization

Yunwen Zhou, Abhishek Kar, Eric Turner, Adarsh Kowdle, Chao X. Guo, Ryan C. DuToit, Konstantine Tsotsos
ECCV 2022

2021

SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpainting

Varun Jampani*, Huiwen Chang*, Kyle Sargent, Abhishek Kar, Richard Tucker, Michael Krainin, Dominik Kaeser, William T. Freeman, David Salesin, Brian Curless, Ce Liu
ICCV 2021Oral

2019

Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines

Ben Mildenhall*, Pratul Srinivasan*, Rodrigo Ortiz-Cayon, Nima Khademi Kalantari, Ravi Ramamoorthi, Ren Ng, Abhishek Kar
SIGGRAPH 2019

Learning Independent Object Motion from Unlabelled Stereoscopic Videos

Zhe Cao, Abhishek Kar, Christian Häne, Jitendra Malik
CVPR 2019

2017

Learning a Multi-View Stereo Machine

Abhishek Kar, Christian Häne, Jitendra Malik
NeurIPS (NIPS) 2017

Learning Category-Specific Deformable 3D Models for Object Reconstruction

Shubham Tulsiani*, Abhishek Kar*, João Carreira, Jitendra Malik
TPAMI 2017

2016

The three R's of computer vision: Recognition, reconstruction and reorganization

Jitendra Malik, Pablo Arbeláez, João Carreira, Katerina Fragkiadaki, Ross Girshick, Georgia Gkioxari, Saurabh Gupta, Bharath Hariharan, Abhishek Kar, Shubham Tulsiani
Pattern Recognition Letters 2016

2015

Shape and Symmetry Induction for 3D Objects

Shubham Tulsiani, Abhishek Kar, Qixing Huang, João Carreira, Jitendra Malik
arXiv 2015

Amodal Completion and Size Constancy in Natural Scenes

Abhishek Kar, Shubham Tulsiani, João Carreira, Jitendra Malik
ICCV 2015

Category-Specific Object Reconstruction from a Single Image

Abhishek Kar*, Shubham Tulsiani*, João Carreira, Jitendra Malik
CVPR 2015Best Student Paper Award · Oral

Virtual View Networks for Object Reconstruction

João Carreira, Abhishek Kar, Shubham Tulsiani, Jitendra Malik
CVPR 2015

2012

Looking At You: Fused Gyro and Face Tracking for Viewing Large Imagery on Mobile Devices

Neel Joshi, Abhishek Kar, Michael F. Cohen
CHI 2012

Career

  1. Sep 2024 – present

    Meta Reality Labs

    AI Research Scientist

    Codec Avatars — photorealistic telepresence and hologram calling.

  2. Jan 2020 – Aug 2024

    Google AR

    Research Scientist

    ML perception and computational photography — depth on 1B+ Android devices, Galaxy XR passthrough (architect), spatial photos.

  3. Nov 2017 – Dec 2019

    Fyusion

    Director of Machine Learning

    Founded and grew the ML team (~10). Damage detection that drove the Cox Automotive acquisition.

  4. 2012 – 2017

    UC Berkeley

    PhD, Computer Science

    Thesis "Learning to Reconstruct 3D Objects" with Jitendra Malik. CVPR 2015 Best Student Paper.

  5. Microsoft Research · Adobe Research

    Research internships

  6. 2008 – 2012

    IIT Kanpur

    B.Tech, Computer Science

Honors & teaching

  • Best Paper Honorable Mention — CHI 2023 (Rapsai)
  • Best Student Paper Award — CVPR 2015
  • Outstanding GSI Award — UC Berkeley, CS189 Machine Learning (2013)
  • GSI, CS188 Artificial Intelligence with Pieter Abbeel — UC Berkeley (2014)
  • Honda Young Engineer and Scientist (YES) Award