Research | Adobe Media and Data Science Research (MDSR) Laboratory

Research from Adobe MDSR spans machine learning, computer vision, natural language processing, multimodal AI, behavior modeling, and computational persuasion. Publications appear at top AI venues including NeurIPS, ICML, ICLR, CVPR, ACL, EMNLP, and ECCV.

2026

Social Agents: Collective Intelligence Improves LLM Predictions

Aanisha Bhattacharyya, Abhilekh Borah, Yaman Kumar Singla, Rajiv Ratn Shah, Changyou Chen, Balaji Krishnamurthy. ICLR, 2026.

ALPHA: Action-Based Learning for Pluralistic Human Alignment in Large Language Models

Aanisha Bhattacharyya, Susmit Aggarwal, Yaman Kumar Singla, Tarun Menta, Nikitha SR, Rajiv Ratn Shah, Changyou Chen, Balaji Krishnamurthy. AAAI Alignment Track, 2026.

ZIPP: Zero-shot Image Personalization from Personas

S I Harini, Somesh Singh, Yaman Kumar Singla, David Doermann, Rajiv Ratn Shah. ECCV, 2026.

BrandFusion: Aligning Image Generation with Brand Styles

Parul, Varun Khurana, Yaman Kumar Singla, Balaji Krishnamurthy, Abhinav Dhall. WACV, 2026.

Unsupervised Memorability Modeling from Tip-of-the-Tongue Retrieval Queries

Sree Bhattacharyya, Yaman Kumar Singla, Sudhir Yarram, Somesh Singh, S I Harini, James Z. Wang. WACV, 2026.

2025

SPRO: Improving Image Generation via Self-Play

Ritika Jha, Aanisha Bhattacharyya, Yaman Kumar Singla, Rajiv Ratn Shah, Changyou Chen, Balaji Krishnamurthy. NeurIPS, 2025.

It Helps to Take a Second Opinion: Teaching Smaller LLMs To Deliberate Mutually via Selective Rationale Optimisation

Sohan Patnaik, Milan Aggarwal, Sumit Bhatia, Balaji Krishnamurthy. ICLR, 2025.

LLaVA Finds Free Lunch: Teaching Human Behavior Improves Content Understanding Abilities Of LLMs

Somesh Singh, S I Harini, Yaman Kumar Singla, Veeky Baths, Rajiv Ratn Shah, Changyou Chen, Balaji Krishnamurthy. ICLR, 2025.

Measuring And Improving Engagement of Text-to-Image Generation Models

Varun Khurana, Yaman Kumar Singla, Jayakumar Subramanian, Changyou Chen, Rajiv Ratn Shah, Zhiqiang Xu, Balaji Krishnamurthy. ICLR, 2025.

Measuring and Improving Persuasiveness of Large Language Models

Somesh Singh, Yaman Kumar Singla, S I Harini, Balaji Krishnamurthy. ICLR, 2025.

AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment

Sohan Patnaik, Rishabh Jain, Balaji Krishnamurthy, Mausoom Sarkar. CVPR, 2025.

Learning Together to Perform Better: Teaching Small-Scale LLMs to Collaborate via Preferential Rationale Tuning

Sohan Patnaik, Milan Aggarwal, Sumit Bhatia, Balaji Krishnamurthy. ACL, 2025.

On the Effect of Instruction Tuning Loss on Generalization

Anwoy Chatterjee, Kowndinya Renduchintala, Sumit Bhatia, Tanmoy Chakraborty. TACL, 2025.

Long-Term Ad Memorability: Understanding & Generating Memorable Ads

S I Harini, Somesh Singh, Yaman Kumar Singla, Aanisha Bhattacharyya, Veeky Baths, Changyou Chen, Rajiv Ratn Shah, Balaji Krishnamurthy. WACV, 2025.

AdQuestA: Knowledge-Guided Visual Question Answer Framework For Advertisements

Neha Choudhary, Poonam Goyal, Devashish Siwatch, Atharva Chandak, Harsh Mahajan, Varun Khurana, Yaman Kumar Singla. WACV, 2025.

ReEdit: Multimodal Exemplar-Based Image Editing using Diffusion Models

Ashutosh Srivastava, Tarun Ram Menta, Abhinava Java, Avadhoot Jadhav, Silky Singh, Surgan Jandial, Balaji Krishnamurthy. WACV, 2025.

HIRE: Lightweight High-Resolution Image Feature Enrichment for Multimodal LLMs

Nikitha SR, Aradhya Neeraj Mathur, Tarun Ram Menta, Rishabh Jain, Mausoom Sarkar. CVPR Workshop, 2025.

EOPose: Exemplar-based object reposing using Generalized Pose Correspondences

Sarthak Mehrotra, Rishabh Jain, Mayur Hemani, Balaji Krishnamurthy, Mausoom Sarkar. ICCV Workshop, 2025.

Evaluating Variance in Visual Question Answering Benchmarks

Nikitha SR. ICCV Workshop, 2025.

2024

Large Content And Behavior Models To Understand, Simulate, And Optimize Content And Behavior

Ashmit Khandelwal, Aditya Agrawal, Aanisha Bhattacharyya, Yaman Kumar Singla, Somesh Singh, Uttaran Bhattacharya, Ishita Dasgupta, Stefano Petrangeli, Rajiv Ratn Shah, Changyou Chen, Balaji Krishnamurthy. ICLR, 2024.

CABINET: Content Relevance based Noise Reduction for Table Question Answering

Sohan Patnaik, Heril Changwal, Milan Aggarwal, Sumit Bhatia, Yaman Kumar Singla, Balaji Krishnamurthy. ICLR, 2024.

All should be equal in the eyes of LMs: Counterfactually Aware Fair Text Generation

Pragyan Banerjee, Abhinav Java, Surgan Jandial, Simra Shahid, Shaz Furniturewala, Balaji Krishnamurthy, Sumit Bhatia. AAAI, 2024.

Advances in Citation Text Generation: Leveraging Multi-Source Seq2Seq Models and Large Language Models

Avinash Anand, Ashwin Nair, Kritarth Prasad, Vrinda Narayan, Naman Lal, Debanjan Mahata, Yaman Kumar Singla, Rajiv Shah. CIKM, 2024.

SMART: Submodular Data Mixture Strategy for Instruction Tuning

Kowndinya Renduchintala, Sumit Bhatia, Ganesh Ramakrishnan. ACL (Findings), 2024.

POSIX: Prompt Sensitivity Index for Large Language Models

Anwoy Chatterjee, Kowndinya Renduchintala, Sumit Bhatia, Tanmoy Chakraborty. EMNLP (Findings), 2024.

2023

Explaining RL Decisions with Trajectories

Shripad Vilasrao Deshmukh, Arpan Dasgupta, Balaji Krishnamurthy, Nan Jiang, Chirag Agarwal, Georgios Theocharous, Jayakumar Subramanian. ICLR, 2023.

DeAR Debiasing vision-language models are with additive residuals

Ashish Seth, Mayur Hemani, Chirag Agarwal.. CVPR, 2023.

Parameter Efficient Local Implicit Image Function Network for Face Segmentation

Mausoom Sarkar, Nikitha SR, Mayur Hemani, Rishabh Jain, Balaji Krishnamurthy. CVPR, 2023.

VGFlow: Visibility guided flow network for human reposing

Rishabh Jain, Krishna Kumar Singh, Mayur Hemani, Jingwan Lu, Mausoom Sarkar, Duygu Ceylan, Balaji Krishnamurthy. CVPR, 2023.

Persuasion Strategies in Advertisements

Yaman Kumar Singla, Rajat Jha, Arunim Gupta, Milan Aggarwal, Aditya Garg, Ayush Bhardwaj, Tushar, Balaji Krishnamurthy, Rajiv Ratn Shah, Changyou Chen. AAAI, 2023.

UMFuse: Unified Multi View Fusion for Human Editing applications

Rishabh Jain, Mayur Hemani, Duygu Ceylan, Krishna Kumar Singh, Jingwan Lu, Mausoom Sarkar, Balaji Krishnamurthy. ICCV, 2023.

A Video Is Worth 4096 Tokens: Verbalize Videos To Understand Them In Zero Shot

Aanisha Bhattacharyya, Yaman Kumar Singla, Balaji Krishnamurthy, Changyou Chen, Rajiv Ratn Shah. EMNLP, 2023.

Explain Like I am BM25: Interpreting a Dense Model's Ranked-List with a Sparse Approximation

Michael Llordes, Debasis Ganguly, Sumit Bhatia, Chirag Agarwal. SIGIR, 2023.

What do audio transformer models hear? Probing Acoustic Representations for Language Delivery and its Structure

Yaman Kumar Singla, Jui Shah, Rajiv Ratn Shah, Changyou Chen. ICDM, 2023.

MobiVSR - Mobile Application for Visual Speech Recognition

Nilay Srivastava, Astitwa Saxena, Yaman Kumar Singla, Debanjan Mahata, Rajiv Ratn Shah, Amanda Stent, Roger Zimmerman. InterSpeech, 2023.

Differentiable Agent-based Epidemiology

Ayush Chopra, Alexander Rodríguez, Jayakumar Subramanian, Arnau Quera-Bofarull, Balaji Krishnamurthy, B Aditya Prakash, Ramesh Raskar. AAMAS, 2023.

LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-training

Silky Singh, Shripad Deshmukh, Mausoom Sarkar, Balaji Krishnamurthy. BMVC, 2023.

One-Shot Doc Snippet Detection: Powering Search in Document Beyond Text

Abhinav Java, Shripad Deshmukh, Milan Aggarwal, Surgan Jandial, Mausoom Sarkar, Balaji Krishnamurthy. WACV, 2023.

Synthesizing Human Gaze Feedback for Improved NLP Performance

Varun Khurana, Yaman Kumar Singla, Nora Hollenstein, Rajesh Kumar, Balaji Krishnamurthy. EACL, 2023.

Automatic Essay Scoring Systems are Both Overstable and Oversensitive: Explaining Why and Proposing Defenses

Yaman Kumar Singla, Swapnil Parekh, Somesh Singh, Junyi Jessy Li, Rajiv Ratn Shah, Changyou Chen. Dialogue & Discourse, 2023.

Public health impact of delaying second dose of BNT162b2 or mRNA-1273 covid-19 vaccine: simulation agent based modeling study

Ayush Chopra, Esma S Gel, Jayakumar Subramanian, Balaji Krishnamurthy, Santiago Romero-Brufau, Kalyan S. Pasupathy, Thomas C. Kingsley, Ramesh Raskar Published at the BMJ. British Medical Journal, 2023.

Robustness and Sample Complexity of Model-Based MARL for General Sum Markov Games

Jayakumar Subramanian, Amit Sinha, Aditya Mahajan. Dynamic Games and Applications, 2023.

HyHTM: Hyperbolic Geometry-based Hierarchical Topic Model

Simra Shahid, Tanay Anand, Nikitha SR, Sumit Bhatia, Balaji Krishnamurthy, Nikaash Puri. ACL (Findings), 2023.

INGENIOUS: Using Informative Data Subsets for Efficient Pre-Training of Language Models

Kowndinya Renduchintala, Krishnateja Killamsetty, Sumit Bhatia, Milan Aggarwal, Ganesh Ramakrishnan, Rishabh Iyer, Balaji Krishnamurthy. EMNLP (Findings), 2023.

2022

CyCLIP: Cyclic Contrastive Language-Image Pretraining

Shashank Goel, Hritik Bansal, Sumit Bhatia, Ryan A. Rossi, Vishwa Vinay, Aditya Grover. NeurIPS, 2022.

Minimal: Mining Models for Universal Adversarial Triggers

Yaman Kumar Singla, Swapnil Parekh, Somesh Singh, Changyou Chen, Balaji Krishnamurthy, Rajiv Ratn Shah. AAAI, 2022.

Harmonized Banner Creation from Multimodal Design Assets

Praneetha Vaddamanu, Vinay Aggarwal, Bhanu Prakash Reddy Guda, Balaji Vasan Srinivasan, Niyati Chhaya. CHI LBW, 2022.

NeurTEx: A Neural Framework for Template Extraction from Flat Images

Vinay Aggarwal, Praneetha Vaddamanu, Bhanu Prakash Reddy Guda, Balaji Vasan Srinivasan, Niyati Chhaya, Vishwa Vinay. CHI LBW, 2022.

Approximate Information State for Approximate Planning and Reinforcement Learning in Partially Observed Systems

Jayakumar Subramanian, Amit Sinha, Raihan Seraj, Aditya Mahajan. JMLR, 2022.

DynamicTOC: Persona-based Table of Contents for Consumption of Long Documents

Himanshu Maheshwari, Nethraa Sivakumar, Shelly Jain, Tanvi Karandikar, Vinay Aggarwal, Navita Goyal, Sumit Shekhar. NAACL, 2022.

CoSe-Co: Text Conditioned Generative CommonSense Contextualizer

Rachit Bansal, Jivat Meet Kaur, Milan Aggarwal, Sumit Bhatia, Balaji Krishnamurthy. NAACL, 2022.

LM-CORE: Language Models with Contextually Relevant External Knowledge

Rachit Bansal, Jivat Meet Kaur, Milan Aggarwal, Sumit Bhatia, Balaji Krishnamurthy. NAACL, 2022.

Span Classification with Structured Information for Disfluency Detection in Spoken Utterances

Sreyan Ghosh, Sonal Kumar, Yaman Kumar Singla, Rajiv Ratn Shah, S Umesh. InterSpeech, 2022.

Status-quo policy gradient in Multi-Agent Reinforcement Learning

Pinkesh Badjatiya, Mausoom Sarkar, Nikaash Puri, Jayakumar Subramanian, Abhishek Sinha, Siddharth Singh, Balaji Krishnamurthy. AAMAS, 2022.

Data Instance Prior for Transfer Learning in GANs

Puneet Mangla, Nupur Kumari, Mayank Singh, Vineeth N. Balasubramanian, Balaji Krishnamurthy. WACV, 2022.

SAC: Semantic Attention Composition for Text-Conditioned Image Retrieval

Surgan Jandial, Ayush Chopra, Pinkesh Badjatiya, Pranit Chawla, Mausoom Sarkar, Balaji Krishnamurthy. WACV, 2022.

SHERLock: Self-Supervised Hierarchical Event Representation Learning

Sumedh Sontakke, Sumegh Roychowdury, Mausoom Sarkar, Nikaash Puri, Balaji Krishnamurthy, Laurent Itti. ICPR, 2022.

Automated Speech Scoring System Under The Lens: Evaluating and interpreting the linguistic cues for language proficiency

Manraj Grover, Pakhi Bamdev, Yaman Kumar Singla, Payman Vafaee, Mika Hama, Rajiv Ratn Shah. International Journal of Artificial Intelligence in Education, 2022.

SARC: Soft Actor Retrospective Critic

Sukriti Verma, Jayakumar Subramanian, Ayush Chopra, Nikaash Puri, Mausoom Sarkar, Piyush Gupta, Balaji Krishnamurthy. RLDM, 2022.

Text simplification for legal domain:{i} nsights and challenges

Aparna Garimella, Abhilasha Sancheti, Vinay Aggarwal, Ananya Ganesh, Niyati Chhaya, Nanda Kambhatla. NLLP Workshop, 2022.

2021

Medical Dead-ends and Learning to Identify High-Risk States and Treatments

Fatemi M., Killian T., Subramanian J., Ghassemi M.. NeurIPS, 2021.

What Ails One-Shot Image Segmentation: A Data Perspective

Mayur Hemani, Abhinav Patel, Tejas Shimpi, Anirudha Ramesh, Balaji Krishnamurthy. NeurIPS, 2021.

TAN-NTM: Topic Attention Networks for Neural Topic Modeling

Madhur Panwar, Shashank Shailabh, Milan Aggarwal, Balaji Krishnamurthy. ACL-IJCNLP, 2021.

ZFlow: Gated Appearance Flow-based Virtual Try-on with 3D Priors

Ayush Chopra, Rishabh Jain, Mayur Hemani, Balaji Krishnamurthy. ICCV, 2021.

ClauseRec: A Clause Recommendation Framework for AI-aided Contract Authoring

Vinay Aggarwal, Aparna Garimella, Balaji Vasan Srinivasan, Anandhavelu N, Rajiv Jain. EMNLP, 2021.

Speaker-Conditioned Hierarchical Modeling for Automated Speech Scoring

Yaman Kumar Singla, Avyakt Gupta, Shaurya Bagga, Changyou Chen, Balaji Krishnamurthy, Rajiv Ratn Shah. CIKM, 2021.

2D to 3D medical image colorization

Aradhya Neeraj Mathur, Apoorv Khattar, Ojaswa Sharma. WACV, 2021.

LT-GAN: Self-Supervised GAN with Latent Transformation Detection

Parth Patel, Nupur Kumari, Mayank Singh, Balaji Krishnamurthy. WACV, 2021.

Lifi: Towards linguistically informed frame interpolation

Aradhya Neeraj Mathur, Devansh Batra, Yaman Kumar Singla, Rajiv Ratn Shah, Changyou Chen, Roger Zimmermann. ICASSP, 2021.

Robustness of Markov perfect equilibrium to model approximations in general-sum dynamic games

Subramanian J., Sinha A., Mahajan A.. Indian Control Conference, 2021.

DeepABM: Scalable and Efficient Agent-Based Simulations via Graph Convolutional Frameworks - a Case Study for COVID-19 Spread and Interventions

Ayush Chopra, Esma S Gel, Jayakumar Subramanian, Balaji Krishnamurthy, Santiago Romero-Brufau, Kalyan S. Pasupathy, Thomas C. Kingsley, Ramesh Raskar. Winter Simulation Conference, 2021.

2020

Explain Your Move: Understanding Agent Actions Using Specific and Relevant Feature Attribution

Nikaash Puri, Sukriti Verma, Piyush Gupta, Dhruv Kayastha, Shripad Deshmukh, Balaji Krishnamurthy, Sameer Singh. ICLR, 2020.

Harnessing GANs for Zero-shot Learning of New Classes in Visual Speech Recognition

Yaman Kumar Singla, Dhruva Sharawat, Shubham Maheshwari, Debanjan Mahata, Rajiv Ratn Shah, Yifang Yin, Roger Zimmermann, Amanda Stent. AAAI, 2020.

SimPropNet: Improved Similarity Propagation for Few-shot Image Segmentation

Siddhartha Gairola, Mayur Hemani, Ayush Chopra, Balaji Krishnamurthy. IJCAI, 2020.

Form2Seq : A Framework for Higher-Order Form Structure Extraction

Milan Aggarwal, Hiresh Gupta, Mausoom Sarkar, Balaji Krishnamurthy. EMNLP, 2020.

Attributional Robustness Training using Input-Gradient Spatial Alignment

Mayank Singh, Nupur Kumari, Puneet Mangla, Abhishek Sinha, Vineeth N Balasubramanian, Balaji Krishnamurthy. ECCV, 2020.

Document Structure Extraction using Prior based High Resolution Hierarchical Semantic Segmentation

Mausoom Sarkar, Milan Aggarwal, Arneh Jain, Hiresh Gupta, Balaji Krishnamurthy. ECCV, 2020.

Retrospective Loss: Looking Back to Improve Training of Deep Neural Networks

Surgan Jandial, Ayush Chopra, Mausoom Sarkar, Piyush Gupta, Balaji Krishnamurthy, Vineeth Balasubramanian. KDD, 2020.

ShapeVis: High-dimensional Data Visualization at Scale

Nupur Kumari, Siddarth R., Akash Rupela, Piyush Gupta, Balaji Krishnamurthy. WWW, 2020.

MixBoost: Synthetic Oversampling with Boosted Mixup for Handling Extreme Imbalance

Anubha Kabra, Ayush Chopra, Nikaash Puri, Pinkesh Badjatiya, Sukriti Verma, Piyush Gupta, Balaji Krishnamurthy. ICDM, 2020.

Charting the Right Manifold: Manifold Mixup for Few-shot Learning

Puneet Mangla, Nupur Kumari, Mayank Singh, Abhishek Sinha, Balaji Krishnamurthy, V N Balasubramaniam.. WACV, 2020.

Multi-Modal Association based Grouping for Form Structure Extraction

Milan Aggarwal, Mausoom Sarkar, Hiresh Gupta, Balaji Krishnamurthy. WACV, 2020.

SieveNet: A Unified Framework for Robust Image-based Virtual Try-On

Ayush Chopra, Surgan Jandial, Kumar Ayush, Mayur Hemani, Balaji Krishnamurthy. WACV, 2020.

Towards A Unified Framework for Visual Compatibility Prediction

Ayush Chopra, Kumar Ayush, Anirudh Singhal, Utkarsh Patel, Balaji Krishnamurthy. WACV, 2020.

Keyphrase Extraction as Sequence Labeling Task using Transformers

Dhruva Sahrawat, Debanjan Mahata, Raymond Zhang, Mayank Kulkarni, Agniv Sharma, Rakesh Gosangi, Amanda Stent, Yaman Kumar Singla, Rajiv Ratn Shah, Roger Zimmermann. ECIR, 2020.

Learning based Methods for Code Runtime Complexity Prediction

Jagriti Sikka, Kushal Satya, Yaman Kumar Singla, Shagun Uppal, Rajiv Ratn Shah, Roger Zimmermann. ECIR, 2020.

 An Empirical Study of Representation Learning for Reinforcement Learning in Healthcare

Killian T., Zhang H., Subramanian J., Fatemi M., Ghassemi M.. PMLR, 2020.

2018

Harnessing AI for speech reconstruction using multiview silent video feed

Yaman Kumar Singla, Mayank Aggarwal, Pratham Nawal, Shin'ichi Satoh, Rajiv Ratn Shah, Roger Zimmerman. ACMMM, 2018.