Riyasat Ohib
I’m a Research Scientist at Google DeepMind in New York. I did my PhD at Georgia Tech with Vince Calhoun and Sergey Plis, working on sparse learning in deep models.
I study how neural networks represent what they learn, how those representations shape behavior, and how understanding them can make models more efficient, interpretable, and controllable. I first explored these questions in research internships at Google DeepMind, Cohere, Dolby Laboratories, and Meta FAIR. Behind all of it is one question: how learning works, in brains and in machines.
When I’m not doing research, I’m usually playing soccer, traveling, hiking, or reading about science, history, and how the world works. I keep a list of what I’ve been reading.
Selected work
-
Concept Spaces in the Residual Stream of Diffusion Transformers
Training-free steering of diffusion transformers by intervening on concept directions in the residual stream, often matching or beating prompting with smoother control.
-
SSFL: Discovering Sparse Unified Subnetworks at Initialization for Efficient Federated Learning
SSFL finds sparse subnetworks before federated training starts, reducing communication while preserving accuracy across non-IID clients.
-
Exploring Sparse Adapters for Scalable Merging of Parameter Efficient Experts
Sparse adapters provide simple, parameter-efficient task experts that merge more effectively than LoRA or full fine-tuning across as many as 20 NLP tasks.
-
Efficient Reinforcement Learning by Discovering Neural Pathways
Neural pathways identify compact subnetworks for reinforcement learning, retaining strong performance with less than 5% of a larger network's parameters and supporting multiple tasks within one model.
News
-
Joined Google DeepMind as a Research Scientist in New York, working on understanding representations and how to control frontier multimodal models.
-
Completed my PhD at Georgia Tech with Vince Calhoun and Sergey Plis. Dissertation: The Hidden Structure of Deep Models: Discovering and Exploiting Sparse Subnetworks.
-
Learning to Query History accepted at the ICLR TSALM workshop, on retrieval-augmented classification under nonstationarity.
-
Concept Spaces in the Residual Stream of Diffusion Transformers accepted at the CVPR HOW workshop, on steering generation through concept directions.