Hi there! đź‘‹ I am a PhD student in Computer Science at Columbia University, where I work in machine learning. I am broadly interested in developing AI systems that are capable of design and invention. My research interests include experimental design, learned physical simulation, and AI4Science. I'm fortunate to be advised by Carl Vondrick and Richard Zemel. My research has received support from an NSF Fellowship.
Previously, I completed my BSE in Computer Science at Princeton University, with a minor in Applied Mathematics. I had the pleasure of working with Olga Russakovsky in the Princeton Visual AI Lab and Ryan P. Adams. I also spent a summer at Google.
I am trained in Carnatic (South Indian Classical) vocal music. Music page coming soon!
Email / CV / Google Scholar / LinkedIn
Research
Few-Shot Design Optimization by Exploiting Auxiliary Information
Arjun Mani, Carl Vondrick, Richard Zemel
arXiv preprint. In submission.
Our work introduces a more realistic problem setting for lab-in-the-loop design optimization, where an experiment returns high-dimensional `auxiliary’ information beyond a scalar reward. We develop a novel method tailored to this setting and demonstrate that it significantly accelerates design optimization across different domains, such as robot hardware design.
SurfsUp: Learning Fluid Simulation for Novel Surfaces
Arjun Mani*, Ishaan Preetam Chandratreya*, Elliot Creager, Carl Vondrick, Richard Zemel
ICCV 2023.
We introduce a novel approach for ML-based fluid simulation. While learned GNN models for particle-based simulation struggle to scale to large scenes, our method addresses this limitation by modeling solid surfaces using implicit 3D representations. This approach enables more scalable and accurate simulation of fluid–surface interactions, as well as inverse design of solid surfaces.
Point and Ask: Incorporating Pointing into Visual Question Answering
Arjun Mani, Will Hinthorn, Nobline Yoo, Olga Russakovsky
VQA Workshop, CVPR 2021 (Poster Spotlight).
We extend Visual Question Answering (VQA) to grounded questions involving pointing gestures and introduce benchmark datasets and model designs for this new question space.
Representing Words in a Geometric Algebra
Arjun Mani, Ryan P. Adams
Best Overall Project, Princeton Program in Applied Mathematics (PACM)
We introduce the use of geometric algebra for more expressive word embedding representations, and demonstrate improved word similarity and analogy-solving capabilities with such a representation.
IEEE Transactions on Medical Imaging, vol. 36, no. 3, March 2017
Assaf Hoogi, Arjun Subramaniam*, Rishi Veerapaneni*, Daniel Rubin
We develop a deep learning-aided apprach for medical image segmentatiom, which significantly improved segmentation compared to previous state-of-the-art methods on MRI and CT lesion datasets.
This website template owes thanks to Sharon Zhang.