Arjun Mani

01/22: Recognized as a Finalist for the Hertz Fellowship!

12/15: Recognized as Honorable Mention for the CRA Outstanding Undergraduate Researcher Award!

I am a senior at Princeton University studying Computer Science and Mathematics. I'm particularly interested in Machine Learning, Computer Vision, and the impact of technology of society. On campus, I do research in the Princeton Visual AI Lab and LIPS. I have one paper released in preprint and in submission to CVPR 2021, and another published in IEEE Transactions on Medical Imaging. I am also President of Princeton Data Science. Please check out my research and projects below!

Outside of academics, I am an Indian Classical Music vocalist and perform concerts in the US and India.

Research

Point and Ask: Incorporating Pointing into Visual Question Answering

Arjun Mani, Will Hinthorn, Nobline Yoo, Olga Russakovsky

In submission to CVPR 2021

ArXiv
Project page
Code

Extends Visual Question Answering (VQA) to questions requiring pointing gestures, a key component of human communication about the visual world. (1) Defines three types of questions in this space with unique visual reasoning challenges, and (2) introduces benchmark datasets and baseline models for each question type.

Geometric Algebra and Deep Learning: A Synthesis

Arjun Mani, Ryan Adams

Currently working on bringing the mathematics of geometric algebra into the computations and latent space of deep learning models. Our goal is to create more powerful and expressive internal representations using multivectors instead of vectors. Starting with word embedding models.

Adaptive Estimation of Active Contour Parameters Using Convolutional Neural Networks and Texture Analysis

Assaf Hoogi, Arjun Subramaniam*, Rishi Veerapaneni*, Daniel Rubin

IEEE Transactions on Medical Imaging, vol. 36, no. 3, March 2017

IEEE Homepage
Paper PDF

We improve on the level-set segmentation approach by using convolutional neural networks to adaptively modify parameters controlling for the expansion and contraction of the outline. The approach is fully automatic once an initial point has been provided. We achieve ~10% improvements on MRI and CT datasets of lesions.

CadML: Computational Antibody Design Using Deep Learning and Structural Protein Analysis

Arjun Mani, Stephen Meier, Thomas MacCarthy

Finalist, Regeneron Science Talent Search

We address the problem of predicting the effect of a mutation on an antibody’s binding affinity, in an attempt to identify beneficial mutations for antibody design. Our deep learning-based approach significantly outperforms existing methods.

 

Projects

Expressivity and Data-Dependency of Pruned Networks

ORF 569 Theory of Deep Learning, Fall 2021

Article coming soon!

Using random label experiments, we examine the extent to which pruning methods at initialization are data-dependent. We also examine the expressivity of these networks (e.g. their ability to fit true vs. random labels) and analyze their characteristics compared to networks pruned after training (e.g. using the lottery ticket hypothesis).

Majority Dynamics and Information Aggregation in Networks

COS 521 Advanced Algorithms, Fall 2020

Final Paper

We provide theory showing that certain graphs will never converge to a correct opinion even if each node is initially biased towards it; we also empirically examine majority dynamics and the effects of seeding or higher thresholds for changing opinions.

Examining Ambiguity in Human Pointing with Computer Vision

COS 529 Advanced Computer Vision, Spring 2019

Final Paper

I study how to understand pointing gestures that have ambiguous intent, examining how ambiguity can be explicitly predicted by semantic segmentation models.

 

Dev

AIDAN: Automated ML and Data Analysis with Voice Commands

Best Overall, HackPrinceton Spring 2018

Devpost Link
Code

We built a chatbot that can respond to user voice/typed commands in realtime and perform linear regression, machine learning (SVM, logistic regression), and basic data analysis (mean/mode/etc.). Requires user only to upload a CSV file of the dataset.

DeepSquat: Deep Learning to Assess Exercise Technique

Best Health/Fitness Hack, HackPrinceton Fall 2017

Devpost Link
Code

We built an app to assess squat technique, using a deep-learning based pose detection model.