Kunal Singh

I'm an AI Researcher based in Pune, India, working at the intersection of Technical AI Governance, adversarial testing, and safety evaluation of frontier models. My research focuses on developing systematic approaches to ensure AI systems are safe, aligned, and beneficial.

I hold a Master's in Computer Applications and a BSc in Physics from Savitribai Phule Pune University. I was selected among 350+ global applicants for the ICTP Advanced ML Workshop in Italy, and have completed AI Safety training through BlueDot Impact.

Kunal Singh

Research Interests

Technical AI Governance AI Safety Evaluations Red Teaming Adversarial Testing Model Robustness Safety Benchmarking AI Policy & Regulation Control Evaluations

Publications

Refining the Giants: A Comprehensive Review of Finetuning Strategies for Large Language Models

Kunal Singh, Dr. Santosh Deshpande, Dr. Swapnaja Patwardhan

20th International Conference on Computing and Machine Learning (CML) · March 2024
Computing and Machine Learning, Volume 2 - Springer Nature

Research Reports

The Open-Weight Paradox: How Model Release Policies Undermine Export Controls

Kunal Singh

US export controls on AI fail because they exempt publicly-released models. Anyone can download and fine-tune open-source models for military/harmful use at 1/1000th the original training cost. The report argues governments should focus on what's actually controllable: the expensive computer chips for training, transparency requirements, legal liability for developers, and defensive investments.

Technical Skills

Python Machine Learning Deep Learning PyTorch TensorFlow Hugging Face LangChain Large Language Models RAG Systems AI Agents Prompt Engineering Vector Databases Fine-tuning

AI Engineer

Pune, India · Sept 2024 - December 2025

Building production-ready AI pipelines, developing goal-based AI Agents using A2A protocol and Google ADK, implementing RAG systems with various vector databases.

Technical Intern - AI

Pune, India · June 2024 - Sept 2024

Led research on prompt engineering, fine-tuning, and RAG architectures. Conducted comparative analysis of LLMs (GPT-4, Claude-3.5, Gemini Pro, Llama-3).

AI Intern

Resumepal, Quoppo Ventures · April - June 2024

Built POC for RAG architecture using Pinecone. Integrated Hugging Face libraries and researched optimization techniques for LLMs.

ICTP ML Workshop

Italy · May-June 2024 · Fully Funded

Selected among 350+ global applicants (1 of 2 from India). Engaged with Intel, Nvidia, IBM experts on GNNs, Transformers, Neuromorphic Computing.

Education

Master of Computer Applications

Savitribai Phule Pune University · 2022-2024

GPA: 8.27/10 (3.31/4)

Bachelor of Science - Physics

Savitribai Phule Pune University · 2018-2022

GPA: 8.46/10 (3.39/4)

Workshops & Conferences

EAGxIndia 2025

New Delhi, India · December 2025

AI Alignment Fast-track Course

BlueDot Impact · Dec 2024

Introduction to Transformative AI

BlueDot Impact · Dec 2024

Data Science in Astronomy

IUCAA · Dec 2023

Gravitational Wave Open Data

LIGO-IUCAA · May 2023

AI Control Security Audit

Control Evaluations Framework

AI controls evaluation demonstrating how different Claude models respond to deceptive audit instructions. Main task: identify vulnerability and classify it. Side Task: find a back door and misclassify it. Tested 3 frontier models across 2 tasks to measure strategic misclassification behavior.

GitHub →

Jailbreaking Resistance Analysis

Frontier Models Security Assessment

Systematic adversarial testing of GPT-5, Claude Sonnet 4.5, and Gemini 2.5 Pro. Revealed 69pp security gap with capability exploitation (51% success) as primary vulnerability.

GitHub →

Few-Shot vs Fine-tuning

Biomedical QA (OpenAI Paper)

Reproduced OpenAI's methodology using GPT-2 and PubMedQA. Few-shot achieved 32.5% higher performance and 57.1% improvement on cross-domain transfer.

GitHub →

Instruction Tuning LLMs

Llama-2 Fine-tuning

Implemented Quantized LoRA for efficient fine-tuning of Llama-2-7b-chat-hf with Open-Platypus dataset, reducing computational resources significantly.

GitHub →

Marine Route Optimization

ML-based Route Planning

Optimized marine routes using Copernicus Marine data. Achieved 5% reduction in fuel costs and CO₂ emissions using Linear Regression and Random Forest.

GitHub →

Read my research and analysis on AI governance, safety, and policy:

The Open-Weight Paradox: How Model Release Policies Undermine Export Controls

Deep dives into AI policy, governance frameworks, and technical safety research. Exploring the intersection of AI capabilities and regulatory mechanisms.

Visit Substack →

How LLMs understand "Cun yew ndirstawnd mei cenTense?"

Medium

Why Claude or ChatGPT can read "Cun yew ndirstawnd mei cenTense?" as "Can you understand my sentence?" Initially it seems magic as every letter is scrambled or replaced, yet Claude or basically any LLM instantly reconstructs the intended meaning. This ability reveals how large language models actually work.

Voice Analysis in Recruitments

Medium

A lot of tech is currently being used in making hiring easy and seamless, one such aspect is Voice Analysis which plays a very important role. Voice analysis contains 48 different dimensions of vocal emotions categorization and there much more to it.

Teaching & Mentorship

Project Guide & Evaluator

Institute of Management and Career Courses (IMCC), Pune

Guided and evaluated semester projects for 10+ First and Second year Masters students, providing mentorship in machine learning implementation, research methodology, and project development. Oversaw end-to-end project execution from ideation to final presentation, ensuring academic rigor and practical applicability.

Guest Lecture: Research using AI

IMCC, Pune · 80+ Second Year Masters Students

Demonstrated comprehensive methodologies for leveraging AI tools to enhance research workflows and quality. Covered advanced techniques for literature review automation, data analysis acceleration, and research paper writing assistance. Emphasized ethical considerations and best practices for AI-augmented academic research.

AI Engineering Mentor

Indicus Software · 10+ Interns

Mentored engineering interns in building production-grade Generative AI applications, designing and implementing ML pipelines, and developing autonomous AI Agents. Provided hands-on training in modern AI frameworks, RAG architectures, and agentic systems. Guided technical problem-solving and professional development in AI engineering practices.

Guest Lecture: Introduction to Large Language Models

IMCC, Pune · October 2024 · 60+ MCA Students

Delivered comprehensive introduction to LLM architectures, training methodologies, and practical applications. Covered transformer models, attention mechanisms, prompt engineering, and fine-tuning strategies. Included hands-on demonstrations of working with state-of-the-art language models and discussed real-world deployment considerations.

Technical Presentation: Recent Developments in AI Agents

Indicus Software · September 2024 · 30+ Employees

Explained cutting-edge developments in AI Agent architectures, autonomous decision-making systems, and multi-agent coordination. Covered agent-based planning, tool use, ReAct frameworks, and the latest research in agentic AI systems. Demonstrated practical implementations and discussed integration strategies for enterprise applications.

Astronomy Research Mentor

Jyotirvidya Parisanstha, Pune · 15+ MSc Physics Students

Mentored graduate physics students in conducting variable star observations and photometric analysis for their Master's thesis projects. Provided guidance on observational astronomy techniques, data collection protocols at the observatory, CCD imaging, light curve analysis, and scientific writing. Supervised thesis development from observation planning through final defense.

Additional Academic Contributions

Amateur Astronomer: Executive Member at India's oldest astronomy organization with 4+ years of active involvement