MR

Mehul Rao

AI/ML Engineer & Founding Engineer

Building AI infrastructure at scale and healthcare AI platforms. Previously optimized inference fleets at AWS Bedrock and currently engineering the future of therapy at Emory Healthcare and Innovar Health.

Mehul Rao

Experience

Founding Engineer

MealPlanR

Current
  • Building an end-to-end therapist platform with Emory & Children's Healthcare of Atlanta.
  • Fine-tuned GPT-OSS 21B with QLoRA/PEFT on therapist materials.
  • Designed an agentic RAG stack using Qdrant with hybrid retrieval (Patent Pending).

AI/ML Engineer

AWS Bedrock AI

May 2024 - Aug 2025
  • Operated large-scale EKS inference fleets (~50k+ nodes) serving Anthropic models.
  • Designed safe rollouts and PDBs to maintain low-latency, high-throughput SLOs.
  • Optimized runtime across AWS Trainium2 and NVIDIA H100 instances.

Software Engineer Intern

Hulu / Disney Streaming

May 2024 - Aug 2024
  • Developed ML models to group Ad Assets, enhancing operational efficiency.
  • Fine-tuned VideoMAE models on 60M parameters, achieving 94% accuracy.
  • Collaborated with cross-functional teams to integrate models into production.

Software Engineer Intern

Buckeye Innovation

Apr 2021 - May 2024
  • Implemented a proactive Slack AI chatbot leveraging NLP.
  • Managed AWS cloud infrastructure using Docker, Terraform, and Ansible.

Education

Georgia Institute of Technology

College of Computing

Bachelor of Science in Computer Science

Concentration

Intelligence and Systems Architecture

Minor

FinTech

Award: Zell Miller Scholarship

Skills

Languages

PythonRustTypeScriptJavaC++C

Cloud & DevOps

AWSGCPDockerTerraformAnsibleKubernetes

AI / ML

LLM Fine-tuningRAGEKS InferencePyTorchHuggingFace

Web & Databases

Next.jsReactPostgreSQLMongoDBRedis

Featured Projects

Get In Touch

I'm currently building the future of therapy at MealPlanR. Feel free to reach out if you want to chat about AI, systems, or just say hi!