🥑
[rag]knowledge base········OK
[vec]bge-base · ONNX········OK
[llm]gemini-2.5-flash········LIVE
[sys]avocado online········✦ ready
>
Open to work · Full-time · Remote · Hybrid
I build AI systems that work under real production pressure.
Software Engineer · Qualcomm Edge AI Hackathon Winner · Agentic AI & Distributed Infra at Scale
0%
Latency Cut
P99 RAG on 3K+ RPS
0K+
Peak RPS
99.9% uptime
0ms
Edge Inference
Snapdragon NPU
0GB
Daily Throughput
Zero data loss
0%
Latency Cut
P99 RAG on 3K+ RPS
0K+
Peak RPS
99.9% uptime
At a Glance
I build AI systems that work under real production pressure. At NYU, I cut RAG query latency by 78% on a Multi-Agent research engine serving 3K+ RPS, and pushed LLM inference to 15ms on Snapdragon NPUs via QLoRA + AWQ quantization. Before that, I kept Shell's maritime telemetry alive 115GB/day, 200+ offshore stations, zero data loss.
Currently, I'm obsessed with recommendation systems and the search technology at scale, where it powers the way humans think and behave with intention and responsibility.
Previously
EnergyBioinformaticsScientific Research
Excited in
Health CareFinanceConsumer Space (Entertainment and Retail)& more
Career path
NYU CAS
NYU IT
NYU
Wipro Limited
Vellore Institute of Technology
Quick Explore
Featured Projects
jayaremala.com (Avocado AI)
Production portfolio with Avocado AI, a streaming RAG agentic chatbot backed by a 4-stage hybrid retrieval pipeline: query expansion (up to 4 variants), batched dense search via ChromaDB (all-MiniLM-L6-v2 ONNX), BM25 lexical search (rank_bm25), and Reciprocal Rank Fusion (k=60) — all before Gemini 2.5 Flash sees the question. Implement model fallback mechanism via Gemini, Grow and OpenRouter with the knowledge base of ~80 atomic documents auto-syncs incrementally: new or edited documents are upserted, deleted documents are purged from ChromaDB, unchanged ones are skipped entirely. Runs as a FastAPI Docker container on AWS Lightsail with zero-downtime blue-green deployments, Nginx + Let's Encrypt HTTPS, daily S3 backup of SQLite analytics, and a Next.js 16 static frontend on GitHub Pages.
Next.js 16FastAPIPythonChromaDB
SnapLog – Edge AI Security Engine
Qualcomm Hackathon WinnerAchieved 15ms token latency on Snapdragon NPUs — a 10× improvement over cloud inference — by fine-tuning Llama 3.2 3B on security logs with QLoRA and deploying via 4-bit AWQ quantization through ONNX Runtime on-device. Guaranteed zero data loss during network partitions via an offline-first SQLite buffer with background sync workers.
PythonFastAPIQLoRAAWQ Quantization
Multi-Agent Research Discovery Engine
Production LangGraph + Llama 3.1 70B system that semantically maps global researcher collaboration networks by indexing millions of papers from Elsevier's Science Direct/Scopus. Cut P99 RAG latency by 78% with Write-Through Redis caching; sustained 99.9% uptime at 3,000+ RPS on AWS ECS.
LangGraphLlama 3.1 70BBGE-M3FastAPI
CodeCollab – Real-Time Collaborative Code Editor
Conflict-free simultaneous multi-user editing using Yjs (CRDTs) and WebSockets, scaled horizontally via Nginx load balancing across containerized instances. Increased AI auto-complete context quality by 65% with a Context-Aware Coding Agent using AST-based chunking and Voyage-Code-2 embeddings.
AWSClaude 3.5Voyage AIRedis
gradeVITian
High-traffic progressive web app for academic grade forecasting at VIT. Scaled to 17K+ monthly active users and around 20K+ registered accounts. Achieved #2 Google Search ranking via programmatic SEO with sub-second mobile load times.
Next.jsReactFastAPISEO
After six years in production and 17,000+ monthly users, gradeVITian has been rebuilt from the ground up — re-engineered on Next.js and FastAPI and relaunched at gradevitian.jayaremala.com. Heartfelt thanks to the VITian community (Class of 2020–2025) for making the original such a success; this journey defined me as an engineer, and this new chapter carries it forward.
Live Product · Spotlight
gradeVITian
A product, not just a project
The grade & attendance calculators tens of thousands of VIT students reach for every exam season — designed, shipped, and still run by me.
A high-traffic progressive web app for academic grade forecasting — GPA, CGPA, grade prediction, and attendance, with sub-second mobile loads and #2 Google ranking from programmatic SEO. Six years live, rebuilt on Next.js + FastAPI.
Milestones & achievements in the gallery · free, no sign-up at gradevitian.jayaremala.com
17K+
Monthly active users
20K+
Registered accounts
#2
On Google Search
6+ yrs
Live in production
Skills & Tools
Languages
AI, ML & Agents
Systems & Cloud
Frameworks & Databases
Certifications
Skills in Action
Project Experience Award ★· hover a skill to see where it's been used
Testimonials
1 / 5
Testimonials
5 recommendationsSabarish is an intuitive and intelligent person, who has offered me solutions in the most difficult times and helped me at multiple occasions. He is prompt, hardworking with a knack for technology, and an absolute delight to work with!
DC
LinkedIn
Dec 2022
Get in Touch
Open to software engineering roles in AI/ML infrastructure, distributed systems, and full-stack. Healthcare, frontier research, and energy tech are my focus but excited by any hard problem.
Book a call
Schedule a 30-min intro on Google Calendar