Data Scientist & AI Engineer

Sourabh
Sonker

Building production-grade LLM systems, RAG pipelines, and ML applications — from cross-lingual Hinglish retrieval to full MLOps pipelines with automated evaluation.

// Interests: Indian AI  ·  LLMs  ·  NLP  ·  Finance  ·  FinTech

LLM · RAG Systems NLP · Transformers MLOps · CI/CD Machine Learning Time Series Indian AI
1.00
Context Recall
0.93
RAG Faithfulness
4.3×
Bearish F1 Gain
6
Live Deployments
// about

The Story

I build production-grade AI systems — end-to-end, from architecture decisions to deployed, measurable applications. My current focus is LLM engineering and RAG pipelines, with particular interest in Indian language AI and the infrastructure that makes models actually useful in the real world.

Across 6 deployed projects, I've worked on cross-lingual multilingual retrieval, transformer-based NLP evaluation, time series forecasting on large-scale data, and MLOps pipelines with Docker, CI/CD, and automated testing. Every project ships with measurable results and live demos — not Jupyter notebooks.

Before pivoting into AI and Data Science, I completed a B.Tech in Mechanical Engineering at Delhi Technological University (2024, CGPA 7.86) — a decision I made deliberately to build real engineering rigour before specialising. That foundation shows up in how I approach system design, debugging, and production reliability.

Current Focus
LLM Engineering · RAG · Indian AI
Live Projects
6 Deployed Applications
Location
Delhi, India · Open to Relocate
Education
B.Tech Mech. Engg. · DTU · 2024
Domain Interest
Indian AI · Finance · FinTech
Skills Apply To
Any data-intensive domain
Availability
Immediately Available
// projects

Featured Projects

01 / 06
ADVANCEDLLM · RAG · INDIAN AI

Multilingual Indic RAG Pipeline

Multilingual Indic RAG Application

A production-grade, fully asynchronous RAG system built for India's linguistic landscape. Accepts queries in Hindi or Hinglish, retrieves from English documents through cross-lingual vector search — no translation loops — and generates grounded answers natively in Hinglish. Three LLM backends. Ragas-evaluated with a human Golden Dataset.

1.0000
Context Recall
0.9250
Faithfulness
8 / 8
Tests Passing
100%
Uptime
  • Cross-lingual retrieval without translation — paraphrase-multilingual-MiniLM-L12-v2 maps Hinglish queries directly onto the same 384-dim vector space as English documents, bypassing translation overhead and semantic loss that breaks code-mixed Hinglish
  • Vendor-agnostic generation layer dynamically routes to Google Gemini 2.5 Flash, Sarvam AI sarvam-30b, or Groq Llama 3.3 70B via custom async httpx client; circuit-breaker graceful degradation catches 429/400/403 failures — serves pre-cached grounded fallback, zero crashes
  • Deterministic UUID v5 idempotency for safe vector upserts; Ragas automated eval harness scored Faithfulness 0.9250, Context Recall 1.0000 on human-curated Golden Dataset; 8/8 pytest unit + integration tests; Ruff + Black + mypy clean
Pythonasyncio · httpxQdrant Cloudmultilingual-MiniLMGemini 2.5 FlashSarvam AIGroq Llama 3.3 70BRagaspytestStreamlit
02 / 06
BEGINNERML · CLASSIFICATION

Bank Customer Churn Prediction & Explainability

Bank Customer Churn Predictor Interface

Full ML lifecycle on 10,000 bank customer records — imbalanced data handling, Bayesian hyperparameter tuning, and SHAP-powered per-customer explainability. Business framing throughout: quantifying the real cost of missing a churn event.

86.9%
XGBoost AUC-ROC
+3.6 pts
Optuna gain
4:1
Imbalance handled
5
Retention levers found
  • Benchmarked 3 models: XGBoost (86.9%) · RF (86.2%) · LR (77.2%) with stratified evaluation; Optuna Bayesian tuning (50 trials) added +3.6 pts over untuned baseline
  • Engineered 4 domain features — products_per_tenure ranked #2 in SHAP importance, capturing the non-linear 3–4 product churn cliff
  • SHAP TreeExplainer identified top 5 levers: age 41–60, Germany geography, inactive membership, mono-product high-balance holders, credit score <600
PythonXGBoostscikit-learnSMOTESHAPOptunaStreamlit
03 / 06
INTERMEDIATENLP · TRANSFORMERS

Financial News Sentiment Analysis + Stock Correlation

Financial News Sentiment Analyser Interface

Finance-domain NLP using FinBERT — a BERT model pre-trained on financial text. Goes beyond accuracy: ablation studies, a caught evaluation bug, and a statistically honest sentiment-price correlation study across 5 tickers and 2 years of data.

75.1%
FinBERT accuracy
4.3×
Bearish F1 gain
5,842
Headlines
<1 sec
Tab load time
  • FinBERT zero-shot: 4.3× improvement in bearish detection (F1: 0.14 → 0.60) over TF-IDF+SVM; domain-aware preprocessing validated via ablation study
  • Identified and corrected a label-misalignment bug that inflated VADER baseline by 25.3 percentage points — caught through EDA notebook review
  • 4-tab Streamlit dashboard; ~1hr cold-start resolved by precomputing FinBERT artifacts; yfinance rate-limiting fixed via precomputed CSVs
PythonFinBERTHuggingFacePyTorchscikit-learnyfinancePlotlyStreamlit
04 / 06
INTERMEDIATETIME SERIES

Retail + NSE Stock Time Series Forecasting

NSE Stock Forecaster Interface

Dual-domain forecasting — 3M+ rows of retail data plus live NSE stock prices. Every modelling decision is documented and justified: why SARIMA beat Prophet here, what the earthquake spike means, why stock MAPE is higher than retail MAPE.

8.8%
SARIMA MAPE
r = −0.47
Oil-sales corr.
3M+
Rows processed
10
NSE tickers live
  • SARIMA: 8.8% MAPE on 90-day retail horizon; Prophet 12.1% — advantage absent in holiday-free Jun–Aug 2017 test window (documented with reasoning)
  • Macro signal: WTI oil price r = −0.47 with Ecuador grocery sales; April 2016 earthquake modelled as named Prophet event (2× normal Saturday demand)
  • Extended to live NSE stocks; ARIMA(0,1,1) order consistent with weak-form EMH — documented as insight, not buried; Streamlit app supporting 10 tickers
PythonStatsmodelspmdarimaProphetyfinancePlotlyStreamlit
05 / 06
ADVANCEDMLOPS · CI/CD

House Price Prediction — End-to-End MLOps Pipeline

House Price Prediction API Documentation Interface

Production ML engineering from pipeline design to live deployment. A leak-proof sklearn pipeline, MLflow experiment tracking, FastAPI REST service, Docker container, and GitHub Actions CI/CD that auto-deploys on every push — with failing tests blocking deployment.

0.1209
XGBoost CV RMSLE
4
Models tracked
5-fold
Cross-validation
Live
API on Render
  • ColumnTransformer fit exclusively on training folds — prevents data leakage; MLflow tracking: XGBoost selected at CV RMSLE 0.1209 over LightGBM (0.1284), Ridge (0.1392)
  • FastAPI with Pydantic validation and Swagger UI; multi-stage Docker build; GitHub Actions CI/CD — tests → retrain → build → deploy; failing tests block deployment
  • Diagnosed and resolved 5 independent production issues including CI mock scoping and Docker image bloat
Pythonscikit-learnXGBoostMLflowFastAPIDockerGitHub ActionsRender
06 / 06
ADVANCEDLLM · RAG · GenAI

RAG-Based Document Q&A System

RAG Document Q&A App Interface

End-to-end Retrieval-Augmented Generation pipeline. Upload any PDF or text document, ask questions in natural language, get answers grounded strictly in the source content — with multi-turn conversation memory and zero hallucination by design.

384-dim
FAISS vectors
2
LLM backends
Zero
Hallucinations
Multi-turn
Conversation
  • PyPDF2 → RecursiveCharacterTextSplitter (800-char/100-overlap) → all-MiniLM-L6-v2 embeddings → FAISS vector store for semantic retrieval
  • Dual LLM backends: Google Gemini 2.5 Flash + Groq Llama 3 via LangChain; custom anti-hallucination system prompt constrains answers to retrieved context only
  • ConversationBufferMemory for multi-turn Q&A; @st.cache_resource model caching eliminates per-request reload; deployed on Streamlit Cloud
PythonLangChainFAISSHuggingFaceGemini 2.5 FlashGroq Llama 3StreamlitPyPDF2
Beyond these 6 featured projects, I have built 20+ additional projects across SQL, Excel analytics, Power BI dashboards, Python automation, and ML pipelines. View GitHub ↗
SQL
Window Functions
CTEs & Subqueries
Business Analytics
Data Cleaning
Excel & BI
Power Query
Pivot Dashboards
Power BI (DAX)
Financial Models
Python Analytics
EDA Pipelines
Automation Scripts
Data Visualisation
Statistical Analysis
ML & MLOps
Classification & Regression
NLP Pipelines
AWS Deployments
Experiment Tracking
// skills

Technical Stack

Languages & Data
PythonSQL PandasNumPy ExcelPlotly Power BIyfinance
Machine Learning
XGBoostLightGBM scikit-learnSMOTE SHAPOptuna ProphetSARIMA PyTorch
LLM / NLP
LangChainFAISS HuggingFaceFinBERT Sentence-Transformers Gemini 2.5 Flash sarvam-30b Groq Llama 3NLTK
MLOps & Deployment
FastAPIDocker GitHub ActionsMLflow RenderStreamlit PydanticCI/CD
// certifications

Learning & Credentials

Hugging Face
AI Agents Course
Verified Certificate
View Certificate ↗
University of Amsterdam · Coursera
Basic Statistics
Verified Certificate
View Certificate ↗
Macquarie University · Coursera
Excel Skills for Business: Essentials
Verified Certificate
View Certificate ↗
Macquarie University · Coursera
Excel Skills for Business: Advanced
Verified Certificate
View Certificate ↗
Kaggle · 10 Micro-Course Certificates
Python · Pandas · Data Visualisation · SQL Intro · SQL Advanced · Data Cleaning · Feature Engineering · Machine Learning · Deep Learning · ML Explainability · Time Series
All Verified
View All Certificates ↗
// contact

Let's Talk

Open to Data Scientist, AI Engineer and Analyst roles at startups and growth-stage companies. Strong preference for data-intensive products — Finance, FinTech, EdTech, HealthTech, SaaS analytics. Available immediately.