Lakshminarayana Natarajan
Data & AI Engineer
— you can call me Lax
- Data Engineering
- Analytics & Warehousing
- Data Analysis / ML
- Applied AI
- Agentic AI
I turn messy, late-arriving, real-world data into correct, auditable systems — and I ship AI products that reason, cite their evidence, and know when to act, ask, or escalate.
I build the whole stack — warehouses and pipelines, the analytics on top of them, the models that score them, and the agentic AI products that act on them. Five years of production data work taught me the part that matters: a number is only worth what its audit trail can prove.
Two I designed, built and shipped end-to-end. Both are being hardened into SaaS — real tenants, real production use.
ReplayOps
Operational Reasoning Compiler
Turn live work into memory your team can trust — capture someone doing a task, compile it into an evidence-linked SOP, operational memory and cited process Q&A, then safely replay it.
Operations experts rely on judgment that never reaches an SOP — exception handling, rule precedence, approval boundaries, and when not to guess. Happy-path automation is unacceptable in support, finance, claims, onboarding and back-office work.
- Capture screen frames, live narration, and semantic browser actions with page context.
- Compile with GPT-5.6 structured extraction — decisions, exceptions, follow-ups and retrieval chunks, each tied to a stable evidence ID.
- Trust pass — a deterministic score for evidence coverage, grounding and replay-readiness.
- Evidence-grounded Q&A that cites the original transcript, action or page — and abstains when the answer isn't in the session.
- Safe DOM replay — confidence-and-margin gating, verifies real post-action change, pauses on protected or manual steps, re-approves on external change.
- Enterprise MCP server (stdio) exposing allowlisted ServiceNow, SharePoint, Outlook, Power Automate and Confluence behind a fail-closed action-authorization gate.
- Next.js
- TypeScript monorepo
- GPT-5.6
- gpt-4o-transcribe
- Zod Structured Outputs
- IndexedDB
- Microsoft Graph
- MCP
“…and if the category is logistics it needs a second reviewer, so I never submit it straight through.”
input#vendor-name0.96
✓type + verify DOM changeok
◆match 0.61 · margin 0.09below gate
‖protected controlPAUSED
Confidence-and-margin gated. It would rather ask than guess.
R.Y.W
“The Resume You Want”
A desktop app that fuses your saved profile with a pasted job description and produces a tailored, one-page, ATS-clean resume — driven by an LLM and your own MCP build server.
Paste a JD → Claude tailors the content (Anthropic API, model swappable, default
claude-opus-5) → the resume-tailor MCP server, spawned as a sidecar,
builds the final one-page .docx/.pdf with structure, auto-fit, and
no-fabrication rules enforced regardless of which model ran.
- Deterministic build — layout and one-page fit live in the MCP server, not the prompt.
- No fabrication — the builder only emits facts present in the stored profile.
- Model-agnostic — swap the model without touching the document contract.
- Local-first — Tauri's Rust core, your profile stays on your machine.
- Tauri (Rust)
- Node orchestrator
- Anthropic API
- resume-tailor MCP sidecar
We need a data engineer fluent in PySpark and Delta Lake to own medallion pipelines, enforce data quality, and partner with analytics on dimensional models.
Pipelines that are provably correct, not just green.
Payments Settlement Lakehouse
A Delta Lake lakehouse that resolves late-arriving, out-of-order payment lifecycle events into correct, auditable merchant settlement figures — proven to the cent against ground truth.
A payment is a lifecycle: authorized → captured → settled → refunded → chargeback.
Events arrive late and out of order — a chargeback can land 60 days later. Naive append-only
pipelines double-count, overpay, and let bad records corrupt totals. That is real financial loss
plus an audit failure.
60,000 transaction lifecycles · 190,446 raw events. Naive would pay merchants $14.45M against a true $12.47M owed — off by roughly $2M.
Z-ORDER clusters by merchant_id, so file skipping — not more
compute — does the work. Same query, same cluster, 1/12th the wall clock.
- Quarantine, never silent drops
- Idempotent backfill
- Point-in-time audit via Delta time travel
- Run-metrics observability table
- PySpark 3.5.3
- Delta Lake 3.2.1
- Medallion
- Idempotent MERGE
- Java 17
- Local → MinIO → Databricks, same code
Supply Chain Late-Delivery Intelligence Platform
End-to-end platform ingesting ~180K supply-chain order events a day, modelling them in a MySQL star schema, orchestrating with Airflow, scoring late-delivery risk with ML, and serving Tableau and Power BI.
- SCD Type 2 on customer and supplier dimensions.
- 20 YAML-driven data-quality rules — critical failures block writes.
- Random Forest late-delivery risk classifier with an auto-retraining DAG.
- 40+ pytest tests, 70% coverage enforced; CI on every push (ruff + black + pytest + DAG validation).
- Parameterized backfill DAG.
- MySQL
- Python
- Airflow 2.9
- scikit-learn
- Docker Compose
- Tableau
- Power BI
- GitHub Actions
Banking Customer-Analytics Lakehouse
Production-style medallion pipeline turning daily raw CSV drops into curated banking customer-payment marts for Power BI.
source: raw/payments/*.csv
target: silver.payments
transform: normalize_channel
dq:
- not_null: [customer_id]
- unique: [payment_id]
- range: {amount: [0, 1e6]}
- Config-driven PySpark framework — each job is a YAML spec: source, target, transform, DQ.
- Runs identically on Databricks or locally; Delta or Parquet via env var, so it stays air-gap friendly.
- Answers paid totals over 30/90/365 days, payment-gap and churn signals, channel trends (ACH/wire/card/check), and SCD2 profile history.
- Synthetic data generator — 10k customers, ~274k payments — plus a pytest suite.
- PySpark
- Delta Lake
- Medallion
- SCD2
- Synapse / Power BI
- Databricks
Veteran Sentiment Analysis
A Deloitte-sponsored graduate capstone measuring what veterans actually say — an end-to-end Python ETL and NLP pipeline that turns unstructured veteran feedback into themes, sentiment and a dashboard the people it describes can read.
- End-to-end Python ETL producing 20,003 curated records across three datasets.
- Normalized PostgreSQL model with documented schemas and data-quality tests.
- Sentiment and theme extraction — spaCy, KeyBERT, UMAP, HDBSCAN, scikit-learn.
- A final veteran sentiment dashboard — sentiment mix, theme ranking and trend over time, built for a non-technical audience.
- RAG Q&A copilot on OpenAI + FastAPI returning grounded, source-cited answers.
Claims wait time1 and appointment access2 dominate, with career transition3 a distant third. Every claim is traced to an indexed response — nothing outside the corpus is asserted.
Tata Consultancy Services
Promoted SQL Developer → ALIP Application Lead. Oracle SQL/PL-SQL, SQL Server T-SQL, IBM DataStage.
- Four and a half years on one insurance platform — long enough to own the run book, not just the tickets.
- The vendor transition is the piece I'm proudest of: a support function moved between companies with zero disruption.
ALIP — Accenture Life Insurance Platform
Application Lead
- Processed 5M+ daily transactions across policy, billing and transaction streams.
- Advanced PL/SQL — procedures, packages, functions, triggers.
- Owned the end-to-end transition of production support from an outgoing vendor — KT, shadow and reverse-shadow, runbooks, steady state, with zero disruption.
- Automated a 4-hour cycle down to 15 minutes for 200+ users.
- Tuned runtimes 30–40% via execution plans, indexing and partitioning.
- SIT/UAT and release validation; mentored 3 developers; ran code reviews.
ACC — Monitoring & ETL Reporting
SQL Developer
- Data quality, validation and reconciliation — null / PK / duplicate checks, row counts, balances.
- Root-cause analysis and incident triage in ServiceNow.
- Documented data flows and lineage; cut manual effort ~25%.
NextGen eStart — Submission Platform
SQL Developer
- Cross-stream SQL extracts and controlled DML deployments.
- ~80% manual-effort reduction.
Five years of production SQL underneath everything else — the reason the pipelines above are auditable rather than merely green.
- SQL — Oracle
- SQL Server
- PostgreSQL
- MySQL
- PL/SQL
- T-SQL
- Python — pandas, NumPy, scikit-learn
- TypeScript
- Rust (via Tauri)
- Bash / Korn shell
Medallion pipelines that quarantine instead of dropping, and merge idempotently so a backfill can be run twice without moving a number.
- PySpark
- Delta Lake
- Medallion architecture
- ETL / ELT
- IBM DataStage
- Airflow
- dbt
- SCD Type 2
- Dimensional modeling
- Partitioning · OPTIMIZE · Z-ORDER
The lakehouse work runs locally, against MinIO's S3 API, or on Databricks from the same code path.
- AWS — S3
- AWS Glue
- Athena
- Redshift
- GCP BigQuery
- Snowflake
- Databricks (exposure)
- MinIO / S3 API
- Docker
The serving layer — marts that answer a question a stakeholder actually asked, not a table that happens to exist.
- Tableau
- Power BI
- Looker Studio
- Advanced Excel
Models and retrieval that cite their evidence — and abstain when the answer isn't in the corpus.
- RAG
- OpenAI GPT-5.6 / 4o
- Anthropic Claude
- spaCy
- KeyBERT
- UMAP
- HDBSCAN
- scikit-learn
- Forecasting (ARIMA)
- Recommenders
Agents that are allowed to act only through an allowlisted, fail-closed tool surface.
- MCP servers & clients
- Structured outputs (Zod)
- FastAPI
- Claude Code
- Codex
- GitHub Actions CI/CD
- Git
- ServiceNow
- Agile / Scrum
Enough front-end to build the interface a data product needs rather than hand it off.
- Svelte 5
- Three.js
- GSAP
- GLSL shaders
- Vite
Graduate coursework and experiments — kept because the methods still show up in production work.
- Tableau final project — interactive dashboard workbook
- Bitcoin price forecasting — Linear Regression + ARIMA on 5-yr BTC data
- Airline customer-satisfaction classifier — binary classification with tuning
- Recommender systems — collaborative filtering and content-based
- Cluster analysis, frequent-pattern mining, feature engineering, lift/gain/ROC
- Regression for direct marketing
- Python data-engineering & DSA master notebooks
Let's build something correct
Open to Data Engineering, Analytics Engineering and Applied / Agentic AI roles. Fastest way to reach me is email.