Skip to content
View Harshsoni-anlt's full-sized avatar
  • Bangalore
  • 06:53 (UTC -12:00)

Block or report Harshsoni-anlt

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Harshsoni-anlt/README.md

Hi, I'm Harsh Soni πŸ‘‹

Forward Deployed Engineer @ Kyndryl Β· Data Scientist Β· Agentic AI, GenAI & LLMs

By day I design and deliver enterprise AI for global clients. Here I build the same kind of systems on free infrastructure, so anyone can clone one and run it in two commands β€” no GPU, no managed services, no monthly bill.

πŸ“ Bengaluru, India


πŸš€ What I'm building

A series of production-shaped AI systems, each taking on an input type the last one couldn't handle. Each repo stands completely alone β€” no shared runtime, no shared database, nothing to install first. What carries across is the approach, not the code.

# Project What it does Stack Status
1 WarehouseOps AI Multi-agent warehouse operations β€” inventory, equipment, safety and forecasting questions answered from live SQL, plus invoice extraction. Bring your own CSV and it answers about your warehouse. LangGraph Β· MCP Β· Groq/Ollama Β· ChromaDB Β· SQLite βœ… Shipped
2 Video Incident Intelligence Ask hours of camera footage a question in plain English. You write the checks β€” safety, stock counts, product types β€” and every answer cites the frame that proves it. A million frames become a few dozen API calls. Gemini vision Β· OpenCV Β· FastAPI Β· React Β· SQLite βœ… Shipped
3 Voice operations agent Hands-free floor assistant for people wearing gloves β€” local speech-to-text, free TTS, Hinglish. Whisper Β· Edge-TTS Β· FastAPI πŸ”¨ Next
4 Catalogue enrichment from a photo Product photo in, full marketplace listing out β€” title, description, attributes, English and Hindi. Vision LLM Β· structured output πŸ“‹ Queued
5 Document intelligence + review loop Extract β†’ validate β†’ route β†’ human review. The reviewer queue that document-AI demos always skip. OCR Β· LLM extraction Β· confidence routing πŸ“‹ Queued

Three rules I hold myself to

  • Answers cite their evidence. The model writes the sentence; the source is real and you can click it. If it can't show you, it doesn't claim.
  • The limitations are in the README. Every repo says plainly what it gets wrong and where it shouldn't be trusted. That costs nothing and it's the part people actually respect.
  • Bring your own data. Every project takes your file, not just my demo. A system that only works on the sample isn't a system.

Why free infrastructure? Most enterprise AI architectures assume a GPU cluster, a managed vector database and a paid inference endpoint β€” which means almost nobody can actually run them. Rebuilding under a hard β‚Ή0 constraint forces the real engineering decisions: what to send, what to skip, what you genuinely need a database for. That constraint is the point.


πŸ’Ό What I do professionally

  • Enterprise AI delivery β€” architect and ship LLM, RAG and agentic solutions from proof-of-concept to production, on-prem and cloud, including regulated industries
  • Document intelligence β€” multilingual pipelines combining OCR, translation and structured extraction
  • GPU-efficient inference β€” model serving with vLLM, quantization, distributed processing
  • Forecasting & analytics β€” 4 years of GenAI + ML demand forecasting for global supply chains: SKU-level ensembles, time-series models, LLM explainability layers
  • MLOps β€” MLflow, CI/CD, automated retraining, model governance at production scale

🧭 Background

  • Kyndryl β€” Lead II, Forward Deployed Engineer (2026–present): enterprise AI & GenAI for global clients; technical delivery lead and mentor
  • UPL β€” Data Scientist (2022–2026): end-to-end ownership of GenAI/ML forecasting for supply chain decisions
  • HPCL β€” Data Science Intern: NLP and semantic search over large-scale survey data, extended into my Master's dissertation
  • Education β€” MA/MSc Analytics, Tata Institute of Social Sciences (TISS), Mumbai

πŸ† Recognition

  • UPL OpenAg Award β€” for leading the AI-based demand forecasting project
  • Databricks GenAI Innovation Award 2025 β€” part of the UPL team recognized for enterprise LLM adoption
  • DeepLearning.AI TensorFlow Developer Specialization

🧰 Toolbox

Python LangGraph LangChain CrewAI FastAPI React Azure OpenAI Gemini Groq Ollama vLLM RAG NeMo Guardrails ChromaDB/Qdrant OpenCV MLflow Databricks Prophet scikit-learn TensorFlow SQL Docker GitHub Actions

πŸ“Š Earlier data science work

Twitter Sentiment Analysis Β· LSTM Stock Prediction Β· Customer Segmentation Β· Big Mart Sales Β· RAG over 10-K filings

πŸ“« Connect

LinkedIn Β· harshsoni.skha@gmail.com

Pinned Loading

  1. customer-segmentation-kmeans customer-segmentation-kmeans Public

    Customer segmentation with K-Means β€” elbow method, EDA, income/age vs rating clusters

    Jupyter Notebook

  2. LSTM-Stock-Prediction LSTM-Stock-Prediction Public

    Stacked LSTM next-day stock price prediction (Keras) on 10 years of Tata Motors data via Tiingo

    Jupyter Notebook

  3. twitter-sentiment-analysis twitter-sentiment-analysis Public

    Real-time tweet sentiment analysis with Tweepy + TextBlob β€” polarity classification, word clouds, user-location mapping

    Jupyter Notebook

  4. Big-Mart-Sales-Prediction Big-Mart-Sales-Prediction Public

    BigMart retail sales regression β€” feature engineering + neural net, 1,014 RMSE on 8.5k samples; full EDA and approach writeup

    Jupyter Notebook

  5. rag_project rag_project Public

    RAG Q&A over 10-K filings β€” FAISS retrieval + cross-encoder re-ranking, sentence-transformers embeddings, Qwen2.5 via HF Inference

    Python

  6. warehouseops-ai warehouseops-ai Public

    Multi-agent warehouse operations assistant β€” LangGraph planner, MCP tools, forecasting and document extraction, running on free open-source infrastructure

    Python