Skip to content
View TurdiyevIslombek's full-sized avatar

Block or report TurdiyevIslombek

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
TurdiyevIslombek/README.md

Islombek Turdiyev

I build language models and software from scratch — starting with my own language.

Self-taught builder from Bukhara, Uzbekistan. I trained a 103M-parameter Uzbek language model from an empty file, built a custom Uzbek tokenizer, and founded a learning platform that's live for 1,000+ students. I ship real things; I'm not here to write papers about them.

Website Hugging Face EduBoost LinkedIn


🛠️ What I've built

uzbek-gpt-103m — a 103M-parameter decoder-only transformer (RoPE · RMSNorm · SwiGLU), pre-trained from scratch on ~1.06B Uzbek tokens.

Single RTX 4090 · ~3.4 hours · ~$3.60 to train · 1.105 bits/byte — beats mGPT-1.3B + QLoRA (1.147) at ~1/13th the size.

uzbek-bpe-16k — a custom BPE tokenizer built specifically for Uzbek (handles , , and apostrophes that multilingual tokenizers fragment).

16,384 vocab · 1.839 tokens/word fertility. For a low-resource language, the tokenizer is the highest-leverage choice — that's the whole thesis.

uzbek-gpt-from-scratch — the full training code, data pipeline, and a from-scratch-vs-fine-tuning study, plus an evaluation harness for scoring Uzbek LLMs fairly.

EduBoost — a free full-stack learning platform (Next.js · TypeScript · PostgreSQL) where students teach students. Built solo, running in production for 1,000+ learners in underserved regions of Uzbekistan.


🧰 Tools I reach for

Python · PyTorch · Transformers · TypeScript · Next.js · PostgreSQL · Node.js Low-resource NLP · tokenization · from-scratch training · full-stack web · Kaggle tabular ML (XGBoost / LightGBM / CatBoost)


📍 About

Bukhara → Navoiy, Uzbekistan · speaks Uzbek, Russian, Tajik, English Outside code I do traditional Uzbek beadwork (munchoq) with my family — patterns built one bead at a time on a grid. Goal: build frontier-capable language models and start my own AI company.

Pinned Loading

  1. EduBoost EduBoost Public

    Peer to peer education

    TypeScript 1

  2. uzbek-gpt-from-scratch uzbek-gpt-from-scratch Public

    From-scratch 103M-parameter Uzbek language model — 1.105 bits/byte on a single RTX 4090.

    Jupyter Notebook 1

  3. uzbek-tokenizer uzbek-tokenizer Public

    Open byte-level BPE tokenizer for Uzbek (16k vocab) — 1.85 tokens/word vs GPT-4's 2.62, at ~12× smaller vocab. Built-in apostrophe/okina normalization; loads with Hugging Face Transformers.

    Python 1

  4. TurdiyevIslombek.github.io TurdiyevIslombek.github.io Public

    HTML 1