computer engineer · AI systems · Linux · inference optimization
I like making heavyweight AI models behave on hardware they were never supposed to fit on.
| Project | What it does | Focus |
|---|---|---|
| ComfyUI-Qwen3-TTS-Quant | Native ComfyUI runtime and streaming quantization toolkit for the full Qwen3-TTS 12 Hz 1.7B family | W8A8 ConvRot · packed INT8 · CUDA graphs · static KV caches |
| comfyui-mixed-quantizer | Diffusion and text-encoder quantization with stable W4A8 and experimental mixed-precision planning | W4A8 · W4A4 · INT8 · validation · memory-aware planning |
| OpenCode 2 support for Ask | OpenCode 2 compatibility work for the Ask terminal AI client | Rust · CLI integration · permissions · read-only agent design |
I spend a lot of time around the point where model architecture, kernels, quantization, memory pressure, and runtime behavior collide.
AI systems: quantization, low-VRAM inference, CUDA kernels, memory residency, KV-cache design, graph capture, attention backends, and runtime optimization.
Inference: local LLMs, diffusion models, speech generation, multimodal systems, custom quantized runtimes, and squeezing maximum performance from constrained hardware.
Linux: rolling-release systems, terminal tooling, performance engineering, containers, and understanding the stack all the way down.
Software engineering: Rust, Python, systems integration, reproducible tooling, testing, and contributing fixes upstream.
OS CachyOS
Desktop KDE Plasma
Terminal Kitty
Shell Fish
AI ComfyUI · llama.cpp · PyTorch
GPU Stack CUDA · FlashAttention · Comfy Kitchen
Languages Python · Rust · C/C++
Dev Git · GitHub · Docker · OpenCode
Terminal micro · mdfried · ltop · lazydocker
I like tools that are fast, composable, transparent, and close to the system.
model
↓
architecture
↓
quantization
↓
kernel
↓
memory layout
↓
runtime
↓
benchmark
↓
repeat
If a model technically shouldn't fit, that usually makes it more interesting.
Linux is the playground. AI systems are the obsession.
I also enjoy philosophy, mathematics, anime & manga, storytelling, and two objectively excellent animals:
_~_ /\_/\
(o o) ( o.o )
/ V \ > ^ <
/( _ )\
^^ ^^
penguin cat
My completely scientific rating scale:
Ω > Z > S > A > B > C > D > F