Inference infrastructure · performance engineering · deterministic systems
Where models meet machines: memory, latency, determinism, and proof that an optimization worked.
| Domain | Direction |
|---|---|
| LLM inference | Multimodal preprocessing, host-memory behavior, runtime efficiency in vLLM |
| Low-latency systems | Deterministic C++20, order-book mechanics, replayable execution |
| Runtime intelligence | Telemetry → prediction → guarded action → measured verification |
| Computing systems | Processor architecture, wireless PHY/DSP, hardware/software interaction |
vllm-project/vllm #61096 · open, under review
Resize Qwen3-VL video frames during decoding to reduce peak host memory · fixes #60985
flowchart LR
A[Decode sampled frames] --> B{Safe to resize early?}
B -- "supported processor,<br/>no sizing overrides" --> C[Bicubic + antialias<br/>at target size]
B -- "unsupported config or<br/>top-level / nested override" --> D[Existing full-resolution path]
C --> E[smart_resize is a no-op:<br/>bit-identical model inputs]
D --> E
- Resize settings are derived from the video processor config, so nothing is hard-coded.
- A review comment exposed that sizing overrides nested under
videos_kwargsbypassed the guard. I fixed it and added regression tests. - Synthetic 720p benchmark: frame-buffer memory 13.18 → 2.11 MiB. End-to-end server memory and GPU decode paths are not yet benchmarked.
ApexHFT · C++20
A deterministic matching-engine simulator: price-time priority, integer ticks, pre-trade risk controls, exact event/OMS replay. It is offline by design, and the README lists its non-goals.
| Verification | Result |
|---|---|
| Test suite (Debug / ASan+UBSan / Release) | 97 / 97 in each configuration |
| Differential fuzzing vs. an independent reference book | 100,000 operations, fixed seed |
| Sanitizer defects | 0 |
Known limit: a 1,000,000-operation differential run was interrupted by cumulative O(N²) cancellation cost under concentrated depth. This is documented in the repo and is the next thing to fix.
AstraOS · Python
A runtime intelligence platform with one loop: predict → decide → optimize → verify. It forecasts resource pressure from real host telemetry and acts only inside explicit guardrails. Each intervention is measured before and after and carries rollback metadata. Simulated components are labelled as simulated.
WaveCore X · TypeScript
An interactive platform for PHY/DSP experimentation: modulation, OFDM, channel modeling, equalization, and BER/SER/EVM analysis. Live
- A claim covers only what was measured.
- Determinism is a testing tool.
- Optimizations ship with evidence and a path back.
- Non-goals are documented.
Open-source contributions are made independently and imply no affiliation with the projects' maintainers or sponsors.