Skip to content
View Casten-Wang's full-sized avatar
🎯
Focusing
🎯
Focusing
  • USTC
  • Hong Kong
  • 06:29 (UTC +08:00)

Highlights

  • Pro

Block or report Casten-Wang

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Casten-Wang/README.md

About me

I'm a systems engineer focused on LLM inference and GPU kernel optimization. I enjoy tracing performance from model graphs down to memory access patterns, then validating improvements on real hardware.

  • 🔧  Working on inference performance, CUDA/HIP kernels, quantization, and memory-bound operators
  • 🖥️  Daily hardware: AMD Radeon 8060S · gfx1151 (RDNA 3.5) · ROCm 7.1
  • 🌱  Exploring vLLM PD disaggregation, speculative decoding, and kernel autotuning
  • 📐  Approach: profile → isolate → optimize → verify correctness → benchmark

Featured work

llama.cpp · RDNA 3.5 F32 CONCAT fast path

Added a shared-memory tiled-transpose path to the HIP backend for a non-contiguous F32 workload observed during Qwen3.6-35B-A3B prefill.

  • +4% to +12% measured prefill throughput
  • Bit-identical output for the copy/reorder operation
  • No meaningful decode regression
  • 32×32 shared-memory tiling with bank-conflict padding
View llama.cpp PR #28303

Toolbox

C++ CUDA HIP / ROCm Python llama.cpp vLLM

Interested in practical LLM systems performance, especially optimizations backed by reproducible measurements.

The Future Is Here

Popular repositories Loading

  1. llama.cpp llama.cpp Public

    Forked from ChenxiHe231/llama.cpp

    LLM inference in C/C++

    C++

  2. ApxInf ApxInf Public

    Forked from infinigence/ApxInf

    C++

  3. nano-vllm nano-vllm Public

    Forked from GeeeekExplorer/nano-vllm

    Nano vLLM

    Python

  4. Casten-Wang Casten-Wang Public

  5. lmdeploy lmdeploy Public

    Forked from InternLM/lmdeploy

    LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

    Python