Skip to content

perf: express geometric residual as one addcmul operator - #2

Merged
DivyamTalwar merged 1 commit into
mainfrom
codex/addcmul-residual
Aug 23, 2026
Merged

perf: express geometric residual as one addcmul operator#2
DivyamTalwar merged 1 commit into
mainfrom
codex/addcmul-residual

Conversation

@DivyamTalwar

Copy link
Copy Markdown
Owner

Summary

  • replace x + delta * k with torch.addcmul(x, k, delta)
  • retain the literal implementation as an auditable reference
  • test forward and backward parity
  • add a local latency/CUDA peak-allocation benchmark

Acceptance

  • default and reference output/gradients agree
  • benchmark reports measured results rather than claiming a universal speedup
  • CI must pass before merge

@DivyamTalwar
DivyamTalwar merged commit 085174b into main Aug 23, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant