Support grouped state heads in GDN attention (#21402) - #21402
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21402
Note: Links to docs will display an error until the docs builds have been completed. ✅ No FailuresAs of commit 7f23e06 with merge base d632341 ( This comment was automatically generated by Dr. CI and updates every 15 minutes. |
meta-cla
Bot
added
the
CLA Signed
|
@JakeStevens has exported this pull request. If you are a Meta employee, you can view the originating Diff in D113299906. |
This PR needs a
|
Summary: Adds separate query-head and state-head configuration to the model definition as well as updates the fused channelwise_gated_delta_rule custom op to support grouped decode and prefill. Differential Revision: D113299906
meta-codesync
Bot
changed the title
Summary: Adds separate query-head and state-head configuration to the model definition as well as updates the fused channelwise_gated_delta_rule custom op to support grouped decode and prefill. Reviewed By: YIWENX14 Differential Revision: D113299906
c6b01e5 to
7d326e2
Compare
Summary: Adds separate query-head and state-head configuration to the model definition as well as updates the fused channelwise_gated_delta_rule custom op to support grouped decode and prefill. Reviewed By: YIWENX14 Differential Revision: D113299906
7d326e2 to
7f23e06
Compare
Summary: Adds separate query-head and state-head configuration to the model definition as well as updates the fused channelwise_gated_delta_rule custom op to support grouped decode and prefill. Reviewed By: YIWENX14 Differential Revision: D113299906
1 participant
Summary:
Adds separate query-head and state-head configuration to the model definition as well as updates the fused
channelwise_gated_delta_rule custom op to support grouped decode and prefill.
Reviewed By: YIWENX14
Differential Revision: D113299906