Skip to content

transformers: in-place KV cache for decode via a fused InPlaceKvSdpa op#2321

Open
czoli1976 wants to merge 1 commit into
sonos:mainfrom
czoli1976:feature/inplace-kv-cache
Open

transformers: in-place KV cache for decode via a fused InPlaceKvSdpa op#2321
czoli1976 wants to merge 1 commit into
sonos:mainfrom
czoli1976:feature/inplace-kv-cache

transformers: in-place KV cache + fused InPlaceKvSdpa op + fusion rew…

8837149
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
prepare
succeeded Jun 19, 2026 in 4s