Commit Graph

2 Commits

Author SHA1 Message Date
nihui 13b6d5318c fix naive mha out-of-bound read (#6812) 2026-07-08 13:55:11 +08:00
nihui adee6a0a53 multiheadattention kvcache (#6333)
* skip input layer forward
* unified kvcache layout
* mha kvcache test
2025-10-15 14:19:57 +08:00