4 Commits

Author	SHA1	Message	Date
nihui	60bfa40044	sdpa flash attention x86 optimization, llm models enable gqa, dispatch for avx2 bfloat2float (#6923) ... * enable gqa * update perf test	2026-09-01 17:35:42 +08:00
nihui	7f162381ab	kvcache allocator (#6901) ... * decode benchmark * reject kvcache batch * enable mha vulkan gemm out_elempack 1	2026-08-17 15:44:30 +08:00
nihui	11fb99795b	sdpa kvcache (#6405)	2025-11-18 11:05:27 +08:00
nihui	adee6a0a53	multiheadattention kvcache (#6333) ... * skip input layer forward * unified kvcache layout * mha kvcache test	2025-10-15 14:19:57 +08:00