4 Commits
Author SHA1 Message Date
nihui 60bfa40044 sdpa flash attention x86 optimization, llm models enable gqa, dispatch for avx2 bfloat2float (#6923)
* enable gqa
* update perf test
2026-09-01 17:35:42 +08:00
nihui f6f734f44d vulkan int8 kernels (#6751)
* vulkan: add int8 kernels for core layers
Implement Vulkan int8 paths for convolution, convolutiondepthwise, innerproduct, and gemm with scalar fallback and integer dot product shader branches. Add goal.md and enable existing int8 unit tests for Vulkan coverage.
* enable int8 gpu benchmark
2026-06-17 17:39:49 +08:00
nihui 13bca30c00 benchncnn_llm (#6711) 2026-05-13 11:38:29 +08:00
nihui 155ab53695 move model files into sub directory (#6710) 2026-05-09 16:32:02 +08:00