Commit Graph

30 Commits

Author SHA1 Message Date
nihui dda2e28bae skip fp16a gpu test (#6820) 2026-07-13 15:13:46 +08:00
nihui 9c62afb90c batch infrastructure (#6656)
* batch-aware record upload download
* cast and packing batch
2026-06-17 17:38:53 +08:00
nihui 104edd7f78 mips/loongarch: remove dead code and optimize transpose pack (#6749)
* limit test nT, add gemm int8 nT test
2026-05-28 23:02:28 +08:00
nihui b76824882e refactor mips loongArch packing coding style (#6745) 2026-05-26 15:15:01 +08:00
nihui 0f5c6ef2ce massive mips and loongarch optimization (#6662)
Co-authored-by: nihui <171016+nihui@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-05-19 08:19:35 +08:00
nihui f6b75ceeb8 add fp16s test, skip cpu test for fp16p (#6724) 2026-05-15 10:14:31 +08:00
nihui 8c18666821 feat(vulkan): persist pipeline cache (#6702)
Add single-file Vulkan pipeline cache save/load support with strict device, driver, shader, and payload validation. Cache compiled SPIR-V per shader hash alongside the driver pipeline cache blob, add focused cache tests, and document the current Vulkan pipeline cache architecture and usage.

Limit Vulkan layer test cache growth with a shared test-only pipeline cache window so repeated test_layer() calls can still exercise cache reuse.

Co-authored-by: futz12 <56149058+futz12@users.noreply.github.com>

Co-authored-by: CLV-Iclucia <89170890+CLV-Iclucia@users.noreply.github.com>
2026-05-09 09:37:06 +08:00
nihui 371bbad09b gemm x86 support out_elemtype, multiheadattention and sdpa x86 support bf16 storage, skip mha bf16 tests (#6623) 2026-03-31 15:29:45 +08:00
nihui 5cb7641afa x86: add LayerNorm_x86 bf16s storage support with avx512bf16 dispatch (#6585) 2026-03-08 16:08:59 +08:00
nihui b1a08ae9ed packed shape hint for vulkan layers (#6553) 2026-02-26 14:33:43 +08:00
nihui e5639d308d discard pipeline cache for gpu shape hint tests, reduce gpu memory usage under tests (#6486) 2026-01-04 22:57:57 +08:00
nihui 6499fc0348 vulkan bf16 infrastructure (#6469)
* skip gpu bf16 winograd
* update doc
2026-01-04 19:34:50 +08:00
nihui c99cb27c42 unroll n-tile x16 for gemm x86 avx512 (#6434) 2025-12-02 15:54:12 +08:00
nihui 544230f71d gemm x86 tile-N threading, drop testutil layer hook function (#6428)
* test threading
* drop testutil layer hook function
2025-11-28 15:48:48 +08:00
nihui 63a7a8a590 optional layer support any packing (#6392)
* split gemm tests, enable gemm vulkan any packing
2025-11-07 14:23:53 +08:00
nihui 3ab4b58d1d optional layer support vulkan packing (#6389)
* pyncnn expose layer support vulkan packing
* doc layer support behavior
2025-11-05 16:27:23 +08:00
nihui b5bc05e2e8 drop vulkan shader pack8 (#6270) 2025-08-22 11:05:59 +08:00
nihui 171b9d1bba use spdx license header, copyright Tencent (#6152) 2025-07-08 11:01:29 +08:00
nihui 9f832c19c1 vulkan int8 packing quantize dequantize requantize (#3731)
* add int8 definitions
* packing vulkan int8/int32, quantize vulkan
* vulkan dequantize
* requantize vulkan
2025-06-26 10:47:25 +08:00
nihui 24a3b99f1f drop layer support_image_storage and option use_image_storage (#6126)
* fix pyncnn build
2025-06-16 11:23:41 +08:00
nihui 211e238639 drop layer forward vkimagemat (#6124)
vkimagemat was originally used as a mat storage in the hope of improving performance on old adreno gpus, but in fact it is slower than the cpu in most cases and is no longer suitable for the latest adreno architecture and large shapes
2025-06-14 10:36:47 +08:00
nihui eed257df1f ci update llvmpipe (#5954)
* check image fp16
2025-03-28 19:05:40 +08:00
nihui 19caca3140 port rvv intrinsic 1.0+ (#5642)
* zfh zvfh xtheadvector infra
* dispatch for rvv and xtheadvector
* dispatch for non-vector zfh
* port xtheadvector recp rsqrt trunc
* general rvv gemm
* c906 and c910 ci
* old tuple code clean
* update riscv64 ci
* update build doc
* drop old th1520 toolchain
2024-12-04 16:16:17 +08:00
nihui 8fe62812c9 arm neon optimization for layernorm fp32/bf16s/fp16s (#5746) 2024-10-18 21:32:18 +08:00
nihui 3752d71200 fix potential fp16s bf16s conflicts on arm vfpv4 (#5578)
* fix potential fp16s bf16s conflicts on armv7 vfpv4

* but prefer fp16 on armv8.2
2024-07-12 10:25:37 +08:00
nihui da7d1a10f7 test x86 arm convolution oom (#5492)
* skip mips loongarch riscv oom test atm

* test softmax oom
2024-06-11 11:06:09 +08:00
nihui 08b7d99a75 rnn/lstm/gru dynamic quantization (#5435) 2024-05-08 19:25:51 +08:00
nihui 984d6dd844 promote vfpv4 for auto fp16 storage conversion (#5325)
* promote vfpv4 for auto fp16 storage conversion

* always report neon and vfpv4 for arm64
2024-02-02 18:50:15 +08:00
nihui 5329d32e74 check vulkan fp16 uniform support and implement lfp conversion without fp16u (#5287) 2024-01-17 15:53:34 +08:00
nihui 556b79ce4d create layer decoupled (#5258)
* create layer decoupled
* no more virtual public
* allow build test with shared library
* decouple cpu vulkan
* drop old scripts
2024-01-05 14:08:15 +08:00