Commit Graph

103 Commits

Author SHA1 Message Date
GIBEREZ 44982d0d23 About the update to the GLSL documentation after the image functions are deprecated (#6173) 2025-07-12 14:22:30 +08:00
chri321 4c72f52954 docs: update Chinese glsl-extension documentation (#6162)
- synchronize the latest English content to the Chinese documentation
- correct spelling errors in the English version of glsl-extention
- Fix spelling 'enable_validation_layer' in src/gpu.cpp
2025-07-10 14:21:34 +08:00
nihui bd0b111775 vulkan tight fp16p pack1 (#6127) 2025-06-16 23:09:35 +08:00
nihui 80da741307 glsl define ncnn_glsl_version macro (#6003) 2025-04-18 18:49:33 +08:00
nihui ef0b0e631c interp output size expression (#5994) 2025-04-17 14:24:57 +08:00
nihui 39c055d7f2 crop axes starts ends expression (#5976)
* skip dynamic tensor index

* handle clone oom
2025-04-14 19:43:50 +08:00
nihui 84970eed4d vulkan validation layer enables NCNN_LOGE in shader source (#5963)
* NCNN_LOGE in glsl

* Update glsl-extension.md
2025-03-31 16:17:16 +08:00
nihui 6396a732ef reshape shape expression, drop reshape permute, test reshape oom (#5918) 2025-03-10 15:31:34 +08:00
nihui 1e3fcb9dda paramdict value string type, natural array representation (#5915) 2025-02-20 19:04:16 +08:00
nihui 0734b657d9 spectrogram and inverse spectrogram (#5779)
* only supports hann, hamming and all-one window
* inverse spectrogram does not support length parameter
* spectrogram always returns torch.view_as_real(out) as ncnn does not support complex typed mat yet
* inverse spectrogram always accepts torch.view_as_complex(in) as ncnn does not support complex typed mat yet
2024-11-22 16:14:54 +08:00
nihui 66b54cbea2 multiheadattention int8 quantization (#5733)
* x86 vulkan fallback
* comment about bf16s
2024-10-15 16:38:00 +08:00
nihui 1c7af00499 gemm int8 quantization (#5706)
* quantize gemm

* write gemm quantize scales

* update doc

* less openmp args

* x86 riscv fallback

* skip gemm vulkan int8

* fix noint8 test, fix arm bf16 test

* enable vfpv4 on neon build only

* fix gemm vulkan without C

* fp16 pack8 output

* enable elempack=8 only for asimdhp+

* tiled gemm int8 test

* opt arm64 tiles, fix asimdhp dispatch
2024-10-12 19:02:55 +08:00
nihui 5df5413c81 embed int8 quantization and add embed test (#5667) 2024-09-02 18:48:01 +08:00
nihui fdf0df3079 RMSNorm (#5630) 2024-08-15 16:52:06 +08:00
nihui 4c3debae2d multiheadattention scale param (#5526)
* update swiftshader

* skip vs2017 swiftshader
2024-06-23 23:51:02 +08:00
nihui db035d602d update ncnnoptimize layers, lightmode=false keeps original weight (#5414) 2024-04-09 23:53:54 +08:00
luqiang-guo 8ddc85f4dd fix doc dual issue (#5342) 2024-02-22 19:13:31 +08:00
hugo-syn f35eb4b3b8 chore: Fix multiple typos (#5301)
Signed-off-by: hugo-syn <hugo.vincent@synacktiv.com>
2024-01-20 21:54:27 +08:00
nihui 5329d32e74 check vulkan fp16 uniform support and implement lfp conversion without fp16u (#5287) 2024-01-17 15:53:34 +08:00
nihui c222208cc9 feat mask for disable threading, make some extractor setter no-op, update doc (#5270) 2024-01-08 17:42:08 +08:00
張小凡 2ecaf37a3e Fix find GPU driver dll path in windows (#5141) 2023-11-10 19:07:24 +08:00
nihui b4f26237cb in-house vulkan loader (#5130)
* vulkan-driver-loader.md
* static vulkan on apple
2023-11-09 16:58:23 +08:00
nihui 4494aadd74 deconvolution dynamic weight (#5119) 2023-10-31 17:37:24 +08:00
nihui 14e14a9ae8 slice with indices (#5103) 2023-10-25 17:12:03 +08:00
Yoh 3f437d3f3d Grid sample op (#4373)
* pnnx support grid_sample op

* complete the permute and gridsample operator fusion

* spilt calculation into two stages and support permute fusion
2023-10-20 19:09:59 +08:00
Amir Ramezani 7e5fa3ade3 shrink operator (#5022) 2023-09-20 14:08:31 +08:00
Beq Jal bcfec1da33 Celu layer and export to ncnn (#5019) 2023-09-12 10:28:22 +08:00
Beq Jal c851231832 add diag layer and its converter (#4935) 2023-09-08 22:01:37 +08:00
nihui 4abadd2ffb binaryop implicit broadcast B with 1 dimension rank for outer axis (#4930) 2023-08-10 21:29:49 +08:00
張小凡 1e0d70af8c Add translated document: glsl-extension.zh.md (#4818) 2023-07-02 11:47:44 +08:00
nihui 43aba6badb Update glsl-extension.md 2023-06-26 11:48:14 +08:00
nihui 172b748c74 add ncnn glsl extension doc (#4817) 2023-06-26 11:13:41 +08:00
nihui 9022b7162a implement all explicit binaryop broadcast types (#4809)
* simplify binaryop

* less gpu test

* update binaryop broadcast doc

* do not test atan2 zero
2023-06-19 19:32:32 +08:00
nihui c28c8c04a1 multiheadattention attn mask (#4668) 2023-04-28 12:28:38 +08:00
nihui b640574b88 rough vulkan gemm and multiheadattention (#4618) 2023-04-26 15:13:27 +08:00
nihui afc9310c62 update new operators for modelwriter (#4540) 2023-02-21 13:30:05 +08:00
nihui fc6ce4a641 copyto operator (#4522) 2023-02-14 15:22:38 +08:00
nihui 242e775d21 pnnx convert torch log10, pow 2 as square (#4518) 2023-02-09 19:28:18 +08:00
nihui 246e71c526 implement atan2 (#4516) 2023-02-09 00:29:18 +08:00
Fangjun Kuang 92e75105c9 Support torch.cumsum (#4505) 2023-02-08 10:50:50 +08:00
nihui ab4cfbf5b0 enrich ncnn binary broadcast rules (#4513) 2023-02-08 10:22:30 +08:00
nihui fed99fd35b gemm output transpose, prepack c (#4479)
* mha is now permute and reshape free
* gemm user defined tile mnk param
2023-01-27 13:03:04 +08:00
WuJinxuan 10e9d91576 Add x86 MultiHeadAttention (#4443)
* fix doc, sync x86 gemm fix

Co-authored-by: EdVince <EdVince@users.noreply.github.com>
Co-authored-by: nihuini <nihuini@tencent.com>
2023-01-04 17:28:20 +08:00
nihui fd1ac3c7a0 x86 optimization for gemm unified elempack (#4387) 2022-12-10 17:36:50 +08:00
nihui eceac35a7f implement MultiheadAttention kdim vdim (#4347) 2022-11-14 12:46:51 +08:00
Lry89757 6a47f8d15c gridsample op support (#4288)
Co-authored-by: LRY89757 <LRY89757@users.noreply.github.com>
Co-authored-by: nihuini <nihuini@tencent.com>
Co-authored-by: nihui <shuizhuyuanluo@126.com>
2022-11-11 20:55:57 +08:00
Fangjun Kuang 5281d51535 implement GLU and pnnx conversion (#4283) 2022-10-19 12:41:23 +08:00
nihui 77eda4c19f implement lstm proj_size (#4263) 2022-10-14 10:54:03 +08:00
miemie2013 720f3c9aab Add DeformableConv2D (#4070)
* Add DeformableConv2D
* add unittest and docs
* pnnx torchvision deformconv2d conversion

Co-authored-by: miemie2013 <miemie2013@users.noreply.github.com>
Co-authored-by: nihui <shuizhuyuanluo@126.com>
2022-07-28 11:45:09 +08:00
Zhouzhou 4158e63668 docs:add sse optimized zh (#4053)
Signed-off-by: Zhouzhou <1197236910@qq.com>
2022-07-25 16:24:44 +08:00