Commit Graph

94 Commits

Author SHA1 Message Date
nihui 0734b657d9 spectrogram and inverse spectrogram (#5779)
* only supports hann, hamming and all-one window
* inverse spectrogram does not support length parameter
* spectrogram always returns torch.view_as_real(out) as ncnn does not support complex typed mat yet
* inverse spectrogram always accepts torch.view_as_complex(in) as ncnn does not support complex typed mat yet
2024-11-22 16:14:54 +08:00
nihui 66b54cbea2 multiheadattention int8 quantization (#5733)
* x86 vulkan fallback
* comment about bf16s
2024-10-15 16:38:00 +08:00
nihui 1c7af00499 gemm int8 quantization (#5706)
* quantize gemm

* write gemm quantize scales

* update doc

* less openmp args

* x86 riscv fallback

* skip gemm vulkan int8

* fix noint8 test, fix arm bf16 test

* enable vfpv4 on neon build only

* fix gemm vulkan without C

* fp16 pack8 output

* enable elempack=8 only for asimdhp+

* tiled gemm int8 test

* opt arm64 tiles, fix asimdhp dispatch
2024-10-12 19:02:55 +08:00
nihui 5df5413c81 embed int8 quantization and add embed test (#5667) 2024-09-02 18:48:01 +08:00
nihui fdf0df3079 RMSNorm (#5630) 2024-08-15 16:52:06 +08:00
nihui 4c3debae2d multiheadattention scale param (#5526)
* update swiftshader

* skip vs2017 swiftshader
2024-06-23 23:51:02 +08:00
nihui db035d602d update ncnnoptimize layers, lightmode=false keeps original weight (#5414) 2024-04-09 23:53:54 +08:00
luqiang-guo 8ddc85f4dd fix doc dual issue (#5342) 2024-02-22 19:13:31 +08:00
hugo-syn f35eb4b3b8 chore: Fix multiple typos (#5301)
Signed-off-by: hugo-syn <hugo.vincent@synacktiv.com>
2024-01-20 21:54:27 +08:00
nihui 5329d32e74 check vulkan fp16 uniform support and implement lfp conversion without fp16u (#5287) 2024-01-17 15:53:34 +08:00
nihui c222208cc9 feat mask for disable threading, make some extractor setter no-op, update doc (#5270) 2024-01-08 17:42:08 +08:00
張小凡 2ecaf37a3e Fix find GPU driver dll path in windows (#5141) 2023-11-10 19:07:24 +08:00
nihui b4f26237cb in-house vulkan loader (#5130)
* vulkan-driver-loader.md
* static vulkan on apple
2023-11-09 16:58:23 +08:00
nihui 4494aadd74 deconvolution dynamic weight (#5119) 2023-10-31 17:37:24 +08:00
nihui 14e14a9ae8 slice with indices (#5103) 2023-10-25 17:12:03 +08:00
Yoh 3f437d3f3d Grid sample op (#4373)
* pnnx support grid_sample op

* complete the permute and gridsample operator fusion

* spilt calculation into two stages and support permute fusion
2023-10-20 19:09:59 +08:00
Amir Ramezani 7e5fa3ade3 shrink operator (#5022) 2023-09-20 14:08:31 +08:00
Beq Jal bcfec1da33 Celu layer and export to ncnn (#5019) 2023-09-12 10:28:22 +08:00
Beq Jal c851231832 add diag layer and its converter (#4935) 2023-09-08 22:01:37 +08:00
nihui 4abadd2ffb binaryop implicit broadcast B with 1 dimension rank for outer axis (#4930) 2023-08-10 21:29:49 +08:00
張小凡 1e0d70af8c Add translated document: glsl-extension.zh.md (#4818) 2023-07-02 11:47:44 +08:00
nihui 43aba6badb Update glsl-extension.md 2023-06-26 11:48:14 +08:00
nihui 172b748c74 add ncnn glsl extension doc (#4817) 2023-06-26 11:13:41 +08:00
nihui 9022b7162a implement all explicit binaryop broadcast types (#4809)
* simplify binaryop

* less gpu test

* update binaryop broadcast doc

* do not test atan2 zero
2023-06-19 19:32:32 +08:00
nihui c28c8c04a1 multiheadattention attn mask (#4668) 2023-04-28 12:28:38 +08:00
nihui b640574b88 rough vulkan gemm and multiheadattention (#4618) 2023-04-26 15:13:27 +08:00
nihui afc9310c62 update new operators for modelwriter (#4540) 2023-02-21 13:30:05 +08:00
nihui fc6ce4a641 copyto operator (#4522) 2023-02-14 15:22:38 +08:00
nihui 242e775d21 pnnx convert torch log10, pow 2 as square (#4518) 2023-02-09 19:28:18 +08:00
nihui 246e71c526 implement atan2 (#4516) 2023-02-09 00:29:18 +08:00
Fangjun Kuang 92e75105c9 Support torch.cumsum (#4505) 2023-02-08 10:50:50 +08:00
nihui ab4cfbf5b0 enrich ncnn binary broadcast rules (#4513) 2023-02-08 10:22:30 +08:00
nihui fed99fd35b gemm output transpose, prepack c (#4479)
* mha is now permute and reshape free
* gemm user defined tile mnk param
2023-01-27 13:03:04 +08:00
WuJinxuan 10e9d91576 Add x86 MultiHeadAttention (#4443)
* fix doc, sync x86 gemm fix

Co-authored-by: EdVince <EdVince@users.noreply.github.com>
Co-authored-by: nihuini <nihuini@tencent.com>
2023-01-04 17:28:20 +08:00
nihui fd1ac3c7a0 x86 optimization for gemm unified elempack (#4387) 2022-12-10 17:36:50 +08:00
nihui eceac35a7f implement MultiheadAttention kdim vdim (#4347) 2022-11-14 12:46:51 +08:00
Lry89757 6a47f8d15c gridsample op support (#4288)
Co-authored-by: LRY89757 <LRY89757@users.noreply.github.com>
Co-authored-by: nihuini <nihuini@tencent.com>
Co-authored-by: nihui <shuizhuyuanluo@126.com>
2022-11-11 20:55:57 +08:00
Fangjun Kuang 5281d51535 implement GLU and pnnx conversion (#4283) 2022-10-19 12:41:23 +08:00
nihui 77eda4c19f implement lstm proj_size (#4263) 2022-10-14 10:54:03 +08:00
miemie2013 720f3c9aab Add DeformableConv2D (#4070)
* Add DeformableConv2D
* add unittest and docs
* pnnx torchvision deformconv2d conversion

Co-authored-by: miemie2013 <miemie2013@users.noreply.github.com>
Co-authored-by: nihui <shuizhuyuanluo@126.com>
2022-07-28 11:45:09 +08:00
Zhouzhou 4158e63668 docs:add sse optimized zh (#4053)
Signed-off-by: Zhouzhou <1197236910@qq.com>
2022-07-25 16:24:44 +08:00
Lry89757 ca9abd1c4a Update the add-custom-layer.zh.md (#3741)
1. 🐛Fix Bug of float and int.  修复了std::max()中参数int和float参数不符合的Bug
2. 👀 The structure of ncnn changes.  ncnn文件结构变动,所有testlayer.cpp改成在tests/文件夹中
2022-04-27 15:02:10 +08:00
nihui 2880eff264 deconv1d deconv3d (#3584)
* fix sigmoid returns nan with very large input
2022-03-01 21:50:17 +08:00
nihuini bc188ece58 update modelwriter for new operators 2022-02-25 11:27:01 +08:00
nihui c5d7f963b9 layer tile (#3491) 2022-01-10 15:05:07 +08:00
nihuini 014387dfae update operators doc 2021-12-31 17:47:23 +08:00
nihui 3a83704c38 binary4d, unary4d (#3443) 2021-12-28 23:13:44 +08:00
FeiGeChuanShu 0dea7a04a8 fix typo in doc (#3436) 2021-12-20 17:20:21 +08:00
nihuini e8d1d40398 update operators doc 2021-12-07 11:10:22 +08:00
nihui f10cc6dd93 initial data structure changes for 3dcnn, conv3d, pooling3d (#3378)
Co-authored-by: ElvisYu <elvisyuovo@gmail.com>
Co-authored-by: 余浩文 <m18107220188@163.com>
Co-authored-by: Zr2223 <67497651+Zr2223@users.noreply.github.com>
2021-12-02 16:50:55 +08:00