10 Commits

Author	SHA1	Message	Date
nihui	171b9d1bba	use spdx license header, copyright Tencent (#6152)	2025-07-08 11:01:29 +08:00
nihui	4c3debae2d	multiheadattention scale param (#5526) ... * update swiftshader * skip vs2017 swiftshader	2024-06-23 23:51:02 +08:00
nihui	8235cad999	mha allow qdim differs from embed_dim (#5519) ... * test mha oom	2024-06-19 23:59:53 +08:00
nihui	556b79ce4d	create layer decoupled (#5258) ... * create layer decoupled * no more virtual public * allow build test with shared library * decouple cpu vulkan * drop old scripts	2024-01-05 14:08:15 +08:00
nihui	c28c8c04a1	multiheadattention attn mask (#4668)	2023-04-28 12:28:38 +08:00
nihui	b640574b88	rough vulkan gemm and multiheadattention (#4618)	2023-04-26 15:13:27 +08:00
WuJinxuan	ff80ac2955	[ARM] Multiheadattention (#4463)	2023-02-23 11:04:55 +08:00
nihui	eceac35a7f	implement MultiheadAttention kdim vdim (#4347)	2022-11-14 12:46:51 +08:00
nihuini	15d63ec0f5	fuse onnx multiheadattention with same qkv blob	2021-03-15 19:08:44 +08:00
nihuini	c17eb4e208	multiheadattention layer	2021-03-05 11:45:02 +08:00