Commit Graph
61 Commits
Author SHA1 Message Date
nihui f74639deeb gemm block quantization infrastructure for llm decoder style (#6814)
* another mha oob read
2026-07-13 10:13:39 +08:00
securekim cb137e07dc docs: add guide for AHB zero-copy input on Android (#6733)
* docs: add guide for AHB zero-copy input on Android

Address #5531 - the AHB import API (VkAndroidHardwareBufferImageAllocator,
ImportAndroidHardwareBufferPipeline) has no user-facing docs today and
existing users hit linker errors against the official prebuilt because
build-android.cmd targets -DANDROID_PLATFORM=android-21 which strips the
AHB symbols.

The new page covers build prerequisites (__ANDROID_API__ >= 26),
AImageReader_newWithUsage setup, the per-frame call sequence, per-AHB-
pointer pipeline caching (~5000x setup-cost reduction), and trouble-
shooting for #5531 / #5190.

* docs(ahb): add ex.input(VkMat) format-matching caveat + soften cache bound

Two findings from a follow-up spike on Adreno 830:

- ex.input(VkMat) does NOT auto-convert format. The previous draft's hint
  "// ex.input(\"data\", dst, cmd);" actually crashes if the network was
  loaded with use_fp16_storage / use_fp16_packed (common on Vulkan path) -
  NetPrivate::forward_layer recurses on itself looking for an implicit
  converter that doesn't exist, observed as a ~180-frame stack overflow at
  net.cpp:251. Add a dedicated caveat explaining the failure mode and the
  vkdev->convert_packing workaround, and weaken the snippet hint accordingly.

- AImageReader's AHB pool isn't strictly bounded by maxImages. Under steady
  state it stays at maxImages (3 -> 3 cache_n in 36 consecutive cycles), but
  surface/focus events can transiently push it higher (observed cache_n=7
  with maxImages=3 in one run). Soften the "<= maxImages entries" claim.

* docs(ahb): note cross-vendor validation (Adreno + Mali)

Same import path verified end-to-end on:
  - Adreno 830, Vulkan 1.3.284 (Galaxy S25 Ultra)
  - Mali-G925 Immortalis MC12, Vulkan 1.3.278 (Galaxy Tab S11)

Both report VK_ANDROID_external_memory_android_hardware_buffer spec
version 5 and surface AHARDWAREBUFFER_FORMAT_Y8Cb8Cr8_420 AHBs from the
camera HAL. Only auxiliary usage bits differ between vendors and are
not consumed by this path (Adreno: 0x20103, Mali: 0x20133).
2026-05-25 16:12:29 +08:00
Laylaandnihui 3724d10fc8 tools:Move Embed/MHA/RNN/LSTM/GRU weight scale generation to ncnn2table (#6688)
Co-authored-by: nihui <nihuini@tencent.com>
2026-05-18 19:38:07 +08:00
風的彷徨 c0f138e466 update docs for new convertmodel website (#6617) 2026-03-30 10:21:56 +08:00
nihui e5e09d5ee3 readonly mappedfile wrapper class, use_mapped_model_loading option (#6537)
* test mmap loading
2026-02-09 22:15:51 +08:00
nihui 419db5e04d net load api wchar_t version (#6491) 2026-01-06 15:33:26 +08:00
nihui 430b3124a7 fix ncnn2int8 top_blob int8 scales saving for dequant only style (#6425) 2025-11-26 17:31:57 +08:00
nihui 414666a6d1 doc supported onnx operators (#6327) 2025-09-23 19:41:06 +08:00
nihui a6eda68f23 disable onnx2ncnn build (#6324)
Migrate most of onnx2ncnn functions to pnnx
2025-09-23 19:06:07 +08:00
nihui a514cf5e9c drop deprecated ex.set_num_threads and ex.set_vulkan_compute api (#6307) 2025-09-09 19:07:43 +08:00
nihui 1f6f01ca20 fix apple glslang package, drop glslang-default-resource-limits (#6022) 2025-04-25 17:21:02 +08:00
shacon wang 701f53794d add read npy for ncnn2table (#5930)
* add read npy for ncnn2table

* optimize npy to mat to avoid non-contiguous memory data

* add create the calibration table from npy

* add catch exception
2025-03-18 16:50:36 +08:00
nihui 2535a6d5b7 update doc about vulkan-sdk (#5911) 2025-02-19 18:48:29 +08:00
張小凡 051b04ffb4 Updated use-ncnn-with-pytorch-or-onnx document (#5557) 2024-07-24 10:40:17 +08:00
RoachZhao d4292e9a65 Update vulkan-notes.md (#5472)
`compute_queue_count` is a function.
2024-05-25 16:50:39 +08:00
nihui 08b7d99a75 rnn/lstm/gru dynamic quantization (#5435) 2024-05-08 19:25:51 +08:00
afredooo 96d073d541 Some typo fixes (#5339) 2024-02-17 21:12:18 +08:00
nihui c222208cc9 feat mask for disable threading, make some extractor setter no-op, update doc (#5270) 2024-01-08 17:42:08 +08:00
Ikko Eltociear Ashimine 5581d27d4d docs: update FAQ-ncnn-vulkan.md (#5268)
plase -> please
2024-01-08 10:44:19 +08:00
lll143653 d4dcb3a2f0 Update FAQ-ncnn-produce-wrong-result.md (#5220) 2023-12-13 17:32:08 +08:00
nihui 6f661f9bc4 Update FAQ-ncnn-throw-error.md 2023-02-22 16:04:16 +08:00
MisakaBit bbbe17c5b5 docs: disable fp16 when wrong results encountered caused by overflow (#4248) 2022-10-09 14:41:12 +08:00
tpoisonooo 207ca0e0bb Improve protobuf FAQ doc (#3973) 2022-07-04 14:53:16 +08:00
nihui 49e70c81a6 update linking glslang libraries 2022-04-16 11:10:15 +08:00
ncnnnnn b61d4cbd60 Update FAQ-ncnn-vulkan.md (#3134) 2021-08-03 09:46:25 +08:00
nihui a2844bbf6c Update build-minimal-library.md 2021-07-15 14:44:57 +08:00
li mengyang be054aacb0 some misspell (#3046)
* just a spell check

* some misspell
2021-07-03 14:47:35 +08:00
Jimmy 8fad97cc68 [ncnn2table]do not always resize image (#3023)
* it's possible not to resize image
2021-06-24 19:48:47 +08:00
Jimmy e47ab30cf5 fix ncnn2table specification (#3006) 2021-06-17 10:38:20 +08:00
nihuini 0e35c66f50 mention pixel drawing in build-minimal-library.md 2021-05-20 17:17:30 +08:00
nihuini 45e548e342 rewrite ncnn2table tool, with better multithreading processing 2021-04-27 19:35:46 +08:00
nihuini 79927a9eeb update quantized int8 inference doc 2021-04-16 11:47:57 +08:00
nihui 7e1aaa5828 cmake option NCNN_INT8 (#2839) 2021-04-14 12:49:35 +08:00
weida wang dd8438558a Update efficient-roi-resize-rotate.md (#2832) 2021-04-11 20:36:58 +08:00
PENGUINLIONG 2d31868389 Trouble shooting guide for Vulkan on NVIDIA GPUs (#2731) 2021-03-06 20:27:13 +08:00
Zhuo Zhang 7c8c6d9ce9 add doc: use ncnn with own project (#2645) 2021-02-01 17:32:31 +08:00
Zhuo Zhang d20bf380f7 fix typos in docs (#2639)
* fix typos in docs

* still fix some typos in docs
2021-01-29 15:59:26 +08:00
Zhuo Zhang 87af7126a3 fix typo in ncnn-load-model document (#2625) 2021-01-26 20:34:05 +08:00
Monkeykingandmeow 1a81be6259 doc: Update support platform and devices (#2540)
* Add [ MacOS ->  apple-cpu/apple-gpu] into supported platform matrix
 * Add [ mac ->  apple] into 'device support vulkan' list

Co-authored-by: meow <826150766@qq.com>
2021-01-02 00:12:35 +08:00
ncnnnnn 16fb78a814 use-ncnn-with-opencv-addmat (#2306) 2020-11-12 14:12:53 +08:00
ncnnnnn a971acda3d efficient-roi-resize-rotate-addmat (#2305) 2020-11-12 14:09:39 +08:00
nihuini d0e6b256f9 drop obsoleted aarch64 auto conv mode, print mac after ncnnoptimize shape inference 2020-10-29 14:22:12 +08:00
youzainn aa665026f3 openmp best practice (#2243) 2020-10-24 22:57:11 +08:00
songqun a0189211d9 docs: add docs about how to build a minimal ncnn library (#2224) 2020-10-15 18:05:03 +08:00
qiqikit 09011f36ad Update FAQ-ncnn-throw-error.md (#2222)
crash when freeing a ncnn dynamic library
2020-10-14 21:28:17 +08:00
nihui c954bd742b update doc 2020-09-14 22:54:07 +08:00
Huang Rui 6f56f07536 FAQ-ncnn-vulkan.md: fix outdated document (#2086)
change document about how to enable ncnn vulkan capablity

Signed-off-by: Huang Rui <vowstar@gmail.com>
2020-09-09 13:16:12 +08:00
nihuini bf279dcf17 workaround corrupted pipeline cache on old qcom adreno 2020-07-23 17:48:21 +08:00
zchrissirhcz 534f8da195 Update FAQ-ncnn-produce-wrong-result.md (#1947)
Mention jpg decoding & resizing issue

mention keep size unchanged if debug with resize issue
2020-07-21 18:34:02 +08:00
Zhuo Zhang 8d984f105b update readme: metion yolact, retinaface, etc (#1916)
* update readme: metion yolact, retinaface, etc

* update doc: add c/cpp/python for code region
2020-07-06 00:05:04 +08:00