leo-pony 6b8447352d [CANN] Adapt to dynamically loadable backends mechanism (#9970) ...

* [CANN] Adapt to dynamically loadable backends mechanism

* Fix the Bug: inference running result is garbled in debug running model for LM models who's type is Q4_0 class

* Handle the review comments of this pull request

2024-10-22 16:16:01 +08:00

..

ggml-amx

add amx kernel for gemm (#8998)

2024-10-18 13:34:36 +08:00

ggml-cann

cann: fix crash when llama-bench is running on multiple cann devices (#9627)

2024-09-25 11:30:38 +08:00

ggml-cuda

Vectorize load instructions in dmmv f16 CUDA kernel (#9816)

2024-10-14 02:49:08 +02:00

ggml-sycl

fix mul_mat_vec_q and *_vec_q error (#9939)

2024-10-21 14:26:09 +08:00

kompute @ 4565194ed7

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

kompute-shaders

ggml : move rope type enum to ggml.h (#8949)

2024-08-13 21:13:15 +02:00

llamafile

ggml : move common CPU backend impl to new header (#9509)

2024-09-16 16:22:07 +02:00

vulkan-shaders

vulkan : argsort barriers must be under uniform control flow (ggml/951)

2024-09-29 21:15:37 +03:00

CMakeLists.txt

add amx kernel for gemm (#8998)

2024-10-18 13:34:36 +08:00

ggml-aarch64.c

ggml : add run-time detection of neon, i8mm and sve (#9331)

2024-09-28 15:06:16 +03:00

ggml-aarch64.h

ggml : minor naming changes (#8433)

2024-07-12 10:46:02 +03:00

ggml-alloc.c

ggml-alloc : remove buffer_id from leaf_alloc (ggml/987)

2024-10-16 11:28:01 +03:00

ggml-amx.cpp

add amx kernel for gemm (#8998)

2024-10-18 13:34:36 +08:00

ggml-backend-impl.h

ggml : add backend registry / device interfaces to BLAS backend (#9752)

2024-10-07 21:55:08 +02:00

ggml-backend.cpp

[CANN] Adapt to dynamically loadable backends mechanism (#9970)

2024-10-22 16:16:01 +08:00

ggml-blas.cpp

ggml : move more prints to the ggml log system (#9839)

2024-10-11 15:34:45 +02:00

ggml-cann.cpp

[CANN] Adapt to dynamically loadable backends mechanism (#9970)

2024-10-22 16:16:01 +08:00

ggml-common.h

ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151)

2024-09-05 21:48:47 -04:00

ggml-cpu-impl.h

ggml : move common CPU backend impl to new header (#9509)

2024-09-16 16:22:07 +02:00

ggml-cuda.cu

ggml : move more prints to the ggml log system (#9839)

2024-10-11 15:34:45 +02:00

ggml-impl.h

fix: use vm_allocate to allocate CPU backend buffer on macOS (#9875)

2024-10-17 00:36:51 +02:00

ggml-kompute.cpp

ggml-backend : add device and backend reg interfaces (#9707)

2024-10-03 01:49:47 +02:00

ggml-metal.m

ggml : add metal backend registry / device (#9713)

2024-10-07 18:27:51 +03:00

ggml-metal.metal

metal : use F32 prec for K*Q in vec FA (#9595)

2024-09-23 11:27:47 +03:00

ggml-quants.c

ggml : add run-time detection of neon, i8mm and sve (#9331)

2024-09-28 15:06:16 +03:00

ggml-quants.h

ggml : add run-time detection of neon, i8mm and sve (#9331)

2024-09-28 15:06:16 +03:00

ggml-rpc.cpp

rpc : pack only RPC structs (#9959)

2024-10-21 13:35:40 +03:00

ggml-sycl.cpp

[SYCL] Add SYCL Backend registry, device and Event Interfaces (#9705)

2024-10-18 06:46:16 +01:00

ggml-vulkan.cpp

vulkan : add backend registry / device interfaces (#9721)

2024-10-17 02:46:58 +02:00

ggml.c

ggml : add asserts for type conversion in fattn kernels (#9971)

2024-10-21 16:20:46 +03:00