CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-30 08:42:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ggml-impl
llama.cpp/ggml-opencl.h
Howard Su 58970a4c39 Leverage mmap for offloading tensors to GPU (#1597) 
* Rebase to latest

* Show progress

* Add assert to make sure we only allocate temp buffer for non-CPU backend tensor

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
2023-06-12 14:44:16 +02:00

845 B
Raw Permalink Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink