Shouzheng Liu 38b16dfca6 metal : bug-fix when enable ggml-alloc (#2757) ...

* metal: better memory alloc w/ concurrency dispatch

The ggml-alloc should only free tensors at memory barriers.

* ggml-alloc: avoid return silently

In certain cases, the allocate_node() function may silently return
without performing any memory allocation.

2023-08-24 19:27:25 +03:00

22 KiB

Raw Blame History

View Raw