Ian Bull f026f8120f metal : use autoreleasepool to avoid memory leaks (#5437) ...

There appears to be a known memory leak when using the
`MLTCommandBuffer`. It is suggested to use `@autoreleasepool` in
[1,2]

[1] https://developer.apple.com/forums/thread/662721
[2] https://forums.developer.apple.com/forums/thread/120931

This change-set wraps the `ggml_metal_graph_compute` in a
`@autoreleasepool`.

This commit addresses https://github.com/ggerganov/llama.cpp/issues/5436

2024-02-10 12:53:28 +02:00

147 KiB

Raw Blame History

View Raw