4onen c0a97b762e llama-bench : Add --override-tensors arg (#12922) ...

* Add --override-tensors option to llama-bench

* Correct llama-bench --override-tensors to --override-tensor

* llama-bench: Update --override-tensors parsing to match --tensor-split, appear in test matrix.

* Make new llama-bench util functions static to fix Ubuntu CI

* llama-bench: Correct -ot corner cases (No -ot calls, leading and trailing empty -ot spans, etc.)

2025-04-27 23:48:26 +02:00

69 KiB

Raw Blame History

View Raw