Jhen-Jie Hong c67fe68e41 metal : implement q5_0 and q5_1 kernels (#3648) ...

* metal : implement dequantize_q5_0

* metal : block_q_n_dot_y for block_q5_0 (broken)

* metal : revert unnecessary change

* metal : implement dequantize_q5_1

* metal : block_q_n_dot_y for q5_1 (broken)

* metal : fix block_q_n_dot_y

* minor : spaces / formatting

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2023-10-18 15:21:48 +03:00

82 KiB

Raw Blame History

View Raw