14 Commits

Author	SHA1	Message	Date
Georgi Gerganov	c8ee87f141	gguf.py : merge all files in gguf.py	2023-08-16 19:55:49 +03:00
klosax	5d22a9db13	convert-gptneox-h5-to-gguf.py : tensor name map changes	2023-08-14 10:55:44 +02:00
klosax	2827b840e4	convert-gptneox-h5-to-gguf.py : add file_type key	2023-08-13 13:54:10 +02:00
klosax	e3d1f07eb1	convert-gptneox-h5-to-gguf.py : load model in parts to save memory	2023-08-13 12:18:34 +02:00
klosax	489616e126	convert-gptneox-h5-to-gguf.py : n_layer --> n_block	2023-08-13 00:02:04 +02:00
klosax	f8218477b3	convert-gptneox-h5-to-gguf.py : simplify nbytes	2023-08-12 22:29:35 +02:00
klosax	8f09157ec9	convert-gptneox-h5-to-gguf.py : no need to convert tensors twice	2023-08-12 21:48:58 +02:00
klosax	f4d137d98c	convert-gptneox-h5-to-gguf.py : map tensor names	2023-08-09 00:50:11 +02:00
klosax	2922280a1a	convert-gptneox-h5-to-gguf.py : gpt2bpe tokenizer	2023-08-04 03:55:23 +02:00
klosax	1b4f9c8eb9	convert-gptneox-h5-to-gguf.py : accumulate kv and ti + special tokens	2023-08-01 23:40:50 +02:00
klosax	e7a741695c	convert-gptneox-h5-to-gguf.py : Special tokens	2023-08-01 14:30:00 +02:00
klosax	4f5b6224be	Update convert-gptneox-h5-to-gguf.py	2023-07-31 03:00:20 +02:00
klosax	2a0914673c	Update convert-gptneox-h5-to-gguf.py	2023-07-30 17:31:11 +02:00
klosax	e9192b0135	add gptneox gguf example	2023-07-30 15:05:37 +02:00