Michael Podvitskiy 8344ef58f8 llama : fix n_vocab init for 'no_vocab' case (#9511) ...

* llama: fixed n_vocab for `no_vocab` models

* llama: updated error output for `llama_decode_internal` and `llama_encode_internal`

* llama: log warning if there's no vocab_size in metadata

* llama: correct vocab size for logging

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2024-09-17 13:18:22 +03:00

..

CMakeLists.txt

llama : move vocab, grammar and sampling into separate files (#8508)

2024-07-23 13:10:17 +03:00

llama-grammar.cpp

llama : refactor sampling v2 (#9294)

2024-09-07 15:16:19 +03:00

llama-grammar.h

llama : refactor sampling v2 (#9294)

2024-09-07 15:16:19 +03:00

llama-impl.h

common : reimplement logging (#9418)

2024-09-15 20:46:12 +03:00

llama-sampling.cpp

llama : llama_perf + option to disable timings during decode (#9355)

2024-09-13 09:53:38 +03:00

llama-sampling.h

llama : refactor samplers internal implementation (#9370)

2024-09-08 15:52:07 +02:00

llama-vocab.cpp

llama : support RWKV v6 models (#8980)

2024-09-01 17:38:17 +03:00

llama-vocab.h

llama : refactor sampling v2 (#9294)

2024-09-07 15:16:19 +03:00

llama.cpp

llama : fix n_vocab init for 'no_vocab' case (#9511)

2024-09-17 13:18:22 +03:00

unicode-data.cpp

Removes multiple newlines at the end of files that is breaking the editorconfig step of CI. (#8258)

2024-07-02 12:18:10 -04:00

unicode-data.h

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

unicode.cpp

unicode : add <algorithm> (#9508)

2024-09-17 09:51:15 +03:00

unicode.h

llama : move vocab, grammar and sampling into separate files (#8508)

2024-07-23 13:10:17 +03:00