David Sommers b46757735d convert.py : fix llama/llama2 conversion due to vocab_size=-1 (#5019) ...

PR #4818 (merged last week) reintroduced a config check for vocab_size that was addressed in PR #4258 (merged 2023-11-30).

Without the fix, llama2 models can't be converted. The error is:

`ValueError: The model's vocab size is set to -1 in params.json. Please update it manually. Maybe 32000?`

2024-01-18 19:20:59 +02:00

60 KiB

Executable File

Raw Blame History

View Raw