mirror of
https://github.com/ggml-org/llama.cpp.git
synced 2025-10-27 08:21:30 +00:00
70cd37dbbe
* requirements : update transformers/torch for Embedding Gemma
This commit updates the requirements to support converting
Embedding Gemma 300m models.
The motivation for this change is that during development I had a local
copy of the transformers package which is what I used for converting
the models. This was a mistake on my part and I should have also updated
my transformers version to the official release.
I had checked the requirements/requirements-convert_legacy_llama.txt
file and noted that the version was >=4.45.1,<5.0.0 and came to the
conculusion that no updated would be needed, this assumed that
Embedding Gemma would be in a transformers release at the time
Commit fb15d649ed ("llama : add support
for EmbeddingGemma 300m (#15798)) was merged. So anyone wanting to
convert themselves would be able to do so. However, Embedding Gemma is
a preview release and this commit updates the requirements to use this
preview release.
* resolve additional python dependencies
* fix pyright errors in tokenizer test and remove unused import
15 lines
475 B
Plaintext
15 lines
475 B
Plaintext
numpy~=1.26.4
|
|
sentencepiece~=0.2.0
|
|
|
|
# Embedding Gemma is currently a preview release:
|
|
# https://github.com/huggingface/transformers/releases/tag/v4.56.0-Embedding-Gemma-preview
|
|
|
|
# The version is needed to be able to convert Embedding Gemma models to GGUF format:
|
|
git+https://github.com/huggingface/transformers@v4.56.0-Embedding-Gemma-preview
|
|
|
|
# Once Embedding Gemma is officially released, we can switch to:
|
|
#transformers>=4.57.1,<5.0.0
|
|
|
|
gguf>=0.1.0
|
|
protobuf>=4.21.0,<5.0.0
|