Georgi Gerganov 806d397c1a parallel : try smaller batches when the KV cache is fragmented

2023-09-19 13:21:36 +03:00

..

baby-llama

Merge branch 'master' into custom-attention-mask

2023-09-18 11:15:18 +03:00

beam-search

llama : add new llama_decode() API that works with llama_batch

2023-09-18 14:23:52 +03:00

benchmark

examples : add compiler version and target to build info (#2998)

2023-09-15 16:59:49 -04:00

convert-llama2c-to-ggml

check C++ code with -Wmissing-declarations (#3184)

2023-09-15 15:38:27 -04:00

embd-input

llama : extend batch API to select which logits to output

2023-09-19 00:24:13 +03:00

embedding

llama : add new llama_decode() API that works with llama_batch

2023-09-18 14:23:52 +03:00

gguf

check C++ code with -Wmissing-declarations (#3184)

2023-09-15 15:38:27 -04:00

gptneox-wip

fix some warnings from gcc and clang-tidy (#3038)

2023-09-07 13:22:29 -04:00

jeopardy

chmod : make scripts executable (#2675)

2023-08-23 17:29:09 +03:00

llama-bench

llama : fix worst case graph build

2023-09-19 11:05:08 +03:00

main

parallel : example for serving multiple users in parallel

2023-09-18 20:37:28 +03:00

main-cmake-pkg

cmake : add relocatable Llama package (#2960)

2023-09-14 20:04:40 +03:00

metal

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

parallel

parallel : try smaller batches when the KV cache is fragmented

2023-09-19 13:21:36 +03:00

perplexity

parallel : example for serving multiple users in parallel

2023-09-18 20:37:28 +03:00

quantize

examples : add compiler version and target to build info (#2998)

2023-09-15 16:59:49 -04:00

quantize-stats

examples : add compiler version and target to build info (#2998)

2023-09-15 16:59:49 -04:00

save-load-state

llama : add new llama_decode() API that works with llama_batch

2023-09-18 14:23:52 +03:00

server

llama : add new llama_decode() API that works with llama_batch

2023-09-18 14:23:52 +03:00

simple

simple : fix token counting

2023-09-19 11:45:33 +03:00

speculative

fixes : speculative KV cache + llama worst-case graph

2023-09-18 22:32:28 +03:00

train-text-from-scratch

Merge branch 'master' into custom-attention-mask

2023-09-18 11:15:18 +03:00

alpaca.sh

…

chat-13B.bat

…

chat-13B.sh

…

chat-persistent.sh

…

chat-vicuna.sh

…

chat.sh

main : log file (#2748)

2023-08-30 09:29:32 +03:00

CMakeLists.txt

parallel : example for serving multiple users in parallel

2023-09-18 20:37:28 +03:00

gpt4all.sh

…

json-schema-to-grammar.py

chmod : make scripts executable (#2675)

2023-08-23 17:29:09 +03:00

llama2-13b.sh

gitignore : changes for Poetry users + chat examples (#2284)

2023-07-21 13:53:27 +03:00

llama2.sh

gitignore : changes for Poetry users + chat examples (#2284)

2023-07-21 13:53:27 +03:00

llama.vim

vim : streaming and more (#2495)

2023-08-08 14:44:48 +03:00

llm.vim

llm.vim : stop generation at multiple linebreaks, bind to <F2> (#2879)

2023-08-30 09:50:55 +03:00

make-ggml.py

chmod : make scripts executable (#2675)

2023-08-23 17:29:09 +03:00

Miku.sh

MIKU MAYHEM: Upgrading the Default Model for Maximum Fun 🎉 (#2287)

2023-07-21 11:13:18 +03:00

reason-act.sh

chmod : make scripts executable (#2675)

2023-08-23 17:29:09 +03:00

server-llama2-13B.sh

chmod : make scripts executable (#2675)

2023-08-23 17:29:09 +03:00