Georgi Gerganov 13b339bcd9 server : do not default to multiple slots with speculative decoding (#17017) ...

* server : do not default to multiple slots with speculative decoding

* cont : fix

2025-11-05 14:32:55 +02:00

..

arg.cpp

mtmd: add --image-min/max-tokens (#16921)

2025-11-03 11:11:18 +01:00

arg.h

common : remove common_has_curl() (#16351)

2025-09-30 17:39:44 +03:00

base64.hpp

llava : expose as a shared library for downstream projects (#3613)

2023-11-07 00:36:23 +03:00

build-info.cpp.in

cmake: Add ability to pass in LLAMA_BUILD_NUMBER/COMMIT (#14167)

2025-06-13 10:38:52 +02:00

chat-parser.cpp

common : handle unicode during partial json parsing (#16526)

2025-10-12 16:18:47 +03:00

chat-parser.h

model : Apertus model implementation (#15852)

2025-10-02 20:43:22 +03:00

chat.cpp

common : move gpt-oss reasoning processing to init params (#16937)

2025-11-02 16:56:28 +02:00

chat.h

chat: Add LFM2 tool handling (#16763)

2025-10-27 23:54:01 +01:00

CMakeLists.txt

common: introduce http.h for httplib-based client (#16373)

2025-10-01 20:22:18 +03:00

common.cpp

llama : add --no-host to disable host buffers (#16310)

2025-10-06 19:55:53 +02:00

common.h

server : do not default to multiple slots with speculative decoding (#17017)

2025-11-05 14:32:55 +02:00

console.cpp

console : utf-8 fix for windows stdin (#9690)

2024-09-30 11:23:42 +03:00

console.h

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

http.h

common: introduce http.h for httplib-based client (#16373)

2025-10-01 20:22:18 +03:00

json-partial.cpp

common : handle unicode during partial json parsing (#16526)

2025-10-12 16:18:47 +03:00

json-partial.h

sync : vendor (#13901)

2025-05-30 16:25:45 +03:00

json-schema-to-grammar.cpp

grammar : support array references in json schema (#16792)

2025-10-28 09:37:52 +01:00

json-schema-to-grammar.h

sync : vendor (#13901)

2025-05-30 16:25:45 +03:00

llguidance.cpp

llguidance : set tokenizer slices to default (#13424)

2025-05-10 17:19:52 +02:00

log.cpp

Implement --log-colors with always/never/auto (#15792)

2025-09-05 19:43:59 +01:00

log.h

Implement --log-colors with always/never/auto (#15792)

2025-09-05 19:43:59 +01:00

ngram-cache.cpp

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

ngram-cache.h

llama : use LLAMA_TOKEN_NULL (#11062)

2025-01-06 10:52:15 +02:00

regex-partial.cpp

common: add partial regex support (#12808)

2025-05-14 19:50:57 +01:00

regex-partial.h

common: add partial regex support (#12808)

2025-05-14 19:50:57 +01:00

sampling.cpp

llama: print memory breakdown on exit (#15860)

2025-09-24 16:53:48 +02:00

sampling.h

sampling : optimize samplers by reusing bucket sort (#15665)

2025-08-31 20:41:02 +03:00

speculative.cpp

sampling : optimize samplers by reusing bucket sort (#15665)

2025-08-31 20:41:02 +03:00

speculative.h

server : implement universal assisted decoding (#12635)

2025-07-31 14:25:23 +02:00