7 Commits

Author	SHA1	Message	Date
Alex Renda	b061ba9e2a	llama : fix top-p sampling to match the canonical definition (#1953) ... * Fix top-p sampling to match the standard definition (smallest set that has probability mass at least p, not largest set with probability mass less than p) * top-p: correct gt to gte * add test for correct top-p behavior	2023-06-24 13:15:01 +03:00
Borislav Stanimirov	9cbf50c041	build : fix and ignore MSVC warnings (#1889)	2023-06-16 21:23:53 +03:00
Georgi Gerganov	6986c7835a	tests : add missing header	2023-05-19 21:17:28 +03:00
Georgi Gerganov	4b7e245adf	minor : fix compile warnings	2023-05-19 20:14:51 +03:00
Jed Fox	3924088512	Remove default arguments from sampling functions (#1343)	2023-05-06 17:01:47 -04:00
Georgi Gerganov	0e6cbff1b7	llama : fix compile warnings	2023-05-02 23:09:08 +03:00
Ivan Stepanov	dd7eff57d8	llama : new sampling algorithms (#1126) ... * Sample interface, new samplers. New samplers: - locally typical sampling - tail free sampling - frequency and presence penalty - mirostat Ignore EOS fix: -inf should be used. * mirostat * Added --logit-bias and --no-penalize-nl, removed std::span * Use C++11, clarify llama API documentation, rename Mirostat parameters to --mirostat_lr and --mirostat_ent, add temperature sampling for Mirostat, simplify Mirostat sampling API parameters (removed N and *k) Use C++11, clarify llama API documentation, rename Mirostat parameters to --mirostat_lr and --mirostat_ent, add temperature sampling for Mirostat, simplify Mirostat sampling API parameters (removed N and *k) * Save and load example adjust * Tests * Windows build fix * Windows test fix	2023-04-29 08:34:41 +03:00