nopperl 9958c81b79 Implement the OLMo architecture (#6741) ...

* implement olmo architecture

* remove unused variable

* remove unused moe branch

* remove check for weight

* remove superfluous moe, bias and rope tensors

* clarified comment

* fix clamp_kqv setting

* remove obsolete parameter name filter

2024-04-19 11:35:54 +02:00

120 KiB

Executable File

Raw Blame History

View Raw