Skip to content

Latest commit

 

History

History
37 lines (32 loc) · 672 Bytes

sample.md

File metadata and controls

37 lines (32 loc) · 672 Bytes

Sampling Parameters

The defaults are okay for chatting.

Mirostat

Mirostat version 2 is the current default with the following parameters.

(temperature 0.7)
; Use Mirostat version 2.
(mirostat 2)
; Target entropy.
(mirostat_tau 5.0)
; Learning rate.
(mirostat_eta 0.1)

Top-K

(temperature 0.7)
; Turn Mirostat off.
(mirostat 0)
; Top-K Sampling (default is 1000).
(top_k 40)
; Top-P Sampling (default is 0.95).
(top_p 0.9)
; Min-P Sampling (default is 0.05).
(min_p 0.05)
; Locally Typical Sampling cutoff (default is 1.0, off).
(typical_p 0.9)

Misc

; Random seed (default is time-based, different every run).
(seed 1234)