SamplingParams

class mint.types.SamplingParams ( BaseModel )¶

Fields:

max_tokens ( Optional[int] ) – Maximum number of tokens to generate
seed ( Optional[int] ) – Random seed for reproducible generation
stop ( Union[str, Sequence[str], Sequence[int], None] ) – Stop sequences for generation
temperature ( float ) – Sampling temperature
top_k ( int ) – Top-k sampling parameter (-1 for no limit)
top_p ( float ) – Nucleus sampling probability