TopKPromptLogprobs
class mint.types.TopkPromptLogprobs ()¶
Top-k most likely tokens at each prompt position, as dense numpy matrices.
Both matrices have shape (prompt_length, k) where k is the number
of top tokens requested. Empty positions are filled with sentinel values
( token_id=0 , logprob=-99999.0 ).
Fields:
- token_ids ( np.ndarray ) β int32 matrix of token IDs, shape
(prompt_length, k). - logprobs ( np.ndarray ) β float32 matrix of log probabilities, shape
(prompt_length, k).
Referenced by¶
- mint.types.SampleResponse