ModelInput
class mint.types.ModelInput ( StrictBase )¶
Fields:
- chunks ( List [ModelInputChunk ] ) – Sequence of input chunks (formerly TokenSequence)
from_ints ( tokens )¶
Create a ModelInput from a list of ints (tokens).
Parameters:
- tokens ( List[int] )
Returns: ModelInput
to_ints ()¶
Convert the ModelInput to a list of ints (tokens) Throws exception if there are any non-token chunks
Returns: List[int]
property length¶
Return the total context length used by this ModelInput.
Returns: int
empty ()¶
Create an empty ModelInput.
Returns: ModelInput
append ( chunk )¶
Add a new chunk, return a new ModelInput.
Parameters:
- chunk ( ModelInputChunk )
Returns: ModelInput
append_int ( token )¶
Add a new token, return a new ModelInput.
Parameters:
- token ( int )
Returns: ModelInput
Referenced by¶
- SamplingClient.compute_logprobs
- SamplingClient.sample
- mint.types.Datum