SamplingPrefillBillingEvent
class mint.types.SamplingPrefillBillingEvent ( StrictBase )¶
Prompt (prefill) tokens processed while sampling.
Fields:
- type ( Literal['sampling_prefill'] )
- cached ( bool ) β True when the tokens were served from the prefill cache (billed at the discounted cached rate); False for full-rate prefill
- token_count ( int ) β Prefill token count for the bucket