logprobs
Sets the logprobs for the CompletionRequest.
Return
The updated Builder instance.
Parameters
logprobs
Include the log probabilities on the logprobs most likely tokens, as well as the chosen tokens.
Sets the logprobs for the CompletionRequest.
The updated Builder instance.
Include the log probabilities on the logprobs most likely tokens, as well as the chosen tokens.