Struct InferenceResponse

pub struct InferenceResponse { /* private fields */ }

Unified response structure for AI inference requests

This struct provides a consistent interface for responses from different AI providers, normalizing the various response formats into a single, easy-to-use structure.

Implementations

impl InferenceResponse

pub fn text(&self) -> &str

Get the generated text content

pub fn input_tokens(&self) -> u32

Get the number of input tokens used

pub fn output_tokens(&self) -> u32

Get the number of output tokens generated

pub fn total_tokens(&self) -> u32

Get the total tokens used (input + output)

pub fn response_time_ms(&self) -> u128

Get the response time in milliseconds

pub fn finish(self) -> String

Consume the response and return the text content

This is useful when you want to take ownership of the text content without cloning it.

Trait Implementations

impl Debug for InferenceResponse

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for InferenceResponse

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for InferenceResponse

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.