Skip to main content

Producer Class

Declaration

class simaai::neat::genai::GenerationStream::Producer { ... }

Friends Index

structImpl

Private Constructors Index

Producer (Impl &impl)

Public Member Functions Index

voidrecord_metric (const std::string &metric, double value)
voidrecord_text (const std::string &text, bool stream_end)
voidpush (TokenSample sample)
voidfinish (std::string finish_reason, std::optional< std::uint32_t > generated_tokens)
boolcancelled () const
GenerationMetricscurrent_metrics () const

Private Member Attributes Index

Impl &impl_

Definition at line 173 of file GenAITypes.h.

Friends

Impl

friend struct Impl

Definition at line 187 of file GenAITypes.h.

187 friend struct Impl;

Private Constructors

Producer()

simaai::neat::genai::GenerationStream::Producer::Producer (Impl & impl)
explicit

Definition at line 183 of file GenAITypes.h.

Public Member Functions

cancelled()

bool simaai::neat::genai::GenerationStream::Producer::cancelled ()

Definition at line 179 of file GenAITypes.h.

current_metrics()

GenerationMetrics simaai::neat::genai::GenerationStream::Producer::current_metrics ()

Definition at line 180 of file GenAITypes.h.

finish()

void simaai::neat::genai::GenerationStream::Producer::finish (std::string finish_reason, std::optional< std::uint32_t > generated_tokens)

Definition at line 178 of file GenAITypes.h.

push()

void simaai::neat::genai::GenerationStream::Producer::push (TokenSample sample)

Definition at line 177 of file GenAITypes.h.

record_metric()

void simaai::neat::genai::GenerationStream::Producer::record_metric (const std::string & metric, double value)

Definition at line 175 of file GenAITypes.h.

record_text()

void simaai::neat::genai::GenerationStream::Producer::record_text (const std::string & text, bool stream_end)

Definition at line 176 of file GenAITypes.h.

Private Member Attributes

impl_

Impl& simaai::neat::genai::GenerationStream::Producer::impl_

Definition at line 185 of file GenAITypes.h.

185 Impl& impl_;

The documentation for this class was generated from the following file:


Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.9.8.