Skip to main content

InferenceTerminalPolicy Struct

Where the inference pipeline should terminate. More...

Declaration​

struct simaai::neat::Model::InferenceTerminalPolicy { ... }

Included Headers​

#include <Model.h>

Public Member Attributes Index​

boolmla_only = false

If true, terminate at the MLA stage; skip postprocess entirely. More...

std::optional< std::size_t >last_stage_index

Stop after this stage index (0-based, inclusive). More...

std::optional< std::string >last_stage_name

Stop after the named stage (matches MPK manifest stage name). More...

std::optional< std::string >last_plugin_id

Stop after the first stage using this plugin ID. More...

std::optional< std::string >last_processor

Stop after the first stage running on this processor (CVU/MLA/APU). More...

Description​

Where the inference pipeline should terminate.

Most pipelines run preprocess → MLA → postprocess. This policy lets advanced users stop earlier — for example, to inspect the raw MLA output before postprocessing, or to chain two models where the first one only needs to run through the MLA stage.

Definition at line 155 of file Model.h.

Public Member Attributes​

last_plugin_id​

std::optional<std::string> simaai::neat::Model::InferenceTerminalPolicy::last_plugin_id

Stop after the first stage using this plugin ID.

Definition at line 161 of file Model.h.

161 std::optional<std::string> last_plugin_id;

last_processor​

std::optional<std::string> simaai::neat::Model::InferenceTerminalPolicy::last_processor

Stop after the first stage running on this processor (CVU/MLA/APU).

Definition at line 163 of file Model.h.

163 last_processor;

last_stage_index​

std::optional<std::size_t> simaai::neat::Model::InferenceTerminalPolicy::last_stage_index

Stop after this stage index (0-based, inclusive).

Definition at line 158 of file Model.h.

158 last_stage_index;

last_stage_name​

std::optional<std::string> simaai::neat::Model::InferenceTerminalPolicy::last_stage_name

Stop after the named stage (matches MPK manifest stage name).

Definition at line 160 of file Model.h.

160 last_stage_name;

mla_only​

bool simaai::neat::Model::InferenceTerminalPolicy::mla_only = false

If true, terminate at the MLA stage; skip postprocess entirely.

Definition at line 156 of file Model.h.

156 bool mla_only = false;

The documentation for this struct was generated from the following file:

Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.9.8.