Skip to main content

ProcessCvuOptions Struct

Simple process-CVU backend placement for model pre/post stages. More...

Declaration​

struct simaai::neat::ProcessCvuOptions { ... }

Included Headers​

#include <SessionOptions.h>

Public Member Attributes Index​

std::stringpre_run_target = "AUTO"
std::stringpost_run_target = "AUTO"
boolasync = true

Enable the prepared safe async processcvu submit path for model-managed CVU stages. More...

Description​

Simple process-CVU backend placement for model pre/post stages.

Use this when a model needs the pre-MLA CVU work and post-MLA CVU work on different devices. Accepted tokens are "AUTO", "EV74", and "A65" (case-insensitive, with compatibility aliases handled by the internal resolver).

Example:

 Model::Options opt;
 opt.processcvu.pre_run_target = "EV74";
 opt.processcvu.post_run_target = "A65";

Definition at line 213 of file SessionOptions.h.

Public Member Attributes​

async​

bool simaai::neat::ProcessCvuOptions::async = true

Enable the prepared safe async processcvu submit path for model-managed CVU stages.

Default true keeps multi-stage model routes throughput-first; set false, or use the plugin/env kill switches, to force the synchronous fallback.

Definition at line 221 of file SessionOptions.h.

221 bool async = true;

post_run_target​

std::string simaai::neat::ProcessCvuOptions::post_run_target = "AUTO"

Definition at line 215 of file SessionOptions.h.

215 std::string post_run_target = "AUTO";

pre_run_target​

std::string simaai::neat::ProcessCvuOptions::pre_run_target = "AUTO"

Definition at line 214 of file SessionOptions.h.

214 std::string pre_run_target = "AUTO";

The documentation for this struct was generated from the following file:

Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.9.8.