ProcessMlaOptions Struct

process-MLA execution options. More...

Declaration

struct simaai::neat::ProcessMlaOptions { ... }

Included Headers

#include <SessionOptions.h>

Public Member Attributes Index

bool	async = true
	Enable the safe async processmla submit/emit path. More...
int	output_pool_buffers = 0
	Optional processmla output pool size override. More...
bool	defer_output_invalidate = true
	For prepared MLASHM outputs, skip the immediate producer-side CPU invalidate and stamp the output metadata as device-produced/cpu-dirty. More...

Description

process-MLA execution options.

Definition at line 227 of file SessionOptions.h.

Public Member Attributes

async

bool simaai::neat::ProcessMlaOptions::async = true

Enable the safe async processmla submit/emit path.

Default true uses the optimized prepared async lane when the plugin/stage is eligible; set false, or use the plugin/env kill switches, to force the synchronous fallback.

Definition at line 231 of file SessionOptions.h.

231 bool async = true;

defer_output_invalidate

bool simaai::neat::ProcessMlaOptions::defer_output_invalidate = true

For prepared MLASHM outputs, skip the immediate producer-side CPU invalidate and stamp the output metadata as device-produced/cpu-dirty.

The framework runtime default is enabled so MLA->CVU/postprocess routes pay the invalidate only at the actual CPU consumer boundary. Manual low-level pipelines that expose raw MLA outputs to legacy CPU readers can still override the element property to false.

Definition at line 245 of file SessionOptions.h.

245 bool defer_output_invalidate = true;

output_pool_buffers

int simaai::neat::ProcessMlaOptions::output_pool_buffers = 0

Optional processmla output pool size override.

A value <= 0 leaves the runtime default in place. The framework runtime default is 4, matching model-managed CVU/MLA buffering and avoiding artificial backpressure while downstream stages still hold previous tensor-set outputs.

Definition at line 237 of file SessionOptions.h.

237 int output_pool_buffers = 0;

---

The documentation for this struct was generated from the following file:

• SessionOptions.h

---

Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.9.8.