InferOptions Struct

Tunables for the preprocess and combined-infer groups. More...

Declaration

struct simaai::neat::nodes::groups::InferOptions { ... }

Included Headers

#include <ModelGroups.h>

Public Member Attributes Index

PreprocessColorFormat	input_format = ...
	Color format the model expects. More...
bool	normalize = false
	If true, apply (x - mean) / stddev normalization. More...
std::vector< float >	mean
	Per-channel mean used when normalize is true. More...
std::vector< float >	stddev
	Per-channel stddev used when normalize is true. More...
std::string	upstream_name
	Name of the upstream Node the preprocess attaches to. More...
std::string	preproc_next_cpu
	Optional CPU-side next-element override after preprocess. More...
int	num_buffers_cvu = 4
	CVU-side buffer pool depth for preprocess. More...
int	num_buffers_mla = 4
	MLA-side buffer pool depth for inference. More...
int	queue_max_buffers = 0
	Cap on queued buffers (0 = default). More...
int64_t	queue_max_time_ns = -1
	Cap on queued time in ns (-1 = unset). More...
std::string	queue_leaky
	Queue leaky policy ("upstream", "downstream", or empty). More...
bool	sync_mode = false
	If true, run sinks in sync (real-time) mode. More...

Description

Tunables for the preprocess and combined-infer groups.

Selects the input color format expected by the model, optional mean/stddev normalization, and the upstream-side queueing / buffering policy applied at the preprocess and MLA boundaries.

Definition at line 38 of file ModelGroups.h.

Public Member Attributes

input_format

PreprocessColorFormat simaai::neat::nodes::groups::InferOptions::input_format

Color format the model expects.

Initialiser

= PreprocessColorFormat::Auto

Definition at line 39 of file ModelGroups.h.

39 PreprocessColorFormat input_format =

mean

std::vector<float> simaai::neat::nodes::groups::InferOptions::mean

Per-channel mean used when normalize is true.

Definition at line 42 of file ModelGroups.h.

42 std::vector<float> mean;

normalize

bool simaai::neat::nodes::groups::InferOptions::normalize = false

If true, apply (x - mean) / stddev normalization.

Definition at line 41 of file ModelGroups.h.

41 bool normalize = false;

num_buffers_cvu

int simaai::neat::nodes::groups::InferOptions::num_buffers_cvu = 4

CVU-side buffer pool depth for preprocess.

Definition at line 46 of file ModelGroups.h.

46 int num_buffers_cvu = 4;

num_buffers_mla

int simaai::neat::nodes::groups::InferOptions::num_buffers_mla = 4

MLA-side buffer pool depth for inference.

Definition at line 47 of file ModelGroups.h.

47 int num_buffers_mla = 4;

preproc_next_cpu

std::string simaai::neat::nodes::groups::InferOptions::preproc_next_cpu

Optional CPU-side next-element override after preprocess.

Definition at line 45 of file ModelGroups.h.

45 std::string preproc_next_cpu;

queue_leaky

std::string simaai::neat::nodes::groups::InferOptions::queue_leaky

Queue leaky policy ("upstream", "downstream", or empty).

Definition at line 50 of file ModelGroups.h.

50 std::string queue_leaky;

queue_max_buffers

int simaai::neat::nodes::groups::InferOptions::queue_max_buffers = 0

Cap on queued buffers (0 = default).

Definition at line 48 of file ModelGroups.h.

48 int queue_max_buffers = 0;

queue_max_time_ns

int64_t simaai::neat::nodes::groups::InferOptions::queue_max_time_ns = -1

Cap on queued time in ns (-1 = unset).

Definition at line 49 of file ModelGroups.h.

49 int64_t queue_max_time_ns = -1;

stddev

std::vector<float> simaai::neat::nodes::groups::InferOptions::stddev

Per-channel stddev used when normalize is true.

Definition at line 43 of file ModelGroups.h.

43 std::vector<float> stddev;

sync_mode

bool simaai::neat::nodes::groups::InferOptions::sync_mode = false

If true, run sinks in sync (real-time) mode.

Definition at line 51 of file ModelGroups.h.

51 bool sync_mode = false;

upstream_name

std::string simaai::neat::nodes::groups::InferOptions::upstream_name

Name of the upstream Node the preprocess attaches to.

Definition at line 44 of file ModelGroups.h.

44 std::string upstream_name;

---

The documentation for this struct was generated from the following file:

• ModelGroups.h

---

Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.9.8.