Quant Class

CVU kernel Node that quantizes FP32 tensors to INT8 using scale + zero-point. More...

Declaration

class simaai::neat::Quant { ... }

Included Headers

#include <Quant.h>

Base classes

class	Node
class	NodeContractProvider
class	NodeContractConfigurable

Public Constructors Index

	Quant (QuantOptions opt={})
	Construct with optional QuantOptions. More...

Public Member Functions Index

std::string	kind () const override
	Type label for this Node kind. More...
NodeCapsBehavior	caps_behavior () const override
	Whether the Node negotiates static or dynamic caps. More...
NodeContractDefinition	contract_definition () const override
	Structural contract definition for this Node. More...
bool	compile_node_contract (const ContractCompileInput &input, CompiledNodeContract *out, std::string *err) const override
	Compile this Node's contract from the given input. More...
void	apply_compiled_contract (const CompiledNodeContract &contract, std::string *err) override
	Apply a compiled contract back into this Node. More...
std::string	backend_fragment (int node_index) const override
	GStreamer fragment this Node emits. More...
std::vector< std::string >	element_names (int node_index) const override
	Deterministic element names this Node will create. More...
const nlohmann::json *	config_json () const
	Resolved kernel config JSON, or null if no config was supplied/loaded. More...
const QuantOptions &	options () const
	Inspect the Node's options. More...
const std::string &	config_path () const
	Path to the kernel config JSON, if one was loaded from disk. More...

Private Member Attributes Index

QuantOptions	opt_
std::shared_ptr< ConfigHolder >	config_holder_
std::string	config_path_

Description

CVU kernel Node that quantizes FP32 tensors to INT8 using scale + zero-point.

Inserted by the route planner at the MLA boundary on the INT8 input path. Application code rarely adds this directly — it appears via planner-generated routing or via a QuantTess fusion.

See Also

"The dtype contract" page in /concepts/dtype_contract

Definition at line 68 of file Quant.h.

Public Constructors

Quant()

simaai::neat::Quant::Quant (QuantOptions opt={})

explicit

Construct with optional QuantOptions.

Definition at line 71 of file Quant.h.

Public Member Functions

apply_compiled_contract()

void simaai::neat::Quant::apply_compiled_contract (const CompiledNodeContract & contract, std::string * err)

Apply a compiled contract back into this Node.

Definition at line 88 of file Quant.h.

backend_fragment()

std::string simaai::neat::Quant::backend_fragment (int node_index)

GStreamer fragment this Node emits.

Definition at line 90 of file Quant.h.

caps_behavior()

NodeCapsBehavior simaai::neat::Quant::caps_behavior ()

inline

Whether the Node negotiates static or dynamic caps.

Definition at line 79 of file Quant.h.

79 NodeCapsBehavior caps_behavior() const override {

80 return NodeCapsBehavior::Static;

81 }

compile_node_contract()

bool simaai::neat::Quant::compile_node_contract (const ContractCompileInput & input, CompiledNodeContract * out, std::string * err)

Compile this Node's contract from the given input.

Definition at line 85 of file Quant.h.

config_json()

const nlohmann::json * simaai::neat::Quant::config_json ()

Resolved kernel config JSON, or null if no config was supplied/loaded.

Definition at line 95 of file Quant.h.

config_path()

const std::string & simaai::neat::Quant::config_path ()

inline

Path to the kernel config JSON, if one was loaded from disk.

Definition at line 102 of file Quant.h.

102 const std::string& config_path() const {

103 return config_path_;

104 }

contract_definition()

NodeContractDefinition simaai::neat::Quant::contract_definition ()

Structural contract definition for this Node.

Definition at line 83 of file Quant.h.

element_names()

std::vector< std::string > simaai::neat::Quant::element_names (int node_index)

Deterministic element names this Node will create.

Definition at line 92 of file Quant.h.

kind()

std::string simaai::neat::Quant::kind ()

inline

Type label for this Node kind.

Definition at line 75 of file Quant.h.

75 std::string kind() const override {

76 return "Quant";

77 }

options()

const QuantOptions & simaai::neat::Quant::options ()

inline

Inspect the Node's options.

Definition at line 98 of file Quant.h.

98 const QuantOptions& options() const {

99 return opt_;

100 }

Private Member Attributes

config_holder_

std::shared_ptr<ConfigHolder> simaai::neat::Quant::config_holder_

Definition at line 112 of file Quant.h.

112 std::shared_ptr<ConfigHolder> config_holder_;

config_path_

std::string simaai::neat::Quant::config_path_

Definition at line 113 of file Quant.h.

113 std::string config_path_;

opt_

QuantOptions simaai::neat::Quant::opt_

Definition at line 111 of file Quant.h.

111 QuantOptions opt_;

---

The documentation for this class was generated from the following file:

• Quant.h

---

Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.9.8.