Skip to main content

TensorRouteMeta Struct

Routing metadata that travels with a tensor through multi-output pipelines. More...

Declaration

struct simaai::neat::TensorRouteMeta { ... }

Included Headers

#include <TensorCore.h>

Public Member Attributes Index

std::stringstage_key

Producing stage's identifier. More...

intlogical_index = -1

Logical output index (user-facing). More...

intbackend_output_index = -1

Backend output index (per-stage; may differ from logical). More...

introute_slot = -1

Internal route-graph slot ID. More...

intphysical_index = -1

Physical memory index for packed outputs. More...

intmemory_index = -1

Underlying memory pool index. More...

int64_tphysical_byte_offset = 0

Byte offset within the physical allocation. More...

std::stringname

Logical (user-facing) name of this output tensor. More...

std::stringbackend_name

Backend (kernel-side) name of this output. More...

std::stringsegment_name

Memory segment name when packed outputs share an allocation. More...

Description

Routing metadata that travels with a tensor through multi-output pipelines.

Multi-head models produce multiple outputs that need to be matched back to logical tensor names. This struct carries the routing identity: which stage produced it (stage_key), what logical output index, where in physical memory, and the user-facing name. Most application code doesn't read this — it's used by the framework's pull machinery to assemble correct Sample payloads.

Definition at line 535 of file TensorCore.h.

Public Member Attributes

backend_name

std::string simaai::neat::TensorRouteMeta::backend_name

Backend (kernel-side) name of this output.

Definition at line 544 of file TensorCore.h.

544 std::string backend_name;

backend_output_index

int simaai::neat::TensorRouteMeta::backend_output_index = -1

Backend output index (per-stage; may differ from logical).

Definition at line 538 of file TensorCore.h.

logical_index

int simaai::neat::TensorRouteMeta::logical_index = -1

Logical output index (user-facing).

Definition at line 537 of file TensorCore.h.

537 int logical_index = -1;

memory_index

int simaai::neat::TensorRouteMeta::memory_index = -1

Underlying memory pool index.

Definition at line 541 of file TensorCore.h.

541 int memory_index = -1;

name

std::string simaai::neat::TensorRouteMeta::name

Logical (user-facing) name of this output tensor.

Definition at line 543 of file TensorCore.h.

543 std::string name;

physical_byte_offset

int64_t simaai::neat::TensorRouteMeta::physical_byte_offset = 0

Byte offset within the physical allocation.

Definition at line 542 of file TensorCore.h.

physical_index

int simaai::neat::TensorRouteMeta::physical_index = -1

Physical memory index for packed outputs.

Definition at line 540 of file TensorCore.h.

540 int physical_index = -1;

route_slot

int simaai::neat::TensorRouteMeta::route_slot = -1

Internal route-graph slot ID.

Definition at line 539 of file TensorCore.h.

539 int route_slot = -1;

segment_name

std::string simaai::neat::TensorRouteMeta::segment_name

Memory segment name when packed outputs share an allocation.

Definition at line 545 of file TensorCore.h.

545 std::string segment_name;

stage_key

std::string simaai::neat::TensorRouteMeta::stage_key

Producing stage's identifier.

Definition at line 536 of file TensorCore.h.

536 std::string stage_key;

The documentation for this struct was generated from the following file:


Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.9.8.