TensorRouteMeta Struct
Routing metadata that travels with a tensor through multi-output pipelines. More...
Declaration
Included Headers
Public Member Attributes Index
| std::string | stage_key |
|
Producing stage's identifier. More... | |
| int | logical_index = -1 |
|
Logical output index (user-facing). More... | |
| int | backend_output_index = -1 |
|
Backend output index (per-stage; may differ from logical). More... | |
| int | route_slot = -1 |
|
Internal route-graph slot ID. More... | |
| int | physical_index = -1 |
|
Physical memory index for packed outputs. More... | |
| int | memory_index = -1 |
|
Underlying memory pool index. More... | |
| int64_t | physical_byte_offset = 0 |
|
Byte offset within the physical allocation. More... | |
| std::string | name |
|
Logical (user-facing) name of this output tensor. More... | |
| std::string | backend_name |
|
Backend (kernel-side) name of this output. More... | |
| std::string | segment_name |
|
Memory segment name when packed outputs share an allocation. More... | |
Description
Routing metadata that travels with a tensor through multi-output pipelines.
Multi-head models produce multiple outputs that need to be matched back to logical tensor names. This struct carries the routing identity: which stage produced it (stage_key), what logical output index, where in physical memory, and the user-facing name. Most application code doesn't read this — it's used by the framework's pull machinery to assemble correct Sample payloads.
Definition at line 535 of file TensorCore.h.
Public Member Attributes
backend_name
|
Backend (kernel-side) name of this output.
Definition at line 544 of file TensorCore.h.
backend_output_index
|
Backend output index (per-stage; may differ from logical).
Definition at line 538 of file TensorCore.h.
logical_index
|
Logical output index (user-facing).
Definition at line 537 of file TensorCore.h.
memory_index
|
Underlying memory pool index.
Definition at line 541 of file TensorCore.h.
name
|
Logical (user-facing) name of this output tensor.
Definition at line 543 of file TensorCore.h.
physical_byte_offset
|
Byte offset within the physical allocation.
Definition at line 542 of file TensorCore.h.
physical_index
|
Physical memory index for packed outputs.
Definition at line 540 of file TensorCore.h.
route_slot
|
segment_name
|
Memory segment name when packed outputs share an allocation.
Definition at line 545 of file TensorCore.h.
stage_key
|
Producing stage's identifier.
Definition at line 536 of file TensorCore.h.
The documentation for this struct was generated from the following file:
Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.9.8.