IP PortfolioCompute acceleratorsnpu

of_acc_attention

Transformer attention engine

Maturity plannedTargets FPGA + ASICDifficulty Very hardPriority 1

Tiled attention engine computing QK transpose, online softmax and the value product without materialising the score matrix, with causal and sliding-window masks.

Planned. This block is specified in the catalog with its interfaces and targets. No implementation exists yet; the skeleton command below generates a lint-clean shell with its ports and registers.

Interfaces

PortDirectionKindWidthNotes
ctrlin/outAXI4-Lite control bus32Control and status registers, including ID, VERSION and STATUS
irqoutinterrupt1Interrupt request
q_ininAXI4-Stream512 
kv_ininAXI4-Stream512 
o_outoutAXI4-Stream512 

Standards

No external standard applies.

More in npu

IDBlockMaturity
of_acc_systolic_gemmSystolic GEMM arrayplanned
of_acc_tpu_mxuTPU-style matrix unitplanned
of_acc_conv_engineConvolution engineplanned
of_acc_depthwise_convDepthwise and pointwise convolution unitplanned
of_acc_winograd_convWinograd convolution engineplanned
of_acc_kv_cache_mgrKV cache managerplanned
of_acc_softmaxSoftmax unitsimulated
of_acc_norm_unitLayerNorm and RMSNorm unitsimulated
of_acc_activationActivation function unitsimulated
of_acc_quantizerQuantise and dequantise unitsimulated