IP PortfolioCompute acceleratorsnpu

of_acc_norm_unit

LayerNorm and RMSNorm unit

Maturity simulatedTargets FPGA + ASICDifficulty MediumPriority 1

Two-pass or Welford streaming normalisation with learned scale and bias for transformer and CNN layers.

Simulated. The RTL is lint clean and passes its self-checking testbench against a reference model in simulation. It has not been run on an FPGA board or in silicon.

Interfaces

PortDirectionKindWidthNotes
ctrlin/outAPB control bus32Control and status registers, including ID, VERSION and STATUS
irqoutinterrupt1Interrupt request
x_ininAXI4-Stream256 
y_outoutAXI4-Stream256 

Standards

  • IEEE 754-2019

More in npu

IDBlockMaturity
of_acc_systolic_gemmSystolic GEMM arrayplanned
of_acc_tpu_mxuTPU-style matrix unitplanned
of_acc_conv_engineConvolution engineplanned
of_acc_depthwise_convDepthwise and pointwise convolution unitplanned
of_acc_winograd_convWinograd convolution engineplanned
of_acc_attentionTransformer attention engineplanned
of_acc_kv_cache_mgrKV cache managerplanned
of_acc_softmaxSoftmax unitsimulated
of_acc_activationActivation function unitsimulated
of_acc_quantizerQuantise and dequantise unitsimulated