IP PortfolioCompute acceleratorsnpu

of_acc_systolic_gemm

Systolic GEMM array

Maturity plannedTargets FPGA + ASICDifficulty HardPriority 1

Parameterised weight- or output-stationary systolic array for INT8, BF16 and FP16 matrix multiply with local scratchpad and accumulator memories.

Planned. This block is specified in the catalog with its interfaces and targets. No implementation exists yet; the skeleton command below generates a lint-clean shell with its ports and registers.

Interfaces

PortDirectionKindWidthNotes
ctrlin/outAXI4-Lite control bus32Control and status registers, including ID, VERSION and STATUS
irqoutinterrupt1Interrupt request
a_ininAXI4-Stream256 
b_ininAXI4-Stream256 
c_outoutAXI4-Stream512 

Standards

  • IEEE 754-2019

Basis projects

Permissive open projects the implementation may build on.

More in npu

IDBlockMaturity
of_acc_tpu_mxuTPU-style matrix unitplanned
of_acc_conv_engineConvolution engineplanned
of_acc_depthwise_convDepthwise and pointwise convolution unitplanned
of_acc_winograd_convWinograd convolution engineplanned
of_acc_attentionTransformer attention engineplanned
of_acc_kv_cache_mgrKV cache managerplanned
of_acc_softmaxSoftmax unitsimulated
of_acc_norm_unitLayerNorm and RMSNorm unitsimulated
of_acc_activationActivation function unitsimulated
of_acc_quantizerQuantise and dequantise unitsimulated