Skip to content

onnx: run MatMulNBits int4 through the fused Q4_0 block-quant matmul#2340

Open
czoli1976 wants to merge 1 commit into
sonos:mainfrom
czoli1976:feature/int4-matmulnbits-fused
Open

onnx: run MatMulNBits int4 through the fused Q4_0 block-quant matmul#2340
czoli1976 wants to merge 1 commit into
sonos:mainfrom
czoli1976:feature/int4-matmulnbits-fused

onnx: route MatMulNBits int4 through the fused Q4_0 block-quant matmul

aadd4e0
Select commit
Loading
Failed to load commit list.