04:00
2026-07-13
machinebrief.com
large-language-models
Accelerating GPU Inference of Large Language Models with Moderately Unstructured Sparse Weight Matrices
Researchers propose a GPU inference method for large language models with moderate unstructured sparsity, using a three-layer matrix storage format and a SpMM kernel that jointly utilizes sparse tenso…