sciwork 2026

Beyond Calling BLAS: Implementing and Optimizing Matrix Multiplication
2026-12-05, 11:00–11:30 (UTC), 403

Matrix multiplication may look like three nested loops or a single BLAS call, but implementing it efficiently in an array library requires more than a fast computational kernel. Shapes, strides, broadcasting, and operand reuse can change which execution strategy works best—even when the arithmetic workload remains the same.

This talk explores the implementation and optimization of matrix multiplication in Solvcon’s SimpleArray. We follow the path from direct computation to layout-aware execution, covering BLAS-compatible layouts, signed-stride operands, and batched matrix multiplication. Particular attention is given to small-matrix execution, reuse of broadcast operands, and the trade-offs between complete packing and streamed packing with reusable scratch storage. We also discuss how separating operation semantics, execution selection, and computation makes these optimizations easier to integrate and maintain.

To evaluate the implementation, we briefly demonstrate a Qt Benchmark Inspector and explain how identical operands, numerical comparisons, and balanced timing help assess performance improvements. The central lesson is that efficient matrix multiplication depends not only on kernel speed, but also on how data layout, reuse, and execution strategy fit together.

Chun-Shih Chang works in Acadamic Sininca. He is interested in machine learning, high performance computing and C++ software development.