Beginner Topic 9 of 51 Math for Computing
Matrix Multiplication
Combining matrices by row-column products.
How it works
The product of an m by n matrix A and an n by p matrix B is an m by p matrix C whose entry c(i,j) is the dot product of row i of A with column j of B. It composes linear transformations: applying B and then A equals applying the product AB. It is associative and distributive but not commutative. The naive algorithm takes O(mnp) operations, while Strassen's and later algorithms reduce the exponent for large square matrices, and blocked and parallel implementations optimize cache and hardware use.
Where it is used
Graphics transformation pipelines, neural network layers, which are mostly matrix multiplications on GPUs, path counting in graphs, solving systems and scientific simulation depend on fast matrix multiplication.
Common pitfall
Order matters, AB differs from BA, and the inner dimensions must match. Memory access order affects performance by large factors due to caching. Accumulating floating-point errors in long products happens. Use vendor-optimized libraries, avoid explicit loops in high-level languages and consider sparse formats for mostly-zero matrices.
Where it fits in the course
Matrix Multiplication is topic 9 of 51 in Math for Computing, rated Beginner. It follows Matrices. The next topic is Determinants.
Practice and explore
- Open the interactive lesson, with a mini quiz.
- Take the Math for Computing quiz.
How to study this topic
- Read the explanation above and restate the definition in your own words.
- Open the interactive lesson and answer its mini quiz.
- Read the common pitfall, then write a short example that avoids it.
- Check your understanding in the Math for Computing quiz, and revisit the topic if you miss a question.
Frequently asked questions
What is Matrix Multiplication?
Where do people use Matrix Multiplication?
What is the most common mistake with Matrix Multiplication?
What should I learn before this topic?
How can I practice it?
Is Matrix Multiplication hard to learn?
How long does it take to learn Matrix Multiplication?
Which topics are related to Matrix Multiplication?
What should I study after Matrix Multiplication?
Related topics
- Matrices (Math for Computing)
- Determinants (Math for Computing)
- Dot Product (Math for Computing)
- Probability Basics (Math for Computing)
- Confusion Matrix (AI & Machine Learning)
- Adjacency Matrix (Data Structures)