Unsolved problems in computer science | Computer arithmetic algorithms | Matrix theory | Computational complexity theory

Computational complexity of matrix multiplication

In theoretical computer science, the computational complexity of matrix multiplication dictates how quickly the operation of matrix multiplication can be performed. Matrix multiplication algorithms are a central subroutine in theoretical and numerical algorithms for numerical linear algebra and optimization, so finding the right amount of time it should take is of major practical relevance. Directly applying the mathematical definition of matrix multiplication gives an algorithm that requires n3 field operations to multiply two n × n matrices over that field (Θ(n3) in big O notation). Surprisingly, algorithms exist that provide better running times than this straightforward "schoolbook algorithm". The first to be discovered was Strassen's algorithm, devised by Volker Strassen in 1969 and often referred to as "fast matrix multiplication". The optimal number of field operations needed to multiply two square n × n matrices up to constant factors is still unknown. This is a major open question in theoretical computer science. As of October 2022, the best announced bound on the asymptotic complexity of a matrix multiplication algorithm is O(n2.37188) time, given by Duan, Wu and Zhou announced in a preprint. This improves on the bound of O(n2.3728596) time, given by Josh Alman and Virginia Vassilevska Williams. However, this and similar improvements to Strassen are not used in practice, because they are galactic algorithms: the constant coefficient hidden by the Big O notation is so large that they are only worthwhile for matrices that are too large to handle on present-day computers. (Wikipedia).

Computational complexity of matrix multiplication
Video thumbnail

Matrix Addition, Subtraction, and Scalar Multiplication

This video shows how to add, subtract and perform scalar multiplication with matrices. http://mathispower4u.yolasite.com/ http://mathispower4u.wordpress.com/

From playlist Introduction to Matrices and Matrix Operations

Video thumbnail

Matrix Multiplication

This video explains how to multiply matrices. http://mathispower4u.yolasite.com/ http://mathispower4u.wordpress.com/

From playlist Matrices

Video thumbnail

Matrix Multiplication

This is the second video of a series from the Worldwide Center of Mathematics explaining the basics of matrices. This video deals with multiplying two matrices. For more math videos, visit our channel or go to www.centerofmath.org

From playlist Basics: Matrices

Video thumbnail

Ex 1: Matrix Multiplication (Basic)

This video provides examples of matrix multiplication. One example is defined and one example is undefined. Site: http://mathispower4u.com

From playlist Introduction to Matrices and Matrix Operations

Video thumbnail

How do you multiply matrices?

► My Precalculus course: https://www.kristakingmath.com/precalculus-course In this video we’re talking about everything you need to know about matrix multiplication. We’ll start simple and look at what it means to multiply a matrix by a scalar, and then move on to multiplying matrices tog

From playlist Popular Questions

Video thumbnail

4.4.5 Matrix-matrix multiplication: Cost

4.4.5 Matrix-matrix multiplication: Cost

From playlist LAFF - Week 4

Video thumbnail

Matrix Addition and Scalar Multiplication

This is the first video of a series from the Worldwide Center of Mathematics explaining the basics of matrices. This video deals with matrix dimensions, matrix addition, and scalar multiplication. For more math videos, visit our channel or go to www.centerofmath.org

From playlist Basics: Matrices

Video thumbnail

On Matrix Multiplication and Polynomial Identity Testing - Robert Andrews

Computer Science/Discrete Mathematics Seminar I Topic: On Matrix Multiplication and Polynomial Identity Testing Speaker: Robert Andrews Affiliation: University of Illinois Urbana-Champaign Date: January 30, 2023 Determining the complexity of matrix multiplication is a fundamental problem

From playlist Mathematics

Video thumbnail

Mod-05 Lec-28 General Systems Continued and Non-homogeneous Systems

Ordinary Differential Equations and Applications by A. K. Nandakumaran,P. S. Datti & Raju K. George,Department of Mathematics,IISc Bangalore.For more details on NPTEL visit http://nptel.ac.in.

From playlist IISc Bangalore: Ordinary Differential Equations and Applications | CosmoLearning.org Mathematics

Video thumbnail

The Lie-algebra of Quaternion algebras and their Lie-subalgebras

In this video we discuss the Lie-algebras of general quaternion algebras over general fields, especially as the Lie-algebra is naturally given for 2x2 representations. The video follows a longer video I previously did on quaternions, but this time I focus on the Lie-algebra operation. I st

From playlist Algebra

Video thumbnail

12.3.2 Eigenvalues of n x n matrices

12.3.2 Eigenvalues of n x n matrices

From playlist LAFF - Week 12

Video thumbnail

Set Theory (Part 14b): Quaternions and 3D Rotations

No background in sets needed for this video - learn about the foundations of quaternions, derivation of the Hamilton product, and their application to 3D rotations. We will also see how dot and cross products are related to quaternion math. This video will be of particular interest to comp

From playlist Set Theory by Mathoma

Video thumbnail

Matej Balog - AlphaTensor: Discover faster matrix multiplication algorithms with RL - IPAM at UCLA

Recorded 27 February 2023. Matej Balog of DeepMind presents "AlphaTensor: Discovering faster matrix multiplication algorithms with RL" at IPAM's Artificial Intelligence and Discrete Optimization Workshop. Abstract: Improving the efficiency of algorithms for fundamental computational tasks

From playlist 2023 Artificial Intelligence and Discrete Optimization

Video thumbnail

Tensor Rank - Avi Wigderson

Computer Science/Discrete Mathematics Reading Seminar Topic: Tensor Rank Speaker: Avi Wigderson Affiliation: IAS, Herbert H. Maass Professor, School of Mathematics Date: June 22, 2021 Tensors occur throughout mathematics. Their rank, defined in analogy with matrix rank, is however much

From playlist Mathematics

Video thumbnail

Solving Laplacian Systems of Directed Graphs - John Peebles

Computer Science/Discrete Mathematics Seminar II Topic: Solving Laplacian Systems of Directed Graphs Speaker: John Peebles Affiliation: Member, School of Mathematics Date: March 02, 2021 For more video please visit http://video.ias.edu

From playlist Mathematics

Video thumbnail

Ex 2: Matrix Multiplication (2x3)*(3x2)

This video provides an example of matrix multiplication. Site: http://mathispower4u.com

From playlist Introduction to Matrices and Matrix Operations

Video thumbnail

Determinant of an Operator and of a Matrix

Determinant of an operator. An operator is not invertible if and only if its determinant equals 0. Formula for the characteristic polynomial in terms of determinants. Determinant of a matrix. Connection between the two notions of determinant.

From playlist Linear Algebra Done Right

Video thumbnail

Matrix multiplication (part 2)

More on multiplying matrices.

From playlist Linear Algebra

Video thumbnail

Tensor rank - Avi Wigderson

Computer Science/Discrete Mathematics Seminar II Topic: Tensor rank Speaker: Avi Wigderson Herbert H. Maass Professor, School of Mathematics Date: Oct 2, 2018 For more video please visit http://video.ias.edu

From playlist Mathematics

Related pages

Monte Carlo algorithm | Abelian group | Strassen algorithm | Galactic algorithm | Finite field | Theoretical computer science | Block matrix | Freivalds' algorithm | Matrix multiplication algorithm | LU decomposition | Big O notation | Computational complexity of mathematical operations | Wreath product | Smith normal form | Computational complexity | Model of computation | Sunflower conjecture | Determinant | Gaussian elimination | Numerical stability | Divide-and-conquer algorithm | Sparse matrix–vector multiplication | Matrix chain multiplication | Duality (optimization) | Field (mathematics) | Hermite normal form | Numerical linear algebra | Group theory | Shmuel Winograd | Basic Linear Algebra Subprograms | Arithmetic circuit complexity | Time complexity | Triple product property | Matrix multiplication | Worst-case complexity | Algorithm | Analysis of algorithms | CYK algorithm