Advanced Topic 40 of 51 Math for Computing
Numerical Methods
Approximate computation of mathematical problems.
How it works
Numerical methods are algorithms that approximate solutions to mathematical problems on computers where exact solutions are impractical: solving equations, integrating, interpolating, solving linear systems and differential equations, optimization and eigenvalue problems. They are analyzed by accuracy, stability, convergence rate and cost, taking into account truncation error from approximating the math and rounding error from finite precision. Conditioning describes how sensitive a problem is to input changes, while stability describes how an algorithm amplifies errors.
Where it is used
Scientific simulations, engineering design, graphics physics, finance, weather forecasting and machine learning rely on numerical methods, implemented in libraries such as LAPACK, NumPy and SciPy.
Common pitfall
Naive textbook formulas can be numerically unstable, such as the quadratic formula with cancellation. Choosing step sizes too small or too large degrades accuracy. Ill-conditioned problems cannot be solved accurately by any algorithm. Verify against known solutions, refine grids to check convergence and use established libraries.
Where it fits in the course
Numerical Methods is topic 40 of 51 in Math for Computing, rated Advanced. It follows Simplex Method. The next topic is Floating Point Error.
Practice and explore
- Open the interactive lesson, with a mini quiz.
- Take the Math for Computing quiz.
How to study this topic
- Read the explanation above and restate the definition in your own words.
- Open the interactive lesson and answer its mini quiz.
- Read the common pitfall, then write a short example that avoids it.
- Check your understanding in the Math for Computing quiz, and revisit the topic if you miss a question.
Frequently asked questions
What is Numerical Methods?
Where do people use Numerical Methods?
What is the most common mistake with Numerical Methods?
What should I learn before this topic?
How can I practice it?
Is Numerical Methods hard to learn?
How long does it take to learn Numerical Methods?
Which topics are related to Numerical Methods?
What should I study after Numerical Methods?
Related topics
- Simplex Method (Math for Computing)
- Floating Point Error (Math for Computing)
- Linear Programming (Math for Computing)
- Root Finding (Math for Computing)
- File Allocation Methods (Operating Systems)
- Research Methods in CS (Emerging & Frontier Topics)