LearnViz CompSci
Home / Learn / Math for Computing / Partial Derivatives and Gradients

Intermediate Topic 32 of 51 Math for Computing

Partial Derivatives and Gradients

Multivariable slopes pointing uphill.

How it works

A partial derivative measures how a multivariable function changes with respect to one variable while holding the others fixed. The gradient is the vector of all partial derivatives, pointing in the direction of steepest increase, with magnitude equal to the rate of increase, and it is perpendicular to level sets. The Jacobian collects derivatives of vector-valued functions, and the Hessian matrix of second partials describes curvature. The multivariable chain rule combines them.

Where it is used

Gradient descent for training machine-learning models, backpropagation, optimization in economics and engineering, fluid and heat flow and computing surface normals in graphics use gradients.

Common pitfall

Moving along the negative gradient reduces the function only locally, so the step size matters. Gradients vanish at saddle points as well as minima, so check the Hessian. Non-differentiable points, as with ReLU or absolute value, require subgradients. Dimensions and shapes of Jacobians are easy to confuse. Verify gradients numerically with finite differences when implementing by hand.

Where it fits in the course

Partial Derivatives and Gradients is topic 32 of 51 in Math for Computing, rated Intermediate. It follows Derivatives. The next topic is Integrals.

Practice and explore

How to study this topic

  1. Read the explanation above and restate the definition in your own words.
  2. Open the interactive lesson and answer its mini quiz.
  3. Read the common pitfall, then write a short example that avoids it.
  4. Check your understanding in the Math for Computing quiz, and revisit the topic if you miss a question.

Frequently asked questions

What is Partial Derivatives and Gradients?
Multivariable slopes pointing uphill. It belongs to Math for Computing and is an intermediate-level topic.
Where do people use Partial Derivatives and Gradients?
Gradient descent for training machine-learning models, backpropagation, optimization in economics and engineering, fluid and heat flow and computing surface normals in graphics use gradients.
What is the most common mistake with Partial Derivatives and Gradients?
Moving along the negative gradient reduces the function only locally, so the step size matters.
What should I learn before this topic?
Start with Derivatives, the topic just before it in Math for Computing.
How can I practice it?
Answer the mini quiz in the interactive lesson, then take the Math for Computing quiz.
Is Partial Derivatives and Gradients hard to learn?
It is an Intermediate topic. Be comfortable with the Beginner topics in this area first, then read the common pitfall carefully, since it is where most mistakes happen.
How long does it take to learn Partial Derivatives and Gradients?
Most learners can read the explanation and finish the interactive lesson in under an hour. Fluency comes from applying the idea, so plan a few short practice sessions with the quiz.
Which topics are related to Partial Derivatives and Gradients?
Derivatives, Integrals, Orthogonality and Projections are closely connected. The full list is in the related topics section of this page.
What should I study after Partial Derivatives and Gradients?
Continue with Integrals, the next topic in Math for Computing.

Related topics