Learning Objectives
By the end of this section, you will be able to:
- Understand the Jacobian matrix as the derivative of a multivariable transformation
- Compute the Jacobian determinant for 2D and 3D coordinate transformations
- Interpret the Jacobian geometrically as a local area/volume scaling factor
- Apply the change of variables formula to evaluate double and triple integrals
- Derive the Jacobians for polar, cylindrical, and spherical coordinates
- Connect the Jacobian to machine learning applications including normalizing flows and probability transformations
The Big Picture: Transforming Integrals
"The Jacobian is the multivariable generalization of the chain rule's factor that appears in u-substitution. It tells us how areas and volumes stretch and compress under coordinate transformations."
In single-variable calculus, u-substitution lets us transform an integral to a new variable: . The derivative appears as a correction factor that accounts for how the variable change stretches or compresses intervals.
In multiple dimensions, the analogous concept is the Jacobian determinant. When we transform from one coordinate system to another , the Jacobian tells us how infinitesimal area elements transform: .
Why This Matters
Change of variables is essential for:
- Simplifying integrals: Converting complex regions to rectangles or other simple shapes
- Exploiting symmetry: Using polar coordinates for circular regions, spherical for spheres
- Physics: Transforming between coordinate systems natural to different problems
- Machine learning: Normalizing flows, probability transformations, and generative models
- Computer graphics: Texture mapping, deformations, and coordinate transforms
Historical Context
The Jacobian is named after Carl Gustav Jacob Jacobi (1804–1851), a German mathematician who made fundamental contributions to analysis, number theory, and mechanics. Jacobi systematically studied determinants of partial derivatives in the 1830s, developing the theory we use today.
The underlying ideas, however, date back to the work of Lagrange and Laplace on celestial mechanics, where transformations between coordinate systems were essential for computing gravitational interactions. The change of variables formula for multiple integrals was developed rigorously in the 19th century by mathematicians including Augustin-Louis Cauchy and Bernhard Riemann.
Jacobi's Legacy
Beyond the Jacobian, Carl Jacobi contributed to elliptic functions, the theory of determinants, and Hamiltonian mechanics. His work on canonical transformations in mechanics directly uses Jacobian determinants to ensure that phase space volume is preserved—a result now known as Liouville's theorem.
Why Change Variables?
Consider computing over a disk of radius centered at the origin. In Cartesian coordinates, this requires integrating over the region , —a mess of square roots.
In polar coordinates, the same region is simply , —a rectangle! And the integrand becomes , which depends only on .
But we cannot simply write . This would give the wrong answer! The area element is not equal to . We need a correction factor—the Jacobian—that accounts for how the transformation stretches area elements.
The Fundamental Question
If and , then
What factor relates the area elements in different coordinate systems?
The Jacobian Matrix
Let be a transformation defined by and . The Jacobian matrix of is the matrix of all first-order partial derivatives:
Definition: Jacobian Matrix
The Jacobian matrix is the total derivative of the transformation—the best linear approximation to near a point. It tells us how small changes in affect changes in :
Example: Polar Coordinates
For polar coordinates with and :
The Jacobian Determinant
For changing variables in integrals, we need the determinant of the Jacobian matrix, often called simply "the Jacobian":
Jacobian Determinant (2D)
Computing for Polar Coordinates
This is exactly the factor we need: in polar coordinates!
Geometric Interpretation
The Jacobian determinant has a beautiful geometric meaning: it measures how the transformation scales areas (in 2D) or volumes (in 3D).
Key Geometric Insight
Consider a small rectangle in space with sides and . Under the transformation, this rectangle maps to a (curved) parallelogram in space.
The area of the original rectangle is . The area of the transformed parallelogram is approximately .
The two sides of the rectangle transform to the vectors formed by the columns (or rows) of the Jacobian matrix. The area of the parallelogram spanned by two vectors is the absolute value of their cross product (in 2D, this is the determinant).
Signed vs. Unsigned
The determinant can be positive or negative. A negative determinant indicates the transformation reverses orientation (like a reflection). For area calculations, we use the absolute value .
Interactive: Area Scaling Under Transformation
Explore how a rectangular element in parameter space transforms to a curved quadrilateral in physical space. Move the highlighted region and observe how the Jacobian varies with position:
(r, θ) Parameter Space
Area = Δr × Δθ = 0.0450
(x, y) Physical Space
Area ≈ |J| × Δr × Δθ = 0.0517
Area Scaling Analysis
Parameter Area
0.0450
Jacobian |J| = r
1.1500
Physical Area
0.0517
The area element in polar coordinates picks up a factor of r from the Jacobian
Key Insight: Notice how the transformed region (green) is larger when r is larger. This is because the Jacobian |J| = r scales the area element. At the origin (r = 0), the area element would shrink to zero, which is why polar coordinates are singular there.
The Change of Variables Formula
Now we can state the main theorem that makes it all work:
Change of Variables Theorem (2D)
Let be a one-to-one transformation with continuous partial derivatives. If is continuous on , then:
In words: to change from to coordinates:
- Replace and with their expressions in and
- Multiply by the absolute value of the Jacobian
- Replace with
- Change the limits of integration to describe the same region in coordinates
Interactive: Jacobian Transform Visualizer
Explore how different coordinate transformations distort space. The highlighted cell shows the local area scaling factor (the Jacobian):
Transform from (r, θ) to (x, y). The Jacobian |J| = r means area elements scale by r.
(r, θ) Space
(x, y) Space
Jacobian Determinant
The green region's area scales by |J| = 0.5000 at this position
Things to Explore
- In polar coordinates, observe how the Jacobian = r means cells near the origin have smaller physical area
- For linear transformations, the Jacobian is constant everywhere
- Try the parabolic and elliptical coordinates to see non-uniform scaling
Example: Polar Coordinates in Detail
Let's work through a complete example using polar coordinates.
Setup
The transformation from polar to Cartesian is:
We computed , so:
Example: Area of a Disk
Find the area of a disk of radius :
Inner integral:
Outer integral:
Example: Gaussian Integral
Evaluate :
Inner integral (u-substitution with u = r²):
Result:
Connection to Probability
This result implies , which normalizes the Gaussian distribution. The change to polar coordinates is the classic trick for evaluating this integral!
Cylindrical and Spherical Coordinates
Cylindrical Coordinates
The Jacobian for cylindrical is the same as polar in the xy-plane, with z contributing a factor of 1:
Spherical Coordinates
The 3×3 Jacobian matrix has determinant:
| Coordinate System | Jacobian |J| | Volume Element dV |
|---|---|---|
| Cartesian | 1 | dx dy dz |
| Polar (2D) | r | r dr dθ |
| Cylindrical | r | r dr dθ dz |
| Spherical | ρ² sin φ | ρ² sin φ dρ dφ dθ |
Interactive: Jacobian Step-by-Step Calculator
Follow the step-by-step process of computing the Jacobian determinant for various coordinate transformations:
Step 1: Identify the Transformation
We have a transformation from (r, \theta) to (x, y):
Worked Examples
Example 1: Elliptical Region
Evaluate where R is the region bounded by .
Solution: Use the transformation . Then is the unit circle.
Jacobian:
Converting to polar for the unit disk:
After integration:
Example 2: Volume of a Sphere
Find the volume of a sphere of radius .
Solution: Use spherical coordinates:
Inner integral:
Middle integral:
Outer integral:
Applications
Physics: Computing Moments of Inertia
The moment of inertia of a solid about an axis often simplifies in cylindrical or spherical coordinates. For a sphere of uniform density about a diameter:
Probability: Multivariate Distributions
When transforming random variables, the Jacobian adjusts the probability density. If where is invertible:
Machine Learning Connection
The Jacobian is central to several machine learning techniques:
Normalizing Flows
Normalizing flows are generative models that transform a simple base distribution (like a Gaussian) through a series of invertible transformations to produce a complex target distribution.
The log-likelihood of a sample involves the Jacobian:
Each transformation must have a tractable Jacobian determinant for efficient training.
Variational Autoencoders (VAEs)
The reparameterization trick in VAEs uses the Jacobian. When sampling where , the Jacobian is , which appears in the density transformation.
Independent Component Analysis (ICA)
ICA finds a linear transformation to independent components. The log-likelihood includes a log-Jacobian term that accounts for the mixing matrix's effect on volume.
Python Implementation
Computing Jacobians
Integration with Change of Variables
Normalizing Flows Example
Common Mistakes
Mistake 1: Forgetting the Jacobian
The most common error is writing without the factor of . Always include !
Mistake 2: Wrong Limits
When changing variables, you must transform the limits too. A disk of radius 2 in Cartesian becomes , —not the original x and y limits!
Mistake 3: Signed vs. Unsigned Jacobian
For area/volume calculations, use (absolute value). The signed determinant matters for orientation, but area is always positive.
Pro Tip: Check Your Answer
When learning, verify with a known result. Compute the area of a circle using polar coordinates—you should get . If not, you likely forgot the Jacobian or set up limits incorrectly.
Test Your Understanding
Summary
The Jacobian is the key to changing variables in multiple integrals. It captures how a transformation stretches or compresses area and volume elements.
Key Formulas
| Concept | Formula |
|---|---|
| Jacobian Matrix (2D) | J = [∂x/∂u ∂x/∂v; ∂y/∂u ∂y/∂v] |
| Jacobian Determinant | |J| = ∂x/∂u · ∂y/∂v − ∂x/∂v · ∂y/∂u |
| Change of Variables (2D) | ∬_R f(x,y) dA = ∬_S f(x(u,v), y(u,v)) |J| du dv |
| Polar | |J| = r, dA = r dr dθ |
| Cylindrical | |J| = r, dV = r dr dθ dz |
| Spherical | |J| = ρ² sin φ, dV = ρ² sin φ dρ dφ dθ |
Key Takeaways
- The Jacobian matrix is the matrix of all first-order partial derivatives—the total derivative of the transformation.
- The Jacobian determinant measures local area/volume scaling—how much an infinitesimal element stretches or shrinks.
- Change of variables requires multiplying by |J| to account for this scaling.
- Polar: |J| = r; Cylindrical: |J| = r; Spherical: |J| = ρ² sin φ. These are the most common cases.
- In machine learning, Jacobians appear in normalizing flows, VAEs, and probability transformations.
- Always remember: transform both the integrand AND the limits, and include the Jacobian factor.
What's Next: With the Jacobian, you can now tackle integrals in any coordinate system. In subsequent chapters, we'll explore vector calculus, where the Jacobian appears in transformations of vector fields and in the proofs of Green's, Stokes', and the Divergence theorems.