The Cross Product

Learning Objectives

By the end of this section, you will be able to:

1. Define and compute the cross product of two vectors using both the determinant formula and component-by-component calculation
2. Apply the right-hand rule to determine the direction of the cross product
3. Interpret geometrically the cross product as a vector perpendicular to both inputs with magnitude equal to the parallelogram area
4. Prove and use the key properties: anti-commutativity, distributivity, and orthogonality
5. Apply the cross product to compute torque, angular momentum, and surface normals
6. Connect the cross product to computer graphics, robotics, and machine learning applications

The Big Picture: A New Way to Multiply Vectors

"The cross product is the tool that lets us construct a vector perpendicular to a plane, find the area of a parallelogram, and calculate rotational effects in physics."

In the previous section, we learned about the dot product $\mathbf{a} \cdot \mathbf{b}$, which takes two vectors and returns a scalar (a number). The dot product measures how much two vectors point in the same direction.

Now we introduce the cross product $\mathbf{a} \times \mathbf{b}$, which takes two vectors and returns a vector. This new vector is:

• Perpendicular to both input vectors
• Has magnitude equal to the area of the parallelogram formed by the two vectors
• Direction determined by the right-hand rule

Historical Context: The Birth of Vector Algebra

The cross product emerged from the work of William Rowan Hamilton and Josiah Willard Gibbs in the 19th century. Hamilton developed quaternions in 1843, a four-dimensional extension of complex numbers. The cross product is actually the "vector part" of quaternion multiplication.

Gibbs, an American physicist at Yale, recognized that for most practical applications in physics and engineering, the full machinery of quaternions was unnecessary. In the 1880s, he developed the modern vector notation we use today, extracting the dot product and cross product as separate operations.

The symbol $\times$ for the cross product was introduced by Gibbs, deliberately chosen to suggest multiplication while being distinct from the dot product symbol $\cdot$.

Geometric Definition

The cross product $\mathbf{a} \times \mathbf{b}$ is defined geometrically by two properties:

The Parallelogram Interpretation

The magnitude $|\mathbf{a} \times \mathbf{b}| = |\mathbf{a}||\mathbf{b}|\sin\theta$ has a beautiful geometric meaning: it equals the area of the parallelogram formed by vectors $\mathbf{a}$ and $\mathbf{b}$.

Why? Consider a parallelogram with sides $\mathbf{a}$ and $\mathbf{b}$:

• The base has length $|\mathbf{a}|$
• The height is $|\mathbf{b}|\sin\theta$ (the perpendicular distance from base to opposite side)
• Area = base × height = $|\mathbf{a}| \cdot |\mathbf{b}|\sin\theta = |\mathbf{a} \times \mathbf{b}|$

Algebraic Definition: The Determinant Formula

For vectors $\mathbf{a} = (a_1, a_2, a_3)$ and $\mathbf{b} = (b_1, b_2, b_3)$, the cross product can be computed using a determinant:

Expanding this determinant using cofactors along the first row:

Component Formula

In component form, if $\mathbf{a} = (a_1, a_2, a_3)$ and $\mathbf{b} = (b_1, b_2, b_3)$, then:

Standard Basis Cross Products

The cross products of the standard basis vectors $\mathbf{i}, \mathbf{j}, \mathbf{k}$ follow a cyclic pattern:

The Right-Hand Rule

The right-hand rule is a physical mnemonic for determining the direction of the cross product. Here's how it works:

1. Point your fingers in the direction of the first vector $\mathbf{a}$
2. Curl your fingers toward the second vector $\mathbf{b}$ (through the smaller angle)
3. Your thumb points in the direction of $\mathbf{a} \times \mathbf{b}$

Interactive Exploration

Use the visualizer below to explore the cross product. Adjust the vectors $\mathbf{a}$ and $\mathbf{b}$ using the sliders and observe how the cross product changes in both magnitude and direction.

Notice how:

• When vectors are perpendicular ($\theta = 90°$), the cross product magnitude is maximized
• When vectors are parallel ($\theta = 0°$ or $180°$), the cross product is zero
• The cross product vector is always perpendicular to both input vectors
• The shaded parallelogram area equals $|\mathbf{a} \times \mathbf{b}|$

Properties of the Cross Product

The cross product satisfies several important algebraic properties:

1. Anti-Commutativity

Unlike the dot product (which is commutative), switching the order of the cross product reverses the direction. This is because the right-hand rule gives the opposite direction when you swap the vectors.

2. Distributivity

The cross product distributes over addition, just like ordinary multiplication.

3. Scalar Multiplication

Scalars can be factored out of the cross product.

4. Self Cross Product

Any vector crossed with itself gives the zero vector. This follows from the formula: $|\mathbf{a} \times \mathbf{a}| = |\mathbf{a}||\mathbf{a}|\sin(0°) = 0$.

5. Orthogonality

The cross product is perpendicular to both input vectors, confirmed by zero dot products.

6. NOT Associative

Summary of Properties

Worked Examples

Example 1: Computing a Cross Product

Example 2: Area of a Triangle

Example 3: Finding a Perpendicular Vector

Applications in Physics and Engineering

The cross product appears throughout physics wherever rotation, torque, or perpendicularity is involved.

1. Torque (Moment of Force)

Torque measures the rotational effect of a force about a pivot point:

The magnitude $|\boldsymbol{\tau}| = |\mathbf{r}||\mathbf{F}|\sin\theta$ explains why:

• Longer lever arms (larger $|\mathbf{r}|$) produce more torque
• Perpendicular forces ($\theta = 90°$) are most effective
• Forces along the lever ($\theta = 0°$) produce no rotation

2. Angular Momentum

Angular momentum measures rotational motion:

Angular momentum is conserved in the absence of external torques, which explains phenomena like a spinning ice skater accelerating when pulling in their arms.

3. Magnetic Force

The force on a charged particle moving through a magnetic field:

This force is always perpendicular to both the velocity and magnetic field, causing charged particles to move in circular or helical paths.

Applications in Computer Graphics and Machine Learning

The cross product is essential in 3D graphics, robotics, and geometric machine learning.

1. Surface Normals for 3D Rendering

In 3D graphics, every surface needs a normal vector for lighting calculations. Given a triangular face with vertices $P_1, P_2, P_3$, the normal is:

This is fundamental to:

• Diffuse lighting: Brightness ∝ $\mathbf{n} \cdot \mathbf{L}$ (Lambert's law)
• Back-face culling: If $\mathbf{n} \cdot \mathbf{v} < 0$, the face points away from the camera
• Collision detection: Determining which side of a surface an object is on

2. Rotation and Orientation in Robotics

Robot kinematics uses cross products extensively:

• Computing joint velocities from angular velocities: $\mathbf{v} = \boldsymbol{\omega} \times \mathbf{r}$
• Constructing rotation axes for inverse kinematics
• Calculating Jacobian matrices for robot arm control

3. 3D Deep Learning

In geometric deep learning and point cloud processing:

• PointNet++ and similar networks use cross products to compute local surface features
• Mesh neural networks require surface normals as input features
• Physics-informed neural networks for fluid dynamics use curl operations (which involve cross products)

Python Implementation

Computing and Verifying Cross Products

Let's implement the cross product and verify its properties:

1import numpy as np
2
3def cross_product(a, b):
4    """
5    Compute the cross product a × b of two 3D vectors.
6
7    The cross product produces a vector perpendicular to both
8    input vectors, with magnitude equal to the parallelogram area.
9    """
10    # Using the determinant formula
11    cx = a[1] * b[2] - a[2] * b[1]
12    cy = a[2] * b[0] - a[0] * b[2]
13    cz = a[0] * b[1] - a[1] * b[0]
14    return np.array([cx, cy, cz])
15
16def verify_cross_product_properties(a, b):
17    """Verify key properties of the cross product."""
18    c = cross_product(a, b)
19
20    # Property 1: Result is perpendicular to both inputs
21    dot_a = np.dot(c, a)
22    dot_b = np.dot(c, b)
23    print(f"(a × b) · a = {dot_a:.10f}  (should be 0)")
24    print(f"(a × b) · b = {dot_b:.10f}  (should be 0)")
25
26    # Property 2: Magnitude equals |a||b|sin(θ)
27    mag_cross = np.linalg.norm(c)
28    mag_a = np.linalg.norm(a)
29    mag_b = np.linalg.norm(b)
30    cos_theta = np.dot(a, b) / (mag_a * mag_b)
31    sin_theta = np.sqrt(1 - cos_theta**2)
32    expected_mag = mag_a * mag_b * sin_theta
33    print(f"|a × b| = {mag_cross:.6f}")
34    print(f"|a||b|sin(θ) = {expected_mag:.6f}")
35
36    # Property 3: Anti-commutativity
37    c_reversed = cross_product(b, a)
38    print(f"b × a = {c_reversed}")
39    print(f"-(a × b) = {-c}")
40    print(f"Are they equal? {np.allclose(c_reversed, -c)}")
41
42    return c
43
44# Example vectors
45a = np.array([1.0, 2.0, 0.0])
46b = np.array([0.0, 1.0, 3.0])
47
48print("Vectors:")
49print(f"a = {a}")
50print(f"b = {b}")
51print()
52
53print("Cross product a × b:")
54c = verify_cross_product_properties(a, b)
55print(f"Result: {c}")
56print()
57
58# Compare with NumPy's built-in
59print("NumPy verification:", np.cross(a, b))

Application: Surface Normals for 3D Graphics

Here's how the cross product computes surface normals for lighting:

1import numpy as np
2
3def compute_surface_normal(p1, p2, p3):
4    """
5    Compute the normal vector to a triangle surface.
6
7    In computer graphics, surface normals are essential for:
8    - Lighting calculations (Lambert's cosine law)
9    - Back-face culling (determining visible faces)
10    - Collision detection
11
12    The normal is computed as the cross product of two edge vectors.
13    """
14    # Create edge vectors from the triangle vertices
15    edge1 = p2 - p1  # Vector from p1 to p2
16    edge2 = p3 - p1  # Vector from p1 to p3
17
18    # The cross product gives a vector perpendicular to the surface
19    normal = np.cross(edge1, edge2)
20
21    # Normalize to unit length
22    magnitude = np.linalg.norm(normal)
23    if magnitude > 1e-10:
24        normal = normal / magnitude
25
26    return normal
27
28def compute_lighting(normal, light_direction, intensity=1.0):
29    """
30    Compute diffuse lighting using Lambert's law.
31
32    I = max(0, n · L) × intensity
33
34    where n is the surface normal and L is the light direction.
35    """
36    # Ensure light direction is normalized
37    light_dir = light_direction / np.linalg.norm(light_direction)
38
39    # Diffuse component (Lambert's cosine law)
40    diffuse = max(0, np.dot(normal, light_dir))
41
42    return diffuse * intensity
43
44# Example: Triangle in 3D space
45p1 = np.array([0.0, 0.0, 0.0])
46p2 = np.array([1.0, 0.0, 0.0])
47p3 = np.array([0.0, 1.0, 0.0])
48
49normal = compute_surface_normal(p1, p2, p3)
50print(f"Triangle vertices: {p1}, {p2}, {p3}")
51print(f"Surface normal: {normal}")
52
53# Light coming from above at an angle
54light_dir = np.array([0.5, 0.5, 1.0])
55brightness = compute_lighting(normal, light_dir)
56print(f"Light direction: {light_dir}")
57print(f"Surface brightness: {brightness:.4f}")
58
59# Perpendicular light (maximum brightness)
60light_dir_perpendicular = np.array([0.0, 0.0, 1.0])
61brightness_max = compute_lighting(normal, light_dir_perpendicular)
62print(f"Perpendicular light brightness: {brightness_max:.4f}")

Common Mistakes to Avoid

Test Your Understanding

Summary

The cross product is a fundamental operation in 3D vector algebra that produces a vector perpendicular to two input vectors with magnitude equal to the parallelogram area they span.

Key Formulas

Key Properties

Key Applications

1. Torque: $\boldsymbol{\tau} = \mathbf{r} \times \mathbf{F}$
2. Angular momentum: $\mathbf{L} = \mathbf{r} \times \mathbf{p}$
3. Magnetic force: $\mathbf{F} = q\mathbf{v} \times \mathbf{B}$
4. Surface normals in 3D graphics
5. Area calculations for triangles and parallelograms
6. Rotation axes in robotics and physics simulations

Coming Next: In the next section, we'll explore Lines and Planes in Space, where the cross product helps us find equations of planes and determine distances and angles in 3D geometry.