Learning Objectives
By the end of this section, you will be able to:
- State and intuitively justify the two fundamental limits and .
- Derive the squeeze inequality from the unit circle and apply the Squeeze Theorem to prove the first limit.
- Use the sinc limit to evaluate many related limits — including , , and — without invoking L'Hôpital.
- Connect the compound-interest sequence to the continuous limit and to .
- Verify both limits numerically in plain Python and recognize them as the limits that define and in PyTorch's autograd.
Why These Two Limits Are Special
Every standard limit rule we have met so far — the sum, product, quotient, and composition laws — says if you already know the pieces, here is how to combine them. But somewhere the chain has to bottom out. Somewhere a few non-trivial limits must be computed from first principles, and all the other calculus rules will then ride on top of them.
Two limits play exactly this role throughout all of analysis. Everything you know about the derivative of sine, cosine, tangent, ex, ln, and every decay, oscillation, or compound-growth process in physics, economics, and machine learning can be traced back to these two sentences:
It says "for small angles the sine is almost equal to the angle itself". This single sentence unlocks the derivative of sine, the small-angle pendulum formula, Fourier analysis, and diffraction optics.
It says "compounding gains infinitely often gives a finite, universal number". This constant e ≈ 2.71828 then drives every differential equation of growth, decay, interest, and probability.
Why they cannot be avoided
Both limits are of the indeterminate type or . Algebra can't resolve them directly — we need either a geometric sandwich argument (for the first) or a delicate monotonic bounded-sequence argument (for the second). That is exactly why they have to be proved once, and every other identity then reuses them.
sin(x)/x — Geometric Intuition
Draw a unit circle centered at O and pick a small positive angle (in radians). Three natural lengths appear in the picture:
- The vertical drop from the circle point to the horizontal axis has length .
- The arc on the circle from the horizontal axis to that point has length exactly — that is the geometric definition of a radian.
- The tangent segment dropped from the end of the arc to the horizontal axis (outside the circle) has length .
Comparing areas of the three shaded regions in the interactive below:
Divide the whole chain by to get
and invert (all three quantities are positive for ):
As , (cosine is continuous at 0), so the ratio is trapped between two things that both converge to 1. The Squeeze Theorem forces to converge to 1 as well.
Interactive: Squeeze sin(x)/x onto 1
Drag the slider (or press Play) to shrink the angle . Watch the green, violet, and red regions flatten onto each other in the unit circle and — at the same time — the purple curve get pinched onto the horizontal line .
Read the picture like this
The violet arc is . The green height is . For small angles these two shrink at the same rate — their ratio approaches 1. For a 0.01 radian slice (about half a degree), the sine and the arc agree to six decimal places: the small-angle approximation is that good.
The Sandwich Proof
Theorem (First Special Limit).
Proof. Fix . From the unit-circle areas we derived
Cosine is continuous at 0 with , so the left bound tends to 1. The right bound is already 1. By the Squeeze Theorem, the middle term is forced to tend to 1. The case is identical because both and flip sign, so the ratio is even. ∎
The one-line corollary
In words: sine is the identity function plus a small error. Physicists call this the small-angle approximation; it is what lets them replace with in the pendulum equation and recover simple harmonic motion.
Worked Example: Why sin(5x)/x → 5
Compute without L'Hôpital, Taylor series, or any machinery beyond the first special limit.
Work it by hand, step by step
Step 1. The numerator is , not , so the first limit does not apply directly. Multiply the numerator and denominator by a compensating :
Step 2. Substitute . Then as , also (because 5 is just a scale factor).
Step 3. Apply the first special limit to the right-hand factor:
Step 4. Combine:
Check numerically. At : , and at : , both approaching 5. ✔
The general rule. The exact same substitution shows for any constant . The factor outside the sine controls the slope at zero; everything else cancels.
Playground: Limits Built from sin(x)/x
Pick a formula and shrink the window. Each curve has a removable hole at 0; the green line marks the value the hole would fill in. Notice how every curve flattens onto its green line as , and how the numerical probe table loses two decimal digits per row — a signature of algebraic rate-of-convergence.
The trick behind (1 − cos x)/x² = 1/2
Multiply numerator and denominator by :
Both factors approach easy values: and . Product → .
(1 + 1/n)^n — The Compound-Interest Story
In 1683 Jacob Bernoulli asked a practical question that secretly founded modern analysis: if a bank pays 100% interest once a year, you end up with $2 on each $1. What if they compound twice a year — 50% every six months?
Four times a year (25% per quarter) gives . Monthly gives . The more often you compound, the more you earn — but the payoff of adding another compounding step keeps shrinking. Is there a ceiling? Yes: the sequence climbs forever but never crosses
This number e is the one Euler later placed at the center of analysis. Its definition is literally the limit of the compound-interest sequence.
e = compounding gains in the limit of instantaneous compounding. Every appearance of in physics — radioactive decay, RC circuit voltage, population growth, Planck radiation — is the continuous limit of a discrete multiplicative process compounded ever more finely.
Interactive: Watch the Balance Climb to e
The left panel shows the running balance of $1 compounded times a year. The right panel plots on a logarithmic axis. Drag the slider to change by orders of magnitude.
What to notice
- The sequence is monotonically increasing — every additional compounding step strictly raises the final balance.
- The sequence is bounded above by . No finite ever reaches .
- Convergence is slow: the gap , so doubling only halves the error. Ten more digits of require .
Why Does It Converge?
Unlike the sinc limit, there is no simple geometric picture — the proof is about numbers on a line, not shapes in a plane. The standard argument is that the sequence is monotonically increasing and bounded above. A classical theorem then forces it to converge.
Step 1 — Monotonicity via the binomial theorem
Expand by the binomial formula:
Each factor strictly increases with and the series has one extra positive term when grows by 1. Every summand grows, so the whole sum grows: .
Step 2 — Boundedness via factorial comparison
Each product , so
(We used for .) So for all . A bounded increasing sequence must converge. Call the limit . The series on the right also converges (to the same number) — that is the other standard formula .
From Discrete n to Continuous x
The same number appears in three equivalentlimits — the discrete sequence we just studied and two continuous-variable versions that come up constantly in calculus:
| Form | Limit | Where you meet it |
|---|---|---|
| Integer sequence | (1 + 1/n)^n → e as n → ∞ | Compound interest, discrete probability |
| Continuous base | (1 + h)^(1/h) → e as h → 0 | General growth, differential equations |
| Exponential derivative | (e^h − 1)/h → 1 as h → 0 | (e^x)' = e^x, neural network gradients |
| Logarithmic derivative | ln(1 + h)/h → 1 as h → 0 | (ln x)' = 1/x at x = 1, information theory |
The bridge from the discrete to the continuous form is simply the substitution : as , , and
The continuous version works for from either side, not just through integer .
How (e^h − 1)/h → 1 follows
Take the log of both sides of :
Substitute , so , and invert:
These three statements are algebraically interchangeable; all three are worth knowing under their own names.
Worked Example: Continuous Compounding on $1000
A bank offers 5% APR on a $1000 deposit for one year. They will compound at any frequency you choose. How much money do you have at the end?
Walk through the hand calculation
Step 1. If interest is compounded times per year at rate , the ending balance is
Step 2. Plug in the standard compounding schedules:
| Frequency | n | Ending balance |
|---|---|---|
| Annually | 1 | $1050.00 |
| Monthly | 12 | $1051.1619 |
| Daily | 365 | $1051.2675 |
| Hourly | 8760 | $1051.2709 |
Step 3. Let . Substitute so and too:
So continuous compounding gives
Step 4 — the punchline. Hourly compounding was already within a fraction of a cent of the continuous limit. The marginal benefit of finer compounding collapses very quickly once you are past daily. That is the practical shadow of : returns are finite even when the number of compounding steps is infinite.
The moral for modeling. Whenever a real process multiplies itself by many times — population growth, inflation, viral spread, RC discharge — the right idealization is the continuous limit . The special limit is not just a curiosity; it is the bridge between discrete repeated multiplication and continuous exponential growth.
Python: Watching Both Limits Converge
Before jumping to PyTorch, let us see the two limits converge in the simplest possible Python. No libraries beyond math. Click any line on the right panel — the left panel shows exactly what value every variable and argument carries at that moment.
What the output looks like
sin(x) / x -> 1
x f(x) |f(x) - 1|
----------------------------------------------
1.0000e+00 0.841470984808 1.59e-01
1.0000e-01 0.998334166468 1.67e-03
1.0000e-02 0.999983333417 1.67e-05
1.0000e-03 0.999999833333 1.67e-07
1.0000e-04 0.999999998333 1.67e-09
(1 + 1/n)^n -> e
e = 2.718281828459045
n a_n e - a_n
------------------------------------------------
1 2.000000000000 7.18e-01
10 2.593742460100 1.25e-01
100 2.704813829422 1.35e-02
10,000 2.718145926825 1.36e-04
1,000,000 2.718280469156 1.36e-06The sinc error drops by a factor of 100 per row (quadratic convergence — because ), while the Euler error drops by only a factor of 10 per row (linear convergence). Two different rates of "approach" — both valid limits.
PyTorch: Using These Limits as Derivatives
The classical proof that uses . The proof that uses . PyTorch's autograd implements those derivative rules, so we can verify numerically that the two "special" limits are exactly the numbers autograd produces.
The deeper story
Every differentiable function in PyTorch has a local linear approximation baked into its backward rule. That local slope is the limit as . For and , those limits are exactly the two special limits of this section. Every gradient-descent step you will ever run is built on top of them.
Where Both Limits Show Up
- Physics: small-angle pendulum becomes simple harmonic motion under .
- Optics: single-slit diffraction amplitude is literally the sinc function .
- Signal processing: ideal low-pass filter's impulse response is — the Whittaker–Shannon interpolation formula.
- Geometry: the derivative and the arc-length element both rely on the small-angle linearization.
- Finance: continuous compounding is the n → ∞ limit of discrete compounding.
- Probability: the Poisson limit of a Binomial rides on .
- Physics: radioactive decay and RC-circuit discharge are the continuous-time realizations of the sequence limit.
- Machine learning: softmax normalization relies on , whose derivative rule is exactly . Adam's running-average decay is a discrete first-order analog of .
Common Pitfalls
Pitfall 1 — Using degrees instead of radians
only in radians. In degrees . Every calculus rule for trig functions silently assumes radians — that is why it is the natural unit of angle.
Pitfall 2 — Evaluating (1 + 1/n)^n numerically for huge n
For , the expression rounds to exactly 1 in double precision, and the computer reports the limit as — a catastrophic underflow. Use the series or the library math.exp(1) for actual high-precision work.
Pitfall 3 — Confusing sin(5x)/x with sin(5x)/(5x)
The second ratio obviously has limit 1 — it is the sinc limit with . The first has limit 5. Missing the compensating factor of 5 is the most common algebra error students make with this limit family.
Pitfall 4 — Claiming the e-limit is "obvious"
The form is indeterminate: , but and . The precise pairing of in the base with in the exponent is what makes the limit equal a finite number — and the number happens to be e.
Summary
Two limits — one trigonometric, one exponential — act as the base cases for almost every derivative rule in single-variable calculus. Everything else is built from them by algebraic manipulation.
| Limit | Value | Proof tool | Derivative it unlocks |
|---|---|---|---|
| sin(x) / x as x → 0 | 1 | Unit-circle areas + Squeeze Theorem | (sin x)' = cos x |
| (1 − cos x) / x² as x → 0 | 1/2 | Algebra + first limit | (cos x)' = − sin x |
| tan(x) / x as x → 0 | 1 | Product of two easy limits | (tan x)' = sec²(x) |
| (1 + 1/n)^n as n → ∞ | e | Monotone + bounded sequence | Definition of e |
| (e^h − 1) / h as h → 0 | 1 | Logarithm of the e-limit | (e^x)' = e^x |
| ln(1 + h) / h as h → 0 | 1 | Log of the e-limit | (ln x)' = 1/x at x = 1 |
Key Takeaways
- sin x / x → 1 is the geometric fact that the sine of a tiny angle is the angle (measured in radians). It is proved with one squeeze and ends up under every derivative of every trig function.
- (1 + 1/n)^n → e is the analytic fact that compounding converges. Equivalent to and , so it underlies every derivative involving e and ln.
- Both limits are of indeterminate form. Neither follows from arithmetic alone — one needs geometry, the other needs a monotone-bounded argument.
- Numerically, sinc converges quadratically, the e-sequence only linearly. "Same limit" in analysis does not mean "same speed" in computation.
- Every gradient PyTorch computes for is these two limits in disguise. Autograd doesn't take a new limit each time — it uses the closed-form rule that these limits proved once and for all.
Coming Next: With these two special limits in our toolbox, we can finally formalize the shortcut every student wants for and forms — L'Hôpital's rule. The next section shows how to use it, when it fails, and why it's a corollary (not a replacement) of the work we did here.