Gradient and Directional Derivatives
By the end of this session, you will be able to:
- Formulate general gradient vectors ∇f=⟨fx,fy⟩ and ∇f=⟨fx,fy,fz⟩ in both bracket and unit vector (i^,j^,k^) notations, evaluate them at specific domain points, and interpret their geometric role as normal vectors orthogonal to level curves (f(x,y)=c) and level surfaces (F(x,y,z)=c).
- Evaluate directional derivatives Duf=∇f⋅u for functions of two and three variables along arbitrary directions, strictly enforcing unit vector normalization (u=v/∥v∥) and directional angle parameterizations (u=⟨cosθ,sinθ⟩).
- Determine the directions and values of maximum rate of increase (∥∇f∥), steepest descent (−∥∇f∥), and zero change (u⊥∇f), and utilize gradient normals n=∇F to construct tangent plane equations Fx(x−x0)+Fy(y−y0)+Fz(z−z0)=0 for implicit 3D level surfaces.
📅 Micro-Lecture
1. The Gradient Operator: Transforming Scalar Fields into Vector Fields
- Mathematical Foundation: In multivariable modeling, physical quantities such as altitude, temperature, voltage, and pressure are scalar fields: functions that assign a single numerical value to each coordinate in space. The vector differential operator del (∇=⟨∂/∂x,∂/∂y,∂/∂z⟩) acts upon a scalar function f to create the gradient vector ∇f. As established in The Gradient Vector, ∇f bundles all spatial sensitivities into a single geometric arrow. It possesses three foundational properties: it points in the direction of steepest ascent, its magnitude ∥∇f∥ equals the maximum instantaneous rate of increase, and it is strictly perpendicular to the level curves or level surfaces passing through that point.
- Engineering Context: Environmental and water resource engineers map topographic elevation h(x,y) in stormwater basins; gravity causes surface water to flow along the direction of steepest descent (−∇h), while earthen retaining dikes follow level contours orthogonal to ∇h.
2. Directional Derivatives: Arbitrary Trajectories and Normalization
- Mathematical Foundation: Partial derivatives fx and fy quantify rates of change strictly along the coordinate axes (i^ and j^). Real-world vehicles, wind patterns, and structural loads move along arbitrary trajectories. The directional derivative Duf calculates the instantaneous rate of change per unit distance in any specified direction u. By the Gradient Theorem for Directional Derivatives (explored in Directional Derivatives), this rate is computed using the scalar dot product: Duf=∇f⋅u=∥∇f∥cosϕ. Crucially, this relationship holds only if u is a unit vector (∥u∥=1). Non-unit vectors must always be normalized to avoid scaling the derivative incorrectly.
- Engineering Context: Civil and geotechnical engineers calculate directional derivatives along proposed bulldozer cut paths to verify that off-axis road grades do not exceed the 30% rollover threshold of heavy earthmoving machinery.
3. Extremal Bounds of Change and Tangent Planes to Implicit Surfaces
- Mathematical Foundation: Because the dot product satisfies Duf=∥∇f∥cosϕ where ϕ is the angle between ∇f and u, the rate of change is bounded by −∥∇f∥≤Duf≤∥∇f∥. The maximum increase occurs when u is parallel to ∇f (ϕ=0), the maximum decrease occurs opposite to ∇f (ϕ=π), and zero change occurs when u is orthogonal to ∇f (ϕ=π/2). Furthermore, for an implicit level surface F(x,y,z)=c, the gradient ∇F(x0,y0,z0) acts directly as the surface normal vector n, enabling immediate construction of tangent plane equations Fx(x−x0)+Fy(y−y0)+Fz(z−z0)=0 as detailed in Tangent Planes to Level Surfaces.
- Engineering Context: Thermal engineers design microprocessor cooling fins parallel to −∇T to maximize heat conduction under Fourier's Law (q=−k∇T), while aerospace engineers compute surface normals n=∇F to position structural stiffeners on pressurized rocket fuel tanks.
Skill Block 1
The Gradient Vector in 2D & 3D (Computation & Geometric Properties)
General Overview
Skill Block 1 covers the formal definition, component extraction, and point evaluation of the gradient vector for functions of two and three variables. Students learn to express gradients in both component bracket form and Cartesian unit vector form, avoid the error of premature numerical substitution, and interpret the gradient's geometric role as a vector perpendicular to level sets.
Conceptual Framework
- Definition of the Gradient in 2D:
For a differentiable scalar function f(x,y):∇f(x,y)=⟨∂x∂f,∂y∂f⟩=∂x∂fi^+∂y∂fj^(Defined in The Gradient Vector.) - Definition of the Gradient in 3D:
For a differentiable scalar function f(x,y,z):∇f(x,y,z)=⟨∂x∂f,∂y∂f,∂z∂f⟩=∂x∂fi^+∂y∂fj^+∂z∂fk^ - Steepest Ascent Property:
At any point P, ∇f(P) points in the direction of maximum instantaneous rate of increase of f. - Magnitude Property:
The Euclidean length ∥∇f(P)∥ equals the maximum rate of change at P. - Orthogonality Property:
∇f(P) is perpendicular to the tangent vector of the level curve f(x,y)=c or level surface F(x,y,z)=c passing through P.
Key Equations & Structural Rules
- Differentiate-First Rule: Always compute the symbolic partial derivatives fx,fy,fz across the domain before substituting coordinates (x0,y0,z0).
- Bracket vs. Unit Vector Form: Gradients may be written as ⟨a,b,c⟩ or ai^+bj^+ck^; both representations represent identical geometric displacement vectors.
- Gradient Magnitude: ∥∇f∥=fx2+fy2+fz2.
Worked Example A: Polynomial Gradient Computation and Point Evaluation
Consider the multivariable function:
- Find the general gradient vector ∇f(x,y).
- Evaluate ∇f at the point P(1,−2).
- State the direction of steepest ascent as a unit vector and determine the maximum rate of change at P.
💡 Reveal Worked Solution
Compute First-Order Partial Derivatives: State the Two-Variable Gradient Formula (defined in The Gradient Vector):
∇f(x,y)=⟨∂x∂f,∂y∂f⟩Differentiate with respect to x treating y as constant:fx(x,y)=∂x∂(4x3y2−3x2+7y)=12x2y2−6xDifferentiate with respect to y treating x as constant:fy(x,y)=∂y∂(4x3y2−3x2+7y)=8x3y+7General gradient vector:∇f(x,y)=⟨12x2y2−6x,8x3y+7⟩=(12x2y2−6x)i^+(8x3y+7)j^Evaluate at Point P(1,−2): Substitute x=1 and y=−2:
fx(1,−2)=12(1)2(−2)2−6(1)=12(4)−6=48−6=42fy(1,−2)=8(1)3(−2)+7=8(−2)+7=−16+7=−9Evaluated gradient vector:∇f(1,−2)=⟨42,−9⟩=42i^−9j^Determine Steepest Ascent Unit Vector and Maximum Rate: Compute the vector magnitude:
∥∇f(1,−2)∥=422+(−9)2=1764+81=1845=3205≈42.95The unit vector pointing in the direction of steepest ascent is:uascent=∥∇f(1,−2)∥∇f(1,−2)=3205⟨42,−9⟩=⟨20514,−2053⟩The maximum rate of change at P is 3205≈42.95.
Practice Problem 1: Concept & Reading Check
Open this Skill Block on the Memex to locate the information needed to answer the following:
- (a) Explain the fundamental mathematical difference between the output of the function f(x,y) and the output of its gradient operator ∇f(x,y).
- (b) In Worked Example A, explain why substituting the point coordinates (1,−2) before taking the partial derivatives would produce an incorrect result.
- (c) In Topographic Retention Basin Drainage (Environmental & Civil Engineering), explain why water flows in the direction of −∇E rather than ∇E.
Review the definition of the gradient vector in The Gradient Vector, check the Differentiate-First Rule in the Key Equations section, and examine the physical gravity runoff discussion in the linked drainage application.
Answer: * (a) f(x,y) outputs a single scalar value, whereas ∇f(x,y) outputs a vector possessing both magnitude and spatial direction.
- (b) Substituting coordinates first yields a constant scalar, whose derivative is identically zero, losing all spatial sensitivity information.
- (c) Gravity pulls water downhill toward lower elevations; because ∇E points uphill along steepest ascent, water naturally cascades down the steepest descent vector −∇E.
Step-by-Step Execution
- (a) The function f(x,y) is a scalar field that assigns a single numerical value (such as elevation, voltage, or temperature) to each domain coordinate. The gradient ∇f(x,y)=⟨fx,fy⟩ is a vector field that assigns a directed vector to each point, encoding both the compass direction of maximum increase and the slope steepness.
- (b) If coordinates (1,−2) are substituted into f(x,y) before differentiating, the expression evaluates to a constant scalar (f(1,−2)=4(1)(4)−3(1)+7(−2)=−1). The derivative of any constant is zero, which would falsely suggest ∇f=⟨0,0⟩. Differentiating symbolically first preserves the rates of change ∂f/∂x and ∂f/∂y.
- (c) By the fundamental properties of the gradient, ∇E points in the direction of steepest elevation increase (straight uphill). Fluid runoff under the influence of gravity seeks the fastest drop in gravitational potential energy, which corresponds to the negative gradient −∇E (the path of steepest descent).
Practice Problem 2
Consider the multivariable function f(x,y)=2x3y2−4x+5y.
- (a) Find the general gradient vector ∇f(x,y).
- (b) Evaluate ∇f at the point P(2,−1).
- (c) State the geometric meaning of the resulting vector's direction and magnitude.
Apply the Two-Variable Gradient Formula: ∇f=⟨fx,fy⟩. Compute fx and fy using standard power rules, then substitute x=2 and y=−1.
Answer: * (a) ∇f(x,y)=⟨6x2y2−4,4x3y+5⟩
- (b) ∇f(2,−1)=⟨20,−27⟩=20i^−27j^
- (c) Direction ⟨20,−27⟩ is the direction of steepest ascent; magnitude ∥∇f∥=1129≈33.60 is the maximum rate of increase.
Step-by-Step Execution
Compute Symbolic Partial Derivatives: State the Gradient Formula (defined in The Gradient Vector):
∇f(x,y)=⟨∂x∂f,∂y∂f⟩Differentiate with respect to x:fx(x,y)=∂x∂(2x3y2−4x+5y)=6x2y2−4Differentiate with respect to y:fy(x,y)=∂y∂(2x3y2−4x+5y)=4x3y+5General gradient:∇f(x,y)=⟨6x2y2−4,4x3y+5⟩Evaluate at P(2,−1): Substitute x=2 and y=−1:
fx(2,−1)=6(2)2(−1)2−4=6(4)(1)−4=24−4=20fy(2,−1)=4(2)3(−1)+5=4(8)(−1)+5=−32+5=−27Evaluated gradient:∇f(2,−1)=⟨20,−27⟩=20i^−27j^State Geometric Meaning:
- Direction: The vector ⟨20,−27⟩ points in the direction of steepest ascent, where the function value increases most rapidly moving away from (2,−1).
- Magnitude: The Euclidean norm ∥∇f(2,−1)∥=202+(−27)2=400+729=1129≈33.60 represents the maximum instantaneous rate of increase of f per unit distance at (2,−1).
Practice Problem 3
Let a three-dimensional scalar field be defined by f(x,y,z)=yln(x)+xz2ey.
- (a) Compute the general gradient vector ∇f(x,y,z).
- (b) Evaluate ∇f at the point P(1,0,3).
State the Three-Variable Gradient Formula: ∇f=⟨fx,fy,fz⟩. Remember that ln(1)=0 and e0=1.
Answer: * (a) ∇f(x,y,z)=⟨xy+z2ey,ln(x)+xz2ey,2xzey⟩
- (b) ∇f(1,0,3)=⟨9,9,6⟩=9i^+9j^+6k^
Step-by-Step Execution
Compute 3D Partial Derivatives: State the Three-Variable Gradient Formula (defined in The Gradient Vector):
∇f(x,y,z)=⟨∂x∂f,∂y∂f,∂z∂f⟩Differentiate with respect to x:fx=∂x∂[yln(x)+xz2ey]=xy+z2eyDifferentiate with respect to y:fy=∂y∂[yln(x)+xz2ey]=ln(x)+xz2eyDifferentiate with respect to z:fz=∂z∂[yln(x)+xz2ey]=2xzeyGeneral gradient:∇f(x,y,z)=⟨xy+z2ey,ln(x)+xz2ey,2xzey⟩Evaluate at Coordinate Point P(1,0,3): Substitute x=1, y=0, and z=3:
fx(1,0,3)=10+32e0=0+9(1)=9fy(1,0,3)=ln(1)+1(32)e0=0+9(1)=9fz(1,0,3)=2(1)(3)e0=6(1)=6Evaluated gradient:∇f(1,0,3)=⟨9,9,6⟩=9i^+9j^+6k^
Practice Problem 4
The topographic elevation of an alluvial retention basin is modeled by the function h(x,y)=500−3x2−y2, where h is ground elevation in meters and x,y are spatial coordinates in meters.
- (a) Compute the general gradient vector ∇h(x,y).
- (b) If a civil surveyor stands at coordinate point P(2,4), determine the compass direction of steepest ascent as a unit vector and calculate the exact slope in that direction.
- (c) Write down a vector representing the natural direction that rainwater runoff will flow as it passes through point P(2,4).
Use ∇h=⟨hx,hy⟩. The steepest ascent unit vector is u=∇h/∥∇h∥, its slope is ∥∇h∥, and rainwater drainage follows the steepest descent vector −∇h.
Answer: * (a) ∇h(x,y)=⟨−6x,−2y⟩
- (b) Direction: uascent=⟨−133,−132⟩; exact slope: ∥∇h(2,4)∥=413≈14.42 m/m
- (c) Drainage flow vector: −∇h(2,4)=⟨12,8⟩ (or unit vector ⟨133,132⟩)
Step-by-Step Execution
Compute General Elevation Gradient: State the Elevation Gradient Formula (defined in The Gradient Vector):
∇h(x,y)=⟨∂x∂h,∂y∂h⟩=⟨−6x,−2y⟩Evaluate Steepest Ascent Direction and Slope at P(2,4): Substitute x=2 and y=4:
∇h(2,4)=⟨−6(2),−2(4)⟩=⟨−12,−8⟩Compute vector magnitude:∥∇h(2,4)∥=(−12)2+(−8)2=144+64=208=413≈14.42 m/mThe direction of steepest ascent as a normalized unit vector is:uascent=413⟨−12,−8⟩=⟨−41312,−4138⟩=⟨−133,−132⟩≈⟨−0.832,−0.555⟩The exact slope along this path is 413≈14.42 meters vertical rise per horizontal meter.Determine Rainwater Runoff Vector: Water flows down the fall line along the direction of steepest descent, governed by the negative gradient:
vdrainage=−∇h(2,4)=−⟨−12,−8⟩=⟨12,8⟩Expressed as a unit vector:udrainage=⟨133,132⟩≈⟨0.832,0.555⟩
📅 Regroup 1
- Clarifying Notation: Emphasize that ∇f(x,y) is a vector while f(x,y) is a scalar. Discuss why KaTeX bracket form ⟨a,b⟩ and unit vector form ai^+bj^ describe the same physical vector.
- Order of Operations Pitfall: Reinforce that evaluating coordinates before differentiation eliminates variable dependencies and destroys the rate information.
Skill Block 2
Directional Derivatives & Vector Normalization
General Overview
Skill Block 2 establishes the formulation and evaluation of directional derivatives Duf=∇f⋅u in arbitrary directions. Students master the mandatory unit vector normalization protocol, compute directional rates along displacement vectors between points, and evaluate directional derivatives defined by heading angles θ.
Conceptual Framework
- The Limit Definition of Directional Derivatives:
Duf(P)=h→0limhf(P+hu)−f(P)where u is a unit vector (∥u∥=1).
- The Gradient Dot Product Theorem:
For any differentiable function f:
Duf=∇f⋅u(Defined in Directional Derivatives.)
- Mandatory Normalization Rule:
If a direction is given as a generic vector v with ∥v∥=1, it must be normalized:
u=∥v∥v
- Displacement Vector Between Two Points: Moving from point P toward point Q yields direction vector v=PQ=Q−P, normalized to u=PQ/∥PQ∥.
- Angle Parameterization in 2D:
When a direction is given by an angle θ measured counterclockwise from the positive x-axis:
u=⟨cosθ,sinθ⟩⟹Duf=fxcosθ+fysinθ
Key Equations & Structural Rules
- Scalar Output Rule: The directional derivative Duf is always a single real number (scalar rate of change), never a vector.
- Normalization Verification: Always check ∥u∥=u12+u22=1 before taking the dot product.
Worked Example A: Standard Directional Derivative with Vector Normalization
Find the directional derivative of f(x,y)=3x2−2y2+5xy at the point P(2,−1) in the direction of the vector v=⟨3,4⟩.
💡 Reveal Worked Solution
Compute and Evaluate the Gradient Vector: State the Gradient Formula (defined in The Gradient Vector):
∇f(x,y)=⟨∂x∂f,∂y∂f⟩Compute the partial derivatives:fx=6x+5y⟹fx(2,−1)=6(2)+5(−1)=12−5=7fy=−4y+5x⟹fy(2,−1)=−4(−1)+5(2)=4+10=14∇f(2,−1)=⟨7,14⟩=7i^+14j^Normalize the Direction Vector: State the Vector Normalization Formula:
u=∥v∥v=v12+v22⟨v1,v2⟩Calculate the magnitude of v=⟨3,4⟩:∥v∥=32+42=9+16=25=5Construct the unit vector:u=5⟨3,4⟩=⟨53,54⟩Compute the Directional Derivative via Dot Product: State the Directional Derivative Formula (defined in Directional Derivatives):
Duf(2,−1)=∇f(2,−1)⋅uEvaluate the dot product:Duf(2,−1)=⟨7,14⟩⋅⟨53,54⟩=7(53)+14(54)=521+56=577=15.4
Practice Problem 5: Concept & Reading Check
Open this Skill Block on the Memex to locate the information needed to answer the following:
- (a) Explain why computing ∇f⋅v using a non-unit vector v=⟨3,4⟩ without normalizing would give an incorrect rate of change.
- (b) In Worked Example A, verify that the vector u=⟨3/5,4/5⟩ satisfies the definition of a unit vector.
- (c) In Highway Grading & Haul Road Stability (Civil Engineering), how is the directional derivative Duh used to assess vehicle rollover risk?
Review the Vector Normalization section of Directional Derivatives and examine the slope threshold evaluation in the linked civil engineering application.
Answer: * (a) Failing to normalize scales the dot product by ∥v∥=5, exaggerating the instantaneous rate of change by a factor of 5 and corrupting its physical units.
- (b) ∥u∥=(3/5)2+(4/5)2=9/25+16/25=25/25=1.
- (c) Duh calculates the actual downhill slope along the vehicle's specific steering heading; if ∣Duh∣>0.30 (30% grade), the path violates heavy equipment stability limits.
Step-by-Step Execution
- (a) The directional derivative measures the rate of change per unit distance (e.g., meters of rise per meter of travel). If an unnormalized vector v of length 5 is used in the dot product, the calculation yields ∇f⋅v=5(∇f⋅u)=77, which inflates the rate by fivefold and distorts the physical slope dimensions.
- (b) The definition of a unit vector requires ∥u∥=1. Squaring each component: (3/5)2=9/25 and (4/5)2=16/25. Summing gives 9/25+16/25=25/25=1. Taking the square root confirms ∥u∥=1.
- (c) Bulldozers and heavy haul trucks have maximum slope tolerances before losing track traction or tipping. While the steepest descent might be excessively steep, traveling along an angled heading u produces an effective grade of Duh. If this directional derivative exceeds −0.30 (30% downhill grade), the civil engineer must reroute the road to a flatter angle.
Practice Problem 6
Let f(x,y)=x2y−2y2. Calculate the directional derivative Duf(3,1) in the direction of the vector v=⟨5,12⟩.
State the Directional Derivative Formula: Duf=∇f⋅u. Find ∇f(3,1), compute ∥v∥=52+122, normalize v to u, and evaluate the dot product.
Answer:
Step-by-Step Execution
Compute and Evaluate the Gradient: State the Gradient Formula (defined in The Gradient Vector):
∇f(x,y)=⟨∂x∂f,∂y∂f⟩Compute partial derivatives:fx=2xy⟹fx(3,1)=2(3)(1)=6fy=x2−4y⟹fy(3,1)=32−4(1)=9−4=5∇f(3,1)=⟨6,5⟩Normalize the Direction Vector: Compute the magnitude of v=⟨5,12⟩:
∥v∥=52+122=25+144=169=13Construct the unit vector:u=13⟨5,12⟩=⟨135,1312⟩Compute the Directional Derivative: State the Directional Derivative Dot Product Formula (defined in Directional Derivatives):
Duf(3,1)=∇f(3,1)⋅uSubstitute values:Duf(3,1)=⟨6,5⟩⋅⟨135,1312⟩=6(135)+5(1312)=1330+60=1390≈6.923
Practice Problem 7
Consider the three-variable function f(x,y,z)=2x2+3yz−z2. Compute the rate of change of f at the point P(1,2,−1) in the direction toward the point Q(4,2,3).
Compute displacement vector PQ=Q−P, normalize it to unit vector u=PQ/∥PQ∥, evaluate ∇f(1,2,−1), and calculate Duf=∇f⋅u.
Answer:
Step-by-Step Execution
Construct and Normalize Displacement Vector PQ:
PQ=⟨4−1,2−2,3−(−1)⟩=⟨3,0,4⟩Compute magnitude:∥PQ∥=32+02+42=9+0+16=25=5Construct unit vector:u=5⟨3,0,4⟩=⟨53,0,54⟩Compute and Evaluate 3D Gradient: State the Three-Variable Gradient Formula (defined in The Gradient Vector):
∇f(x,y,z)=⟨4x,3z,3y−2z⟩Evaluate at P(1,2,−1):fx(1,2,−1)=4(1)=4fy(1,2,−1)=3(−1)=−3fz(1,2,−1)=3(2)−2(−1)=6+2=8∇f(1,2,−1)=⟨4,−3,8⟩Compute Directional Derivative: State the Directional Derivative Formula (defined in Directional Derivatives):
Duf(P)=∇f(P)⋅uSubstitute values:Duf(1,2,−1)=⟨4,−3,8⟩⋅⟨53,0,54⟩=4(53)+(−3)(0)+8(54)=512+0+32=544=8.8
Practice Problem 8
Calculate the directional derivative of g(x,y)=4cos(2x−y) at the point P(4π,0) in the direction specified by an angle θ=32π measured counterclockwise from the positive x-axis.
State the Angle Parameterization Formula: u=⟨cosθ,sinθ⟩. Compute partial derivatives of g(x,y) using the single-variable trigonometric chain rule, evaluate ∇g at P, and evaluate Dug=∇g⋅u.
Answer:
Step-by-Step Execution
Compute and Evaluate the Gradient: State the Gradient Formula (defined in The Gradient Vector):
∇g(x,y)=⟨∂x∂g,∂y∂g⟩Using the Chain Rule on cos(2x−y):gx=4(−sin(2x−y))⋅∂x∂(2x−y)=−8sin(2x−y)gy=4(−sin(2x−y))⋅∂y∂(2x−y)=4sin(2x−y)Evaluate at P(4π,0) where the argument is 2(π/4)−0=π/2:sin(2π)=1gx(4π,0)=−8(1)=−8gy(4π,0)=4(1)=4∇g(4π,0)=⟨−8,4⟩Construct Directional Unit Vector from Angle θ: State the 2D Directional Angle Unit Vector Formula (defined in Directional Derivatives):
u=⟨cosθ,sinθ⟩For θ=32π:cos(32π)=−21,sin(32π)=23u=⟨−21,23⟩Evaluate the Directional Derivative:
Dug=∇g⋅u=⟨−8,4⟩⋅⟨−21,23⟩=(−8)(−21)+(4)(23)=4+23≈7.464
📅 Regroup 2
- Geometric Dot Product Meaning: Review Duf=∥∇f∥cosϕ. Highlight how the sign of Duf directly reveals whether the function is increasing (ϕ<π/2), decreasing (ϕ>π/2), or stationary (ϕ=π/2).
- Displacement Vector Construction: Ensure students distinguish between the destination point coordinates Q and the direction vector PQ=Q−P.
Skill Block 3
Extremal Rates of Change & Tangent Planes to Level Surfaces
General Overview
Skill Block 3 covers the synthesis of gradient geometry to identify extremal rates of change and model tangent planes to implicit level surfaces. Students learn how to bound directional derivatives using Cauchy-Schwarz, identify zero-change contour directions, extract normal vectors n=∇F, and assemble linear tangent plane equations for 3D surfaces.
Conceptual Framework
- Maximum Rate of Increase (Steepest Ascent):
- Direction: u=∥∇f∥∇f
- Rate: ∥∇f∥
- Maximum Rate of Decrease (Steepest Descent):
- Direction: u=−∥∇f∥∇f
- Rate: −∥∇f∥
- Zero Rate of Change (Level Curve Tangents):
- Direction: Any unit vector orthogonal to ∇f (u⋅∇f=0). For ∇f=⟨a,b⟩, the two orthogonal directions are ±⟨−b,a⟩/a2+b2.
- Rate: 0
- Tangent Planes to Implicit Level Surfaces:
For a level surface F(x,y,z)=c, the gradient ∇F(x0,y0,z0) is orthogonal to the surface at P0(x0,y0,z0), serving as the plane normal vector:
n=⟨Fx,Fy,Fz⟩The tangent plane equation is:Fx(x0,y0,z0)(x−x0)+Fy(x0,y0,z0)(y−y0)+Fz(x0,y0,z0)(z−z0)=0(Defined in Tangent Planes to Level Surfaces.)
Key Equations & Structural Rules
- Extremal Bounds Inequality: −∥∇f∥≤Duf≤∥∇f∥.
- Point-Normal Plane Equation: a(x−x0)+b(y−y0)+c(z−z0)=0 where ⟨a,b,c⟩=∇F(P0).
Worked Example A: Bounds of Change and Zero-Change Unit Vectors
Let f(x,y)=x2y−3y2. At the coordinate point P(3,1):
- Find the direction and value of the maximum rate of increase.
- Find the two unit vector directions along which the function does not change.
💡 Reveal Worked Solution
Compute and Evaluate the Gradient: State the Gradient Formula (defined in The Gradient Vector):
∇f(x,y)=⟨2xy,x2−6y⟩Substitute x=3 and y=1:∇f(3,1)=⟨2(3)(1),32−6(1)⟩=⟨6,9−6⟩=⟨6,3⟩Compute the maximum rate of increase:Max Rate=∥∇f(3,1)∥=62+32=36+9=45=35≈6.708The direction of maximum increase as a unit vector is:umax=35⟨6,3⟩=⟨52,51⟩Determine Zero-Change Directions (u⊥∇f): Zero change requires Duf=∇f⋅u=0. For a 2D gradient ⟨a,b⟩=⟨6,3⟩, orthogonal vectors swap components and negate one:
w1=⟨−3,6⟩,w2=⟨3,−6⟩Normalize to unit vectors:∥w1∥=(−3)2+62=45=35u1=⟨−353,356⟩=⟨−51,52⟩u2=−u1=⟨51,−52⟩
Worked Example B: Tangent Plane to an Implicit Level Surface
Find the equation of the tangent plane to the quadric level surface:
💡 Reveal Worked Solution
Define the Implicit Function and Compute the Gradient: State the Level Surface Function F(x,y,z)=x2+y2−z2=4. Compute the gradient vector ∇F (defined in Tangent Planes to Level Surfaces):
∇F(x,y,z)=⟨∂x∂F,∂y∂F,∂z∂F⟩=⟨2x,2y,−2z⟩Evaluate the Normal Vector n at P0(3,2,3):
n=∇F(3,2,3)=⟨2(3),2(2),−2(3)⟩=⟨6,4,−6⟩Assemble the Tangent Plane Equation: State the Tangent Plane to a Level Surface Formula:
Fx(x0,y0,z0)(x−x0)+Fy(x0,y0,z0)(y−y0)+Fz(x0,y0,z0)(z−z0)=0Substitute components a=6,b=4,c=−6 and coordinates (3,2,3):6(x−3)+4(y−2)−6(z−3)=0Expand:6x−18+4y−8−6z+18=0⟹6x+4y−6z=8Divide by 2 to obtain simplified standard linear form:3x+2y−3z=4
Practice Problem 9: Concept & Reading Check
Open this Skill Block on the Memex to locate the information needed to answer the following:
- (a) Use the dot product angle formula Duf=∥∇f∥cosϕ to prove why the maximum possible directional derivative equals ∥∇f∥ and occurs when u is parallel to ∇f.
- (b) In Worked Example B, identify how the normal vector n=⟨6,4,−6⟩ was determined directly from the surface equation without solving for z.
- (c) In Microprocessor Heat Sink Thermal Gradients (Mechanical & Computer Engineering), why are heat sink micro-channels aligned parallel to −∇T rather than parallel to ∇T?
Review the dot product geometric derivation in The Gradient Vector, check the surface normal extraction steps in Tangent Planes to Level Surfaces, and inspect Fourier's Law of Heat Conduction in the linked mechanical engineering application.
Answer: * (a) Because −1≤cosϕ≤1, the maximum value of cosϕ is 1, occurring at ϕ=0 (parallel vectors), which yields Duf=∥∇f∥(1)=∥∇f∥.
- (b) The level surface gradient ∇F=⟨2x,2y,−2z⟩ is proven to be perpendicular to the surface at every point, giving normal vector components directly upon substituting (3,2,3).
- (c) By Fourier's Law (q=−k∇T), heat naturally conducts down temperature gradients from hotter zones to cooler zones; aligning channels with −∇T aligns coolant flow with the fastest heat extraction path.
Step-by-Step Execution
- (a) By the definition of the scalar dot product, Duf=∇f⋅u=∥∇f∥∥u∥cosϕ. Because u is a unit vector, ∥u∥=1, reducing the expression to ∥∇f∥cosϕ. The cosine function attains its absolute upper bound of +1 if and only if ϕ=0, meaning u points in the exact direction of ∇f. Thus, the maximum rate of change is ∥∇f∥.
- (b) In an implicit surface F(x,y,z)=c, any curve on the surface satisfies F(r(t))=c. Applying the chain rule yields ∇F⋅r′(t)=0, proving that ∇F is perpendicular to every tangent line on the surface. Evaluating ∇F(3,2,3)=⟨6,4,−6⟩ immediately provides the normal vector n needed for the plane equation without requiring explicit square root algebra.
- (c) Fourier's Law of Heat Conduction states that heat flux q is driven by negative temperature gradients: q=−k∇T (where k>0). Thermal energy naturally migrates toward lower temperatures. Heat sink micro-channels are aligned parallel to −∇T (the direction of steepest descent) so that cooling fluids absorb heat directly along the natural conduction stream, minimizing hotspot formation.
Practice Problem 10
The steady-state temperature profile across an aluminum cooling plate is modeled by T(x,y)=150−2x2−4y2, where T is in ∘C and x,y are in centimeters.
- (a) At the location P(3,1), determine the unit vector direction ucool in which the plate cools most rapidly.
- (b) Determine the maximum possible rate of temperature increase at P(3,1).
- (c) Identify the two unit vectors representing paths along which a temperature sensor experiences zero temperature change.
Evaluate the temperature gradient ∇T(3,1). The steepest cooling direction is −∇T, the maximum rate of increase is ∥∇T∥, and paths of zero change are orthogonal to ∇T.
Answer: * (a) ucool=⟨133,132⟩≈⟨0.832,0.555⟩
- (b) Maximum rate of increase: ∥∇T(3,1)∥=413≈14.42∘C/cm
- (c) Constant paths: uiso=±⟨132,−133⟩≈±⟨0.555,−0.832⟩
Step-by-Step Execution
Compute and Evaluate Temperature Gradient: State the Temperature Gradient Formula (defined in The Gradient Vector):
∇T(x,y)=⟨−4x,−8y⟩Evaluate at P(3,1):∇T(3,1)=⟨−4(3),−8(1)⟩=⟨−12,−8⟩∘C/cmDetermine Direction of Most Rapid Cooling: The direction of steepest descent is given by the negative gradient:
vcool=−∇T(3,1)=−⟨−12,−8⟩=⟨12,8⟩Normalize to a unit vector:∥vcool∥=122+82=144+64=208=413ucool=413⟨12,8⟩=⟨133,132⟩Maximum Possible Rate of Increase: The maximum rate of increase equals the magnitude of the gradient:
∥∇T(3,1)∥=413≈14.42∘C/cmZero-Change Isothermal Directions: Zero rate of change requires u⋅∇T=0. For ⟨−12,−8⟩, orthogonal vectors are ±⟨8,−12⟩. Normalizing yields:
uiso=±413⟨8,−12⟩=±⟨132,−133⟩
Practice Problem 11
An electrostatic potential field is defined by V(x,y,z)=x2+y2+z2, which measures Euclidean distance from a point charge at the origin.
- (a) Prove that the gradient vector satisfies ∇V=x2+y2+z2⟨x,y,z⟩=r^.
- (b) Explain physically or geometrically why ∇V always points radially outward from the origin.
- (c) Identify the geometric shape formed by the level surfaces V(x,y,z)=c for c>0.
Use the multivariable Chain Rule to differentiate x2+y2+z2 with respect to x,y,z. Notice that the numerator is the radial position vector r=⟨x,y,z⟩ and the denominator is its magnitude ∥r∥.
Answer: * (a) Differentiating yields Vx=x2+y2+z2x, Vy=x2+y2+z2y, Vz=x2+y2+z2z, so ∇V=∥r∥r=r^.
- (b) The function measures radial distance from (0,0,0); distance increases most rapidly when traveling directly away from the center along straight radial rays.
- (c) Concentric spheres centered at the origin with radius c.
Step-by-Step Execution
Prove the Gradient Expression: Write V(x,y,z)=(x2+y2+z2)1/2. Differentiating with respect to x via the Chain Rule:
Vx=21(x2+y2+z2)−1/2⋅∂x∂(x2+y2+z2)=2x2+y2+z21(2x)=x2+y2+z2xBy cyclic symmetry with respect to y and z:Vy=x2+y2+z2y,Vz=x2+y2+z2zAssembling into vector form:∇V=⟨x2+y2+z2x,x2+y2+z2y,x2+y2+z2z⟩=x2+y2+z2⟨x,y,z⟩=∥r∥r=r^Geometric and Physical Explanation:
- Geometric: The numerator r=⟨x,y,z⟩ is the standard position vector emanating straight from the origin to (x,y,z), while the denominator is its Euclidean length ∥r∥. A vector divided by its length is the radial unit vector r^, which points directly away from the origin.
- Physical: The potential V measures straight-line distance from the origin. Moving along any curved or tangential path dilutes the rate of distance expansion; moving radially outward maximizes distance growth at a rate of exactly 1 unit/unit distance (∥r^∥=1).
Identify Level Surfaces: Setting V(x,y,z)=c (for c>0):
x2+y2+z2=c⟹x2+y2+z2=c2This is the standard equation of a sphere centered at the origin with radius c. The gradient ∇V=r^ is everywhere orthogonal to these spherical shells.
Practice Problem 12
An implicit manufacturing cost surface is defined by the level surface F(x,y,z)=x2y+yz+z3=11.
- (a) Find the normal vector n to this surface at the point P0(2,1,2) using the gradient.
- (b) Write the equation of the tangent plane to the surface at P0(2,1,2) in simplified standard form.
State the Tangent Plane to a Level Surface Formula: Fx(x−x0)+Fy(y−y0)+Fz(z−z0)=0. Compute partial derivatives of F, evaluate at (2,1,2) to find n=⟨Fx,Fy,Fz⟩, and expand.
Answer: * (a) n=∇F(2,1,2)=⟨4,6,13⟩=4i^+6j^+13k^
- (b) Tangent plane equation: 4x+6y+13z=40
Step-by-Step Execution
Compute Gradient of the Implicit Surface: State the Level Surface Normal Vector Formula (defined in Tangent Planes to Level Surfaces):
n=∇F(x,y,z)=⟨∂x∂F,∂y∂F,∂z∂F⟩Differentiate F(x,y,z)=x2y+yz+z3:Fx=2xyFy=x2+zFz=y+3z2Evaluate at Point P0(2,1,2):
Fx(2,1,2)=2(2)(1)=4Fy(2,1,2)=22+2=4+2=6Fz(2,1,2)=1+3(22)=1+3(4)=1+12=13The normal vector is:n=∇F(2,1,2)=⟨4,6,13⟩=4i^+6j^+13k^Construct the Tangent Plane Equation: State the Point-Normal Plane Equation:
a(x−x0)+b(y−y0)+c(z−z0)=0Substitute normal vector components ⟨4,6,13⟩ and point (2,1,2):4(x−2)+6(y−1)+13(z−2)=0Expand and simplify:4x−8+6y−6+13z−26=04x+6y+13z−40=0⟹4x+6y+13z=40
📅 Regroup 3
- Orthogonality to Level Sets: Connect the level surface normal n=∇F to the 2D contour property where ∇f is orthogonal to level curves.
- Explicit vs. Implicit Planes: Revisit how z=f(x,y) is simply F(x,y,z)=f(x,y)−z=0, giving n=⟨fx,fy,−1⟩.
📅 Synthesis Wrap-up
- Core Takeaways:
- The gradient vector ∇f encapsulates all first-order directional rates of change and points in the direction of steepest ascent.
- The directional derivative Duf=∇f⋅u requires a unit vector ∥u∥=1 to calculate accurate rates of change.
- Directional derivatives are bounded by −∥∇f∥≤Duf≤∥∇f∥, with zero change occurring along tangent lines to level sets.
- The gradient of an implicit function F(x,y,z)=c supplies the surface normal vector n=∇F for constructing 3D tangent planes.
- Knewton Alta Homework Alignment:
- Directional Derivatives and Gradients for Functions in Two Variables (Practice Problems 1, 2, 4, 5, 6, 8)
- Applications of Directional Derivatives and Gradients (Practice Problems 4, 8, 10, and linked engineering applications)
- Directional Derivatives and Gradients for Functions in Three Variables (Practice Problems 3, 7, 9, 11, 12)