Optimization with Constraints
By the end of this session, you will be able to:
- Formulate and locate critical points (βf=0 or undefined) for functions of two and three variables, construct the Hessian matrix and discriminant D=fxxβfyyββ(fxyβ)2, and rigorously classify candidates as local minima, local maxima, saddle points, or inconclusive.
- Execute the 3-tier candidate search strategy (interior critical points, boundary edge parameterization, and corner vertices) to evaluate global extrema for continuous multivariable functions on closed and bounded planar regions under the Extreme Value Theorem.
- Formulate and solve constrained multivariable optimization models using the method of Lagrange multipliers (βf=Ξ»βg), resolve non-linear coordinate systems, and interpret the multiplier Ξ» as a quantitative measure of physical system sensitivity and shadow pricing.
π Micro-Lecture
1. Unconstrained Extrema & The Curvature Hessian
- Mathematical Foundation: In multivariable modeling, stationary equilibrium states occur where the gradient vector vanishes: βf=0, creating a completely horizontal tangent plane z=f(a,b). As established in Critical Points in Multivariable Functions, stationary points represent candidates for local peaks, valleys, or directional inflection saddles. To classify these candidates, The Second Derivative Test inspects the determinant of the Hessian curvature matrix D=fxxβfyyββ(fxyβ)2. If D>0, the surface curves uniformly in all directions (concave up for fxxβ>0βΉ local min; concave down for fxxβ<0βΉ local max). If D<0, the surface bends upward in one cross-section and downward in a transverse cross-section, forming a saddle point.
- Engineering Context: Aerospace engineers optimize airfoil lift-to-drag performance surfaces E(Ξ±,Ξ²); a true local maximum (D>0,EΞ±Ξ±β<0) guarantees cruise stability, whereas a saddle point exposes the aircraft to violent aerodynamic pitching oscillations.
2. Compact Domains & The Multi-Tier Boundary Search
- Mathematical Foundation: Engineering designs rarely operate across an infinite plane; physical systems are restricted to compact (closed and bounded) operating envelopes. Under the Extreme Value Theorem (explored in Extrema on Closed and Bounded Regions), a continuous multivariable function on a closed and bounded domain is guaranteed to attain an absolute maximum and minimum. Because global extrema frequently reside on perimeter boundaries or structural vertices rather than at interior stationary points, engineers must execute a systematic 3-tier search: interior critical points, 1D parameterized boundary edges, and geometric corner vertices.
- Engineering Context: Geotechnical engineers evaluate contact soil bearing pressure P(x,y) under heavy foundation footings to guarantee that peak stresses along foundation edges or corner toes do not exceed the soil's ultimate bearing capacity, preventing structural punch-through failure.
3. Constrained Surfaces & The Method of Lagrange Multipliers
- Mathematical Foundation: When optimization variables are strictly bound to an equation constraint g(x,y,z)=k (such as fixed material mass, trajectory pathways, or fluid flow cross-sections), interior gradients do not vanish. Instead, as proven in Lagrange Multipliers, an extreme value along the constraint path occurs when the constraint curve is tangent to a level set of the objective function. Because their tangent lines coincide, their normal gradient vectors are parallel: βf=Ξ»βg. The scalar multiplier Ξ» represents the marginal sensitivity (shadow price) of the system: Ξ»=dkdfoptββ.
- Engineering Context: Satellite mission analysts minimize orbit-raising propulsion fuel burn metrics subject to an orbital insertion velocity plane, where Ξ» quantifies the exact propellant mass penalty per unit increase in required mission delta-V.
Skill Block 1
Unconstrained Local Extrema & The Second Derivative Test
General Overview
Skill Block 1 covers the identification and geometric classification of unconstrained stationary points for functions of two variables. Students learn to compute simultaneous partial derivative systems βf=0, avoid premature coordinate substitution, construct the Hessian matrix, evaluate the discriminant D=fxxβfyyββ(fxyβ)2, and classify points as local minima, local maxima, saddle points, or inconclusive.
Conceptual Framework
- Critical Point Definition:
A point (a,b) is a critical point of f(x,y) if:βf(a,b)=0βΊβxβfβ(a,b)=0andβyβfβ(a,b)=0or if either first partial derivative fails to exist at (a,b). (Defined in Critical Points in Multivariable Functions.) - The Hessian Matrix & Discriminant:
For a function with continuous second-order partial derivatives, the Hessian matrix and its determinant D are:H=[fxxβfyxββfxyβfyyββ],D(x,y)=fxxβfyyββ(fxyβ)2(Defined in Second Derivative Test for Multivariable Functions.) - Classification Criteria:
- Local Minimum: D(a,b)>0 and fxxβ(a,b)>0.
- Local Maximum: D(a,b)>0 and fxxβ(a,b)<0.
- Saddle Point: D(a,b)<0.
- Inconclusive Test: D(a,b)=0.
Key Equations & Structural Rules
- Differentiate-First Rule: Always compute the symbolic partial derivatives fxβ,fyβ,fxxβ,fyyβ,fxyβ across the entire domain before substituting numerical coordinates (a,b).
- Clairaut's Symmetry: For smooth surfaces, mixed partial derivatives are equal (fxyβ=fyxβ), guaranteeing that the Hessian matrix is symmetric.
- Same-Sign Rule for D>0: If D>0, the product fxxβfyyβ>(fxyβ)2β₯0, which mathematically forces fxxβ and fyyβ to have the exact same non-zero algebraic sign.
Worked Example A: Polynomial Gradient and Hessian Point Classification
Find and classify all critical points of the multivariable function:
π‘ Reveal Worked Solution
Compute First-Order Partial Derivatives: State the Two-Variable Gradient Formula (defined in The Gradient Vector):
βf(x,y)=β¨βxβfβ,βyβfββ©=βxβfβi^+βyβfβj^βDifferentiate with respect to x treating y as a constant:fxβ(x,y)=βxββ(2x3β6x+2y2β4y)=6x2β6Differentiate with respect to y treating x as a constant:fyβ(x,y)=βyββ(2x3β6x+2y2β4y)=4yβ4Locate Critical Points: State the Critical Point Condition (defined in Critical Points in Multivariable Functions):
βf(x,y)=0βΉfxβ(x,y)=0andfyβ(x,y)=0Solve the two decoupled equations:6x2β6=0βΉ6(x2β1)=0βΉx=1orx=β14yβ4=0βΉ4y=4βΉy=1Combining x and y solutions yields two distinct critical points:(1,1)and(β1,1)Compute Second-Order Partial Derivatives: State the Second-Order Partial Derivatives (defined in Second-Order Partial Derivatives):
fxxβ=βxββ(6x2β6)=12xfyyβ=βyββ(4yβ4)=4fxyβ=βyββ(6x2β6)=0Construct and Evaluate the Hessian Discriminant: State the Hessian Discriminant Formula (defined in Second Derivative Test for Multivariable Functions):
D(x,y)=fxxβfyyββ(fxyβ)2=(12x)(4)β(0)2=48x- Evaluate at (1,1):
D(1,1)=48(1)=48>0fxxβ(1,1)=12(1)=12>0Because D>0 and fxxβ>0, the critical point (1,1) is a local minimum.
The local minimum value is:f(1,1)=2(1)3β6(1)+2(1)2β4(1)=2β6+2β4=β6 - Evaluate at (β1,1):
D(β1,1)=48(β1)=β48<0Because D<0, the critical point (β1,1) is a saddle point.
The saddle point value is:f(β1,1)=2(β1)3β6(β1)+2(1)2β4(1)=β2+6+2β4=2
- Evaluate at (1,1):
Practice Problem 1: Concept & Reading Check
Open this Skill Block on the Memex to locate the information needed to answer the following:
- (a) State the algebraic condition on the gradient vector βf required for a point (a,b) to be classified as a critical point, and explain what this means for the surface's tangent plane.
- (b) In Worked Example A, explain why knowing D(1,1)>0 alone is insufficient to conclude that (1,1) is a local minimum, and state what additional derivative sign must be verified.
- (c) In Aerospace Wing Profile Lift-to-Drag Optimization (Aerospace & Mechanical Engineering), explain why an aircraft engineer seeks an operating point with D>0 and Exxβ<0 rather than a saddle point where D<0.
Review the definition of critical points in Critical Points in Multivariable Functions, inspect the classification criteria in Second Derivative Test for Multivariable Functions, and read the aerodynamic stability discussion in the linked aerospace wing application.
Answer: * (a) βf(a,b)=β¨0,0β©=0; the tangent plane is completely horizontal (z=f(a,b)).
- (b) D>0 indicates definite curvature (bowl shape), but it could be concave up (minimum) or concave down (maximum); you must verify fxxβ>0 (or fyyβ>0).
- (c) D>0,Exxβ<0 represents a stable local maximum in cruise efficiency; a saddle point (D<0) causes the wing to lose performance under pitch variations.
Step-by-Step Execution
- (a) By the Critical Point Definition (defined in Critical Points in Multivariable Functions), all first-order partial derivatives must vanish simultaneously: βf(a,b)=0βΊfxβ(a,b)=0 and fyβ(a,b)=0. Geometrically, the tangent plane equation zβf(a,b)=fxβ(xβa)+fyβ(yβb) reduces to the constant horizontal plane z=f(a,b).
- (b) By the Hessian Discriminant Criteria (defined in Second Derivative Test for Multivariable Functions), D>0 guarantees that the principal curvatures share the same sign. To distinguish whether the surface forms an upright bowl (local minimum) or an inverted dome (local maximum), one must evaluate the sign of the pure second derivative fxxβ (or fyyβ): fxxβ>0 confirms upward concavity (local minimum).
- (c) In aerospace flight mechanics, an aerodynamic efficiency peak requires negative concavity in all directions (D>0,Exxβ<0) so that deviations in angle of attack or camber produce graceful performance boundaries. A saddle point (D<0) represents an unstable equilibrium where slight perturbations induce catastrophic loss of lift.
Practice Problem 2: Decoupled Polynomial Local Extrema
Find and classify all critical points of the function:
Compute first partial derivatives using the Two-Variable Gradient Formula (see The Gradient Vector). Set fxβ=0 and fyβ=0 independently, then evaluate the discriminant D=fxxβfyyββ(fxyβ)2 (see Second Derivative Test for Multivariable Functions).
Answer: Critical point (1,0) is a local minimum (f(1,0)=β2); critical point (β1,0) is a saddle point (f(β1,0)=2).
Step-by-Step Execution
Compute First Partial Derivatives: State the Two-Variable Gradient Formula:
βf(x,y)=β¨βxβfβ,βyβfββ©fxβ=βxββ(x3β3x+y2)=3x2β3fyβ=βyββ(x3β3x+y2)=2yLocate Critical Points: Set both partial derivatives equal to zero:
3x2β3=0βΉ3(x2β1)=0βΉx=1orx=β12y=0βΉy=0This yields two critical points: (1,0) and (β1,0).Compute Second-Order Partials and Discriminant: State the Hessian Discriminant Formula:
D(x,y)=fxxβfyyββ(fxyβ)2fxxβ=6x,fyyβ=2,fxyβ=0D(x,y)=(6x)(2)β02=12xClassify Points:
- At (1,0):
D(1,0)=12(1)=12>0,fxxβ(1,0)=6(1)=6>0Since D>0 and fxxβ>0, (1,0) is a local minimum with value f(1,0)=13β3(1)+0=β2.
- At (β1,0):
D(β1,0)=12(β1)=β12<0Since D<0, (β1,0) is a saddle point with value f(β1,0)=(β1)3β3(β1)+0=2.
- At (1,0):
Practice Problem 3: Coupled Polynomial Extrema with Cross-Terms
Determine and classify all critical points of the function:
Calculate fxβ and fyβ. Notice that fxβ=0 contains only y, allowing you to solve for y immediately. Substitute this into fyβ=0, compute fxxβ,fyyβ,fxyβ, and evaluate D (see Second Derivative Test for Multivariable Functions).
Answer: Critical point (16,4) is a saddle point (f(16,4)=64).
Step-by-Step Execution
Compute First Partial Derivatives: State the Two-Variable Gradient Formula:
βf(x,y)=β¨βxβfβ,βyβfββ©fxβ=βxββ(y3β3xy+12x)=β3y+12fyβ=βyββ(y3β3xy+12x)=3y2β3xLocate Critical Points: Set both equations to zero:
β3y+12=0βΉ3y=12βΉy=4Substitute y=4 into fyβ=0:3(4)2β3x=0βΉ3(16)β3x=0βΉ48=3xβΉx=16The single critical point is (16,4).Compute Second-Order Partials and Discriminant: State the Hessian Discriminant Formula:
fxxβ=βxββ(β3y+12)=0fyyβ=βyββ(3y2β3x)=6yfxyβ=βyββ(β3y+12)=β3D(x,y)=fxxβfyyββ(fxyβ)2=(0)(6y)β(β3)2=0β9=β9Classify the Point: At (16,4), D=β9<0.
Since D<0, the critical point (16,4) is a saddle point.
Its value is f(16,4)=43β3(16)(4)+12(16)=64β192+192=64.
Practice Problem 4: Non-Linear Coordinate Elimination and Local Maxima
Find and classify all critical points of the higher-degree multivariable function:
Differentiate to find fxβ and fyβ. Set them to zero to obtain y=x3 and x=y3. Substitute y=x3 into x=y3 to get x(1βx8)=0, giving real solutions x=0,1,β1. Construct D(x,y)=144x2y2β16 (see Second Derivative Test for Multivariable Functions).
Answer: Critical point (0,0) is a saddle point (f(0,0)=0); critical points (1,1) and (β1,β1) are local maxima (f(1,1)=2,f(β1,β1)=2).
Step-by-Step Execution
Compute First-Order Partials:
fxβ=4yβ4x3,fyβ=4xβ4y3Solve the Non-Linear System: Set fxβ=0βΉ4y=4x3βΉy=x3. Substitute y=x3 into fyβ=0:
4xβ4(x3)3=0βΉ4xβ4x9=0βΉ4x(1βx8)=0The real solutions for x are x=0, x=1, and x=β1.- If x=0βΉy=03=0βΉ(0,0)
- If x=1βΉy=13=1βΉ(1,1)
- If x=β1βΉy=(β1)3=β1βΉ(β1,β1)
Compute Second Partials and Discriminant:
fxxβ=β12x2,fyyβ=β12y2,fxyβ=4State the Hessian Discriminant Formula:D(x,y)=fxxβfyyββ(fxyβ)2=(β12x2)(β12y2)β(4)2=144x2y2β16Classify Each Critical Point:
- At (0,0):
D(0,0)=144(0)β16=β16<0βΉSaddleΒ pointValue: f(0,0)=0.
- At (1,1):
D(1,1)=144(1)2(1)2β16=128>0,fxxβ(1,1)=β12(1)2=β12<0βΉLocalΒ maximumValue: f(1,1)=4(1)(1)β14β14=2.
- At (β1,β1):
D(β1,β1)=144(β1)2(β1)2β16=128>0,fxxβ(β1,β1)=β12(β1)2=β12<0βΉLocalΒ maximumValue: f(β1,β1)=4(β1)(β1)β(β1)4β(β1)4=2.
- At (0,0):
π Regroup 1
- Visualizing Curvature: Emphasize why D<0 guarantees a saddle point: the quadratic expansion has eigenvalues of opposite signs, meaning the surface climbs in one direction and falls in another.
- Algebraic Pitfall: Highlight that when solving coupled systems like 4yβ4x3=0, students must never divide by x or y without accounting for the origin (0,0) as a solution.
Skill Block 2
Global Extrema on Closed and Bounded Regions
General Overview
Skill Block 2 focuses on finding absolute maximum and absolute minimum values for multivariable functions defined over compact sets in R2. Students learn how the Extreme Value Theorem guarantees extrema, how to execute the 3-tier candidate search strategy across interiors, edges, and corners, and how to compile a master evaluation table.
Conceptual Framework
- Extreme Value Theorem (EVT) for Two Variables:
If f(x,y) is continuous on a closed and bounded set DβR2, then f attains an absolute maximum value f(x1β,y1β) and an absolute minimum value f(x2β,y2β) at some points in D. (Defined in Extrema on Closed and Bounded Regions.) - Closed vs. Bounded Criteria:
- Closed: Contains its boundary points (β€,β₯).
- Bounded: Enclosed completely within a disk of finite radius centered at the origin.
- The 3-Tier Search Strategy:
- Tier 1 (Interior): Solve βf=0, keeping only points inside D.
- Tier 2 (Boundary Edges): Parameterize boundary paths, substitute into f, and solve 1D derivative equations gβ²(t)=0.
- Tier 3 (Vertices): Evaluate f at all geometric intersection corners.
Key Equations & Structural Rules
- Interior Filtering Rule: Discard any critical point where (a,b)β/D.
- Boundary Substitution Technique: If a boundary is given by y=mx+b or y2=R2βx2, substitute directly into f(x,y) to form a single-variable function g(x).
- Global Comparison Standard: You do not need the second derivative test for boundary optimization; simply evaluate f(x,y) numerically across all candidates to find the highest and lowest values.
Worked Example A: Absolute Extrema on a Closed Rectangular Plate
Find the absolute maximum and minimum values of:
π‘ Reveal Worked Solution
Tier 1: Interior Critical Points: Compute the first partial derivatives using the Two-Variable Gradient Formula:
fxβ=2xβ2=0βΉx=1fyβ=2yβ4=0βΉy=2The point (1,2) lies strictly inside D because 0<1<4 and 0<2<4.
Evaluate f at (1,2):f(1,2)=12+22β2(1)β4(2)+5=1+4β2β8+5=0Tier 2: Boundary Edge Search:
- Bottom Edge (y=0,0β€xβ€4):
g1β(x)=f(x,0)=x2β2x+5βΉg1β²β(x)=2xβ2=0βΉx=1Candidate: (1,0). Value: f(1,0)=12β2(1)+5=4.
- Right Edge (x=4,0β€yβ€4):
g2β(y)=f(4,y)=16+y2β8β4y+5=y2β4y+13βΉg2β²β(y)=2yβ4=0βΉy=2Candidate: (4,2). Value: f(4,2)=22β4(2)+13=4β8+13=9.
- Top Edge (y=4,0β€xβ€4):
g3β(x)=f(x,4)=x2+16β2xβ16+5=x2β2x+5βΉg3β²β(x)=2xβ2=0βΉx=1Candidate: (1,4). Value: f(1,4)=12β2(1)+5=4.
- Left Edge (x=0,0β€yβ€4):
g4β(y)=f(0,y)=y2β4y+5βΉg4β²β(y)=2yβ4=0βΉy=2Candidate: (0,2). Value: f(0,2)=22β4(2)+5=1.
- Bottom Edge (y=0,0β€xβ€4):
Tier 3: Corner / Vertex Check: Evaluate f at the four square corners:
- At (0,0): f(0,0)=5
- At (4,0): f(4,0)=42β2(4)+5=16β8+5=13
- At (4,4): f(4,4)=42+42β2(4)β4(4)+5=16+16β8β16+5=13
- At (0,4): f(0,4)=42β4(4)+5=5
Master Comparison & Conclusion: Construct the comparison table:
Candidate (x,y) Source Function Value f(x,y) (1,2) Interior Critical Point 0 (Absolute Minimum) (0,2) Left Boundary Edge 1 (1,0) Bottom Boundary Edge 4 (1,4) Top Boundary Edge 4 (0,0) Corner Vertex 5 (0,4) Corner Vertex 5 (4,2) Right Boundary Edge 9 (4,0) Corner Vertex 13 (Absolute Maximum) (4,4) Corner Vertex 13 (Absolute Maximum) - Absolute Minimum: 0, occurring at (1,2).
- Absolute Maximum: 13, occurring at (4,0) and (4,4).
Practice Problem 5: Concept & Reading Check
Open this Skill Block on the Memex to locate the information needed to answer the following:
- (a) State the two geometric/topological conditions that a domain DβR2 must satisfy for the Extreme Value Theorem to guarantee the existence of absolute extrema.
- (b) In Worked Example A, explain why calculating the Hessian discriminant D=fxxβfyyββ(fxyβ)2 is unnecessary when executing a global boundary-value optimization problem.
- (c) In Triangular Foundation Slab Soil Bearing Pressure (Civil & Construction Engineering), explain why civil engineers must evaluate contact pressure at the corner vertices of the footing slab.
Check the Extreme Value Theorem conditions in Extrema on Closed and Bounded Regions, review the Global Comparison Standard in the Key Equations, and read the geotechnical structural discussion in the linked foundation application.
Answer: * (a) The domain must be closed (contains all its boundary points) and bounded (enclosed by a disk of finite radius).
- (b) The global extrema are determined strictly by comparing the numerical heights f(x,y) across all candidates; local curvature classifications do not dictate absolute maximums or minimums.
- (c) Corners represent geometric transitions where boundary derivatives fail to exist, and overturning moments frequently produce peak contact stresses at exterior foundation toes.
Step-by-Step Execution
- (a) By the Extreme Value Theorem for Two Variables (defined in Extrema on Closed and Bounded Regions), the domain D must be both closed (including all boundary lines) and bounded (finite in extent). If the domain is open (missing boundary lines) or unbounded (extending infinitely), the function may grow without bound or approach an infimum on a missing edge.
- (b) The second derivative test classifies local behavior in an open neighborhood. For global optimization on compact domains, the Extreme Value Theorem guarantees that the highest and lowest points must be among the interior critical points, boundary critical points, or corner vertices. A direct numerical evaluation of f(x,y) across this finite list automatically identifies the global extrema without computing D.
- (c) In geotechnical foundation engineering, eccentric overturning loads induce linear and quadratic stress gradients. Because edges intersect sharply at vertices, mathematical boundary parameterizations terminate at corners. Physical foundation toe blowout frequently occurs at these sharp vertices.
Practice Problem 6: Absolute Extrema on a Closed Triangular Region
Find the absolute maximum and minimum values of:
Check the interior for critical points (is (0,0) strictly in the interior?). Parameterize the three boundary segments: y=0 (0β€xβ€4), x=0 (0β€yβ€3), and the hypotenuse line y=β43βx+3. Test all edge critical points and corner vertices (see Extrema on Closed and Bounded Regions).
Answer: Absolute minimum is 0 at (0,0); absolute maximum is 16 at (4,0).
Step-by-Step Execution
Tier 1: Interior Search:
fxβ=2x=0βΉx=0,fyβ=2y=0βΉy=0The point (0,0) is on the boundary (it is a vertex); thus there are no critical points strictly in the open interior.Tier 2: Boundary Edge Search:
- Bottom Edge (y=0,0β€xβ€4):
f(x,0)=x2βΉdxdβ[x2]=2x=0βΉx=0This reproduces vertex (0,0) (f=0); endpoint x=4 yields (4,0) (f=16).
- Left Edge (x=0,0β€yβ€3):
f(0,y)=y2βΉdydβ[y2]=2y=0βΉy=0This reproduces vertex (0,0) (f=0); endpoint y=3 yields (0,3) (f=9).
- Hypotenuse Line (y=β43βx+3,0β€xβ€4):
Substitute y=β43βx+3 into f(x,y):
g(x)=x2+(β43βx+3)2=x2+169βx2β29βx+9=1625βx2β29βx+9Differentiate and set to zero:gβ²(x)=1650βxβ29β=825βxβ29β=0βΉx=25/89/2β=29ββ 258β=2536β=1.44Since 1.44β[0,4], calculate y:y=β43β(2536β)+3=β2527β+2575β=2548β=1.92Evaluate function at (1.44,1.92):f(1.44,1.92)=(1.44)2+(1.92)2=2.0736+3.6864=5.76
- Bottom Edge (y=0,0β€xβ€4):
Tier 3: Corner Vertices:
- At (0,0): f(0,0)=0
- At (4,0): f(4,0)=16
- At (0,3): f(0,3)=9
Comparison & Conclusion:
- Candidate values: 0 (at (0,0)), 5.76 (at (1.44,1.92)), 9 (at (0,3)), 16 (at (4,0)).
- Absolute Minimum: 0 at (0,0).
- Absolute Maximum: 16 at (4,0).
Practice Problem 7: Absolute Extrema on a Closed Circular Disk
Find the absolute maximum and minimum values of:
Find interior critical points satisfying βf=0 and check if x2+y2<4. For the boundary x2+y2=4, express y2=4βx2 for xβ[β2,2]. Substitute this into f(x,y) to create a single-variable function g(x), find critical points of g(x), and check interval endpoints x=Β±2 (see Extrema on Closed and Bounded Regions).
Answer: Absolute minimum is β7 at (1,0); absolute maximum is 11 at (β2,0).
Step-by-Step Execution
Tier 1: Interior Search: Compute partial derivatives:
fxβ=4xβ4=0βΉx=1fyβ=6y=0βΉy=0Check boundary inequality: 12+02=1<4, so (1,0) lies strictly inside D.
Evaluate f at (1,0):f(1,0)=2(1)2+3(0)2β4(1)β5=2β4β5=β7Tier 2: Circular Boundary Search (x2+y2=4 for β2β€xβ€2): Solve for y2=4βx2 and substitute directly into f(x,y):
g(x)=2x2+3(4βx2)β4xβ5=2x2+12β3x2β4xβ5=βx2β4x+7Differentiate g(x) with respect to x and set to zero:gβ²(x)=β2xβ4=0βΉ2x=β4βΉx=β2Since x=β2 lies in the interval [β2,2], find y:y2=4β(β2)2=4β4=0βΉy=0Candidate boundary point: (β2,0).
Evaluate f at (β2,0):f(β2,0)=2(β2)2+3(0)2β4(β2)β5=2(4)+8β5=8+8β5=11Check Endpoints of the Interval xβ[β2,2]:
- At x=β2: y=0, giving (β2,0) already evaluated (f=11).
- At x=2: y2=4β22=0βΉy=0, giving point (2,0).
Evaluate f at (2,0):f(2,0)=2(2)2+3(0)2β4(2)β5=8β8β5=β5
Master Comparison & Conclusion:
Candidate Point Region Location Function Value f(x,y) (1,0) Interior Critical Point β7 (Absolute Minimum) (2,0) Boundary Point β5 (β2,0) Boundary Point 11 (Absolute Maximum) - Absolute Minimum: β7 at (1,0).
- Absolute Maximum: 11 at (β2,0).
π Regroup 2
- Boundary Substitution Standard: Emphasize how substituting y2=4βx2 reduces a 2D boundary search into single-variable Calculus 1 optimization.
- Filtering Discarded Candidates: Remind students to always verify that interior critical points satisfy the domain inequalities before adding them to the candidate table.
Skill Block 3
Constrained Optimization via Lagrange Multipliers
General Overview
Skill Block 3 presents the method of Lagrange multipliers for optimizing objective functions subject to smooth constraint equations. Students learn the geometric foundation of gradient tangency (βf=Ξ»βg), formulate component equation systems, avoid illegal division by zero when eliminating variables, and interpret Ξ» as a measure of system sensitivity and shadow pricing.
Conceptual Framework
- Lagrange Multiplier Vector System:
To find the extrema of f(x,y,z) subject to g(x,y,z)=k:βf=Ξ»βgandg(x,y,z)=k(Defined in Lagrange Multipliers.) - Geometric Tangency Condition:
At a constrained extremum, the level surface of f and the constraint surface g=k share a common tangent plane. Because gradient vectors are orthogonal to level sets, βf and βg must be collinear (parallel). - Physical Meaning of the Multiplier Ξ»:Ξ»=dkdfoptββΞ» represents the marginal change in the optimal objective value per unit relaxation of the constraint threshold k.
Key Equations & Structural Rules
- Vector Component Equations:i^:βxβfβ=Ξ»βxβgβ,j^β:βyβfβ=Ξ»βyβgβ,k^:βzβfβ=Ξ»βzβgβ
- Zero-Division Ban: Never divide by a variable without verifying whether that variable can equal zero.
- Candidate Testing Rule: After solving for coordinate candidates, substitute all points back into the objective function f to determine the maximum and minimum values.
Worked Example A: Constrained Distance Minimization in 3D Space
Find the point on the plane x+y+z=12 that is closest to the origin, and evaluate the minimum squared distance and minimum Euclidean distance.
π‘ Reveal Worked Solution
Formulate Objective and Constraint Functions: Minimizing Euclidean distance x2+y2+z2β is mathematically equivalent to minimizing the squared distance:
f(x,y,z)=x2+y2+z2subject to the linear plane constraint:g(x,y,z)=x+y+z=12Compute Gradient Vectors: State the Three-Variable Gradient Formula (defined in The Gradient Vector):
βf=β¨βxβfβ,βyβfβ,βzβfββ©=β¨2x,2y,2zβ©=2xi^+2yj^β+2zk^βg=β¨βxβgβ,βyβgβ,βzβgββ©=β¨1,1,1β©=i^+j^β+k^Set Up the Lagrange Multiplier System: State the Lagrange Multiplier Vector System (defined in Lagrange Multipliers):
βf=Ξ»βgandx+y+z=12Equate the scalar components:i^:2x=Ξ»(1)βΉx=2Ξ»βj^β:2y=Ξ»(1)βΉy=2Ξ»βk^:2z=Ξ»(1)βΉz=2Ξ»βEliminate Ξ» and Relate Variables: Since all three variables equal 2Ξ»β, we obtain:
x=y=zSubstitute into the Constraint Equation:
x+x+x=12βΉ3x=12βΉx=4Since x=y=z, our candidate optimal point is (4,4,4), with multiplier:Ξ»=2x=2(4)=8Evaluate Minimum Distances:
- Minimum squared distance:
f(4,4,4)=42+42+42=16+16+16=48
- Minimum Euclidean distance:
dminβ=f(4,4,4)β=48β=43ββ6.93The point on the plane closest to the origin is (4,4,4).
- Minimum squared distance:
Practice Problem 8: Concept & Reading Check
Open this Skill Block on the Memex to locate the information needed to answer the following:
- (a) Explain why the gradient vectors βf and βg must be parallel (βf=Ξ»βg) at a constrained optimal point, using the geometry of level curves.
- (b) In Worked Example A, state the value of the Lagrange multiplier Ξ», and explain what this number predicts if the plane constant is relaxed from 12 to 13.
- (c) In Orbital Insertion Satellite Delta-V Thruster Burn (Aerospace Engineering), explain how the Lagrange multiplier Ξ» informs mission control regarding fuel mass penalties.
Review the geometric tangency derivation in Lagrange Multipliers, inspect the sensitivity formula Ξ»=dfoptβ/dk, and read the mission delta-V analysis in the linked aerospace application.
Answer: * (a) The constraint curve is tangent to a level curve of f; because gradients are perpendicular to level sets, the two normal gradients must point along the same line (βf=Ξ»βg).
- (b) Ξ»=8; it predicts that increasing the plane constraint constant by +1 will increase the minimum squared distance by approximately Ξfβ8(1)=8 units.
- (c) Ξ» represents the marginal fuel burn penalty per km/s of required velocity change, guiding whether to invest in trajectory correction burns.
Step-by-Step Execution
- (a) By the Geometric Tangency Principle (defined in Lagrange Multipliers), if a constraint curve g=k crosses a level curve f=c at an angle, the value of f can be increased or decreased by sliding along the constraint. An extremum occurs only where the curves are tangent. Because βf is orthogonal to the level curve of f and βg is orthogonal to the constraint curve, the normal vectors must be collinear, yielding βf=Ξ»βg.
- (b) In Worked Example A, Ξ»=8. By the Sensitivity Theorem Ξ»=dkdfoptββ, relaxing the plane equation from x+y+z=12 to x+y+z=13 (Ξk=+1) increases the minimum squared distance by ΞfβΞ»Ξk=8(1)=8 units (exact new value: 3Γ(13/3)2=169/3β56.33, Ξf=8.33).
- (c) In aerospace propulsion, propellant is mass-constrained. The multiplier Ξ»=12 gives the direct marginal cost in fuel metric units per unit increase in target delta-V, allowing systems engineers to evaluate aerodynamic gravity assist trade-offs.
Practice Problem 9: Constrained Distance to a 2D Line
Minimize the objective function f(x,y)=x2+y2 subject to the linear constraint 4x+3y=12.
Calculate βf=β¨2x,2yβ© and βg=β¨4,3β©. Formulate component equations 2x=4Ξ» and 2y=3Ξ». Express x and y in terms of Ξ», substitute into 4x+3y=12, and solve for Ξ» (see Lagrange Multipliers).
Answer: Minimum value is 5.76 (or 144/25), occurring at coordinates (1.92,1.44)=(48/25,36/25).
Step-by-Step Execution
Compute Gradients:
βf=β¨2x,2yβ©,βg=β¨4,3β©Formulate Component Equations (βf=Ξ»βg):
i^:2x=4Ξ»βΉx=2Ξ»j^β:2y=3Ξ»βΉy=1.5Ξ»=23Ξ»βSubstitute into Constraint:
4(2Ξ»)+3(1.5Ξ»)=12βΉ8Ξ»+4.5Ξ»=12βΉ12.5Ξ»=12Ξ»=12.512β=2524β=0.96Compute Optimal Coordinates and Minimum Value:
x=2(0.96)=1.92=2548βy=1.5(0.96)=1.44=2536βEvaluate f(x,y):f(1.92,1.44)=(1.92)2+(1.44)2=3.6864+2.0736=5.76=25144β(The shortest Euclidean distance from the origin to the line is 5.76β=2.4).
Practice Problem 10: Constrained Extrema on an Elliptical/Circular Boundary
Find the maximum and minimum values of f(x,y)=xy subject to the circular constraint x2+y2=8.
Compute βf=β¨y,xβ© and βg=β¨2x,2yβ©. Set up y=2Ξ»x and x=2Ξ»y. Multiply the first by y and the second by x to show y2=x2βΉy=Β±x. Substitute into x2+y2=8 (see Lagrange Multipliers).
Answer: Maximum value is 4 at (2,2) and (β2,β2); minimum value is β4 at (2,β2) and (β2,2).
Step-by-Step Execution
Compute Gradients:
βf=β¨y,xβ©,βg=β¨2x,2yβ©Lagrange System:
- y=2Ξ»x
- x=2Ξ»y
- x2+y2=8
Eliminate Ξ»: Multiply equation (1) by y and equation (2) by x:
y2=2Ξ»xyandx2=2Ξ»xyβΉx2=y2βΉy=Β±xSubstitute into Constraint:
x2+x2=8βΉ2x2=8βΉx2=4βΉx=Β±2- For y=x, candidates are (2,2) and (β2,β2).
- For y=βx, candidates are (2,β2) and (β2,2).
Evaluate Objective f(x,y)=xy:
- At (2,2): f(2,2)=(2)(2)=4
- At (β2,β2): f(β2,β2)=(β2)(β2)=4
- At (2,β2): f(2,β2)=(2)(β2)=β4
- At (β2,2): f(β2,2)=(β2)(2)=β4
Conclusion:
- Maximum value: 4 at (2,2) and (β2,β2).
- Minimum value: β4 at (2,β2) and (β2,2).
Practice Problem 11: Geometric Optimization of a Rectangular Channel
An environmental engineer is sizing a rectangular open water channel with cross-sectional area A=xy=9Β m2, where x and y are positive dimensions. Using Lagrange multipliers, find the dimensions (x,y) that minimize the total perimeter P(x,y)=2x+2y.
Objective is P(x,y)=2x+2y, constraint is g(x,y)=xy=9. Compute βP=β¨2,2β© and βg=β¨y,xβ©. Equate 2=Ξ»y and 2=Ξ»x to show x=y (see Lagrange Multipliers).
Answer: Optimal dimensions are x=3Β m and y=3Β m; minimum perimeter is 12Β m.
Step-by-Step Execution
Formulate Functions:
- Objective: P(x,y)=2x+2y
- Constraint: g(x,y)=xy=9 (with x>0,y>0)
Compute Gradients:
βP=β¨2,2β©,βg=β¨y,xβ©Set Up System:
i^:2=Ξ»yβΉΞ»=y2βj^β:2=Ξ»xβΉΞ»=x2βEliminate Ξ» and Solve:
y2β=x2ββΉx=ySubstitute x=y into xy=9:x2=9βΉx=3Β mSince x=y, y=3Β m. Minimum perimeter:P(3,3)=2(3)+2(3)=6+6=12Β m
Practice Problem 12: Three-Variable Box Surface Area Minimization
An open-top rectangular shipping crate must have a specified volume of V=xyz=32Β m3. Using the method of Lagrange multipliers, determine the dimensions x,y,z that minimize the external surface area S(x,y,z)=xy+2xz+2yz.
Objective: S(x,y,z)=xy+2xz+2yz; constraint: g(x,y,z)=xyz=32. Compute βS=β¨y+2z,x+2z,2x+2yβ© and βg=β¨yz,xz,xyβ©. Show that x=y and x=2z, then substitute into xyz=32 (see Lagrange Multipliers).
Answer: Base dimensions are x=4Β m and y=4Β m, height is z=2Β m; minimum surface area is 48Β m2.
Step-by-Step Execution
Formulate Functions:
- Objective: S(x,y,z)=xy+2xz+2yz (base plus four vertical faces)
- Constraint: g(x,y,z)=xyz=32, with x,y,z>0
Compute Gradients:
βS=β¨y+2z,x+2z,2x+2yβ©βg=β¨yz,xz,xyβ©Lagrange Component Equations (βS=Ξ»βg):
- y+2z=Ξ»yz
- x+2z=Ξ»xz
- 2x+2y=Ξ»xy
Eliminate Ξ» and Relate Dimensions: Multiply equation (1) by x, (2) by y, and (3) by z:
xy+2xz=Ξ»xyzxy+2yz=Ξ»xyz2xz+2yz=Ξ»xyzEquating the first two expressions:xy+2xz=xy+2yzβΉ2xz=2yzβΉx=yEquating the first and third expressions with y=x:x2+2xz=2xz+2xzβΉx2+2xz=4xzβΉx2=2xzβΉx=2zβΉz=2xβSubstitute into Volume Constraint:
xyz=32βΉ(x)(x)(2xβ)=32βΉ2x3β=32βΉx3=64βΉx=4Β mNow find y and z:y=x=4Β mz=24β=2Β mEvaluate Minimum Surface Area:
S(4,4,2)=(4)(4)+2(4)(2)+2(4)(2)=16+16+16=48Β m2The optimal crate has a square base of 4Β mΓ4Β m and a height of 2Β m, achieving a minimum surface area of 48Β m2.
π Regroup 3
- Component Equation Setup: Reiterate how multiplying by x, y, and z cleanly aligns terms to Ξ»xyz in symmetric 3D problems.
- Physical Meaning of Constraints: Discuss how Ξ» serves as an economic shadow price in industrial fabrication when evaluating the cost of material limits.
π Synthesis Wrap-up
- Core Takeaways:
- Unconstrained Extrema: Use βf=0 and classify with the Hessian discriminant D=fxxβfyyββ(fxyβ)2.
- Closed & Bounded Extrema: Use the 3-tier strategy (interior, boundary curves, vertices) and evaluate directly in a global comparison table.
- Constrained Extrema: Use Lagrange multipliers βf=Ξ»βg when restricted to smooth curves or surfaces, and interpret Ξ»=βfoptβ/βk as sensitivity.
- Homework Assignment (Knewton Alta):
- Critical Points and the Second Derivative Test for Functions of Several Variables
- Maximization and Minimization Problems for Functions of Several Variables
- Lagrange Multipliers
- Next Session Preview: Session 14 introduces Double Integrals over Rectangular and General Regionsβaccumulating volume and mass under multivariable surfaces.