Why is gradient perpendicular to the level curve




















Implicit Function Theorem for the system of implicit functions. Jacobian matrix. Example of application IFT for the system of implicit functions part 1. Example of application IFT for the system of implicit functions part 2.

Example of application in microeconomics. Cramer's rule. Taught By. Kirill Bukin Associate Professor, Candidate of sciences phys.

Try the Course for Free. Explore our Catalog Join for free and get personalized recommendations, updates and offers. Get Started. Learn Anywhere. All rights reserved. If you are standing on a level set and want to walk some small distance d and get as far as possible from the level set, you want to walk along the normal. Otherwise, if the path you take has a tangent component, it will tend to keep you closer to the level set if d is small enough compared to the size of the level set. As for Lagrange multipliers taking the geometric interpretation of the gradient as given , I think the best way to see what's going on is to consider the 2-variable case.

Consider the level curves of the objective function f x,y. If, moving along the constraint curve, we happen to be crossing one of these level curves of f x,y , then subject to the constraint we are either increasing or decreasing the value of f x,y. Therefore, we cannot be at a local extremum. Kim, remember the level sets' names in practical applications are isoclines, isotherms, isobars, isoutility curves: they are loci of places which all share the same scalar value, say feet elevation.

Alternately you can imagine that someone cut a walkable path on the side of the mountain. It's walkable because it's completely flat, i. You are looking straight uphill. This is the gradient direction.

Now keep in mind this is just one gradient at one point. Maybe you heard of a gradient field which sticks an uphill arrow at every point in the surrounding area. If you can envisage the gradient field of the pictures above from volcano. The bundle of tangent vectors to the surface at a point live in the tangent plane at that point.

The tangent[s] to the level set at that point are exactly the vectors in the tangent plane whose "vertical" component is zero. The vector[s] pointing in the direction of greatest increase are those with the largest relative "vertical" components. Plane geometry in the tangent plane shows that these must to be perpendicular.

If gradient is not perpendicular to the level curve, it will have some component along the level curve. This means that function's value will increase if you move in that direction, but on a level curve, function's value can not increase or decrease so gradient can not have component along level curve and this is possible only when gradient is perpendicular to level curve.

A very useful way to think about the gradient or more generally, the first derivative of any function on some Euclidean space is as "the thing that gives you the best linear approximation to the function at a given point.

That generalizes, by the way, to vector-valued functions: then f' p is a linear transformation, not simply a vector. The point is that if you look at your function very closely near the point p, then it looks more and more like that linear function, and the approximation just gets better as you look closer.

In particular, that linear approximation completely captures both the direction of the level curve of f through p and the direction of fastest growth. Now you should visualize a linear function of two variables, whose graph is simply a slanted plane, and it should be obvious that the level curves which are horizontal lines embedded in the plane are perpendicular to the slant of the plane, if you're visualizing it correctly.

One subtlety that my explanation doesn't completely cover is what happens when the gradient is zero: that would give you the linear approximation. Of course, the function f may not literally be constant near p, so you might still want to know what the level set looks like and where the fastest growth is.

To get that information, you will have to use the higher derivatives. All the gradient tells you is that:. Start in the 1-variable case. The derivative of a function at a point is a number that can be considered a vector that either points left or right. It is by default perpendicular to the level curve which is a point. So the perpendicular to the tangent of that graph f' c ,-1 is up to a constant the gradient of g.

Finally, consider the case of a linear function. The proof I usually see: Choose an arbitrary unit length tangent vector on the level set, and write it with coordinates.

If you take the inner product of this vector with the gradient, the sum you get is the definition of the directional derivative along that vector, and therefore zero. I think there is a more geometric way to think of it by taking a linear approximation to your function near a noncritical point, and restricting the linear function to a sphere.

After a suitable rotation, the extrema lie at poles, and the level set lies at the equator. Sign up to join this community. Context I found the question "why is the level curve perpendicular to the gradient" in an exam protocol for probabilistic planning. Jess 1, 2 2 gold badges 6 6 silver badges 23 23 bronze badges. Martin Thoma Martin Thoma 9, 14 14 gold badges 54 54 silver badges bronze badges.

Add a comment. Active Oldest Votes. It makes sense intuitively but what is the justification? Mariah Mariah 3, 1 1 gold badge 11 11 silver badges 24 24 bronze badges. Sign up or log in Sign up using Google. Sign up using Facebook. Sign up using Email and Password. Post as a guest Name. Email Required, but never shown. Upcoming Events. Featured on Meta.



0コメント

  • 1000 / 1000