Gradient 


Definition$\textrm{grad } f(x_0, y_0,z_0,...) = \nabla f(x_0, y_0,z_0,...) = \begin{bmatrix} \frac{\partial f}{\partial x}(x_0, y_0,z_0,...)\\ \frac{\partial f}{\partial y}(x_0, y_0,z_0,...)\\ \frac{\partial f}{\partial z}(x_0, y_0,z_0,...)\\ .\\ . \end{bmatrix}$
1 

MotivationThe gradient can be thought of as the multidimensional analogue of the one dimensional slope, given by the derivative. A popular preliminary example encountered while studying single variable calculus is that of the ball rolling down a hill. Notice how the calculation of the rate of change doesn't have to factor in the direction of the movement of the ball; since the hill itself is one dimensional, there is one direction (only one dependent variable in single variable functions) in which the ball can move. So is not the case when we move to higher dimensions. In higher dimensions (functions of several variables), the gradient takes the place of the derivative to calculate the slope.
0 

0 

Animation 1: The gradient is a multidimensional analogue of the derivative. 

Since there are now more than a single path the ball can take down the hill, the slope of the hill would depend on the direction as well. The gradient, which accounts for the direction, gives the slope of the hill.
0 

Bird's Eye ViewThe gradient, represented by the symbol nabla, $\nabla$ is an operator that calculates the rate of change of a function of more than one variable. Going back to the example of the hill, the gradient operator takes into consideration both the direction and position of the point at which the slope has to be calculated. Recall that while computing the slope of single variable functions, only the position had to be taken into account. The gradient operator takes as input a function, and gives as output a vector field. 0 

0 

Animation 2: The gradient operator takes the function and gives a corresponding vector field 

The specification of both position and direction is captured by the idea of partial differentiation. The rate of change of a multivariable function f(x,y) in the x direction is given by its partial derivative with respect to x, which is $\frac{\partial f}{\partial x}$. Similarly, $\frac{\partial f}{\partial y}$ represents the change of f in the y direction. The components of the vector field that $\nabla $ outputs are precisely these partial derivatives. 0 

0 

Animation 3: The process of computing the gradient 

Context of the Definition


0 

Animation 4: Each point in the vector field has a vector attached to it, which represents the combined result of the rate of change of the function with respect to x and with respect to y. 

Properties of the GradientBefore beginning the exploration into the properties of gradients, let's look at contour plots. A contour plot is a graph popular in topography and the study of inclines in landforms. Contour maps are used to indicate regions of constant altitude. 0 

0 

Figure 1: Contour maps are used widely in topography. It represents a three dimensional landform by plotting constant z slices onto a two dimensional surface. 

1. The gradient at a particular point is perpendicular to any line of zero incline passing through that point
Each contour line indicates a constant z value. This is why it is also referred to a level curve has no incline. The rate of change of the function at any point on the level curve is zero, as $f(x,y)= c$. In other words, the value of its directional derivative, given by $\left\ \nabla f \right\. cos\theta = 0$. Since the dot product is 0, we have that $\theta = 90$. Thus, the gradient is always perpendicular to the level curve. 0 

0 

Figure 2: The figure shows how a three dimensional function is mapped onto a two dimensional contour plot. 

Let's take a brief look at directional derivatives before moving on to the next property.


3. A zero gradient indicates a local maximumThe intuition for this property follows directly from the previous one. Since the gradient is an operator that points in the direction of greatest increase, a zero gradient would mean you are already at the point of greatest increase. Any movement from this point will result in a decrease in the output of the function f. ApplicationsThe gradient sees numerous applications in various fields of science and technology. Predominantly used in physics, it is a foundational element in interpreting Maxwell's Equations that features in the fields of optics, electromagnetism, and electric circuitry. In biology and life sciences, the gradient finds its application in a particular process by which motile cells move. Chemotaxis depends on the gradient of the relative concentration of the substance surrounding the cell. In the field of population dynamics and evolution, the notion of a fitness function is used to determine the survival of a population of species. the increase or decrease of a population depending on various parameters, and is given by the gradient of the fitness function.
1 

1 

Animation 7: A heatseeking missile moves in the direction of greatest increase in temperature, which leads it most rapidly to the hottest part of the enemy aircraft  its engine. In this way, the heatseeking missile makes use of a temperature gradient. 

HISTORY
Oliver Heaviside It is widely believed that the formal study of vector calculus began in response to the need in the physical sciences, to describe forces and velocities. The notion of the gradient finds its thorough use in physics, and has historically been an integral tool in the physicist's inventory. Devised by Hamilton during his study of quaternions, the symbol for the gradient, called nabla and denoted \(\nabla\) comes from the Greek word for the Pheonician harp. It makes its appearance several times in letters exchanged between schoolmates Clerk Maxwell and Peter Tait. About a problem dealing with orthogonal planes, Maxwell wrote to Tait "It is neater and perhaps wiser to compose a nablody on this theme which is well suited for this species of composition." Maxwell dedicated his Tyndallic Ode to Tait, referring to him in it as the "Chief Musician upon Nabla". 1 

PAUSE AND PONDER(or wait and \(\nabla\)iberate ? )
(Hint: The gradient points in the direction of steepest ascent)
1 

1 

Animation 8: Notice how the fluid swirls. Which is the direction of steepest ascent in this vector field? 

FURTHER READING
1 

References
1 

Contributor: 
Mentor & Editor: 
Verified by: 
Approved On: 
The work under this website is licenced under a Creative Commons AttributionShare Alike 4.0 International License CC BYSA