What are differential equations?

Differential equations are the most commonly used tool to model the world around us. Many equations you learned in high-school physics, or in first year physics are derived from solutions to differential equations.

Definition: A differential equation is an equation that relates a function to one or more of its derivatives. The order of a differential equation is the highest order of derivative that appears in the equation.

Example: Newton's second law states that the acceleration of an object is due to the forces acting on that object. This can be succinctly stated with the equation $$ma = F.$$

Acceleration is defined as an instantaneous change in an object's velocity, and velocity is defined as an instantaneous change in an object's position. We can then express acceleration as the second derivative of an objects position with respect to time. For an idealized projectile, the only force acting on the object is the force due to gravity, so we can write $$ m \frac{d^2x}{dt^2} = -mg. $$ This is a second order differential equation for the position of the object.

The anatomy of a differential equation: The unknown function in the differential equation is called a state variable, the variables witch which the state variable depends on are called independent variables, and other unspecified quantities that appear in the equation are called parameters.

In the example above, the state variable is the position $x$, the independent variable is time $t$, and the only parameters are the acceleration due to gravity $g$, and the mass of the object $m$.

Definition: A differential equation is an ordinary differential equation if it only has one independent variable. Differential equations where the state variable depends on more than one independent variable are called partial differential equations.

Example: Let $\theta(t)$ be the angular position of a simple pendulum at time $t$. The motion of the pendulum can be described using the ordinary differential equation $$ \frac{d^2\theta}{dt^2}+\frac{g}{\ell}\theta = 0.$$ What are the state variable, dependent variable(s), and parameters of this equation? Is this an ordinary or partial differential equation?

The state variable is $\theta$, the independent variable is $t$, and the parameters are $g$ and $\ell$. This is an ordinary differential equation.

Example: The flow of heat in a uniform rod can be described by the equation $$ \frac{\partial u}{\partial t } = \alpha\frac{\partial^2 u}{\partial x ^2}.$$ What are the state variable, dependent variable(s), and parameters of this equation? Is this an ordinary or partial differential equation?

The state variable is the temperature $u$, the independent variables are time $t$ and position $x$, and the only parameter is $\alpha$. This is a partial differential equation since there are two independent variables.

In this class we will only consider ordinary differential equations. You may learn about partial differential equations in your numerical methods class next semester.

Definition: A function $u$ is a solution to an $n$th order ordinary differential equation on an interval $(a,b)$ (called an interval of existence) if $u$ is $n$ times differentiable, and satisfies the equation for all $t\in(a,b)$.

Example: Consider the ordinary differential equation $$ \frac{dy}{dt} = y^2.$$ This is a first order ordinary differential equation with state variable $y$ and independent variable $t$. The function $y(t) = \frac{1}{1-t}$ is a solution for $t\in (-\infty,1)$ since by the quotient rule, we have \begin{align} \frac{d}{dt}y(t) &= \frac{d}{dt} \frac{1}{1-t}\\ &= \frac{1}{(1-t)^2} \\ &= y^2. \end{align} Notice that $y(t)$ is not defined for $t = 1$, and so it can't be a solution at that point. We need to restrict the interval of existence to a connected piece of the domain of $y(t)$. We could also have said that $y(t)$ is a solution for $t\in (1,\infty)$.

Discussion: Is $y(t) = \frac{1}{1-t}$ the only solution to this differential equation? Can we change anything about $y(t)$, and still have a solution?

Differential equations typically have an infinite number of solutions. The reason for this is that when we solve differential equations, we are in some sense finding an indefinite integral (or several indefinite integrals). Recall from calculus, that when you find the indefinite integral of a function, there is always a constant of integration that comes with the solution.

The infinite set of solutions to a differential equation are called a family of solutions. If a family of solutions has $n$ different constants of integrations, we say it is an $n$-parameter family of solutions. Each constant of integration in the family of solutions adds a degree of freedom the solutions, allowing us to satisfy some additional conditions.

Typically, we will be interested in two types of additional conditions that will allow us to select a particular member of a family of solutions. Initial conditions are additional conditions defined at one particular value of the independent variable $t_0$. Boundary conditions are conditions defined at two different ends of an interval $(a,b)$. The specification of these conditions are typically given by the physics of the problem we are trying to solve.

Example: The solution to the pendulum equation $$ \frac{d^2\theta}{dt^2}+\frac{g}{\ell}\theta = 0.$$ is given by $\theta(t) = A \sin\left(\sqrt{\frac{g}{l}}t\right)+B\cos\left(\sqrt{\frac{g}{l}}t\right)$, where $A$ and $B$ are arbitrary constants. This is a two-parameter family of solutions. We can specify initial conditions by determining what the starting angular position $\theta(0)$ and angular velocity $\frac{d}{dt}\theta(0)$ are.

Exercises:

  • Show $y(t) = C e^{-3x}$ is a solution to $\frac{d^2y}{dt^2}-9y = 0$ on the interval $(-\infty,\infty),$ where $C$ is an arbitrary constant.
  • Show $u(x) = \frac{e^{x}}{1+e^{x}}$ is the solution to $\frac{du}{dt} = u(1-u)$ on the interval $(-\infty,\infty)$ with the initial condition $u(0) = \frac{1}{2}.$
  • Show that $w(t) = -\frac{t^3-8}{7t}$ is the solution to $\frac{d^2w}{dt^2}=\frac{2w}{t^2}$ on the interval $(0,\infty)$ and satisfying the boundary conditions $w(1) = 1$ and $w(2) = 0$.