Initial value problems
What an IVP is, when it has a unique solution (Lipschitz condition), how it is discretized, and how systems and higher-order equations reduce to the same scheme.
What an initial value problem is
Differential equations model dynamical systems: the trajectory of a particle, the evolution of a temperature, an electrical circuit or the growth of a population. An initial value problem (IVP) combines the differential equation with the state of the system at the initial time:
A classic example is the Malthus population model, : the growth rate is proportional to the number of individuals (with it describes decay). The logistic or Verhulst model adds a nonlinear term that slows growth when resources are limited: . The latter appears as a recurring example in the methods of this section.
Existence and uniqueness of the solution
Before approximating a solution it helps to know that one exists and is unique. The condition controls how fast changes with respect to :
From the continuous to the discrete solution
Analytic techniques produce the continuous solution , but they only work for specific families of equations. Numerical methods approximate the solution when the analytic computation is impossible or too costly: they produce a discrete solution on the nodes of a partition of the interval.
Every method in this area (Euler, Heun, Runge-Kutta and the Adams multistep methods) follows this scheme: start from and advance node by node, building from the available information.
Systems of first-order equations
When several quantities evolve together (for instance interacting populations), the IVP is stated with unknown functions and one equation for each. With vector notation the system mirrors the scalar case:
This notation carries over to computation: one-step methods apply to the system component by component with no conceptual change, as the SIR epidemic model exercise shows.
Higher-order equations
An order- equation, , defines an IVP when and its derivatives up to order are known at the initial time. To solve it numerically, convert it into a first-order system:
Introduce new variables: the function and its successive derivatives.
Differentiating each new variable yields the next one, and the last one carries the original equation.
The initial conditions of the equation translate directly into those of the system: , , and so on. The sought solution is the first component, .
Write as a first-order system the equation of a pendulum of length , , with initial angle and initial angular velocity .
With and , the second-order equation becomes two first-order equations:
The initial conditions of the system are , , and any one-step method can integrate it in vector form.