This paper investigates the moments of a stochastic process that satisfies the one-dimensional linear stochastic differential equation (SDE) with nonlinear time-dependent drift and diffusion coefficients. The goal is to derive formulas for the exact moment, that instead of seeking the transition density function by solving the Fokker-Plank equations or moment-generating functions, which can be difficult to solve in closed form. We will appropriately apply Itô’s formula and the properties of the Wiener process with a constant drift and diffusion term, which is a Gaussian process to obtain the exact higher-order moments.
In this paper we consider a stochastic process governed by linear stochastic differential equation (SDE) with nonlinear time-dependent coefficients:
where denotes a one-dimensional standard Wiener process (or Brownian motion) with independent and identically Gaussian distributed (i.i.d) increments for all . The time-dependent drift and diffusion terms are known functions. The parameters and . We assume that is piecewise continuous function on and is derivative of , where for all . The form of Eq. (1) contains some popular stochastic processes as its special cases. For instance, when , the stochastic process becomes Merton (1973) model. When , and , it becomes Brownian bridge process with time-dependent diffusion (see example 2). In addition, when , and , the model becomes the Vasicek (1977) process with mean and variance . These models have a variety of applications in many disciplines and emerge naturally in the study of many phenomena. An example of this application is in financial modeling, including pricing of bond options, swaptions, modeling future interest short rates, and other interest rate derivatives (see e.g., Klebaner, 2005; Henderson& Plaschko, 2006; Alle, 2007; Mackevicius, 2016), as well as in many other fields of science and engineering.
In most cases, the density function or moment-generating function of a random variable is first acquired or specified. Then, either by integrating a power function along with the density function or by differentiating the moment-generating function are often used to obtain the moments. The higher-order moments of a stochastic process are very important because they provide information about the shape and spread of the distribution of the process. In particular, they can help characterize skewness and kurtosis of the distribution, as well as the estimation of diffusion models (see e.g., Bishwal, 2008, 2012). In most cases, the transition density function of linear non-homogeneous SDE may be determined by solving the corresponding Kolmogorov forward or Fokker-Planck equations (Risken, 1996). Even if the density or moment-generating functions can be established for certain exceptional circumstances, computing the moments would not be accessible if one desired high-order moments. In general, computing higher-order moments of a stochastic process satisfying a linear non-homogeneous SDE can be challenging, as the Fokker-Planck equation may not have an analytical solution. In such cases, numerical methods, such as Monte-Carlo simulations, may be used to approximate the moments of the process.
The main purpose of this paper is to investigate the exact higher-order moments of Eq. (1), which can provide important information about the statistical properties of this process, including its mean, variance, skewness, and kurtosis. Instead of seeking the density or moment-generating functions, we utilize Itô’s formula and the properties of the Wiener process with a constant drift and diffusion term. These formulas provide a simple computation of the exact moment. This leads to a very effective way to validate the performance of numerical simulations in stochastic modeling when applying the Eq. (1). Overall, by computing the higher-order moments of the process described by Eq. (1), researchers can gain a better understanding of its statistical properties and make more accurate predictions about its behavior over time.
The paper is structured into three main sections. In Section 2, we present the main results by deriving the exact formulas for the moment of Eq. (1). In Section 3, we perform a numerical Monte-Carlo simulation to calculate the moments of the propagation process and compare them with the analytical expressions derived in the previous section. Finally, we provide the conclusions of the paper in Section 4.
Main results
Suppose that is a probability space. Let be a stochastic process on with state space ; that is, takes values in for all . We consider the stochastic process as the solution of the SDE:
we assume that is well-defined for all and can be either a random or a non-random initial condition independent of . The time-dependent drift and diffusion coefficients which are assumed to be sufficiently regular (Lipschitz, bounded growth) for the existence and uniqueness the solution of Eq. (2) (see Oksendal, 2003). Throughout this paper we assume that all the moments of are finite. More precisely, we suppose for all non-negative integer , where . In what follows we consider a function and let so that is again an Itô process. by assuming , we applying Itô’s Lemma to , which results in:
it is then easy to find the exact solution of Eq. (2):
it’s clear to find the moments of the process , we take expectation on both sides of Eq. (4).
.
Assume is piecewise continuous function on and . The parameters and . For all non-negative integer , the exact high-order moments of Eq. (2) are given by:
where is the Hermite polynomial evaluated at (see e.g., Olver et al., 2010, p. 438). The functions and satisfies the following expressions:
in which .
Proof..
From the Eq. (3), the stochastic process is called a Wiener process with constant drift, which has the mean and variance . We see that has a Gaussian distribution:
for a non-negative integer , the exact higher-order moments of which are given by (see Willink, 2005):
then, we will apply the following change of variable to find the moments of Eq. (2):
therefore we get:
hence, we plug the last expression into higher-order moments of we obtain:
by inserting the expression of (with ) and into last equation the proof is completed. ∎
.
For a non-negative integer , the higher-order moments Eq. (5) satisfies the recurrence relation of the following differential equation:
with and , where , and satisfies the following expressions:
Proof..
We consider the following change of variables , and applying Itô’s formula, the stochastic differential are obtained:
the last equation can be written in integral form:
we take expectation on both sides of the last equation and we use the properties of stochastic integrals, we get:
Afterward, differentiate with respect to on each side, one obtains the recurrence relation of the differential equation, for :
here we set , and . ∎
Theorem 1 provides the exact formula for the moments of in terms of the Hermite polynomial without the recurrence relations for all non-negative integer . Theorem 2 can be found these moments explicitly with recurrence relations and can be computed without difficulty. If we impose an additional constraint or find it difficult to apply those theorems. Instead, we provide an alternative formula for the exact high-order moments of Eq. (2) in the following theorem.
.
Suppose that , and for all . For all non-negative integer the exact high-order moments of Eq. (2) is given by:
where:
Proof..
From the Eq. (4), and for all non-negative integer we have:
now, we rewrite in binomial expansion:
we take expectation on both sides of the last equation:
then we have the high-order moments of standard Wiener process :
hence, we noted and , and we plug the last expression into we obtain:
Therefore, Eq. (7) holds for all non-negative integer .∎
Generally, to compute the higher-order moments of a stochastic process of the type Eq. (2) we use Theorem 2. In other words, the use of Itô’s formula and the properties of stochastic integration is essential. Through this technique, one easily obtains a linear system of differential equations (recurrence relation of ODEs) with nonlinear time-dependent coefficients Eq. (6). The disadvantage is that this system is difficult to solve in a closed-form. For this reason, we recommend directly using the results obtained in Theorem 1 and 3.
Numerical experiment
In this section, we conduct a numerical experiment on computation of the moments of the stochastic process defined by Eq. (2). The formula derived in the previous section will be used to calculate the exact moments. These results will be compared with the simulation results that will be computed using a Monte-Carlo method. For the Monte-Carlo method, we utilize the R Core Team (2023) package Sim.DiffProc (Guidoum & Boukhetala, 2020) to numerically simulate the solution of Eq. (2). In Examples 1, 2 and 3, we simulate 100000 number of sample paths in the time range and compute the approximate moment defined by . We will then apply the formula from Theorem 1 and 3 to compute the exact moment, i.e., . For a numerical comparison, we scale the moments to be comparable and similar to each other. The scaled moment is defined by:
(case : linear time-dependent function).
We consider the following SDE as a numerical example to compute its moments, with: , , , and (where: for all ). We have:
as an illustration, in this example we will use the formula from Theorem 3 (we can also use Theorem 1 and 2 we will find the same results). From the Eq. (7) we have:
In Fig. 1 we provide a visual comparison of the accuracy of the Monte-Carlo simulation approach (continuous lines) to the exact values (dashed lines) of the moments from to over time .
approximate and exact moments of Eq. (8), with: , , , and .
(case : nonlinear time-dependent function).
We consider the linear non-homogeneous SDE, with: , , and :
for any , we obtain Brownian bridge process:
From the Eq. (5), the exact high-order moments of Eq. (9) are given by:
If we have difficulties in calculating by the last equation, we can also use the alternative Eq. (7), and we will find explicitly the same results for all non-negative integer .
to illustrate, for any we obtain explicitly the first, second, and third moments of Eq. (9):
The Fig. 2 shows the moments of Eq. (9) from to , where there is an excellent agreement between the Monte-Carlo simulation (continuous lines) and that were calculated using the formula (dashed lines). In the top for is first derivative of and for is second derivative of at the bottom. As one can see, the rough and unsmooth curves (continuous lines) are caused by the approximation errors in the simulated sample pathways. However, the graph displays the smooth curves (dashed lines) as the Eqs (5) and (7) produces the exact values of the high-order moments of Eq. (9).
approximate and exact moments of Eq. (9), with: , , and . Left: , Right .
In that last example, we suppose a more complex SDE with multiple nonlinear time-dependent drift and diffusion coefficients (hybrid SDE), with parameters: , and . We assume that is defined on two states as follows:
for , we have the second and third derivative of :
hence we have the following model:
Here, we will directly use the formula from Theorem 1 to explicitly find the high-order moments. For example, we obtain explicitly the first, second, and third moments of Eq. (10):
The results obtained by the Monte-Carlo simulation and which were calculated by Eq. (5) are shown in Fig. 3.
approximate and exact moments of Eq. (10), with: , , , and .
Conclusion
Statistical moments provide relevant information, for example the peak location and width of the stochastic transient are determined by the first and second moment. However, an explicit solution for the Fokker-Plank equation is unlikely. Therefore, it is necessary to adopt approximate solutions. The evaluation of high-order moments is therefore valuable, and we can obtain them quickly and explicitly by the formulas discussed in this article, as shown in the above examples. In this sense, the resulting procedures are highly effective techniques for validating the effectiveness of Monte-Carlo simulations in stochastic modeling when using the linear SDE with nonlinear time-dependent drift and diffusion coefficients.
Footnotes
Acknowledgments
The authors are thankful to the editor and the anonymous referees for their thorough review and highly appreciate the comments and suggestions which significantly contributed to increasing the quality of our article. The work described in this paper was supported by the project entitled: “Mathematical Methods and Tools for System Performance” under the number “C00L03UN110120230001”, within the framework “Projets de Recherche Formation-Universitaire (PRFU)”, University of Tamanghasset, Ministry for Higher Education and Scientific Research, Algeria.
Supplementary material
The R code can be found on GitHub at https://github.com/acguidoum/R-code-MAS-231435, so that readers can replicate the results.
GuidoumA.C., & BoukhetalaK. (2020). Performing parallel monte carlo and moment equations methods for itô and stratonovich stochastic differential systems: R package Sim.DiffProc. Journal of Statistical Software, 96(2), 1-82. doi: 10.18637/jss.v096.i02.
5.
HendersonD., & PlaschkoP. (2006). Stochastic differential equations in science and engineering. World Scientific. doi: 10.1142/5806.
6.
KlebanerF.C. (2005). Introduction to stochastic calculus with applications (2nd ed.). Imperial College Press. doi: 10.1142/p386
MertonR.C. (1973). Theory of rational option pricing. The Bell Journal of Economics and Management Science, 4(1), 141-183. doi: 10.2307/3003143.
9.
ØksendalB. (2003). Stochastic differential equations: An introduction with applications (6th ed.). Springer Berlin, Heidelberg. doi: 10.1007/978-3-642-14394-6.
10.
OlverF.W.LozierD.W.BoisvertR.F., & ClarkC.W. (2010). Nist handbook of mathematical functions (1st ed.). New York, United States: Cambridge University Press.
11.
R Core Team. (2023). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria. Retrieved from https://www.R-project.org/.
12.
RiskenH. (1996). The fokker-planck equation: Methods of solution and applications (2nd ed., Vol. 18). Springer-Verlag. doi: 10.1007/978-3-642-61544-3.
13.
VasicekO. (1977). An equilibrium characterization of the term structure. Journal of Financial Economics, 5(2), 177-188. doi: 10.1016/0304-405X(77)90016-2.
14.
WillinkR. (2005). Normal moments and hermite polynomials. Statistics & Probability Letters, 73(3), 271-275. doi: 10.1016/j.spl.2005.03.015.