Uncertain differential equation has become an important tool to deal with uncertain dynamic systems such as finance, control and medical fields. The paper aims to study the problem of estimating unknown parameters in uncertain differential equations (UDEs). Least-square method is introduced to estimate unknown parameters of a class of simple UDEs. Further, two least-square estimators of a simple UDE are obtained. The simulation results show that the proposed method is feasible for estimating unknown parameters of some UDEs.
Uncertain differential equation (UDE) proposed by Liu [2] is a type of differential equations defined by Liu process. It is an important tool to deal with uncertain dynamic systems in finance, control and medical fields. Liu [3] proposed the first uncertain stock model. Chen [12] obtained the American option pricing formula in uncertain financial market. Uncertain interest rate model was introduced by Chen and Gao [14]. Yao [11] provided a no-arbitrage theorem for uncertain stock model. Liu [18] studied uncertain currency model. Yao [8] applied UDE to a stock model with floating interest rate. Besides, Zhu [20] discussed uncertain optimal control model. Recently, Li et al. [22, 23] and Fang et al. [6] established uncertain SIS epidemic models to study the dynamic properties of epidemic. In order to investigate properties of UDEs, many researchers analyzed the analytic solution of UDEs. Chen and Liu [13] provided the analytic solution of a linear UDE. Liu [17] introduced an analytic method for solving UDEs. Yao [7] studied a type of UDEs with analytic solution. More details about the topic to see Wang [21], Yao [7], Yang and Sheng [15], Sheng et al. [19], Zhou and Li [5].
However, there exist always some unknown parameters in uncertain differential equations. In order to analyze the dynamic properties of UDEs, it is key to obtain the estimators of unknown parameters. Classical methods such as the methods of least-square and moment have been commonly employed in the estimation of unknown parameters in uncertainty distribution of uncertain variable. For example, Liu [4] applied the least-square method to estimate the unknown parameters in the uncertainty distribution. Wang and Peng [16] used the method of moments to estimate those of uncertainty distributions. Yao and Liu [10] introduced uncertain regression analysis to estimate the relationships among the response variable and the explanatory variables by the principle of least squares.
Different from uncertain variable, uncertain differential equation is the evolution of uncertain phenomenon indexed by time or spaces. Until now, estimating unknown parameters of UDEs has not been done and analyses have not been made. In this paper, we provide a method to estimate unknown parameters of a class of simple uncertain differential equations. The method can be extended to solve such uncertain differential equation, which its solution has the explicit expression of uncertainty distribution.
The rest is organized as follows. Definitions and notation of uncertainty theory are reviewed in Section 2. In Section 3, we introduce a class of simple uncertain differential equations with unknown parameters and obtain the corresponding solution and uncertainty distribution. Based on the least-square method, we obtain the estimators of unknown parameters. As an application, two least-square estimators of a simple uncertain differential equation are obtained in Section 4. Discussions are given in Section 5.
Preliminaries
Let ℒ be a σ-algebra on a non-empty set Γ. Every element Λ ∈ ℒ is called an event.
Definition 1. [1] A set function ℳ: ℒ → [0, 1] is called an uncertain measure if it is supposed to satisfy four axioms:
Axiom 1 (Normality Axiom) ℳ {Γ} =1 for the universal set Γ.
Axiom 2 (Duality Axiom) ℳ {Λ} + ℳ {Λc} =1 for any event Λ.
Axiom 3 (Subadditivity Axiom) For every countable sequence of events Λ1, Λ2, . . . ,
The triplet (Γ, ℒ, ℳ) is called an uncertainty space.
Axiom 4 (Product Axiom) Let (Γi, ℒi, ℳi) be uncertainty spaces and Λi be arbitrarily chosen events from ℒi for i = 1, 2, . . . , then the product uncertain measure ℳ is an uncertain measure satisfying
where a ∧ b = min {a, b}.
Definition 2. [1] An uncertain variable ξ is a measurable function from uncertainty space (Γ, ℒ, ℳ) to the set of real numbers ; that is, for any Borel set B of , the set {ξ ∈ B} = {γ ∈ Γ|ξ (γ) ∈ B} is an event.
For any real number , uncertainty distribution Φ of uncertain variable ξ is defined by Φ (x) = ℳ {ξ ≤ x}. An uncertainty distribution Φ (x) is said to be regular if it is a continuous and strictly increasing function with respect to x at which 0 < Φ (x) < 1, and
If the inverse function Φ-1 exists and is unique for each α ∈ (0, 1), then it is called inverse uncertainty distribution of ξ, denoted by Φ-1 (α).
An uncertain variable ξ is said to be normal if it has uncertainty distribution
denoted by ξ ∼ 𝒩 (e, σ), where e and σ are real numbers with σ > 0. Evidently, the inverse uncertain distribution of ξ is
Especially, if e = 0 and σ = 1, ξ is called standard normal, denoted by ξ ∼ 𝒩 (0, 1).
Let T be an index set, and (Γ, ℒ, ℳ) be an uncertainty space. An uncertain process Xt is a measurable function from T × (Γ, ℒ, ℳ) to the set of real numbers, i.e., for each t ∈ T and any Borel set B of real numbers, the set {Xt ∈ B} = {γ|Xt (γ) ∈ B} is an event. An uncertain process Xt is said to have an uncertainty distribution Φt (x), if at each time t uncertain variable Xt has uncertainty distribution Φt (x).
Definition 3. [2] An uncertain process Xt is said to have independent increments if Xt1, Xt2 - Xt1, …, Xtu - Xtu-1 are independent uncertain variables, where t1, t2, …, tu are any times with t1 < t2 < ⋯ < tu.
Definition 4. [2] An uncertain process is said to be a stationary independent increment process if it has not only stationary increments but also independent increments.
Definition 5. [3] An uncertain process Ct is said to be Liu process, if
C0 = 0 and almost all sample paths are Lipschitz continuous.
Ct has stationary and independent increments with C0 = 0.
Every increment Ct+s - Cs is a normal uncertain variable with an uncertainty distribution
Let Xt be an uncertain process and Ct be Liu process. For any partition of closed interval [a, b] with a = t1 < t2 < ⋯ < tu+1 = b, the mesh is written as . Then, Liu integral of Xt is defined by
provided that the limit exists almost surely and is finite. Let f and g be two given functions. Then
is called an uncertain differential equation (UDE). An uncertain process Xt is called a solution of UDE (1), if Xt satisfies the UDE (1) for any time t.
Definition 6. [3] An uncertain differential equation is said to be stable if for any two solutions Xt and Yt, we have
for any given number ɛ > 0.
Parameter estimation
Consider the parameter estimation problem of a class of simple uncertain differential equations
with X0 = x0, where αl (l = 0, 1, …, p) and β (≠0) are unknown parameters. In order to get the solution of the UDE (14), it is reasonable to provide the following assumption.
Assumption 1: For any t > 0, each Fl (t) (l = 1, 2, …, p) is a time integrable and differentiable function.
For a time interval [0, t], by integration, we have
Based on Appsumption 1, denote . Then,
Obviously, the solution Xt is an uncertain process, which is essentially a function of the variable t and Liu process Ct.
Theorem 1.The UDE (2) is stable.
Proof. From (3), it is easy to get two solutions of the UDE (2) with initial values x0 and y0, that is,
For any given number ɛ > 0, we have
By Definition 6, the UDE (2) is stable.□
Theorem 2.Let Ψt (x) be uncertainty distribution of the solution Xt in (3) for and t > 0.
If β > 0, then
If β < 0, then
Proof. Based on the Equation (3), for any ,
(i) If β > 0, one has
(ii) If β < 0, one has
Thus, the conclusion is established.□
Remark 1. From Theorem 2, the unified form of uncertainty distribution of the solution Xt is
for and t > 0. It reveals that
Theorem 3.Suppose Gl (t - s) = Gl (t) - Gl (s) for l = 1, 2, …, p. Then, the solution Xt with the initial value x0 = 0 is a stationary independent increment process. Further, every incrementfor any t, s > 0.
Proof. Since Ct is an independent increment process, the uncertain process Ct1, Ct2 - Ct1, …, Ctu - Ctu-1 are independent for t1 < t2 < ⋯ < tu. For i = 1, 2, …, u, we have
where Xt0 = x0 = 0. Thus, Xti - Xti-1 (i = 1, 2, …, u) are independent, that is, Xt is an independent increment process. Moreover, the increment Ct+s - Ct ∼ 𝒩 (0, s) for all s > 0 and G (t - s) = G (t) - G (s). Thus,
are identically distributed uncertain variables for all s > 0, that is, Xt is a stationary increment process. Therefore, uncertain process Xt with x0 = 0 is a stationary independent increment process. Based on Theorem 2, it is easy to get the uncertainty distribution of increment Xt+s - Xs for any t, s > 0.□
Yao and Liu [10] introduced uncertain regression analysis to estimate the relationships among uncertain response variable and the explanatory variables. Let y be an uncertain observed response and u = (u1, u2, …, uk) be a vector of explanatory variables. Suppose that the functional relationship between y and u can be expressed by a regression model
where θl (l = 0, 1, …, k) are unknown parameters called the regression coefficients, and ɛ is a disturbance term. Then, (4) is called an uncertain linear regression model.
Let yi be the ith observed response of y and uil be the i observation or level of regressor ul. Suppose that n > k observations are available. The functional relationship between yi and uil is written by
In matrix form,
where
and θ = (θ0, θ1, ⋯ , θk) T, ɛ = (ɛ1, ɛ2, ⋯ , ɛn) T . Hereafter, the superscript T represents transpose of a vector or matrix.
An important objective of uncertain regression analysis is to estimate unknown parameters in regression model. One of these techniques is the method of least-square, which is used to estimate parameters in model (5). The least-square function is
Let be the estimator of parameter vector θ. With respect to θ, the function Q must be minimized and satisfies
If the inverse matrix (UTU) -1 exists, the least-square estimator of θ is
Case 1: β > 0.
From Theorem 2 (i), uncertainty distribution Ψt (x) of Xt becomes
Let (xi, tj, Ψtj (xi)) be observations and take X0 = x0, then
for i = 1, 2, …, n and j = 1, 2, …, m.
Denote
for i = 1, 2, …, n, j = 1, 2, …, m. In order to estimate unknown parameters of (7), the elements of Y, U, ɛ and θ of (5) are replaced by Y, U, ε and ϑ as follows
Then, the Equation (5) is equivalent to the matrix form
Based the Equation (6), the following result is directly obtained.
Theorem 4.Let , and be the least-square estimators of ϑ, αl and β in (7), respectively. Then, the estimators and satisfywhere Y and U are defined in (8).
Case 2: β < 0
Based on Theorem 2 (ii), uncertainty distribution Ψt (x) of Xt becomes
Let (xi, tj, Ψtj (xi)) be observations and take X0 = x0, then
for i = 1, 2, …, n and j = 1, 2, …, m.
Similar to Theorem 4, we get the following result.
Theorem 5.Let and be the least-square estimators of αl and β in (7), respectively. Then, the estimators and satisfywhere U is defined in (8), andwith .
A simple uncertain differential equation
Consider a simple uncertain differential equation
where α and β (≠0) are unknown parameters. By integration, it is to get
From Theorem 2, uncertainty distribution Ψt (x) of Xt is
for and t > 0.
Example 1. Consider a simple UDE dXt = αdt + βdCt with X0 = x0. For x ∈ [-50, 50] and t ∈ (0, 10], take β = 0.5 and x0 = 0, Fig. 1(a)–(c) respectively show the curves of uncertainty distribution Ψt (x) for α = -1, 3, 6.
Trajectories of uncertainty distribution Ψt (x) with α = -1, 3, 6.
Theorem 6.Let (xi, tj, Ψtj (xi)) be observations from (10) for i = 1, 2, …, n and j = 1, 2, …, m.
If β > 0, then the least-square estimators and of α and β in (10) arewhere for i = 1, 2, …, n, j = 1, 2, …, m .
If β < 0, then the least-square estimators and of α and β in (10) arewhere for i = 1, 2, …, n, j = 1, 2, …, m.
Thus,
for i = 1, 2, …, n and j = 1, 2, …, m. From Theorem 4, take
and , we have
where
Then,
The estimators and follow. The proof of (ii) is similar to that of (i). □
Example 2. Similar to Example 1, for a simple UDE dXt = αdt + βdCt with Xt = x0, take α = -1, β = 0.5, x0 = 0. Thus, the uncertainty distribution Ψt (x) of Xt is
for and t > 0. Take x ∈ [-50, 50], t ∈ (0, 10]. Figure 1(a) shows the trajectories of uncertainty distribution Ψt (x).
Denote
From the Equation (11) and the above parameters, we have
for i = 1, 2, …, n and j = 1, 2, …, m. Figure 2(a) provides the curves of the above equation yij and the corresponding data set.
Trajectories of the true values yij and fitted values .
Next we try to estimate the parameters α and β for the UDE from the observations of yij. Suppose xi = -50 : 0.1 : 50 and tj = 0.1 : 0.1 : 10, we have n = 1001 and m = 100. There exist 100, 100 observations yij from (xi, tj) in Fig. 2(a). From Theorem 6, the least-square estimators and of α and β are
Thus, by least-square method, we get the estimated parameters of the UDE, denoted by
Figure 2(b) shows the curves of estimated value of yij, that is,
Define the coefficient of determination
where . From the Equations (12) and (13), we have R2 = 0.98, which reveals the estimated values and are the good estimations of unknown parameters α and β.
Discussions
In the paper, we solve the estimation problem of a class of simple uncertain differential equations. The solution and uncertainty distribution of uncertain differential equation are first obtained. By the method of least-square, the estimators of unknown parameters are given. Further, we provide the analytic expressions of two unknown parameters for a simple uncertain differential equation. The conclusions were validated and illuminated by numerical simulation.
The above results can be extended such uncertain differential equations, which the explicit expressions of their solutions and uncertainty distribution can be obtained. For example, consider an uncertain differential equation
with the initial value f (x0), where Xt is an uncertain process and f (x) is a non-negative function. If f (x) = x (x > 0), we get a linear UDE
If f (x) = sin x (0 < x < π), we get a non-linear UDE
For (14), since
it is equivalent to the following UDE
From (3), it is easy to get
that is, the solution of the UDE (14) is
If f (x) is a non-negative monotone function, then
Let Ψf (x, t) be the uncertainty distribution of f (Xt). Similar to Theorem 2, for any x > 0, we have
Then,
That is,
Let (xi, tj, Ψf (xi, tj)) be observations from the above equation. Then,
for i = 1, 2, …, n and j = 1, 2, …, m. In (8), denote
for i = 1, 2, …, n, j = 1, 2, …, m, and the last column of the matrix U is replaced by
Based on Theorems 4 and 5, we respectively obtain the least-square estimators and of αl (l = 0, 1, …, p) and β in (14).
For some complicate uncertain differentialequations
where α = (α0, α1, …, αp) and β = (β0, β1, …, βq) are unknown parameter vectors, we can not obtain their analytic solution and uncertainty distribution. Thus, the method isn’t applicable for this type. In the future, we plan to develop new methods to solve the problem.
Footnotes
Acknowledgments
This research is funded by the National Natural Science Foundation of China (Grant No. 11661076) and the Natural Science Foundation of Xinjiang (Grant No. 2016D01C043).
B.Liu, Fuzzy process, hybird process and uncertain process, J. Uncertain Syst2 (2008), 3–16.
3.
B.Liu, Some research problems in uncertainty theory, J. Uncertain Syst3 (2009), 3–10.
4.
B.Liu, Uncertainty Theory: A Branch of Mathematics for Modeling Human Uncertainty, Springer-Verlag, Berlin, 2010.
5.
C.Zhou and Z.M.Li, Analytic solutions of two types of nonlinear uncertain differential equations, J. Intell. Fuzzy Syst35 (2018), 2413–2420.
6.
J.Fang, Z.M.Li, F.Yang and M.Y.Zhou, Solution and α-path of uncertain SIS epidemic model with standard incidence and demography, J. Intell. Fuzzy Syst35 (2018), 927–935.
7.
K.Yao, a type of uncertain differential equations with analytic solution, Journal of Uncertainty Analysis and Applications1 (2013), 1–8.
8.
K.Yao, Uncertain contour process and its application in stock model with floating interest rate, Fuzzy Optim Decis Ma14 (2015), 399–42.
9.
K.Yao and B.Liu, Uncertain regression analysis: an approach for imprecise observations, Soft computing22 (2018), 5579–5582.
10.
K.Yao, Multi-dimensional uncertain calculus with Liu process, J. Uncertain Syst8 (2014), 244–254.
11.
X.Chen, American option pricing formula for uncertain financial market, International Journal of Operations Research8 (2011), 32–37.
12.
X.Chen and B.Liu, Existence and uniqueness theorem for uncertain differential equations, Fuzzy Optim Decis Ma19 (2010), 69–81.
13.
X.Chen and J.Gao, Uncertain term structure model of interest rate, Soft Computing17(4) (2013), 597–604.
14.
X.F.Yang and Y.Y.Shen, Runge-Kutta method for solving uncertain differential equations. Journal of Uncertainty Analysis and Applications (2015), 3–17.
15.
X.S.Wang and Z.X.Peng, Method of moments for estimating uncertainty distribution. Journal of Uncertainty Analysis and Applications, (2014), 1–10.
16.
Y.H.Liu, An analytic method for solving uncertain differential equations. J. Uncertain Syst16 (2012), 244–249.
17.
Y.H.Liu, Uncertain currency model and currency option pricing, International Journal of Intelligent Systems30 (2015), 40–51.
18.
Y.H.Sheng, G.Shi and Q.Cui, Almost sure stability for multifactor uncertain differential equation, J. Intell. Fuzzy Syst32 (2017), 2187–2194.
19.
Y.Zhu, Uncertain optimal control with application to a portfolio selection model. Cybernetics and Systems41 (2010), 535–547.
20.
Z.Wang, Analytic solution for a general type of uncertain differential equation. Information: An International Interdisciplinary Journal16 (2013), 1003–1010.
21.
Z.M.Li, Y.H.Sheng, Z.D.Teng and H.Miao, An uncertain differential equation for SIS epidemic model. J. Intell. Fuzzy Syst33 (2017), 2317–2327.
22.
Z.M.Li, Z.Teng, J.Hong and X.Shi, Comparison of three SIS epidemic models: deterministic, stochastic and uncertain. J. Intell. Fuzzy Syst35 (2018), 5785–5796.