7.2
CiteScore
3.7
Impact Factor
Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Filter by Categories
ABUNDANCE ESTIMATION IN AN ARID ENVIRONMENT
Case Study
Editorial
Invited review
Letter to the Editor
Original Article
REVIEW
Review Article
SHORT COMMUNICATION
7.2
CiteScore
3.7
Impact Factor
Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Filter by Categories
ABUNDANCE ESTIMATION IN AN ARID ENVIRONMENT
Case Study
Editorial
Invited review
Letter to the Editor
Original Article
REVIEW
Review Article
SHORT COMMUNICATION
View/Download PDF

Translate this page into:

Original article
29 (
1
); 114-118
doi:
10.1016/j.jksus.2016.06.004

Estimation for stochastic volatility model: Quasi-likelihood and asymptotic quasi-likelihood approaches

Department of Basic Sciences and Humanities, College of Engineering, University of Dammam, Saudi Arabia
Department of Mathematics, Faculty of Science, Al-Balqa’ Applied University, Jordan

⁎Address: Department of Basic Sciences and Humanities, College of Engineering, University of Dammam, Saudi Arabia. raalzghool@uod.edu.sa (Raed Alzghool) raedalzghool@bau.edu.jo (Raed Alzghool)

Disclaimer:
This article was originally published by Elsevier and was migrated to Scientific Scholar after the change of Publisher.

Peer review under responsibility of King Saud University.

Abstract

For estimation of the stochastic volatility model (SVM), this paper suggests the quasi-likelihood (QL) and asymptotic quasi-likelihood (AQL) methods. The QL approach is quite simple and does not require full knowledge of the likelihood functions of the SVM. The AQL technique is based on the QL method and is used when the covariance matrix Σ is unknown. The AQL approach replaces the true variance–covariance matrix Σ by nonparametric kernel estimator of Σ in QL.

Keywords

Stochastic volatility model (SVM)
Quasi-likelihood (QL)
Asymptotic quasi-likelihood (AQL)
Martingale difference
Kernel estimator
1

1 Introduction

Consider the stochastic volatility process y t which satisfies the stochastic volatility model

(1.1)
y t = e h t 2 η t , t = 1 , 2 , 3 , , T and
(1.2)
h t = γ + ϕ h t - 1 + δ t , t = 1 , 2 , 3 , , T .

Furthermore, η t are independent and identically distributed (i.i.d) with E ( η t ) = 0 and V ( η t ) = σ η 2 , and δ t are i.i.d with E ( δ t ) = 0 and V ( δ t ) = σ δ 2 . For estimation and application of the stochastic volatility model (SVM) (see Jacquire et al., 1994; Breidt and Carriquiry, 1996; Sandmann and Koopman, 1998; Pitt and Shepard, 1999; Papanastastiou and Ioannides, 2004; Alzghool and Lin, 2008; Chan and Grant, 2015; Pinho et al., 2016) Sandmann and Koopman (1998) introduced the Monte Carlo maximum-likelihood procedure. Davis and Rodriguez-Yam (2005) proposed another estimation technique that relies on the likelihood function.

This paper applies the quasi-likelihood (QL) and asymptotic quasi-likelihood (AQL) approaches to SVM. The QL approach relaxes the distributional assumptions but has a restriction that assumes that the conditional variance process is known. To overcome this limitation, we suggest a substitute technique, the AQL methodology, merging the kernel technique used for parameter estimation of the SVM. This AQL methodology enables a substitute technique for parameter estimation when the conditional variance process is unknown.

This paper is structured as follows. The QL and AQL approaches are introduced in Section 2. The SVM estimation using the QL and AQL methods, reports of simulation outcomes, and numerical cases are presented in Section 3. The QL and AQL techniques are applied to a real data set in Section 4. Section 5 summarizes and concludes the paper.

2

2 The QL and AQL methods

In this section, we introduce the QL and AQL methods.

2.1

2.1 The QL Method

Let the observation equation be given by

(2.1.1)
y t = f t ( θ ) + ζ t , t = 1 , 2 , 3 , T .

ζ t is a sequence of martingale difference with respect to F t , F t denotes the σ -field generated by y t , y t - 1 , , y 1 for t 1 ; that is, E ( ζ t | F t - 1 ) = E t - 1 ( ζ t ) = 0; where f t ( θ ) is an F t - 1 measurable; and θ is a parameter vector, which belongs to an open subset Θ R d . Note that θ is a parameter of interest. We assume that E t - 1 ( ζ t ζ t ) = Σ t is known. Now, the liner class G T of the estimating function (EF) can be defined by G T = t = 1 T W t ( y t - f t ( θ ) ) and the quasi-likelihood estimation function (QLEF) can be defined by

(2.1.2)
G T ( θ ) = t = 1 T f ̇ t ( θ ) Σ t - 1 ( y t - f t ( θ ) ) , where W t is F t - 1 -measurable and f ̇ t ( θ ) = f t ( θ ) / θ . Then, the estimation of θ by the QL method is the solation of the QL equation G T ( θ ) = 0 (see Hedye, 1997).

If the sub-estimating function spaces of G T are considered as follows, G t = { W t ( y t - f t ( θ ) ) , t = 1 , 2 , 3 , T } , then the QLEF in the space G t can be defined by

(2.1.3)
G ( t ) ( θ ) = f ̇ t ( θ ) Σ t - 1 ( y t - f t ( θ ) ) and the estimation of θ by the QL method is the solation of the QL equation G ( t ) ( θ ) = 0 .

A limitation of the QL method is that the nature of Σ t may not be obtainable. A misidentified Σ t could result in a deceptive inference about parameter θ . In the next subsection, we introduce the AQL method, which is basically the QL estimation assuming that the covariance matrix Σ t is unknown.

2.2

2.2 The AQL method

The QLEF (see (2.1.2) and (2.1.3)) relies on the information of Σ t . Such information is not always accessible. To find the QL when E t - 1 ( ζ t ζ t ) is not accessible, Lin (2000) proposed the AQL method.

Definition 2.2.1

Let G T , n be a sequence of the EF in G . For all G T G , if ( E G ̇ T ) - 1 ( E G T G T ) ( E G ̇ T ) - 1 - ( E G ̇ T , n ) - 1 ( E G T , n G T ) ( E G ̇ T , n ) - 1 is asymptotically non-negative definite, G T , n can be denoted as the asymptotic quasi-likelihood estimation function (AQLEF) sequence in G , and the AQL sequence estimates θ T , n by the AQL method is the solution of the AQL equation G T , n = 0 .

Suppose, in probability, Σ t , n is converging to E t - 1 ( ζ t ζ t ) . Then,

(2.2.1)
G T , n ( θ ) = t = 1 T f ̇ t ( θ ) Σ t , n - 1 ( y t - f t ( θ ) ) expresses an AQLEF sequence. The solution of G T , n ( θ ) = 0 expresses the AQL sequence estimate { θ T , n } , which converges to θ under certain regular conditions.

In this paper, the kernel smoothing estimator of Σ t is suggested to find Σ t , n in the AQLEF ((2.2.1)). A wide-ranging appraisal of the Nadaraya–Watson (NW) estimator-type kernel estimator is available in Härdle (1990) and Wand and Jones (1996). By using these kernel estimators, the AQL equation becomes

(2.2.2)
G T , n ( θ ) = t = 1 T f ̇ t ( θ ) Σ ̂ t , n - 1 ( θ ̂ ( 0 ) ) ( y t - f t ( θ ) ) = 0 .

The estimation of θ by the AQL method is the solution to (2.2.2). Iterative techniques are suggested to solve the AQL equation (2.2.2). Such techniques start with the ordinary least squares (OLS) estimator θ ̂ ( 0 ) and use Σ ̂ t , n ( θ ̂ ( 0 ) ) in the AQL equation (2.2.2) to obtain the AQL estimator θ ̂ ( 1 ) . Then, update θ ̂ ( 0 ) by θ ̂ ( 1 ) . Repeat this a few times until it converges.

The next section presents the parameter estimation of SVM using the QL and AQL methods.

3

3 Parameter estimation of SVM

In the following, we present the parameter estimation of SVM, which include non-linear and non-Gaussian models. We propose the QL and AQL approaches for SVM estimation. The estimations of states and unknown parameters are considered without any distribution assumptions about processes, and the estimation is based on different scenarios in which the conditional covariance of the error terms are assumed to be known or unknown.

3.1

3.1 Parameter estimation of SVM using the QL method

The stochastic volatility model is given by

(3.1.1)
y t = e h t 2 η t , t = 1 , 2 , 3 , T and
(3.1.2)
h t = γ + ϕ h t - 1 + δ t , t = 1 , 2 , 3 , T
δ t are i.i.d with E ( δ t ) = 0 and V ( δ t ) = σ δ 2 .

The SVM in (3.1.1) can be transformed into a linear model as follows:

(3.1.3)
ln ( y t 2 ) = h t + ln η t 2 , t = 1 , 2 , 3 , T .

Abramovitz and Stegun (1970) showed that if η t N ( 0 , 1 ) , then E ( ln η t 2 ) = - 1.2704 and Var ( ln η t 2 ) = π 2 / 2 . Now, assume that ε t = ln η t 2 + 1.2704 . Thus, E ( ε t ) = 0 . However, if η t has an unknown distribution, then E ( ln η t 2 ) = μ and Var ( ln η t 2 ) = σ 2 . Therefore, let t = ln η t 2 - μ . For this scenario, the martingale difference is t δ t = ln ( y t 2 ) - h t - μ h t - γ - ϕ h t - 1 .

First, to estimate h t , the QLEF is given by

(3.1.4)
G ( t ) ( h t ) = ( - 1 , 1 ) σ 2 0 0 σ δ 2 - 1 ln ( y t 2 ) - h t - μ h t - γ - ϕ h t - 1 = σ - 2 ( ln ( y t 2 ) - h t - μ ) + σ δ - 2 ( h t - γ - ϕ h t - 1 ) .

Given that h ̂ 0 = 0 , the initial values ψ 0 = ( γ 0 , ϕ 0 , σ δ 0 2 , μ 0 , σ 0 2 ) , and h ̂ t - 1 is the QL estimation of h t - 1 , the QL estimation of h t is the solation of G ( t ) ( h t ) = 0 ,

(3.1.5)
h ̂ t = σ δ 0 2 ( ln ( y t 2 ) - μ 0 ) + σ 0 2 ( ϕ 0 h ̂ t - 1 + γ 0 ) σ δ 0 2 + σ 0 2 , t = 1 , 2 , 3 , T .

Second, using { h ̂ t } and { y t } , and considering γ , μ , and ϕ as unknown parameters, the QLEF can be given by G T ( μ , γ , ϕ ) = t = 1 T - 1 0 0 - 1 0 - h t - 1 σ 0 2 0 0 σ δ 0 2 - 1 ln ( y t 2 ) - h t - μ h t - γ - ϕ h t - 1 .

The QL estimation of μ , γ , and ϕ is the solation of G T ( μ , γ , ϕ ) = 0 . Therefore,

(3.1.6)
μ ̂ = t = 1 T ln ( y t 2 ) - t = 1 T h ̂ t T , t = 1 , 2 , 3 , T .
(3.1.7)
ϕ ̂ = t = 1 T h ̂ t t = 1 T h ̂ t - 1 - T t = 1 T h ̂ t - 1 h ̂ t 1 2 - T t = 1 T h ̂ t - 1 2 , t = 1 , 2 , 3 , T .
(3.1.8)
γ ̂ = t = 1 T h ̂ t - ϕ ̂ t = 1 T h ̂ t - 1 T , t = 1 , 2 , 3 , T .

Further,

(3.1.9)
σ ̂ δ 2 = t = 1 T ( δ ̂ t - δ ̂ ¯ ) 2 T - 1 ,
(3.1.10)
σ ̂ 2 = t = 1 T ( ̂ t - ̂ ¯ ) 2 T - 1 ,
where ̂ t = ln ( y t 2 ) - h ̂ t - μ ̂ , and δ ̂ t = h t ̂ - γ ̂ - ϕ ̂ h ̂ t - 1 , t = 1 , 2 , 3 , , T .

ψ ̂ = ( μ ̂ , γ ̂ , ϕ ̂ , σ ̂ δ 2 , σ ̂ 2 ) is an updated initial value in the iterative procedure. The initial values h 0 and ψ 0 might be affected by the estimation results of SVM. For an extensive discussion on assigning initial values in the QL estimation procedures, see Alzghool and Lin (2011).

3.2

3.2 Parameter estimation of SVM using the AQL method

Consider the SVM given by ((3.1.1)) and ((3.1.2)) and the same argument listed under ((3.1.2)). First, to estimate h t , the AQLEF sequence is given by G ( t ) ( h t ) = ( - 1 , 1 ) Σ t , n - 1 ln ( y t 2 ) - h t - μ h t - γ - ϕ h t - 1

Given h ̂ 0 = 0 , θ ( 0 ) = ( γ 0 , ϕ 0 , μ 0 ) , Σ t , n ( 0 ) = I 2 , and h ̂ t - 1 is the AQL estimation of h t - 1 , the AQL estimation of h t is the solation of G ( t ) ( h t ) = 0 ; that is,

(3.2.3)
h ̂ t = ln ( y t 2 ) - μ 0 + ϕ 0 h ̂ t - 1 + γ 0 2 , t = 1 , 2 , 3 , T .

Second, using the kernel estimation method, we find Σ ̂ t , n ( θ ( 0 ) ) = σ ̂ n ( y t ) σ ̂ n ( y t , h t ) σ ̂ n ( h t , y t ) σ ̂ n ( h t ) .

Third, to estimate the parameters θ = ( γ , ϕ , μ ) , we use { h ̂ t } and { y t } and the AQLEF sequence G T ( γ , ϕ , μ ) = t = 1 T - 1 0 0 - 1 0 - h ̂ t - 1 Σ ̂ t , n - 1 ln ( y t 2 ) - h ̂ t - μ h ̂ t - γ - ϕ h ̂ t - 1 .

The AQL estimation of γ , ϕ , and μ is the solation of G T ( γ , ϕ , μ ) = 0 . Then θ ( 0 ) = ( γ 0 , ϕ 0 , μ 0 ) is updated and replaced by the θ ̂ = ( γ ̂ , ϕ ̂ , μ ̂ ) , the estimate of θ = ( γ , ϕ , μ ) . The estimation procedure will be iteratively repeated until it converges.

In the following, the setup for this simulation study is similar to the design used by Rodriguez-Yam (2003). Samples of size T = 500 are taken, and the mean and root mean squared errors (RMSE) for ϕ ̂ , γ ̂ , μ ̂ , σ δ , and σ are calculated, where N = 1000 independent samples.

In Table 1, QL represents the QL estimate and AQL represents the AQL estimate.

Table 1 The QL and AQL estimates; the RMSE of each estimate is given below that estimate.
γ ϕ μ σ δ σ γ ϕ μ σ δ σ
True −0.821 0.90 −1.271 0.675 2.22 -0.411 0.95 −1.271 0.484 2.22
QL −0.809 0.901 −1.366 0.344 2.15 -0.417 0.950 −1.144 0.382 2.05
0.108 0.013 0.157 0.331 0.123 0.080 0.010 0.147 0.104 0.205
AQL −0.821 0.896 −1.257 0.330 2.34 -0.429 0.943 −1.360 0.342 2.25
0.108 0.015 0.088 0.158 0.347 0.085 0.014 0.120 0.111 0.148
True −0.736 0.90 −1.271 0.363 2.22 -0.368 0.95 −1.271 0.260 2.22
QL −0.889 0.881 −1.199 0.321 2.02 -0.511 0.931 −1.185 0.318 2.01
0.176 0.022 0.099 0.046 0.23 0.159 0.021 0.098 0.061 0.23
AQL −0.850 0.876 −1.279 0.293 2.16 −0.496 0.927 −1.284 0.309 2.16
0.231 0.038 0.051 0.089 0.124 0.181 0.030 0.049 0.063 0.129
True −0.706 0.90 −1.271 0.135 2.22 -0.353 0.95 −1.271 0.096 2.22
QL −0.695 0.905 −1.043 0.040 2.21 -0.364 0.946 −1.660 0.070 2.17
0.017 0.006 0.247 0.095 0.12 0.019 0.006 0.404 0.026 0.13
AQL −0.889 0.872 −1.111 0.28 2.09 −0.504 0.927 −1.125 0.295 2.10
0.329 0.049 0.164 0.153 0.164 0.224 0.034 0.150 0.167 0.202
True −0.147 0.98 −1.271 0.166 2.22 -0.141 0.98 −1.271 0.061 2.22
QL −0.169 0.977 −1.327 0.072 2.23 -0.140 0.979 −1.705 0.018 2.22
0.027 0.004 0.155 0.094 0.12 0.003 0.001 0.450 0.043 0.12
AQL −0.225 0.965 −1.342 0.316 2.13 −0.238 0.961 −1.336 0.310 2.11
0.109 0.019 0.083 0.130 0.15 0.125 0.023 0.074 0.156 0.251

The results in Table 1 confirm that QL and AQL have succeeded in SVM parameter estimation.

The effect of sample size on parameter estimation is considered. Samples of sizes T = 20 , 40 , 60 , 80 , and 100 were generated.

The results in Table 2 show that the RMSE decreases when the sample size increases.

Table 2 The QL and AQL estimates; the RMSE of each estimate is given below that estimate.
γ ϕ μ σ δ σ
True −0.141 0.98 −1.271 0.061 2.220
T = 20 QL −0.147 0.976 −1.273 0.067 2.127
0.032 0.024 0.405 0.019 0.573
AQL −0.294 0.828 −1.056 0.399 1.952
0.268 0.206 0.260 0.547 0.426
T = 40 QL −0.145 0.978 −1.286 0.069 2.143
0.022 0.010 0.264 0.015 0.415
AQL −0.249 0.917 −1.052 0.397 1.991
0.174 0.086 0.248 0.421 0.379
T = 60 QL −0.147 0.976 −1.273 0.067 2.127
0.018 0.006 0.201 0.013 0.334
AQL −0.225 0.943 −1.074 0.387 2.012
0.125 0.048 0.219 0.356 0.354
T = 80 QL −0.144 0.979 −1.290 0.070 2.162
0.016 0.004 0.171 0.013 0.283
AQL −0.214 0.954 −1.088 0.382 2.037
0.099 0.032 0.203 0.308 0.342
T = 100 QL −0.144 0.979 −1.285 0.070 2.163
0.015 0.004 0.156 0.012 0.253
AQL −0.211 0.958 −1.110 0.368 2.050
0.094 0.027 0.180 0.279 0.322

4

4 Application to SVM

The QL and AQL methods developed in the previous section are applied to real-life data, where the data are modeled by SVM (1.1) and (1.2). The data are the pound/dollar exchange rates x t , t = 1 , , 945 from 1/10/1981 to 28/6/1985 (see Davis and Rodriguez-Yam, 2005; Rodriguez-Yam, 2003; Durbin and Koopman, 2001).

In the literature, SVM (1.1) and (1.2) are used to model y t = log ( x t ) - log ( x t - 1 ) , where η t N ( 0 , 1 ) and ψ = ( μ , γ , ϕ , σ δ 2 , σ 2 ) is the parameter.

Table 3 gives the estimates of ψ obtained using different methods. QL represents the estimate obtained using the QL method, AQL represents the AQL estimate, AL is the estimate found by maximizing the approximate likelihood as suggested by Davis and Rodriguez-Yam (2005), and the MCL estimate is found by maximizing the likelihood estimate as suggested by Durbin and Koopman (2001). Note that the AL and MCL outcomes are given in Rodriguez-Yam (2003).

Table 3 Estimation of ψ = ( μ , γ , ϕ , σ δ 2 , σ 2 ) for pound/dollar exchange rate data.
γ ϕ σ δ μ σ
QL −0.0250 0.974 0.0210 −1.27 2.140
AQL −0.078 0.977 0.224 −1.042 2.12
AL −0.0227 0.957 0.0267
MCL −0.0227 0.975 0.0273

The estimates of γ , ϕ , and σ δ by the QL, AL and MCL methods are conceded. These three estimates are based on the same assumption where both η t and δ t are independent. However, the AQL estimates are a little dissimilar from the QL, AL, and MCL estimates.

The QL and AQL estimates are carried out in diverse model sceneries. The first scenario assumes that cov ( η t , δ t ) = 0 and the second scenario assumes that cov ( η t , δ t ) = σ ( h t , y t ) . To know which model scenario is suitable, we need to examine whether we can adapt cov ( η t , δ t ) = 0 . We compute the ̂ t and δ ̂ t given by QL approach and find that ̂ t and δ ̂ t are not independent with a significant correlation coefficient r = 0.89 at the 0.01 level. Thus, assuming that t and δ t are independent is not effective and using the QL technique for these data is not suitable. Therefore, the estimation using the AQL technique is accepted more than the QL estimates.

5

5 Summary

In this paper, we presented the estimation of parameters in SVMs using two alternative approaches. The study has shown that the QL and AQL estimating procedures are easy to apply, especially when the SVM’s probability structure cannot be fully identified. Results from the simulation study show that the AQL technique is a competent estimation procedure. The technique can escape the threat of possible misspecification of Σ by using the kernel estimator of covariance matrixes to substitute the true Σ in the QL and thus make the parameter estimation more efficient in SVMs.

References

  1. , , . Handbook of Mathematical Functions. New York: Dover Publication; .
  2. , , . Parameters estimation for SSMs: QL and AQL approaches. IAENG Int. J. Appl. Math.. 2008;38:34-43.
    [Google Scholar]
  3. Alzghool, Lin, 2011. Initial values in estimation procedures for state space models (SSMs). In: Proceedings of World Congress on Engineering 2011, vol. I, WCE 2011, London, UK.
  4. , , . Improved quasi-maximum likelihood estimation for stochastic volatility models. In: , , eds. Modelling and Prediction: Honouring Seymour Geisser. New York: Springer; . p. :228-247.
    [Google Scholar]
  5. , , . Modeling energy price dynamics: GARCH versus stochastic volatility. Energy Econ. 2015
    [CrossRef] [Google Scholar]
  6. , , . Estimation for state-space models: an approximate likelihood approach. Stat. Sinica. 2005;15:381-406.
    [Google Scholar]
  7. , , . Time Series Analysis by State Space Methods. New York: Oxford; .
  8. , . Applied Nonparametric Regression. Cambridge: University Press; .
  9. , . Quasi-likelihood and its Application: A General Approach to Optimal Parameter Estimation. New York: Springer; .
  10. , , , . Bayesian analysis of stochastic volatility models (with discussion) J. Bus. Econ. Stat.. 1994;12:371-417.
    [Google Scholar]
  11. , . A new kind of asymptotic quasi-score estimating function. Scandinavian J. Stat.. 2000;27:97-109.
    [Google Scholar]
  12. , , . The estimation of a state space model by estimating functions with an application. Stat. Neerlandica. 2004;58(4):407-427.
    [Google Scholar]
  13. , , , . Modeling volatility using state space models with heavy tailed distributions. Math. Comput. Simul.. 2016;119:108-127.
    [Google Scholar]
  14. , , . Filtering via simulation: auxiliary particle filters. J. Am. Stat. Assoc.. 1999;94:590-599.
    [Google Scholar]
  15. , . Estimation for state-space models and Baysian regression analysis with parameter constraints. Colorado State University; . Ph.D. Thesis
  16. , , . Estimation of stochastic volatility models via Monte Carlo maximum likelihood. J. Econometrics. 1998;87:271-301.
    [Google Scholar]
  17. , , . Kernel Smoothing. New York: Chapman and Hall; .
Show Sections