Create Regression Models with ARIMA Errors

Default Regression Model with ARIMA Errors Specifications

Regression models with ARIMA errors have the following form (in lag operator notation):

$\begin{matrix} y_{t} = c + X_{t} β + u_{t} \\ a (L) A (L) {(1 - L)}^{D} (1 - L^{s}) u_{t} = b (L) B (L) ε_{t}, \end{matrix}$

where

t = 1,...,T.
y_t is the response series.
X_t is row t of X, which is the matrix of concatenated predictor data vectors. That is, X_t is observation t of each predictor series.
c is the regression model intercept.
β is the regression coefficient.
u_t is the disturbance series.
ε_t is the innovations series.
$L^{j} y_{t} = y_{t - j} .$
$a (L) = (1 - a_{1} L - ... - a_{p} L^{p}),$ which is the degree p, nonseasonal autoregressive polynomial.
$A (L) = (1 - A_{1} L - ... - A_{p_{s}} L^{p_{s}}),$ which is the degree p_s, seasonal autoregressive polynomial.
${(1 - L)}^{D},$ which is the degree D, nonseasonal integration polynomial.
$(1 - L^{s}),$ which is the degree s, seasonal integration polynomial.
$b (L) = (1 + b_{1} L + ... + b_{q} L^{q}),$ which is the degree q, nonseasonal moving average polynomial.
$B (L) = (1 + B_{1} L + ... + B_{q_{s}} L^{q_{s}}),$ which is the degree q_s, seasonal moving average polynomial.

For simplicity, use the shorthand notation Mdl = regARIMA(p,D,q) to specify a regression model with ARIMA(p,D,q) errors, where p, D, and q are nonnegative integers. Mdl has the following default properties.

Property Name	Property Data Type
`AR`	Length `p` cell vector of `NaN`s
`Beta`	Empty vector `[]` of regression coefficients, corresponding to the predictor series
`D`	Nonnegative scalar, corresponding to D
`Distribution`	`"Gaussian"`, corresponding to the distribution of ε_t
`Intercept`	`NaN`, corresponding to c
`MA`	Length `q` cell vector of `NaN`s
`P`	Number of AR terms plus degree of integration, p + D
`Q`	Number of MA terms, q
`SAR`	Empty cell vector
`SMA`	Empty cell vector
`Variance`	`NaN`, corresponding to the variance of ε_t
`Seasonality`	`0`, corresponding to s

If you specify nonseasonal ARIMA errors, then

The properties D and Q are the inputs D and q, respectively.
Property P = p + D, which is the degree of the compound, nonseasonal autoregressive polynomial. In other words, P is the degree of the product of the nonseasonal autoregressive polynomial, a(L) and the nonseasonal integration polynomial, (1 – L)^D.

The values of properties P and Q indicate how many presample observations the software requires to initialize the time series.

You can modify the properties of Mdl using dot notation. For example, Mdl.Variance = 0.5 sets the innovation variance to 0.5.

For maximum flexibility in specifying a regression model with ARIMA errors, use name-value pair arguments to, for example, set each of the autoregressive parameters to a value, or specify multiplicative seasonal terms. For example, Mdl = regARIMA('AR',{0.2 0.1}) defines a regression model with AR(2) errors, and the coefficients are a₁ = 0.2 and a₂ = 0.1.

Specify regARIMA Models Using Name-Value Pair Arguments

You can only specify the nonseasonal autoregressive and moving average polynomial degrees, and nonseasonal integration degree using the shorthand notation regARIMA(p,D,q). Some tasks, such as forecasting and simulation, require you to specify values for parameters. You cannot specify parameter values using shorthand notation. For maximum flexibility, use name-value pair arguments to specify regression models with ARIMA errors.

The nonseasonal ARIMA error model might contain the following polynomials:

The degree p autoregressive polynomial a(L) = 1 – a₁L – a₂L₂ –...– a_pL^p. The eigenvalues of a(L) must lie within the unit circle (i.e., a(L) must be a stable polynomial).
The degree q moving average polynomial b(L) = 1 + b₁L + b₂L₂ +...+ b_qL^q. The eigenvalues of b(L) must lie within the unit circle (i.e., b(L) must be an invertible polynomial).
The degree D nonseasonal integration polynomial is (1 – L)^D.

The following table contains the name-value pair arguments that you use to specify the ARIMA error model (i.e., a regression model with ARIMA errors, but without a regression component and intercept):

\begin{matrix} y_{t} = u_{t} \\ a (L) (^{1 - L) D} = b (L) ε_{t} . \end{matrix}

(1)

Name-Value Pair Arguments for Nonseasonal ARIMA Error Models

Name	Corresponding Model Term(s) in Equation 1	When to Specify
`AR`	Nonseasonal AR coefficients: a₁, a₂,...,a_p	To set equality constraints for the AR coefficients. For example, to specify the AR coefficients in the ARIMA error model $u_{t} = 0.8 u_{t - 1} - 0.2 u_{t - 2} + ε_{t},$ specify `'AR',{0.8,-0.2}`. You only need to specify the nonzero elements of `AR`. If the nonzero coefficients are at nonconsecutive lags, specify the corresponding lags using `ARLags`. The coefficients must correspond to a stable AR polynomial.
`ARLags`	Lags corresponding to nonzero, nonseasonal AR coefficients	`ARLags` is not a model property. Use this argument as a shortcut for specifying `AR` when the nonzero AR coefficients correspond to nonconsecutive lags. For example, to specify nonzero AR coefficients at lags 1 and 12, e.g., $u_{t} = a_{1} u_{t - 1} + a_{2} u_{t - 12} + ε_{t},$ specify `'ARLags',[1,12]`. Use `AR` and `ARLags` together to specify known nonzero AR coefficients at nonconsecutive lags. For example, if in the given AR(12) error model with a₁ = 0.6 and a₁₂ = –0.3, then specify `'AR',{0.6,-0.3},'ARLags',[1,12]`.
`D`	Degree of nonseasonal differencing, D	To specify a degree of nonseasonal differencing greater than zero. For example, to specify one degree of differencing, specify `'D',1`. By default, `D` has value `0` (meaning no nonseasonal integration).
`Distribution`	Distribution of the innovation process, ε_t	Use this argument to specify a Student’s t distribution. By default, the innovation distribution is `"Gaussian"`. For example, to specify a t distribution with unknown degrees of freedom, specify `'Distribution','t'`. To specify a t innovation distribution with known degrees of freedom, assign `Distribution` a structure with fields `Name` and `DoF`. For example, for a t distribution with nine degrees of freedom, specify `'Distribution',struct('Name','t','DoF',9)`.
`MA`	Nonseasonal MA coefficients: b₁, b₂,...,b_q	To set equality constraints for the MA coefficients. For example, to specify the MA coefficients in the ARIMA error model $u_{t} = ε_{t} + 0.5 ε_{t - 1} + 0.2 ε_{t - 2},$ specify `'MA',{0.5,0.2}`. You only need to specify the nonzero elements of `MA`. If the nonzero coefficients are at nonconsecutive lags, specify the corresponding lags using `MALags`. The coefficients must correspond to an invertible MA polynomial.
`MALags`	Lags corresponding to nonzero, nonseasonal MA coefficients	`MALags` is not a model property. Use this argument as a shortcut for specifying `MA` when the nonzero MA coefficients correspond to nonconsecutive lags. For example, to specify nonzero MA coefficients at lags 1 and 4, e.g., $u_{t} = ε_{t} + b_{1} ε_{t - 1} + b_{4} ε_{t - 4},$ specify `'MALags',[1,4]`. Use `MA` and `MALags` together to specify known nonzero MA coefficients at nonconsecutive lags. For example, if in the given MA(4) error model b₁ = 0.5 and b₄ = 0.2, specify `'MA',{0.4,0.2},'MALags',[1,4]`.
`Variance`	Scalar variance, σ², of the innovation process, ε_t	To set equality constraints for σ². For example, for an ARIMA error model with known innovation variance 0.1, specify `'Variance',0.1`. By default, `Variance` has value `NaN`.

Use the name-value pair arguments in the following table in conjunction with those in Name-Value Pair Arguments for Nonseasonal ARIMA Error Models to specify the regression components of the regression model with ARIMA errors:

\begin{matrix} y_{t} = c + X_{t} β + u_{t} \\ a (L) (^{1 - L) D} = b (L) ε_{t} . \end{matrix}

(2)

Name-Value Pair Arguments for the Regression Component of the regARIMA Model

Name	Corresponding Model Term(s) in Equation 2	When to Specify
`Beta`	Regression coefficient values corresponding to the predictor series, β	Use this argument to specify the values of the coefficients of the predictor series. For example, use `'Beta',[0.5 7 -2]` to specify $β = {[\begin{matrix} 0.5 & 7 & - 2 \end{matrix}]}^{'} .$ By default, `Beta` is an empty vector, `[]`.
`Intercept`	Intercept term for the regression model, c	To set equality constraints for c. For example, for a model with no intercept term, specify `'Intercept',0`. By default, `Intercept` has value `NaN`.

If the time series has seasonality s, then

The degree p_s seasonal autoregressive polynomial is A(L) = 1 – A ₁L – A₂L² –...– A_{p_s}L^p_s.
The degree q_s seasonal moving average polynomial is B(L) 1 + B ₁L + B₂L² +...+ B_{q_s}L^q_s.
The degree s seasonal integration polynomial is (1 – L^s).

Use the name-value pair arguments in the following table in conjunction with those in tables Name-Value Pair Arguments for Nonseasonal ARIMA Error Models and Name-Value Pair Arguments for the Regression Component of the regARIMA Model to specify the regression model with multiplicative seasonal ARIMA errors:

\begin{matrix} y_{t} = c + X_{t} β + u_{t} \\ a (L) (^{1 - L) D} A (L) (1 - L^{s}) u_{t} = b (L) B (L) ε_{t} . \end{matrix}

(3)

Name-Value Pair Arguments for Seasonal ARIMA Models

Argument	Corresponding Model Term(s) in Equation 3	When to Specify
`SAR`	Seasonal AR coefficients: A₁, A₂,...,A_{p_s}	To set equality constraints for the seasonal AR coefficients. Use `SARLags` to specify the lags of the nonzero seasonal AR coefficients. Specify the lags associated with the seasonal polynomials in the periodicity of the observed data (e.g., 4, 8,... for quarterly data, or 12, 24,... for monthly data), and not as multiples of the seasonality (e.g., 1, 2,...). For example, to specify the ARIMA error model $(1 - 0.8 L) (1 - 0.2 L^{12}) u_{t} = ε_{t},$ specify `'AR',0.8,'SAR',0.2,'SARLags',12`. The coefficients must correspond to a stable seasonal AR polynomial.
`SARLags`	Lags corresponding to nonzero seasonal AR coefficients, in the periodicity of the responses	`SARLags` is not a model property. Use this argument when specifying `SAR` to indicate the lags of the nonzero seasonal AR coefficients. For example, to specify the ARIMA error model $(1 - a_{1} L) (1 - A_{12} L^{12}) u_{t} = ε_{t},$ specify `'ARLags',1,'SARLags',12`.
`SMA`	Seasonal MA coefficients: B₁, B₂,...,B_{q_s}	To set equality constraints for the seasonal MA coefficients. Use `SMALags` to specify the lags of the nonzero seasonal MA coefficients. Specify the lags associated with the seasonal polynomials in the periodicity of the observed data (e.g., 4, 8,... for quarterly data, or 12, 24,... for monthly data), and not as multiples of the seasonality (e.g., 1, 2,...). For example, to specify the ARIMA error model $u_{t} = (1 + 0.6 L) (1 + 0.2 L^{4}) ε_{t},$ specify `'MA',0.6,'SMA',0.2,'SMALags',4`. The coefficients must correspond to an invertible seasonal MA polynomial.
`SMALags`	Lags corresponding to the nonzero seasonal MA coefficients, in the periodicity of the responses	`SMALags` is not a model property. Use this argument when specifying `SMA` to indicate the lags of the nonzero seasonal MA coefficients. For example, to specify the model $u_{t} = (1 + b_{1} L) (1 + B_{4} L^{4}) ε_{t},$ specify `'MALags',1,'SMALags',4`.
`Seasonality`	Seasonal periodicity, s	To specify the degree of seasonal integration s in the seasonal differencing polynomial Δ_s = 1 – L^s. For example, to specify the periodicity for seasonal integration of quarterly data, specify `'Seasonality',4`. By default, `Seasonality` has value `0` (meaning no periodicity nor seasonal integration).

Note

You cannot assign values to the properties P and Q. For multiplicative ARIMA error models,

regARIMA sets P equal to p + D + p_s + s.
regARIMA sets Q equal to q + q_s

Specify Linear Regression Models Using Econometric Modeler App

You can specify the predictor variables in the regression component, and the error model lag structure and innovation distribution, using the Econometric Modeler app. The app treats all coefficients as unknown and estimable.

At the command line, open the Econometric Modeler app.

econometricModeler

Alternatively, open the app from the apps gallery (see Econometric Modeler).

In the app, you can see all supported models by selecting a time series variable for the response in the Data Browser. Then, on the Econometric Modeler tab, in the Models section, click the arrow to display the models gallery.

The Regression Models section contains supported regression models. To specify a multiple linear regression (MLR) model, select MLR. To specify regression models with ARMA errors, select RegARMA.

After you select a model, the app displays the Type Model Parameters dialog box, where Type is the model type. This figure shows the RegARMA Model Parameters dialog box.

Adjustable parameters depend on the model Type. In general, adjustable parameters include:

Predictor variables for the linear regression component, listed in the Predictors section.
- For regression models with ARMA errors, you must include at least one predictor in the model. To include a predictor, select the corresponding check box in the Include? column.
- For MLR models, you can clear all check boxes in the Include? column. In this case, you can specify a constant mean model (intercept-only model) by selecting the Include Intercept check box. Or, you can specify an error-only model by clearing the Include Intercept check box.
The innovation distribution and nonseasonal lags for the error model, for regression models with ARMA errors.

As you adjust parameter values, the equation in the Model Equation section changes to match your specifications. Adjustable parameters correspond to input and name-value pair arguments described in the previous sections and in the regARIMA reference page.

For more details on specifying models using the app, see Fitting Models to Data and Specifying Lag Operator Polynomials Interactively.

Documentation