CODEWITHSUNDEEP
rtime-seriesarimafable-r
Tyler Smith
Tyler Smith

Reputation: 328

Comparing AICc of ARIMA models produced in fable

When using fable to produce a set of different ARIMA models using different combinations of xregs, if different models choose a different d and D parameters then the AICc are no longer comparable, right? In that case, should I just find the max d and D chosen from all the models and fix those parameters and retrain the models for comparison?

Upvotes: 0

Views: 350

Answers (2)

BqKaXeu29y
BqKaXeu29y

Reputation: 103

@Mitchel, if you have the following models:

  • y ~ ARIMA
  • y ~ ARIMA + xreg_1
  • y ~ ARIMA + xreg_2
  • y ~ ARIMA + xreg_1 + xreg_2,

Can you compare the AICs between these models directly? can you select the best model to forecast y from these four different models just minimising the AICc?

Upvotes: 0

Mitchell O'Hara-Wild
Mitchell O'Hara-Wild

Reputation: 2459

Correct, information criterions can only be compared when the model uses the same response variable (same transformation, same differencing).

The automatic selection algorithm uses the regression residuals to perform repeated unit root tests to identify the appropriate d and D parameters. If you're varying the exogenous regressors, the choice of d and D may vary.

To compare the models via AICc you will need to keep the differencing fixed. Alternatively, you can compare ARIMA models with different amounts of differencing using other accuracy measures via the accuracy() function (more details here: https://otexts.com/fpp3/accuracy.html)

Upvotes: 1

Related Questions