nixtla [FIX] Raise warning on missing X

Adds a warning that exogenous features in df are ignored if X_df is not provided.

Fix for #294 until we support historical exogenous variables in TimeGPT.

Apr 18 '24 19:04 elephaint

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

Apr 18 '24 19:04 review-notebook-app[bot]

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	4.0145	3.3862	0.0096	0.006

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	3.1827	3.2184	0.0073	0.0061

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	7.6017	10.0252	0.0093	0.0088

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	6.0658	5.7825	0.0085	0.0078

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	6.0991	8.5711	0.0086	0.0079

Plot:

Apr 18 '24 19:04 github-actions[bot]

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	3.3112	2.7634	0.0102	0.0063

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	7.3294	8.5508	0.0067	0.0061

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	5.0722	18.0813	0.0091	0.0083

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	4.3591	6.8605	0.0085	0.0084

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	8.3927	5.4465	0.0089	0.0087

Plot:

Apr 22 '24 07:04 github-actions[bot]

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	2.8458	12.1773	0.0091	0.0053

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	4.2787	4.1985	0.0066	0.0056

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	5.3386	16.1826	0.0084	0.0074

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	6.2802	4.5132	0.0082	0.0075

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805038	441118	1.61572e+06	6.04619e+06
total_time	8.2883	5.6749	0.0085	0.0078

Plot:

Apr 22 '24 08:04 github-actions[bot]

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	4.4493	4.9387	0.0093	0.0056

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	7.0727	3.9457	0.0065	0.0055

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	4.6266	4.534	0.0084	0.0077

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	5.8322	5.8916	0.0084	0.008

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	10.1121	4.3415	0.0085	0.0081

Plot:

Apr 22 '24 09:04 github-actions[bot]

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	10.2876	22.5171	0.01	0.0061

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	2.8543	7.2691	0.0068	0.006

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	5.3345	8.3446	0.0093	0.0085

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	5.6988	10.8699	0.0083	0.0079

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	6.1453	5.6838	0.0085	0.0078

Plot:

Apr 22 '24 10:04 github-actions[bot]

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	18.4675	17.1915	0.0093	0.0053

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	17.4633	16.3406	0.0061	0.0055

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	18.4091	19.6196	0.0079	0.0072

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	17.2432	15.1347	0.0078	0.0078

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	15.9406	17.721	0.0078	0.0073

Plot:

Apr 29 '24 20:04 github-actions[bot]

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	3.7107	2.6284	0.0084	0.0047

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	2.668	3.7092	0.0056	0.0046

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	10.4476	6.5569	0.0077	0.0067

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	11.1307	9.7257	0.0074	0.0069

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	12.2319	11.9713	0.0078	0.007

Plot:

Apr 30 '24 07:04 github-actions[bot]

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	3.2097	3.1181	0.009	0.0047

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	3.4301	3.1889	0.0062	0.005

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	3.2358	3.4804	0.0082	0.0071

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	4.651	3.4048	0.0079	0.0073

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	5.5793	3.8998	0.0075	0.007

Plot:

May 03 '24 13:05 github-actions[bot]

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	2.345	2.7454	0.0084	0.0048

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.22	4110.79	5928.17	18859.2
total_time	2.4011	2.1655	0.0056	0.0046

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.8	123119	213677	4.68961e+06
total_time	2.3171	2.5586	0.0078	0.0067

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966295	422332	656723	3.17316e+06
total_time	4.4213	2.7285	0.0074	0.0069

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805038	441118	1.61572e+06	6.04619e+06
total_time	6.4818	6.6452	0.0075	0.0068

Plot:

May 06 '24 19:05 github-actions[bot]

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	16.956	15.8886	0.0085	0.0048

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	17.416	17.1856	0.0056	0.0046

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	14.5907	11.5613	0.0078	0.0067

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966295	422332	656723	3.17316e+06
total_time	17.2093	11.8399	0.0074	0.0068

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805038	441118	1.61572e+06	6.04619e+06
total_time	16.5269	14.5226	0.0076	0.0072

Plot:

May 06 '24 21:05 github-actions[bot]

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.935	199.132	2571.33	10604.2
total_time	20.7539	21.6852	0.0085	0.0047

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	16.8789	23.4286	0.006	0.005

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	178.293	196.363	269.23	1331.02
mape	0.0234	0.0234	0.0304	0.1692
mse	121588	123119	213677	4.68961e+06
total_time	23.2417	24.4021	0.008	0.0069

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	465.532	353.528	398.956	1119.26
mape	0.062	0.0454	0.0512	0.1583
mse	835120	422332	656723	3.17316e+06
total_time	21.8872	19.4425	0.0077	0.007

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	558.649	361.033	602.926	1340.95
mape	0.0697	0.046	0.0787	0.17
mse	1.22721e+06	441118	1.61572e+06	6.04619e+06
total_time	23.3614	23.2938	0.0077	0.0073

Plot:

May 08 '24 15:05 github-actions[bot]

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	22.5271	19.0403	0.0085	0.0048

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	22.3402	22.2262	0.0057	0.0048

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	178.293	196.363	269.23	1331.02
mape	0.0234	0.0234	0.0304	0.1692
mse	121588	123119	213677	4.68961e+06
total_time	23.3278	24.4255	0.0077	0.0066

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	465.532	353.528	398.956	1119.26
mape	0.062	0.0454	0.0512	0.1583
mse	835120	422332	656723	3.17316e+06
total_time	23.3977	23.3197	0.0073	0.0068

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	558.649	361.033	602.926	1340.95
mape	0.0697	0.046	0.0787	0.17
mse	1.22721e+06	441118	1.61572e+06	6.04619e+06
total_time	22.7146	23.144	0.0077	0.0071

Plot:

May 08 '24 21:05 github-actions[bot]

nixtla nixtla copied to clipboard

[FIX] Raise warning on missing X_df when df has exogenous

Experiment 1: air-passengers

Description:

Results:

Plot:

Experiment 2: air-passengers

Description:

Results:

Plot:

Experiment 3: electricity-multiple-series

Description:

Results:

Plot:

Experiment 4: electricity-multiple-series

Description:

Results:

Plot:

Experiment 5: electricity-multiple-series

Description:

Results:

Plot:

Experiment 1: air-passengers

Description:

Results:

Plot:

Experiment 2: air-passengers

Description:

Results:

Plot:

Experiment 3: electricity-multiple-series

Description:

Results:

Plot:

Experiment 4: electricity-multiple-series

Description:

Results:

Plot:

Experiment 5: electricity-multiple-series

Description:

Results:

Plot:

Experiment 1: air-passengers

Description:

Results:

Plot:

Experiment 2: air-passengers

Description:

Results:

Plot:

Experiment 3: electricity-multiple-series

Description:

Results:

Plot:

Experiment 4: electricity-multiple-series

Description:

Results:

Plot:

Experiment 5: electricity-multiple-series

Description:

Results:

Plot:

Experiment 1: air-passengers

Description:

Results:

Plot:

Experiment 2: air-passengers

Description:

Results:

Plot:

Experiment 3: electricity-multiple-series

Description:

Results:

Plot:

Experiment 4: electricity-multiple-series

Description:

Results:

Plot:

Experiment 5: electricity-multiple-series

Description:

nixtla
nixtla copied to clipboard