this post was submitted on 25 Nov 2023
1 points (100.0% liked)

Machine Learning

1 readers
1 users here now

Community Rules:

founded 11 months ago
MODERATORS
 

These are plots of some of my features and rest of the others having similar pattern. The data here is spanned for 2 days and I need to predict labels for 3rd day. It has 60,000 samples (seconds).

Any popular time series regression methods or repos I must be aware of to solve this kind of problems? I don't need to forecast as I have labels for validation.

Also what are current trends for statistical models vs ML models.

Does considering lag or sliding window the only popular and effective option?

https://preview.redd.it/9vjh75m7ki2c1.png?width=1354&format=png&auto=webp&s=f1da6b7fcda0cd96f4b997b818b0272f911cf120

top 7 comments
sorted by: hot top controversial new old
[–] nikgeo25@alien.top 1 points 10 months ago

anything that implements ARIMA

[–] house_lite@alien.top 1 points 10 months ago

R AutoQuant has ML based models that handle single series and panel data with lots of feature engineering options.

[–] trial_and_err@alien.top 1 points 10 months ago

If the oscillations are periodic then Fourier series can capture them. If they’re white noise you can’t predict anything. If they’re autoregressive white noise you can fit an ARMA model on them.

[–] eamonnkeogh@alien.top 1 points 10 months ago (2 children)

Based on this figure, simple persistence would work very well.

Persistence says, the predicted value, is the same as 24 hours ago.

If the data has cultural effects, then the predicted value, is the same as 7 days ago (because, a Saturday is not like a Friday).

[–] rumblepost@alien.top 1 points 10 months ago

Arima for that

[–] ade17_in@alien.top 1 points 10 months ago (1 children)

100%. I did exactly the way you described and it works awesome. And got to know it's called "persistence".

I implemented a very interesting and creative approach to train such a model, and will surely make a post here later for a detailed summary.

[–] eamonnkeogh@alien.top 1 points 10 months ago

Great!

“Satisfied customer. We should have him stuffed.” Basil Fawlty: