CODEWITHSUNDEEP
pythonmachine-learningneural-networkkeraslstm
Zach
Zach

Reputation: 1351

Handling Missing Data in RNN / LSTM (Time-Series)

As the title suggests, I have a time-series data set and there is a lot of missing data. What is the best way to handle this for a LSTM model?

To give further detail, I have about five data sources to create the dataset and some of them do not allow me to get historical data so I'm missing quite a bit for the features in that source. I can fill some in using the most recently observed sample, but for the most part that isn't possible.

Some suggestions I have seen are:

But for all I feel like I will be losing a lot of data integrity. How is this usually handled / what is the best way to adjust for this in LSTM models?

I'm using Python / Keras / TensorFlow.

Upvotes: 4

Views: 4889

Answers (1)

Toni Piza
Toni Piza

Reputation: 515

Maybe masking at the top layer of your model could help.

For each timestep in the input tensor (dimension #1 in the tensor), if all values in the input tensor at that timestep are equal to mask_value, then the timestep will be masked (skipped) in all downstream layers (as long as they support masking).

Upvotes: 4

Related Questions