user2934244
user2934244

Reputation: 39

TFX / Tensorflow Data Validation (TFDV) throws overflow encountered in float_scalars error

Following basic tutorial, and trying to generate stats for a TFRecord, I get a overflow error:

import tensorflow_data_validation as tfdv
stats = tfdv.generate_statistics_from_tfrecord(data_location='/path/tfrec-train-00067-of-00100')

Error:
basic_stats_generator.py:221: RuntimeWarning: overflow encountered in float_scalars
  self.sum_of_squares += v * v

The dataset is audio examples (float32) <=17sec and associated labels.

Is there something different that needs to be done to handle these types of examples?

Upvotes: 0

Views: 198

Answers (1)

Paul Suganthan
Paul Suganthan

Reputation: 86

This issue has been fixed (GitHub commit).

Upvotes: 0

Related Questions