Reputation: 15
Are there any methods to use pandas, numpy for doing transformations in google cloud data flow?
https://cloud.google.com/blog/big-data/2016/03/google-announces-cloud-dataflow-with-python-support In the above link it says having support for numpy, scipy and pandas, But there are no examples available
Upvotes: 1
Views: 1293
Reputation: 11041
Dataflow or Beam do not currently have transforms that use Numpy or Pandas. Nonetheless, you must be able to use them without much trouble.
If you give more info about your use case, we can help you figure it out.
Upvotes: 0