Reputation: 11
How to use previous version of dataset as input in palantir foundry code repository. I want to take input of pervious version of dataset and apply the transformation on it in code repository. I know it is possible in contour but I need to write code in pyspark.
how to use previous version of dataset as input in palantir foundry code repository
Upvotes: 1
Views: 581
Reputation: 1
you can use df= output_dataset.dataframe('current').localCheckpoint()
Upvotes: 0