Reputation: 883
I have a flow that fetches data from Presto and does some ETL and pushes back the CSV file to the s3 bucket. My flow is as follows:
**QueryDatabaseTable -> convertRecord -> RouteText -> puts3Object**
I know we can achieve this with cron job scheduling feature. The idea is to have new files ingested every morning in the s3 bucket.
what will be the cron syntax?? I tried 0 0 3 1/1 * ? *
but it doesn't seem to run at 3 am every day. Any reason why?
How can I achieve this?
Thanks in advance!
Upvotes: 0
Views: 4935
Reputation: 4294
Use this Generator to easily create your cron jobs compatible with Nifi. (quartz cron)
https://www.freeformatter.com/cron-expression-generator-quartz.html
Example :
0 0 0 1/1 * ? *
At 00:00:00am, every day starting on the 1st, every month
Upvotes: 0
Reputation: 31510
Nifi uses quartz cron
for syntax, you can create/test your cron expressions in this link.
To schedule at 3AM
everyday use the below cron expression:
Right Click on QuerydatabaseTable -> configure -> Scheduling tab -> Scheduling Strategy(choose) CRON driven!
0 0 3 1/1 * ? *
Upvotes: 7