CODEWITHSUNDEEP
jupyter-notebookairflowfilepathpapermill
Digital_eye1
Digital_eye1

Reputation: 1

Can't find output file/folder of papermill operator. Apache Airflow 2.0. Suppose to be in tmp folder. Output_nb="/tmp/out-{{ execution_date }}.ipynb"

Can't find output file/folder of papermill operator. Apache Airflow 2.0. Suppose to be in tmp folder. Output_nb="/tmp/out-{{ execution_date }}.ipynb" I am not able to find the file or folder anywhere.

with DAG(
    dag_id='fahar_papermill_operator_2',
    schedule_interval='0 0 * * *',
    start_date=days_ago(2),
    dagrun_timeout=timedelta(minutes=60),
) as dag_2:

run_this = PapermillOperator(
    task_id="run_example_notebook",
    input_nb=os.path.join(os.path.dirname(os.path.realpath(__file__)), 
    "count_20.ipynb"),
    output_nb="/tmp/out-{{ execution_date }}.ipynb", 
    parameters={"msgs": "Ran from Airflow at {{ execution_date }}!"},
)

Upvotes: 0

Views: 563

Answers (0)

Related Questions