CODEWITHSUNDEEP
airflowsnowflake-cloud-data-platform
Danieledu
Danieledu

Reputation: 391

How to hide the query rendering in airflow (hide secrets from logs)

I have a query in snowflake to share data to AWS S3. I have to enter the access keys in the query. How can I hide the query rendering in airflow?

CREATE OR REPLACE STAGE MY_STAGE
    url='s3://my_bucket/others'
  credentials=(
      aws_key_id='XXXXXXXXXXXXXXXXXXXX'
      aws_secret_key='DFgsdFGSdfgAqTRjfFGHJ343'
      aws_token='hsfdjfhksdfhskdfhsdkjfhiauowqegkhbHSALDfkshdfisuhiqwuger8748sf0!$#%FGH#$%'
)

Upvotes: 0

Views: 246

Answers (1)

Felipe Hoffa
Felipe Hoffa

Reputation: 59175

Moving Simon's answer from comment to answer, for closure:

Create your stage beforehand or with storage integrations.

If you create the stage beforehand, then you can just reference it by name, without the need to type credentials again.

Upvotes: 1

Related Questions