StackOverflow Questions for Tag: data-engineering

John Carter

Reputation: 1

CI/CD-style automation solution for NiFi flow deployments with reliable support

apache-nifidata-engineering

Score: 0

Answers: 0

sourav macwan

Reputation: 11

Is there any way to change profile.name for multiple pipelines in an automated way in Gcp DataFusion

google-cloud-platformcloudvirtual-machinegoogle-cloud-data-fusiondata-engineering

Score: 0

Answers: 1

César Arroyo Cárdenas

Reputation: 51

Is hard-coding the source and destination table names in my Python data pipeline code a security risk?

pythongoogle-bigquerydata-engineering

Score: 0

Answers: 0

seiya

Reputation: 1534

Search Optimization Service Not Used With AND conjunction

snowflake-cloud-data-platformdata-engineering

Score: 0

Answers: 0

Tim

Reputation: 11

How to access Snowflake secrets from Snowpark API in VSCode

snowflake-cloud-data-platformdata-engineering

Score: 0

Answers: 0

trinh lap

Reputation: 3

Efficiently Migrating 40TB of BLOB Data from Oracle to a Scalable System

bigdataetldatabase-migrationdata-migrationdata-engineering

Score: 0

Answers: 0

phani437

Reputation: 11

Snowflake TASK got stuck in STARTED state

sqlsnowflake-cloud-data-platformdata-engineering

Score: 0

Answers: 2

Aaryan Ohekar

Reputation: 31

Using config block in dbt_project.yml

databasedbtdata-engineering

Score: 0

Answers: 1

SafiJunaid

Reputation: 469

Deploying Starrocks on EKS with S3 i.e., shared-data cluster

amazon-s3data-engineeringstarrocks

Score: 0

Answers: 0

Mig Rivera Cueva

Reputation: 63

pyspark statistical window function keeps calculating NULL values

pythonsqlpysparkairflowdata-engineering

Score: 0

Answers: 1

sown

Reputation: 23

Azure Databricks - notebook not found exception

databricksazure-databricksdata-engineering

Score: -1

Answers: 1

Bardan Pokhrel

Reputation: 13

How to save data from kafka to iceberg table into desired namespace using tabular iceberg sink connector

apache-kafkaapache-icebergdata-engineeringnessieredpanda-connect

Score: 1

Answers: 0

Sam

Reputation: 9

How to reverse engineer dashboard in ibm cognos?

reverse-engineeringcognosdata-engineering

Score: 0

Answers: 2

David Whiting

Reputation: 21

Using upstream Parameter to determine if downstream data aware DAG should run

airflowdirected-acyclic-graphsdata-engineering

Score: 1

Answers: 0

Shailesh

Reputation: 11

How to write custom logs into LAW using Azure OpenTelemetry in databrick notebook

azureloggingopen-telemetrydata-engineering

Score: -1

Answers: 1

David Whiting

Reputation: 21

Using data aware scheduling to trigger downstream dags while using metadata contained in extra parameter as parameters for downstream dag

airflowdirected-acyclic-graphsairflow-taskflowdata-engineering

Score: 1

Answers: 1

Elis Evans

Reputation: 188

Parallelising dlthub Rest API pipeline

pythonconcurrencyparallel-processingdata-engineeringdlt

Score: 1

Answers: 1

William

Reputation: 131

Using Spark Thrift Server with Delta Lake

apache-sparkapache-spark-sqldelta-lakespark-thriftserverdata-engineering

Score: 0

Answers: 0

Will

Reputation: 1

Testing Atomicity of Delta Tables Using Delta-RS: Unexpected Files Written Despite Exception

pythonpandasamazon-s3delta-lakedata-engineering

Score: 0

Answers: 0

Sourabh Bidikar

Reputation: 21

Need to fix time zone issue for my Python, Pyspark processing job

pythonpysparkdata-scienceparquetdata-engineering

Score: 1

Answers: 2

PreviousPage 1Next