CODEWITHSUNDEEP
avroazure-synapseazure-data-lake-gen2azure-eventhub
Mauro Minella
Mauro Minella

Reputation: 179

How to read AVRO files captured by Azure Event Hubs from Synapse SQL Serverless

I receive realtime data through an Azure Event Hubs, which captures and stores directly to an Azure Storage Account. I'd prefer a parquet format, however it is not possible because only DataLake V1 is supported for parquet files, and it is not avilable in my Azure region. Now that I have such AVRO files, I'd like to read them from Synapse without moving them, as Synapse SQL Serverless can do very well for CSV, Json and Parquet files. In fact my idea was to create some CET tables which are just wrapper around data stored in the storage account.

But the problem is that it seems that Synapse cannot read this AVRO format, so I'm stuck. Any help, really appreciated.

Upvotes: 0

Views: 808

Answers (1)

GregGalloway
GregGalloway

Reputation: 11625

I would recommend you adjust the Event Hubs Capture to write to Parquet files in ADLS Gen2. Then you can query it in Synapse Serverless SQL easily.

Upvotes: 0

Related Questions