CODEWITHSUNDEEP
jsonavroazure-data-lakeu-sqlazure-eventhub
gertrude89
gertrude89

Reputation: 47

Azure Data Lake - .avro to SQL

I'm using the capture function on an Event Hub to push data into a data lake. This is being saved into the lake in .avro files.

I would like to join this data to some existing data I have in in a SQL data warehouse. So the most sensible action seems for me to push the .avro files into SQL. How can I do this?

Frustratingly the data from the API is originally in JSON format, but is returned as .avro from the web app on azure. If I could get the files to be JSON then I would just use the OPENJSON functions in T-SQL.

Thank you

Upvotes: 0

Views: 662

Answers (1)

Martin Esteban Zurita
Martin Esteban Zurita

Reputation: 3209

I know im kind of late with this answer, but whenever I work with U-SQL I find it useful to check their github for examples to have a baseline so I can work on improving those to my needs.

Going to your question, have you checked this? https://github.com/Azure/usql/tree/master/Examples/AvroExamples It shows the basics of handling avro files.

Hope this helped!! Martin

Upvotes: 1

Related Questions