CODEWITHSUNDEEP
google-cloud-platformgoogle-bigquery
Bad Coder
Bad Coder

Reputation: 906

Bigquery Concurrently Performance

We have data size of around 100GB in BQ, we made the required partition and clustering in our table. So all our queries are simple select only queries with order by clause and having the required partition and cluster filter.

We want to maintain high concurrency (around 1000) and latency of under 1 sec, Is big query the right fit for this ?

Currently the query performance is good but only their google doc they say 100 limit on concurrent queries ?

BI Engine is good fit here ?

Upvotes: 0

Views: 680

Answers (1)

Poala Astrid
Poala Astrid

Reputation: 842

The query jobs quota for concurrent queries is 100 queries in a reservation as per documentation. Since your use case is involving around 1000 concurrent queries, you need to purchase reservation slots because your concurrent queries are higher than 200. The number of slots that you might want to purchase will depend on type/size of the queries you will make e.g 8000-16000 slots for 1000 concurrent queries. The reservation slots will help increase limits and can prevent the queries to slow down.

Upvotes: 0

Related Questions