Reputation: 101
I Have some questions about bigquery cost about things I didn't find on google doc. I have a spring boot application that consume a bigquery table with lots of registers, today I have a pagination through query using offset and limit but as I have researched every query has the same cost as if it didn't have the limit as a parameter(it cost the full result of the query every time I do it), it only helps on lessing the returned rows so my application won't crash. So I am now thinking about using pagination through big query library on spring using listTableResults with a good limit, intering the results until I have the limit I want(Example: 100.000 is the limit so I will do it 10 times because the limit of a page is 10.000) notifying them, cleaning the stored results and doing it over and over again until I have finished all the results of that given query. But I have some questions, when I do this query and put the results on a destination Table, will it cost to put the results on that table and everytime I call the table using nextPage? How does a temporary table work in this environment? Couldn't find examples of temporary table creation during application time and information about the cost of this case. I need to control the load I have so the server won't crash.
Upvotes: -1
Views: 26