CODEWITHSUNDEEP
google-cloud-bigtablebigtable
shal
shal

Reputation: 3024

BigTable: will column qualifier or timestamp filter cause the full scan?

Say I have a table that contains billions of records.

  1. On a particular day there are only 7 records though. If I filter it by timestamp range (as described here), will it cause the full table scan?
  2. Only one row has a column "col36847629". if I apply a column qualifier filter, will it scan the entire table?

Upvotes: 1

Views: 877

Answers (1)

Billy Jacobson
Billy Jacobson

Reputation: 1703

Any filters on Bigtable reads (besides ones related to the rowkey) will cause a full table scan if not contained by a rowkey or range. The filters are in place to help reduce the amount of data sent over the network for lower network costs and faster throughput, but are not going to reduce the size of the scan.

If this is a common scenario you're facing, you might want to add some date or timestamp information into your rowkey as a way to filter on that and then perform the scans.

Upvotes: 1

Related Questions