Reputation: 757
I'm running into an issue with GCP Bigtable Python Client that it occasionally lost connection with Bigtable and causes a server error.
The error message is attached below. This one happens when I was trying to write to Bigtable. I also observed that when the server has been inactive for a while, this issue tends to happen more often.
_Rendezvous: <_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Endpoint read failed)>
at _end_unary_response_blocking (/env/local/lib/python2.7/site-packages/grpc/_channel.py:455)
at __call__ (/env/local/lib/python2.7/site-packages/grpc/_channel.py:507)
at commit (/env/local/lib/python2.7/site-packages/google/cloud/bigtable/row.py:417)
at send (/env/local/lib/python2.7/site-packages/google/cloud/happybase/batch.py:113)
at __exit__ (/env/local/lib/python2.7/site-packages/google/cloud/happybase/batch.py:275)
at put (/env/local/lib/python2.7/site-packages/google/cloud/happybase/table.py:435)
at write_row (/home/vmagent/app/app/v0/helpers/bigtable_util.py:26)
at get_current_user (/home/vmagent/app/app/v0/controllers/controller.py:98)
at dispatch_request (/env/local/lib/python2.7/site-packages/flask/app.py:1598)
at full_dispatch_request (/env/local/lib/python2.7/site-packages/flask/app.py:1612)
at handle_user_exception (/env/local/lib/python2.7/site-packages/flask/app.py:1517)
at wrapped_function (/env/local/lib/python2.7/site-packages/flask_cors/extension.py:161)
at full_dispatch_request (/env/local/lib/python2.7/site-packages/flask/app.py:1614)
at wsgi_app (/env/local/lib/python2.7/site-packages/flask/app.py:1982)
Have anyone had similar experience? Is this a know bug in Bigtable Python Client?
Upvotes: 0
Views: 343
Reputation: 106
It looks like this has been fixed in https://github.com/googleapis/google-cloud-python/issues/2683.
Given this is a very old question, I assume the newer releases should already fix the problem.
Upvotes: 3
Reputation: 757
So far my solution for handling this is to put a manual retry when it fails. It worked for us since the issue doesn't occur frequently. Also, it seems to be less of an issue in version 0.28.1
Upvotes: 0