opensearch-py not accepting connection with AWS signer on async client

Question

In the past, opensearch-py does not support signing AWS requests with AsyncOpenSearch client, but it seems to have been fixed in V2.01. Unfortunately, I still am unable to sign request using AsyncOpenSearch. I am using version 2.31. Here is my code:

from opensearchpy import AsyncOpenSearch, RequestsHttpConnection
from requests_aws4auth import AWS4Auth

auth =  AWS4Auth(aws_access_key, aws_secret_key, aws_region, "es")
es_client = AsyncOpenSearch(host, http_auth = auth, connection_class = RequestsHttpConnection, timeout=120)

asyncio.run(es_client.info())

Running this code gave me the following error.

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\Users\lightning_missile\AppData\Local\Programs\Python\Python311\Lib\asyncio\runners.py", line 190, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "C:\Users\lightning_missile\AppData\Local\Programs\Python\Python311\Lib\asyncio\runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\lightning_missile\AppData\Local\Programs\Python\Python311\Lib\asyncio\base_events.py", line 653, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "C:\Users\lightning_missile\AppData\Local\Programs\Python\Python311\Lib\site-packages\opensearchpy\_async\client\__init__.py", line 252, in info
    return await self.transport.perform_request(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\lightning_missile\AppData\Local\Programs\Python\Python311\Lib\site-packages\opensearchpy\_async\transport.py", line 374, in perform_request
    status, headers_response, data = await connection.perform_request(
                                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: object tuple can't be used in 'await' expression

I do not know what I am doing wrong and I cannot find anything in the docs that explain how to sign request in AsyncOpenSearch client. Can anyone help me?

Answer 1

Old question, but using connection_class=RequestsHttpConnection is for the non-async client. Use connection_class=AsyncHttpConnection for the async client.

Answer 2

Got it. It seems you need boto3 installed because you need an async version of AWSV4SignerAuth which needs boto3 credential objects.

import boto3
from opensearchpy import AsyncOpenSearch, AsyncHttpConnection, AWSV4SignerAsyncAuth

credentials = boto3.Session(aws_access_key_id=aws_access_key, aws_secret_key_id=aws_secret_key).get_credentials()

auth = AWSV4SignerAsyncAuth(credentials, region)
es_client = AsyncOpenSearch(host, http_auth = auth, connection_class = AsyncHttpConnection, timeout=120)

asyncio.run(es_client.info())

This is enough for me, but if there is a better solution, feel free to comment or add another answer.