CODEWITHSUNDEEP
pythonpython-3.xpython-asynciopython-3.5
CthUlhUzzz
CthUlhUzzz

Reputation: 757

Does asyncio supports asynchronous I/O for file operations?

Does asyncio supports asynchronous I/O for file operations? If yes, how I can use this in Python 3.5 with async/await syntax code?

Upvotes: 68

Views: 56362

Answers (4)

Dima Tisnek
Dima Tisnek

Reputation: 11781

That depends on what library you use.

curio

curio offers this functionality, see https://curio.readthedocs.io/en/latest/reference.html#module-curio.file

asyncio

Update 2021: aiofile ~2 and ~3 (current) supports true asynchronous IO on Linux >= 4.18 via https://github.com/mosquito/caio and falls back to threaded implementations otherwise.

Plain asyncio doesn't, although there are 3rd party libraries, e.g. aiofiles (where synchronous file access is isolated in threads) and aiofile (note the spelling) (where synchronous file access is in threads in other circumstances than the above paragraph)

Modern operating systems do provide asynchronous file primitives, but these are varied, thus each would need own implementation. Please compare:

I suspect someone will soon rip out underlying async io from node.js and make a decent Python library, or perhaps someone already has.

Specifically for Linux, there are low-level bindings in https://pypi.org/project/liburing/

For a solid overview of asynchronous IO APIs in Linux, circa 2020, see https://www.scylladb.com/2020/05/05/how-io_uring-and-ebpf-will-revolutionize-programming-in-linux/

Upvotes: 31

Swedgin
Swedgin

Reputation: 893

As per Python 3.9 this is possible to do with asyncio. https://docs.python.org/3.9/library/asyncio-task.html#asyncio.to_thread

await asyncio.to_thread(shutil.copyfile, "a", "b")

Upvotes: 6

Z. Qui
Z. Qui

Reputation: 199

asyncio does not have support for this. However, aiofiles supports just this. Please have a look.

Upvotes: 15

Andrew Svetlov
Andrew Svetlov

Reputation: 17366

Most operating systems don't support asynchronous file operations. That's why asyncio doesn't support them either.

See the asyncio wiki for further explanation.

Upvotes: 41

Related Questions