Asyncio

repo: timofurrer/awesome-asyncio
category: Programming Languages related: Python

[!WARNING] This project is looking for a new home. I'm no longer maintaining it. Please let me know if you want to take over maintainance for it. Write me an email to [email protected]

Awesome asyncio

A carefully curated list of awesome Python asyncio frameworks, libraries, software and resources.

The Python asyncio module introduced to the standard library with Python 3.4 provides infrastructure for writing single-threaded concurrent code using coroutines, multiplexing I/O access over sockets and other resources, running network clients and servers, and other related primitives.

Asyncio is not really a brand-new technology however it appears to be very trending since a few years - especially in the Python community and with the release of Python 3.4 in March 2014. Thus, it's pretty hard to keep yourself up-to-date with the most awesome packages out there. Find some of those awesome packages here and if you are missing one we count on you to create an Issue or a Pull Request with your suggestion.

Contents

• Web Frameworks
• Message Queues
• Database Drivers
• Networking
• GraphQL
• Testing
• Alternative Loops
• Misc
• Writings
• Talks
• Alternatives to asyncio

Web Frameworks

Libraries to build web applications.

• FastAPI - A very high performance Python 3.6+ API framework based on type hints. Powered by Starlette and Pydantic.
• Django - An established, high-level Python web framework with a huge community and ecosystem.
• Starlette - A lightweight ASGI framework/toolkit for building high performance services.
• aiohttp - Http client/server for asyncio (PEP-3156).
• sanic - Python 3.5+ web server that's written to go fast.
• Quart - An asyncio web microframework with the same API as Flask.
• autobahn - WebSocket and WAMP supporting asyncio and Twisted, for clients and servers.
• websockets - A library for building WebSocket servers and clients in Python with a focus on correctness and simplicity.
• Tornado - Performant web framework and asynchronous networking library.
• uvicorn - The lightning-fast ASGI server.

Message Queues

Libraries to implement applications using message queues.

• aioamqp - AMQP implementation using asyncio.
• pyzmq - Python bindings for ZeroMQ.
• aiozmq - Alternative Asyncio integration with ZeroMQ.
• crossbar - Crossbar.io is a networking platform for distributed and microservice applications.
• asyncio-nats - Client for the NATS messaging system.
• aiokafka - Client for Apache Kafka.

Database Drivers

Libraries to connect to databases.

• asyncpg - Fast PostgreSQL Database Client Library for Python/asyncio.
• asyncpgsa - Asyncpg with sqlalchemy core support.
• aiopg - Library for accessing a PostgreSQL database.
• aiomysql - Library for accessing a MySQL database
• aioodbc - Library for accessing a ODBC databases.
• pymongo - The Official MongoDB Python driver, offering both synchronous and asynchronous APIs.
• redis-py - Redis Python Client (which includes aioreadis now).
• aiocouchdb - CouchDB client built on top of aiohttp (asyncio).
• aioinflux - InfluxDB client built on top of aiohttp.
• aioes - Asyncio compatible driver for elasticsearch.
• peewee-async - ORM implementation based on peewee and aiopg.
• GINO - is a lightweight asynchronous Python ORM based on SQLAlchemy core, with asyncpg dialect.
• Tortoise ORM - native multi-backend ORM with Django-like API and easy relations management.
• Databases - Async database access for SQLAlchemy core, with support for PostgreSQL, MySQL, and SQLite.
• Prisma Client Python - An auto-generated, fully type safe ORM powered by Pydantic and tailored specifically for your schema - supports SQLite, PostgreSQL, MySQL, MongoDB, MariaDB and more.
• Piccolo - An ORM / query builder which can work in async and sync modes, with a nice admin GUI, and ASGI middleware.
• Beanie - An async MongoDB ODM built on pymongo and Pydantic.

Networking

Libraries to communicate in your network.

• AsyncSSH - Provides an asynchronous client and server implementation of the SSHv2 protocol.
• aiodns - Simple DNS resolver for asyncio.
• aioping - Fast asyncio implementation of ICMP (ping) protocol.
• httpx - asynchronous HTTP client for Python 3 with requests compatible API.

GraphQL

Libraries to build GraphQL servers.

• Ariadne - Schema-first Python library for implementing GraphQL servers.
• Tartiflette - Schema-first Python 3.6+ GraphQL engine built on top of libgraphqlparser.
• Strawberry - Code-first Python 3 GraphQL server with Django, Flask and FastAPI/Starlette support.

Testing

Libraries to test asyncio based applications.

• aiomock - A python mock library that supports async methods.
• asynctest - Enhance the standard unittest package with features for testing. asyncio libraries
• pytest-asyncio - Pytest support for asyncio.
• aresponses - Asyncio http mocking. Similar to the responses library used for requests.
• aioresponses - Helper for mock/fake web requests in Python aiohttp package.

Alternative Loops

Alternative asyncio loop implementations.

• uvloop - Ultra fast implementation of asyncio event loop on top of libuv.

Misc

Other awesome asyncio libraries.

• aiochan - CSP-style concurrency with channels, select and multiprocessing on top of asyncio.
• aiocache - Cache manager for different backends.
• aiofiles - File support for asyncio.
• aiopath - Asynchronous pathlib for asyncio.
• aiodebug - A tiny library for monitoring and testing asyncio programs.
• aiorun - A run() function that handles all the usual boilerplate for startup and graceful shutdown.
• aiosc - Lightweight Open Sound Control implementation.
• aioserial - A drop-in replacement of pySerial.
• aiozipkin - Distributed tracing instrumentation for asyncio with zipkin
• asgiref - Backend utils for ASGI to WSGI integration, includes sync_to_async and async_to_sync function wrappers.
• async_property - Python decorator for async properties.
• ruia - An async web scraping micro-framework based on asyncio.
• kubernetes_asyncio - Asynchronous client library for Kubernetes.
• aiomisc - Miscellaneous utils for asyncio.
• taskiq - Asynchronous distributed task manager (like celery, but async).

Writings

Documentation, blog posts, and other awesome writing about asyncio.

• Official asyncio documentation - Asynchronous I/O, event loop, coroutines and tasks.
• Short well-written intro to asyncio - Generators, Coroutines, Native Coroutines and async/await.
• [AsyncIO for the Working Python Developer](https://hackernoon.com/asyncio-for-the-working-python-developer-5c468e6e2e8e) - A gentle introduction to asynchronous programming from basic examples working up to URL fetching.
• [Test limits of Python aiohttp](https://pawelmhm.github.io/asyncio/python/aiohttp/2016/04/22/asyncio-aiohttp.html) - Making 1 million requests with python-aiohttp.
• ASGI (Asynchronous Server Gateway Interface) - A spiritual successor to WSGI, intended to provide a standard interface between async-capable Python web servers, frameworks, and applications.
• First Principles Introduction to Asyncio - A no-buzzword first principles introduction to the internal workings of asyncio.
• [Developing and Testing an Asynchronous API with FastAPI and Pytest](https://testdriven.io/blog/fastapi-crud/) - This tutorial looks at how to develop and test an asynchronous API with FastAPI using Test-Driven Development (TDD).
• Python Concurrency with asyncio - Learn how to speed up slow Python code with concurrent programming and the cutting-edge asyncio library.

Talks

Recordings of awesome talks about asyncio.

• Topics of Interest (Python Asyncio) | screencast | slides - PyCon Brasil 2015 keynote (David Beazley).
• Python Asynchronous I/O Walkthrough - 8-part code walkthrough (Philip Guo).
• [Async/await in Python 3.5 and why it is awesome](https://www.youtube.com/watch?v=m28fiN9y_r8&t=132s) - EuroPython 2016 (Yury Selivanov).
• Fear and Awaiting in Async: A Savage Journey to the Heart of the Coroutine Dream | screencast - PyOhio 2016 keynote (David Beazley).
• [Asynchronous Python for the Complete Beginner](https://www.youtube.com/watch?v=iG6fr81xHKA) | slides - PyCon 2017 (Miguel Grinberg).
• [Demystifying Python's Async and Await Keywords](https://www.youtube.com/watch?v=F19R_M4Nay4) - JetBrains TV 2020 (Michael Kennedy)

Alternatives to asyncio

Alternative approaches to async programming in Python, some of which attempt to support some compatibility with asyncio, others are not compatible at all.

• curio - The coroutine concurrency library.
  • Curio-Asyncio Bridge - basic curio -> asyncio coroutine bridge.
• trio - Pythonic async I/O for humans and snake people.
  • trio-asyncio - re-implementation of the asyncio mainloop on top of Trio.
• AnyIO - High level asynchronous concurrency and networking framework that works on top of either trio or asyncio.