#37 · Primary category： AI Data Infrastructure & Storage
fugue
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
Project last updated：05/19/26
GitHub Stars
2.2K
Forks
103
Contributors
25
License
Apache-2.0
Why we included this project
Fugue is for teams whose Pandas code has outgrown a single machine but who do not want to rewrite it for a cluster. It exposes one Python API that runs the same SQL, Python, Pandas, or Polars logic on Spark, Dask, or Ray, so you can prototype locally and scale up without maintaining separate code paths. The FugueSQL layer is especially useful for end-to-end workflows that mix declarative SQL with Python functions, and the transform() helper parallelizes an existing function by pointing it at a different engine. If you are standardizing how your data team moves from notebooks to distributed execution, this is a solid abstraction to evaluate.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ClickHouse
ClickHouse® is a real-time analytics database management system
simdjson
Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks
gun
An open source cybersecurity protocol for syncing decentralized graph data.
emqx
The most scalable and reliable MQTT broker for AI, IoT, IIoT and connected vehicles
server
MariaDB server is a community developed fork of MySQL server. Started by core members of the original MySQL team, MariaDB actively works with outside developers to deliver the most featureful, stable, and sanely licensed open SQL server in the industry.