Per suggestion from the crowd, I will be exploring Ibis in the next live coding stream on behalf of :probabl.. I'll also do my best to find a fun dataset for this one 🙂

youtube.com/live/xoipV_Fh7…

PSA: Tomorrow you can learn about Ibis Project from Vincent D. Warmerdam on the :probabl. live coding stream! Click the link to see what time it is streaming in your area.

Unix is all you need! Ibis already supports 20+ backends including DuckDB, polars data, PostgreSQL, ClickHouse, and now it has cross-platform, web-scale, production-ready Unix support! Try it out today (use WSL on Windows): ibis-project.org/posts/unix-bac…

Good news: Ibis is now production ready. 🥳

ibis-project.org/posts/unix-bac…

TL; DR: We're adding the Unix backend for Ibis.

You should probably put this into production immediately.

This thing really does check all the boxes.

✔️Web scale
✔️Cloud native
✔️Production ready

Medium-temperature take: most local analyses can be done with coreutils and (g)awk.

We've had out-of-core sort functionality and streaming relational operators literally at our fingertips for decades.

The interface is the issue: it's pretty hard to work with awk-the-language.

Are people aware that coreutils has a join command?

Personally, creating multiple queries for a single analysis was very frustrating! 😕

While exploring DuckDB for something else, I stumbled upon @ibisdata and I was convinced that this is it! ⚡️

Just discovered Ibis Project and we're blown away! 🤩

Excited to announce that we're now rewriting the entire query building code from scratch and we're already 50% there! 😎

Stay tuned for some major improvements! ✨

#DataAnalytics

Infornomics yuppppppp! exactly. this is largely the case with geo tools already. everything is just an API to geos and gdal. I think we're going to get a similar thing with Rust (polars, datafusion, etc etc).

this is why dplyr and ibis are so cool

DuckDB and RAG ?
That's what the Ibis team is discussing in this blog 👇
ibis-project.org/posts/duckdb-f…

We have our first public roadmap! Check out the blog -- streaming backends, more geospatial operation supports in backends (like DuckDB), and a new ML library or two are on the way or already released!

ibis-project.org/posts/roadmap-…

Did you know you can perform RAG with DuckDB? Ibis makes it easy in Python!

ibis-project.org/posts/duckdb-f…

ABC Ibis Project DuckDB polars data it depends! generally in our testing, DuckDB has a slight edge

you might be interested in this post: ibis-project.org/posts/1brc/

timings were not given because there was some weird amount of slowness with the Polars backend we still need to investigate

DuckDB is the default backend for Ibis! It brings great performance and tons of features, while Ibis brings the Pythonic dataframe API on top of the otherwise SQL-only query engine. Check out our latest blog post from Phillip Cloud!

ibis-project.org/posts/why-duck…

🔥🔥🔥 Woot! Ibis Project roadmap is here!
Really looking forward to Ibis ML and more geospatial features!

🔥🔥🔥Ibis Project 8.0 brings dedicated streaming backends for Apache Flink & RisingWave: Postgres for streaming data! The portable Python #openstandards API should be in every data team's toolkit! Bridging local/distributed, then CPU/GPU, and now batch/realtime... epic! ibis-project.org/posts/ibis-ver…

Check out the latest Ibis blog, where we explore how large language models fit into data workflows – from synthetic data generation to analytic code writing. Demos use Marvin 🤖🧦 & Ibis with the default DuckDB backend.

ibis-project.org/posts/lms-for-…

When scale is the name of the game…

Welcome Chip Huyen and Claypot AI (Voltron Data) team to Voltron Data! 💪🔥

polars data and Ibis Project are the most recent data backends supported by our sister libraries #hvPlot and HoloViews ❤️

Folks in the #pydata space: if you haven’t already, install Ibis Project. Insanely useful package; it’s saved me so many times these past few weeks.