DuckDB Ducklake (github.com)
83 points by saikatsg a day ago
smithclay 2 hours ago
Don't think it's widely known or understood, but Ducklake doesn't require duckdb: it's just a (good) data lake spec that works in duckdb.
There's a cool alternate rust/datafusion ecosystem initiative going on at https://github.com/datafusion-contrib/datafusion-ducklake, and think the Quack protocol opens up a lot of cool possibilities too.
If you need an idea for what do do with ducklake: recommend throwing all of your agent traces in it.
celias 21 hours ago
Motherduck is offering a free copy of O'reilly's "DuckLake: The Definitive Guide" book on their DuckLake web page
engineeringwoke an hour ago
It's alright, it's pretty alpha software. On v1.5.4, catalog filtered counts are broken, afaik. I went to main/v2 to fix it, and then the SQL parser in duckdb v2 is 10x slower, which was another wrench in the gears. It's been a bit of a pain tbh
jauco an hour ago
Yep, they made the spec 1.0 but it isn’t 1.0 software. Browse the bugs before use.
When it works well it’s really nice. And it beats handrolling a multi level parquet store.
engineeringwoke 8 minutes ago
Absolutely. I love it, but you need a fork for now.
suchire a day ago
But "Duckpond" was right there!
HackerThemAll 14 hours ago
DuckDB is the best thing world got since 1990s.
https://duckdb.org/2025/05/19/the-lost-decade-of-small-data....
loufe 2 hours ago
Why program greenfield in C++? I know "made with rust" is a meme but seriously, why not a memory safe language in 2026?
esafak an hour ago
DuckDB has been around since 2018. Naturally its offspring use C++.
OutOfHere 17 minutes ago
Rust has been out since 2010. It was recognized and popular by 2017.