Vignesh Chandramohan
@vigneshc.bsky.social
Stream processing, data infra, Table formats. https://vigneshc.github.io/
Does anyone have a production use case example for Quack? Remote reads make sense for local cache like scenarios. I am curious about remote writes. Great talk from this year's AI council on duckdb quack : youtu.be/O_tzHeDpjrE?...
Super-Secret Next Big Thing for DuckDB
YouTube video by AI Council
youtu.be
Exploring Apache Iceberg and SlateDB formats - with a repo link for additional exploration. datapapers.substack.com/p/exploring-...
Exploring Table Formats - Iceberg & SlateDB
What is common between Apache Icerberg, SlateDB and object-store first table formats? Explore with real examples.
datapapers.substack.com
Short talk on Iceberg use cases in last week's Seattle Iceberg meetup. youtu.be/F7qpOVVnxek?...
Iceberg Use Cases at DoorDash
YouTube video by Apache Iceberg™ Meetup
youtu.be
If you find yourself in SF next week, @almog.xyz is talking about SlateDB at the SF Systems Meetup on Wednesday!
SF Systems Meetup: Databases and Stateful Apps · Luma
The SF Systems Meetup is back with a pair of talks giving us a peek at the future of state management! This month, we're excited to have talks from Almog Gavra…
luma.com
1/ Nice read: medium.com/@xiafan/time... Software engineer growth in AI era: * Build composable tools. * Assume non deterministic outcomes from a group of ai agents. * Understand how LLM works to the next level, like how you would understand to read a query plan.
Time to Adapt and Become a Better Engineer
A colleague recently asked if I think AI agents could do all the jobs humans do. My answer was an unequivocal yes. Given the same sensory…
medium.com
Just added sqlync.com to SlateDB's adopters list! They're building a streaming system that speaks MQTT or PostgreSQL across millions of connected users and devices. 🤯
SQLync
sqlync.com
Insane amount of SlateDB work going on: - snapshot reads - split/merge DBs (zero copy) - deterministic simulation testing And someone just pushed Python bindings in a PR! 🤯
SlateDB 0.6.0 is out! github.com/slatedb/slat... Highlights include a hybrid cache (using Foyer), a lot of internal cleanup, and more groundwork for transactions. Oh, and put performance jumped ~80% for write-heavy workloads :) slatedb.io/performance/...
Today marks SlateDB’s one year anniversary! It’s been a lot of fun. Thanks to @rohanpd.bsky.social @flaneur2024.bsky.social @almog.ai @vigneshc.bsky.social @paulbutler.org Jason Gustafson, David Moravek, and many others for joining the project. 😀
SlateDB - An embedded storage engine built on object storage | SlateDB
Description will go into a meta tag in <head />
slatedb.io
Commonhaus is 1! 🎂 14 projects, solid foundations, and more on the way. If you believe in light governance, shared care, and thoughtful support for open source, come see what we’re building. www.commonhaus.org/activity/253...
🎂 Commonhaus Turns One — A Look Back, and the Road Ahead
Commonhaus Foundation celebrates its first anniversary and lays down expectations for its future
commonhaus.org
Yo SF Bay Area #databs crew, want to talk lakehouses at a real Lake House? :) Next week after Data Council, join the founders of @clickhouse.com, @motherduck.com, @startreedata.bsky.social, and @tobikodata.com to talk real-time databases and next-generation ETL. www.rilldata.com/events/data-...
SlateDB 0.5.0 is out! Features: - Checkpoints - Clones - Read only client - Split/merge database foundation - TTL filtering on reads - Last version with breaking byte format changes By the numbers: - 62 commits - 2 new contributors - 10 total contributors github.com/slatedb/slat...
Release v0.5.0 · slatedb/slatedb
What's Changed Refactor Block Tests to Use Table-Driven Test Cases by @samsond in #410 Update await calls in README.md by @criccomini in #425 chore: Apply table driven test for sst.rs by @jeffreyl...
github.com
DEBS conference hosts a grand challenge every year. This year's challenge is detecting outliers in a stream of images from laser powder bed fusion. The challenge involves submitting a kubernetes app (constraint: 2 cores 8 gb). Interesting to try if you have the time! 2025.debs.org/call-for-gra...
CALL FOR GRAND CHALLENGE SOLUTIONS
DEBS2025
2025.debs.org
Python Folks - which data/workflow engine has the best developer experience for packaging code? We have looked into - Modal, Beam, Airflow, Flyte, AWS Lambda, Prefect, Dagster and Spark. Haven’t seen any approach which is fast, reliable and intuitive.
What are some papers or blogs about data quality challenges? I see tools like great expectations, table formats features like 'check constraints' in Delta. I don't yet see it as a first class property of catalogs. Found this, are there others? journalofbigdata.springeropen.com/articles/10....
Big data quality framework: a holistic approach to continuous quality management - Journal of Big Data
Big Data is an essential research area for governments, institutions, and private agencies to support their analytics decisions. Big Data refers to all about data, how it is collected, processed, and ...
journalofbigdata.springeropen.com
Great talk by Binwei Yang on Apache Gluten last week. youtu.be/GWTj3INSzPg?... Apache Gluten moves execution of spark operators to native backend like Velox, accelerating query performance. It has basic iceberg support too! github.com/apache/incub...
Big Data Bellevue: Apache Gluten: Accelerating SparkSQL with Spark on Velox
YouTube video by BDB
youtu.be
SlateDB 0.4.0 is out! Features: - Range scans - No DynamoDB needed for S3 - Nightly perf tests - Merge operator groundwork - GC improvements By the numbers: - 57 commits - 5 new contributors - 11 total contributors github.com/slatedb/slat...
SlateDB is now part of @commonhaus-fdn.bsky.social! I think we might be the first non-JVM project. Looking forward to more projects joining us here. Our experience with the foundation has been excellent so far. github.com/commonhaus/f...
SlateDB would like to join Commonhaus · commonhaus foundation · Discussion #213
Project information Project name: SlateDB Project website: https://slatedb.io Code repository: https://github.com/slatedb/slatedb License: Apache 2.0 Do you have authority to represent this project...
github.com
The 3 reasons to backfill: 1) new pipeline, who dis? 2) logic changed, recompute 3) whoops downstream lost everything. resend it.
