Mimoune Djouallah
@mimdj.bsky.social
#MicrosofFabric Customer advocate, interests in Small Data & Self Service #Microsoftemployee since Dec 2023 , but my tweets are my own
AI, dbt and Iceberg are already changing data engineering, and as a data analyst I could not be happier #dataengineering #AI #viscode #apacheiceberg #onelake #vscode #claude #dbt #sql datamonkeysite.com/2026/08/09/a...
AI, dbt and Iceberg are already changing data engineering
I have been using AI in VS Code and Onelake, initially trying to make sense of Chat with your data (without much success, that thing is very hard and we need some breakthrough), and more recently f…
datamonkeysite.com
impact of parquet layout on #powerbi direct lake performance fully automated testing using #dbt and gitthub runners djouallah.github.io/fabric-dbt-b...
Short demo: querying the #OneLake catalog from #DuckDB WASM , entirely in the browser The data was written through the new #ApacheIceberg REST Catalog for OneLake (private preview, coming soon). www.youtube.com/watch?v=XajC...
Querying Onelake Catalog using DuckDB Wasm
YouTube video by DataMonkey
youtube.com
I spent some time testing writing to Iceberg REST catalogs across vendors. Same code, seven catalogs. Code's public 👇 github.com/djouallah/te... #ApacheIceberg #DataEngineering #onelake #Lakehouse #Databricks #Snowflake #s3 #cloudflare #Microsoftfabric #duckdb
Power BI with DuckDB, 4 years later 600 M rows under 4 seconds in Direct Query mode ( warm run) datamonkeysite.com/2026/05/19/p... #onelake #apacheiceberg #PowerBI #duckdb #PowerQuery #ADBC
Power BI with DuckDB, 4 years later
Four years ago I wrote a blog about using DuckDB with Power BI in DirectQuery. It got a fair number of likes on LinkedIn :) along with the one comment I didn’t want to hear: how does this wor…
datamonkeysite.com
The Boring Reason apache Iceberg Matters datamonkeysite.com/2026/05/09/t...
The Boring Reason Iceberg Matters
TL;DR: Iceberg’s value is sociological, not technical. And if you care about lightweight, single-process engines like datafusion and duckdb, it’s probably your best shot at first-class …
datamonkeysite.com
This is (AFAIK) the first ever #apacheiceberg table written by #duckdb using #onelake catalog , thanks to opus 4.7 for finding the bug and providing a PR
Sneak peek at what’s coming with the #OneLake Iceberg Catalog 👀 This is what the power of open standards looks like write using #lakesail read using #duckdb with table name like a real Database :) #Lakehouse #C++ #Rust #MicrosoftFabric #ApacheIceberg
Poor man's vertical scaling in Single Node Python Notebook:) 158 GB of CSV. One pipeline parameter. Instead of hardcoding vCores in your notebook, pass them from the pipeline to find your sweet spot. Full write-up 👇 datamonkeysite.com/2026/04/24/d... #onelake #python #MicrosoftFabric
Dynamic vCores in Microsoft Fabric Python Notebooks
Microsoft Fabric lets you dynamically configure the number of vCores for a Python notebook session at runtime — but only when the notebook is triggered from a pipeline. If you run it interactively,…
datamonkeysite.com
Text-to-SQL using Semantic Models and Small language models datamonkeysite.com/2026/03/31/t...
Text-to-SQL using Semantic Models and Small language models
The high-end version of this problem is mostly solved. GPT-4 or Claude Opus paired with a mature proprietary semantic layer like Microsoft Power BI’s will handle natural language queries reli…
datamonkeysite.com
analytics as code, everything inside github #vscode #dbt #duckdb #apacheiceberg #wasm #claude djouallah.github.io/analytics-as...
Building a Data Pipeline Using VSCode and Claude Out of Thin Air #duckdb #onelake #vscode datamonkeysite.com/2026/03/05/b...
Building a Data Pipeline Using VSCode and Claude Out of Thin Air
A complete data pipeline running on Microsoft Fabric that downloads public data, transforms it into a star schema, exports it as Delta Lake tables, and serves it through a Power BI semantic model w…
datamonkeysite.com
Duckdb 1.5 is planned to be released next week and it the first time where apache iceberg support is substantially better than Delta , and I don't know how to feel about it.
I built a community extension for #DuckDB called Delta Classic. Point it to a path containing Delta tables and it mounts them as a read-only database. all the code was written by #claude but i wrote the #python tests 👇 github.com/djouallah/de...
GitHub - djouallah/delta_classic: DuckDB extension to attach a directory of Delta tables as a database
DuckDB extension to attach a directory of Delta tables as a database - djouallah/delta_classic
github.com
when you apply RLS and CLS to a #onelake table, direct storage access get blocked, which means, #duckdb can not read it, there is a solution though using #SQLServer extension datamonkeysite.com/2026/02/14/q...
Querying a Onelake Table with RLS and CLS Using DuckDB’s MSSQL Extension
Microsoft Fabric Lakehouse supports Row-Level Security (RLS) and Column-Level Security (CLS) . it works with trusted engines like PowerBI, Spark running inside Fabric etc, but if you use Python not…
datamonkeysite.com
Seriously impressive performance from #Polars with delta_sink to #onelake 🚀 Fully reproducible test: github.com/djouallah/Fa...
a sql script that export #deltatable metadata from a #ducklkake db never thought that #sql can do that !!!! github.com/djouallah/Fa...
#duckdb #apacheiceberg is becoming good enough to be useful the script will download zip files from the web, extract them, create 4 tables and generate a summary table for reporting all in pure #SQL github.com/djouallah/Fa...
DuckDB just added native write support to OneLake. It is still early, and for now it only works through the blob API, There is no Delta write yet, but it is a very exciting first step. #MicrosoftFabric #duckdb #Python #SQL www.youtube.com/watch?v=V01W...
Second Look at Ducklake in Onelake
YouTube video by DataMonkey
youtube.com
how to query #onelake iceberg catalog using pure sql with #duckdb the query cross join a table from #MicrosoftFabric Warehouse and #Snowflake, why not :) duckdb has no read only mode, so every query check the remote table state, which create a not so great experience www.youtube.com/watch?v=DK8i...
Querying Onelake Iceberg REST Catalog using DuckDB CLI with pure SQL
YouTube video by DataMonkey
youtube.com
Explaining how Python engines read and write #DeltaTable is not for the faint of heart. The theory is everything will depends on the delta kernet rust for read and write, but we are not there yet github.com/djouallah/Fa... #duckdb #delta_rs #datafusion #chdb #daft #polars #rust #lakesail
Any system that allows exchanging real money for stuff with an element of chance is morally equivalent to a casino. Corollary: Pokémon cards, Roblox, Labubus, and even claw machines should all be 18+
Zach Weinersmith@zachweinersmith.bsky.social · 10mo agoDo you have any extremely niche, but serious, ethical stances?
running #duckdb at 10 TB scale using #tpch like benchmark #delta #onelake #singlenode #MicrosoftFabric datamonkeysite.com/2025/10/19/r...
you are looking at #duckdb running tpch 1 TB with only 16 cores it used to crash even with 64 pip install duckdb --upgrade is an act of faith basically
Put together a small python package duckrun :) point it at a folder of SQL/Python files, define a pipeline, and it will create Delta tables in #OneLake with #DuckDB and #delta_rs github.com/djouallah/du...
actually #Microsoftfabric Datawarehouse automatically expose an Iceberg rest Catalog thanks to #duckdb UI extension, you can see proper catalog
First Look at #onelake #apacheiceberg REST Catalog, please notice it is coming soon and not in production yet #MicrosoftFabric www.youtube.com/watch?v=_QRE...
First Look at Onelake Iceberg REST Catalog
YouTube video by DataMonkey
youtube.com
