dbt: Incremental but Incomplete
dbt's new microbatch incremental models in version 1.9 are a step forward but come with limitations that require advanced handling. They don't have state or history, leading to data gaps and incomplete results.
Tobiko Articles
-
-
The Data Dev Environment Graveyard
How SQLMesh makes data development environments a first class citizen.
-
Docs + Testing: Are We Optimizing for the Wrong Thing?
How much context and assurance do I need to know I’m developing in the right direction?
-
How SQLMesh reduces warehouse costs with cron and partitions
Learn about how SQLMesh saves money with cron and partitions.
-
Column level lineage for dbt
Step by step guide for column level lineage within your dbt project.
-
SQLMesh for dbt Users - Part 2
Are you using dbt and have heard of SQLMesh, but aren't quite sure what it is? This post will teach you the basics of SQLMesh from a dbt user's perspective to help get you up to speed. Part 2 of 2.
-
SQLMesh for dbt Users - Part 1
Are you using dbt and have heard of SQLMesh, but aren't quite sure what it is? This post will teach you the basics of SQLMesh from a dbt user's perspective to help get you up to speed.
-
Simplicity or Efficiency: How dbt Makes You Choose
Comparing development experience and runtime efficiency of dbt and SQLMesh.
-
The False Promise of dbt Contracts
Creating highly efficient and scalable development environments for data.