Metadata everywhere!
Creating, updating, and locating project metadata is a hassle. SQLMesh makes it easier by letting models speak for themselves: inline comments automatically registered with your SQL engine.
Creating, updating, and locating project metadata is a hassle. SQLMesh makes it easier by letting models speak for themselves: inline comments automatically registered with your SQL engine.
How can you tell if two SQL queries are the same? Can you do better than just checking if two statements are textually equivalent?
Introducing the Rust implementation of the SQLGlot tokenizer, which significantly improves parsing performance.
SQLMesh now supports the Write-Audit-Publish pattern when model tables are stored in the Apache Iceberg format.
Explaining the surge in popularity of declarative data transformation while drawing some parallels with DevOps.
How we're trying to build a trustworthy and thriving open source community.
Manually tracing DAGs and jumping between models is a drag. If you know that pain, check out the free, open source SQLMesh browser UI - it makes understanding and developing data transformation models easy.
The tremendous push towards streaming pipelines lately has led some to believe that the days of batch processing are either over or will soon be coming to an end. But is this actually true? In this post, I explore the reasons for keeping some of your batch pipelines.
Learn about what SQLMesh has to offer when it comes to evolving really large datasets.
The practice of augmenting SQL code with Jinja templates has gained significant traction and is consistently growing in popularity. However, is this truly the optimal approach? In this article, we examine the common challenges that arise when combining SQL and Jinja, while also suggesting a more effective method for metaprogramming in SQL.