Tobiko Articles

Explaining the surge in popularity of declarative data transformation while drawing some parallels with DevOps.

The tremendous push towards streaming pipelines lately has led some to believe that the days of batch processing are either over or will soon be coming to an end. But is this actually true? In this post, I explore the reasons for keeping some of your batch pipelines.

Explore the two fundamental methods of loading data (Full Refresh and Incremental). Learn about two common approaches for determining what data to load incrementally and how they compare.