about
Data engineering specialist with 10+ years experience building scalable ETL pipelines, functional programming advocate, and open-source contributor focused on Scala/ScalaJS ecosystems
Category: Software
Apache Airflow has become a cornerstone tool in the data engineering world, offering robust workflow orchestration capabilities. As someone who has extensively used Airflow, I can attest to its flexibility and power in automating ETL processes. In this guide, I’ll walk you through setting up Airflow using Docker, creating and scheduling Directed Acyclic Graphs (DAGs),…
As a seasoned software engineer, I’m always on the lookout for tools that can streamline my workflow and enhance productivity. Over the past month, I’ve been using dbt (Data Build Tool), and it has transformed the way I handle data operations. In this blog post, I’ll share why I made the switch and how dbt…