1️⃣ Set Up Google Cloud Platform (GCP) and BigQuery 📌 Step 1: Create a Google Cloud Account 📌 Step 2:…
Category: Data Engineering
End-to-End Data Engineering project with dbt Core , Snowflake and Apache Airflow
In this blog, we will walk through an end-to-end data engineering project using dbt, Snowflake, and Apache Airflow. We’ll cover…
Mastering dbt: Your Complete Step-by-Step Handbook
Setting up dbt Core involves installing the tool, configuring your environment, and running your first dbt project. Below is a…
DBT Tutorial for Beginners: What is DBT and Why Use It?
This is DBT Tutorial and you can download pdf material at the end of this article. Let’s start by stating…
What is Data Fabric?
Data fabric is a unified layer that seamlessly connects diverse data sources, including relational databases, data warehouses, data lakes, cloud…
Data Warehouse vs Data Lake vs Data Lakehouse
“Data Warehouse vs Data Lake vs Data Lakehouse” is a topic that often confuses many people. In this blog, we…
What are Transactional Databases?
Transactional databases are designed to manage and facilitate transactions in a way that ensures data integrity and consistency. They are…
Understanding DAG Scheduling in Apache Airflow
Hey there! Ready to dive into the world of Apache Airflow and make your workflows run like a charm? Let’s…
What are the differences between ETL, ELT, and ELTP?
The differences between ETL, ELT, and ELTP methodologies highlight the evolution of data integration strategies over the past few decades.…
Apache Airflow Tutorial: Architecture, Concepts, and How to Run Airflow Locally With Docker
Apache Airflow is an open-source platform that provides a way to programmatically author, schedule, and monitor workflows. It is widely used…