A comparison of Azure Datalake gen 2 and AWS S3
1. Introduction This article is about the comparison of features of Azure Datalake gen 2…
How to build CI/CD pipelines for Serverless?
What is Continuous Integration (CI) / Continuous Delivery (CD)? Continuous Integration(CI) is a development and…
Building a Low-cost, Fault-tolerant, HA, Real-time Serverless Data Pipeline on AWS
This article is to discuss a modern data pipeline architecture using S3 storage and AWS…
Introduction to Apache Airflow
What is Apache airflow? Apache Airflow is a workflow management system. Airflow provides tools to…
Big Data Architecture
Big data architecture is the foundation for big data analytics. Think of big data architecture…