Open in app

Sign In

Write

Sign In

Akanksha Khushboo
Akanksha Khushboo

11 Followers

Home

About

Published in Google Cloud - Community

·Pinned

Store Service Account keys in GCP Secret Manager

Written in collaboration with Bipin Upadhyaya — Nov 16, 2022 Airflow DAGs may need connections and variables passed to them during runtime to execute operators and sensors. Traditionally, Airflow developers have used environment variables or the metastore database to store and retrieve these connections and variables used during DAG parsing…

Airflow

6 min read

Store Service Account keys in GCP Secret Manager
Store Service Account keys in GCP Secret Manager
Airflow

6 min read


Published in Google Cloud - Community

·Feb 16

DAG-Dependency Patterns in Composer Multi-cluster environment

Written in collaboration with Bipin Upadhyaya — Feb 15, 2023 Introduction When designing Airflow DAGs, it’s often a good idea to include all related tasks in the same DAG. However, sometimes you need to create dependencies between your DAGs. According to the Airflow documentation, designing cross-DAG dependencies can be useful when: …

Composer

7 min read

DAG-Dependency Patterns in Composer Multi-cluster environment
DAG-Dependency Patterns in Composer Multi-cluster environment
Composer

7 min read

Akanksha Khushboo

Akanksha Khushboo

11 Followers

Cloud Consultant, Google

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech