![]() ![]() The static DAG (created by dag_1.py) contains a task at a later stage which generates some of these input json files for dag_2.py and dynamic DAGs are created in this manner. You can manage connections directly from the UI, and the sensitive data will be encrypted and stored in PostgreSQL or MySQL.I have 2 files inside dags directory - dag_1.py and dag_2.pyĭag_1.py creates a static DAG and dag_2.py creates dynamic DAGs based on external json files at some location. This includes authentication credentials and API tokens. Connections-these contain information that enable a connection to an external system.Plugins-a variety of Hooks and Operators to help perform certain tasks, such as sending data from SalesForce to Amazon Redshift.They are maintained by the community and can be directly installed on an Airflow environment. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |