airflow-plugin-config-storage
Inject connections into the airflow database from configuration
Quickstart
Basic
$ pip install airflow-plugin-config-storage
$ export AIRFLOW_CONN_POSTGRES_MASTER=postgres://username:password@my.db.example.com/my-schema
$ load-airflow-conf-env-var
$ airflow webserver
Common
CLI Commands
delete-all-airflow-connnections
Removes all the connections from Airflow. Used to clean out the default connections.
Environment Variables
Structure
The Environment Variables to read from by default are the same as those defined in the Airflow documentation.
CLI Commands
load-airflow-conf-env-var
Takes a single optional argument --env-var-prefix ENV_VAR_PREFIX
to override the Environment Variable prefix. Default is AIRLFOW_CONN_
.
AWS
NOTE: Not yet implemented, these are proposals
SSM
Hierarchy
-
/${user_prefix}/airflow/connections/
[ { "conn_type": "s3", }, {} ]
-
/${user_prefix}/airflow/