[ x] Provide the PostgreSQL URL to the Airflow instances
- Manually setup the DB with airflow db init & airflow db check
Description
Description
Details
Details
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Antoine_Quhen | T326193 Airflow upgrade (refactor deb creation + version bump + switch to PostgreSQL) | |||
| Resolved | Stevemunene | T326195 Edit puppet code to provide Airflow the PostgreSQL connection |
Event Timeline
Comment Actions
Change 878128 had a related patch set uploaded (by Stevemunene; author: Stevemunene):
[operations/puppet@production] Update analytics_text conf compatibility with airflow2.3.4 connect postgresql
Comment Actions
On change 878128 Airflow 2.3.4 compatible configuration changes were made but were not properly tested since the test instance an-test-client1001.eqiad.wmnet is running airflow 2.1.4.
The changes made covered
connecting airflow instances to PostgreSQL T326195
handling the connection in a way compatible with airflow 2.3.4 upwards T315580
Since the changes made were only compatible in Airflow 2.3.0 upwards, pcc runs resulted in the error below.
Error: Evaluation Error: Error while evaluating a Resource Statement, Airflow::Instance[analytics_test]: has no parameter named 'sql_alchemy_schema' has no parameter named 'database' (file: /srv/jenkins/puppet-compiler/39047/change/src/modules/profile/manifests/airflow.pp, line: 222) on node an-test-client1001.eqiad.wmnet Error: Evaluation Error: Error while evaluating a Resource Statement, Airflow::Instance[analytics_test]: has no parameter named 'sql_alchemy_schema' has no parameter named 'database' (file: /srv/jenkins/puppet-compiler/39047/change/src/modules/profile/manifests/airflow.pp, line: 222) on node an-test-client1001.eqiad.wmnet Warning: Failed to compile catalog for node an-test-client1001.eqiad.wmnet: Evaluation Error: Error while evaluating a Resource Statement, Airflow::Instance[analytics_test]: has no parameter named 'sql_alchemy_schema' has no parameter named 'database' (file: /srv/jenkins/puppet-compiler/39047/change/src/modules/profile/manifests/airflow.pp, line: 222) on node an-test-client1001.eqiad.wmnet Error: Failed to compile catalog for node an-test-client1001.eqiad.wmnet: undefined method `to_resource' for nil:NilClass
Comment Actions
Change 887735 had a related patch set uploaded (by Btullis; author: Btullis):
[labs/private@master] Add some dummy tokens for the airflow_test database
Comment Actions
Change 887735 merged by Btullis:
[labs/private@master] Add some dummy tokens for the airflow_test database
Comment Actions
Change 878128 merged by Nicolas Fraison:
[operations/puppet@production] Update airflow conf compatibility with airflow 2.5.0 connect postgresql