Page MenuHomePhabricator
Paste P95329

(An Untitled Masterwork)
ActivePublic
Actions

Authored by atsuko on Jul 28 2026, 10:30 AM.
Project Tags
None
Referenced Files
F96291943: raw-paste-data.txt
Jul 28 2026, 10:30 AM
Subscribers
None
/home/app/.local/lib/python3.11/site-packages/airflow/providers/amazon/aws/utils/connection_wrapper.py:32 DeprecatedImportWarning: The `airflow.utils.types.NOTSET` attribute is deprecated. Please use `'airflow.serialization.definitions.notset.ArgNotSet'`.
/home/app/.local/lib/python3.11/site-packages/airflow/providers/amazon/aws/utils/connection_wrapper.py:32 DeprecatedImportWarning: The `airflow.utils.types.ArgNotSet` attribute is deprecated. Please use `'airflow.serialization.definitions.notset.ArgNotSet'`.
2026-07-28T10:27:39.894778Z [info ] Successfully loaded custom StatsD client [airflow.sdk.observability.metrics.statsd_logger] loc=statsd_logger.py:45
2026-07-28T10:27:40.002070Z [warning ] The secret_key option in [webserver] has been moved to the secret_key option in [api] - the old setting has been used, but please update your config. [py.warnings] category=DeprecationWarning filename=/home/app/.local/lib/python3.11/site-packages/airflow/configuration.py lineno=446
2026-07-28T10:27:40.098865Z [warning ]
Please define the 'cli' section in the 'get_provider_info' for custom executors to avoid this warning.
For community providers, please update to the version that support 'cli' section.
For more details, see https://airflow.apache.org/docs/apache-airflow-providers/core-extensions/cli-commands.html
Providers with executors missing 'cli' section in 'get_provider_info': {'airflow.providers.cncf.kubernetes.executors.kubernetes_executor.KubernetesExecutor': 'apache-airflow-providers-cncf-kubernetes', 'airflow.providers.amazon.aws.executors.ecs.ecs_executor.AwsEcsExecutor': 'apache-airflow-providers-amazon'}
[airflow.cli.cli_parser] loc=cli_parser.py:97
2026-07-28T10:27:41.099428Z [warning ] Using 'from airflow.stats import Stats' is deprecated. Please use 'from airflow.sdk.observability import stats' instead. [py.warnings] category=DeprecatedImportWarning filename=/home/app/.local/lib/python3.11/site-packages/airflow/providers/cncf/kubernetes/executors/kubernetes_executor.py lineno=74
2026-07-28T10:27:41.101511Z [warning ]
Please define the 'cli' section in the 'get_provider_info' for custom auth manager to avoid this warning.
For community providers, please update to the version that support 'cli' section.
For more details, see https://airflow.apache.org/docs/apache-airflow-providers/core-extensions/cli-commands.html
Providers with auth manager missing 'cli' section in 'get_provider_info': {'airflow.providers.amazon.aws.auth_manager.aws_auth_manager.AwsAuthManager': 'apache-airflow-providers-amazon'}
[airflow.cli.cli_parser] loc=cli_parser.py:142
____________ _____________
____ |__( )_________ __/__ /________ __
____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / /
___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ /
_/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/
2026-07-28T10:27:42.449247Z [warning ] The `airflow.models.baseoperator.BaseOperator` attribute is deprecated. Please use `'airflow.sdk.bases.operator.BaseOperator'`. [py.warnings] category=DeprecatedImportWarning filename=/opt/airflow/dags/airflow_dags/wmf_airflow_common/plugins/pod_resources_grafana_link.py lineno=11
2026-07-28T10:27:42.449395Z [warning ] The `airflow.models.baseoperatorlink.BaseOperatorLink` attribute is deprecated. Please use `'airflow.sdk.BaseOperatorLink'`. [py.warnings] category=DeprecatedImportWarning filename=/opt/airflow/dags/airflow_dags/wmf_airflow_common/plugins/pod_resources_grafana_link.py lineno=12
2026-07-28T10:27:42.461503Z [warning ] airflow.exceptions.AirflowSkipException is deprecated and will be removed in a future version. Use airflow.sdk.exceptions.AirflowSkipException instead. [py.warnings] category=DeprecatedImportWarning filename=/opt/airflow/dags/airflow_dags/wmf_airflow_common/operators/dumpsv1.py lineno=10
2026-07-28T10:27:42.461794Z [warning ] The `airflow.operators.python.PythonOperator` attribute is deprecated. Please use `'airflow.providers.standard.operators.python.PythonOperator'`. [py.warnings] category=DeprecatedImportWarning filename=/opt/airflow/dags/airflow_dags/wmf_airflow_common/operators/dumpsv1.py lineno=11
2026-07-28T10:27:42.466388Z [warning ] airflow.exceptions.AirflowSkipException is deprecated and will be removed in a future version. Use airflow.sdk.exceptions.AirflowSkipException instead. [py.warnings] category=DeprecatedImportWarning filename=/home/app/.local/lib/python3.11/site-packages/airflow/providers/standard/operators/python.py lineno=44
2026-07-28T10:27:42.467150Z [warning ] The `airflow.utils.operator_helpers.KeywordParameters` attribute is deprecated. Please use `'airflow.sdk.bases.decorator.KeywordParameters'`. [py.warnings] category=DeprecatedImportWarning filename=/home/app/.local/lib/python3.11/site-packages/airflow/providers/standard/operators/python.py lineno=62
2026-07-28T10:27:42.470567Z [warning ] airflow.exceptions.AirflowSkipException is deprecated and will be removed in a future version. Use airflow.sdk.exceptions.AirflowSkipException instead. [py.warnings] category=DeprecatedImportWarning filename=/home/app/.local/lib/python3.11/site-packages/airflow/providers/cncf/kubernetes/operators/pod.py lineno=44
2026-07-28T10:27:42.470661Z [warning ] airflow.exceptions.TaskDeferred is deprecated and will be removed in a future version. Use airflow.sdk.exceptions.TaskDeferred instead. [py.warnings] category=DeprecatedImportWarning filename=/home/app/.local/lib/python3.11/site-packages/airflow/providers/cncf/kubernetes/operators/pod.py lineno=44
2026-07-28T10:27:42.896455Z [warning ] The `airflow.utils.timezone.utcnow` attribute is deprecated. Please use `'airflow.sdk.timezone.utcnow'`. [py.warnings] category=DeprecatedImportWarning filename=/home/app/.local/lib/python3.11/site-packages/airflow/providers/cncf/kubernetes/utils/pod_manager.py lineno=52
2026-07-28T10:27:42.897814Z [warning ] Module airflow.utils.context is deprecated and will be removed in the future. Use airflow.sdk.execution_time.context if you are using the classes inside an Airflow task. [py.warnings] category=DeprecatedImportWarning filename=/opt/airflow/dags/airflow_dags/wmf_airflow_common/operators/dumpsv1.py lineno=18
2026-07-28T10:27:42.897965Z [warning ] The `airflow.utils.context.Context` attribute is deprecated. Please use `'airflow.sdk.definitions.context'`. [py.warnings] category=DeprecatedImportWarning filename=/opt/airflow/dags/airflow_dags/wmf_airflow_common/operators/dumpsv1.py lineno=18
2026-07-28T10:27:43.306942Z [error ] Failed to import plugin /opt/airflow/dags/airflow_dags/wmf_airflow_common/plugins/pod_resources_grafana_link.py [airflow._shared.plugins_manager.plugins_manager] loc=plugins_manager.py:261
Traceback (most recent call last):
File "/home/app/.local/lib/python3.11/site-packages/airflow/_shared/plugins_manager/plugins_manager.py", line 254, in _load_plugins_from_plugin_directory
loader.exec_module(mod)
File "<frozen importlib._bootstrap_external>", line 940, in exec_module
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "/opt/airflow/dags/airflow_dags/wmf_airflow_common/plugins/pod_resources_grafana_link.py", line 20, in <module>
from wmf_airflow_common.operators.dumpsv1 import WikimediaSqlXmlDumpsOperator
File "/opt/airflow/dags/airflow_dags/wmf_airflow_common/operators/dumpsv1.py", line 94, in <module>
class WikimediaSqlXmlDumpsOperator(KubernetesPodOperator):
File "/opt/airflow/dags/airflow_dags/wmf_airflow_common/operators/dumpsv1.py", line 161, in WikimediaSqlXmlDumpsOperator
def build_pod_request_obj(self, context: Context | None = None) -> k8s.V1Pod:
~~~~~~~~^~~~~~
TypeError: unsupported operand type(s) for |: 'module' and 'NoneType'
2026-07-28T10:27:43.313137Z [warning ] The `airflow.models.baseoperator.BaseOperator` attribute is deprecated. Please use `'airflow.sdk.bases.operator.BaseOperator'`. [py.warnings] category=DeprecatedImportWarning filename=/home/app/.local/lib/python3.11/site-packages/datahub_airflow_plugin/_airflow_shims.py lineno=6
2026-07-28T10:27:43.313337Z [error ] Failed to import plugin acryl-datahub-airflow-plugin [airflow._shared.plugins_manager.plugins_manager] loc=plugins_manager.py:208
Traceback (most recent call last):
File "/home/app/.local/lib/python3.11/site-packages/datahub_airflow_plugin/_airflow_shims.py", line 11, in <module>
from airflow.models.mappedoperator import MappedOperator
ModuleNotFoundError: No module named 'airflow.models.mappedoperator'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/app/.local/lib/python3.11/site-packages/airflow/_shared/plugins_manager/plugins_manager.py", line 200, in _load_entrypoint_plugins
plugin_class = entry_point.load()
^^^^^^^^^^^^^^^^^^
File "/home/app/.local/lib/python3.11/site-packages/importlib_metadata/__init__.py", line 221, in load
module = import_module(self.module)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "<frozen importlib._bootstrap>", line 1206, in _gcd_import
File "<frozen importlib._bootstrap>", line 1178, in _find_and_load
File "<frozen importlib._bootstrap>", line 1149, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 940, in exec_module
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "/home/app/.local/lib/python3.11/site-packages/datahub_airflow_plugin/datahub_plugin.py", line 8, in <module>
from datahub_airflow_plugin._airflow_shims import (
File "/home/app/.local/lib/python3.11/site-packages/datahub_airflow_plugin/_airflow_shims.py", line 20, in <module>
from airflow.operators.dummy import DummyOperator as EmptyOperator # type: ignore
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ModuleNotFoundError: No module named 'airflow.operators.dummy'
2026-07-28T10:27:43.419292Z [warning ] `api_auth/jwt_secret` was empty, using a generated one for now. Please set this in your config [airflow.api_fastapi.auth.tokens] loc=tokens.py:553
2026-07-28T10:27:43.419758Z [info ] Loaded executor: :KubernetesExecutor: [airflow.executors.executor_loader] loc=executor_loader.py:376
2026-07-28T10:27:43.790193Z [info ] Successfully loaded custom StatsD client [airflow.observability.metrics.statsd_logger] loc=statsd_logger.py:45
2026-07-28T10:27:43.914210Z [info ] Starting the scheduler [airflow.jobs.scheduler_job_runner.SchedulerJobRunner] loc=scheduler_job_runner.py:1589
2026-07-28T10:27:43.915306Z [info ] Start Kubernetes executor [airflow.providers.cncf.kubernetes.executors.kubernetes_executor.KubernetesExecutor] loc=kubernetes_executor.py:236
2026-07-28T10:27:43.916333Z [error ] Exception when executing SchedulerJob._run_scheduler_loop [airflow.jobs.scheduler_job_runner.SchedulerJobRunner] loc=scheduler_job_runner.py:1617
Traceback (most recent call last):
File "/home/app/.local/lib/python3.11/site-packages/airflow/jobs/scheduler_job_runner.py", line 1603, in _execute
executor.start()
File "/home/app/.local/lib/python3.11/site-packages/airflow/providers/cncf/kubernetes/executors/kubernetes_executor.py", line 239, in start
from airflow.providers.cncf.kubernetes.executors.kubernetes_executor_utils import (
File "/home/app/.local/lib/python3.11/site-packages/airflow/providers/cncf/kubernetes/executors/kubernetes_executor_utils.py", line 50, in <module>
from airflow.utils.singleton import Singleton
ModuleNotFoundError: No module named 'airflow.utils.singleton'
2026-07-28T10:27:43.917732Z [info ] Shutting down Kubernetes executor [airflow.providers.cncf.kubernetes.executors.kubernetes_executor.KubernetesExecutor] loc=kubernetes_executor.py:772
2026-07-28T10:27:43.928443Z [info ] Exited execute loop [airflow.jobs.scheduler_job_runner.SchedulerJobRunner] loc=scheduler_job_runner.py:1629
Traceback (most recent call last):
File "/home/app/.local/bin/airflow", line 8, in <module>
sys.exit(main())
^^^^^^
File "/home/app/.local/lib/python3.11/site-packages/airflow/__main__.py", line 55, in main
args.func(args)
File "/home/app/.local/lib/python3.11/site-packages/airflow/cli/cli_config.py", line 49, in command
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/app/.local/lib/python3.11/site-packages/airflow/utils/cli.py", line 113, in wrapper
return f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "/home/app/.local/lib/python3.11/site-packages/airflow/utils/providers_configuration_loader.py", line 54, in wrapped_function
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/app/.local/lib/python3.11/site-packages/airflow/cli/commands/scheduler_command.py", line 68, in scheduler
run_command_with_daemon_option(
File "/home/app/.local/lib/python3.11/site-packages/airflow/cli/commands/daemon_utils.py", line 82, in run_command_with_daemon_option
callback()
File "/home/app/.local/lib/python3.11/site-packages/airflow/cli/commands/scheduler_command.py", line 71, in <lambda>
callback=lambda: _run_scheduler_job(args),
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/app/.local/lib/python3.11/site-packages/airflow/utils/memray_utils.py", line 61, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/app/.local/lib/python3.11/site-packages/airflow/cli/commands/scheduler_command.py", line 50, in _run_scheduler_job
run_job(job=job_runner.job, execute_callable=job_runner._execute)
File "/home/app/.local/lib/python3.11/site-packages/airflow/utils/session.py", line 100, in wrapper
return func(*args, session=session, **kwargs) # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/app/.local/lib/python3.11/site-packages/airflow/jobs/job.py", line 353, in run_job
return execute_job(job, execute_callable=execute_callable)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/app/.local/lib/python3.11/site-packages/airflow/jobs/job.py", line 382, in execute_job
ret = execute_callable()
^^^^^^^^^^^^^^^^^^
File "/home/app/.local/lib/python3.11/site-packages/airflow/jobs/scheduler_job_runner.py", line 1603, in _execute
executor.start()
File "/home/app/.local/lib/python3.11/site-packages/airflow/providers/cncf/kubernetes/executors/kubernetes_executor.py", line 239, in start
from airflow.providers.cncf.kubernetes.executors.kubernetes_executor_utils import (
File "/home/app/.local/lib/python3.11/site-packages/airflow/providers/cncf/kubernetes/executors/kubernetes_executor_utils.py", line 50, in <module>
from airflow.utils.singleton import Singleton
ModuleNotFoundError: No module named 'airflow.utils.singleton'
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits