Page MenuHomePhabricator
Paste P87832

Airflow logs for move_model_to_s3_task
ActivePublic
Actions

Authored by gkyziridis on Jan 21 2026, 2:42 PM.
Tags
None
Referenced Files
F71584300: Airflow logs for move_model_to_s3_task
Jan 21 2026, 2:42 PM
Subscribers
gkyziridis
tone-check-training-dag-move-model-to-s3-p56ysy2n
▶ Log message source details
/home/app/.local/lib/python3.11/site-packages/airflow/metrics/statsd_logger.py:184 RemovedInAirflow3Warning: The basic metric validator will be deprecated in the future in favor of pattern-matching. You can try this now by setting config option metrics_use_pattern_match to True.
/opt/airflow/airflow_local_settings.py:14 DeprecationWarning: The `airflow.kubernetes.pod_generator.PodDefaults` class is deprecated. Please use `'airflow.kubernetes.pre_7_4_0_compatibility.pod_generator_deprecated.PodDefaults'`. The `cncf.kubernetes` provider must be >= 7.4.0 for that..
[2026-01-20, 14:14:57 UTC] {dagbag.py:588} INFO - Filling up the DagBag from /opt/airflow/dags/airflow_dags/ml/dags/tone_check_training_dag.py
[2026-01-20, 14:14:57 UTC] {dag_default_args.py:273} INFO - Dag-default-args set is `dev_wmf`.
/home/app/.local/lib/python3.11/site-packages/conda_pack/core.py:15 UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
[2026-01-20, 14:14:57 UTC] {task_command.py:467} INFO - Running <TaskInstance: tone_check_training_dag.move_model_to_s3 manual__2026-01-20T14:14:29.438216+00:00 [queued]> on host tone-check-training-dag-move-model-to-s3-p56ysy2n
[2026-01-20, 14:14:57 UTC] {local_task_job_runner.py:123} ▶ Pre task execution logs
[2026-01-20, 14:14:57 UTC] {crypto.py:82} WARNING - empty cryptography key - values will not be stored encrypted.
[2026-01-20, 14:14:58 UTC] {tone_check_training_dag.py:97} INFO - [+] S3 client loaded !
[2026-01-20, 14:14:58 UTC] {tone_check_training_dag.py:99} INFO - Searching files in /mnt/model-training/tone_check/20251014T132011/output_model:
[2026-01-20, 14:14:58 UTC] {tone_check_training_dag.py:105} INFO - - File: /mnt/model-training/tone_check/20251014T132011/output_model/checkpoint-63618/config.json | wmf-ml-models | retrained-models/tone-check/checkpoint-63618/config.json
[2026-01-20, 14:14:58 UTC] {tone_check_training_dag.py:105} INFO - - File: /mnt/model-training/tone_check/20251014T132011/output_model/checkpoint-63618/model.safetensors | wmf-ml-models | retrained-models/tone-check/checkpoint-63618/model.safetensors
[2026-01-20, 14:15:05 UTC] {tone_check_training_dag.py:105} INFO - - File: /mnt/model-training/tone_check/20251014T132011/output_model/checkpoint-63618/special_tokens_map.json | wmf-ml-models | retrained-models/tone-check/checkpoint-63618/special_tokens_map.json
[2026-01-20, 14:15:05 UTC] {tone_check_training_dag.py:105} INFO - - File: /mnt/model-training/tone_check/20251014T132011/output_model/checkpoint-63618/rng_state.pth | wmf-ml-models | retrained-models/tone-check/checkpoint-63618/rng_state.pth
[2026-01-20, 14:15:06 UTC] {tone_check_training_dag.py:105} INFO - - File: /mnt/model-training/tone_check/20251014T132011/output_model/checkpoint-63618/tokenizer_config.json | wmf-ml-models | retrained-models/tone-check/checkpoint-63618/tokenizer_config.json
[2026-01-20, 14:15:06 UTC] {tone_check_training_dag.py:105} INFO - - File: /mnt/model-training/tone_check/20251014T132011/output_model/checkpoint-63618/vocab.txt | wmf-ml-models | retrained-models/tone-check/checkpoint-63618/vocab.txt
[2026-01-20, 14:15:06 UTC] {tone_check_training_dag.py:105} INFO - - File: /mnt/model-training/tone_check/20251014T132011/output_model/checkpoint-63618/tokenizer.json | wmf-ml-models | retrained-models/tone-check/checkpoint-63618/tokenizer.json
[2026-01-20, 14:15:07 UTC] {tone_check_training_dag.py:105} INFO - - File: /mnt/model-training/tone_check/20251014T132011/output_model/checkpoint-63618/training_args.bin | wmf-ml-models | retrained-models/tone-check/checkpoint-63618/training_args.bin
[2026-01-20, 14:15:07 UTC] {tone_check_training_dag.py:105} INFO - - File: /mnt/model-training/tone_check/20251014T132011/output_model/checkpoint-63618/scheduler.pt | wmf-ml-models | retrained-models/tone-check/checkpoint-63618/scheduler.pt
[2026-01-20, 14:15:07 UTC] {tone_check_training_dag.py:105} INFO - - File: /mnt/model-training/tone_check/20251014T132011/output_model/checkpoint-63618/trainer_state.json | wmf-ml-models | retrained-models/tone-check/checkpoint-63618/trainer_state.json
[2026-01-20, 14:15:07 UTC] {tone_check_training_dag.py:105} INFO - - File: /mnt/model-training/tone_check/20251014T132011/output_model/checkpoint-63618/optimizer.pt | wmf-ml-models | retrained-models/tone-check/checkpoint-63618/optimizer.pt
[2026-01-20, 14:15:22 UTC] {tone_check_training_dag.py:108} INFO - [+] Files uploded correctly at: s3://wmf-ml-models/retrained-models/tone-check//
[2026-01-20, 14:15:22 UTC] {python.py:240} INFO - Done. Returned value was: None
[2026-01-20, 14:15:22 UTC] {taskinstance.py:341} ▶ Post task execution logs
[2026-01-20, 14:15:22 UTC] {crypto.py:82} WARNING - empty cryptography key - values will not be stored encrypted.
[2026-01-20, 14:15:22 UTC] {base.py:84} INFO - Retrieving connection 's3_dpe'
[2026-01-20, 14:15:22 UTC] {connection_wrapper.py:331} INFO - AWS Connection (conn_id='s3_dpe', conn_type='aws') credentials retrieved from login and password.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits