brouberol@deploy2002:~$ airflow-devenv create --branch main --dags-folder ml
Airflow development environment provisioning parameters:
- instance name: dev-brouberol
- pulled git branch: main
- airflow-dags folder: ml

Installation progress:
- Creating PG database dev_brouberol ✅
- Installing airflow dev environment dev-brouberol ✅
- Waiting for the kerberos pod to start .............. ✅
Password for brouberol@WIKIMEDIA:
- Kerberos credentials successfully setup ✅
- Waiting for the scheduler pod to be ready ✅
- Forcing DAG serialization ✅
- Waiting for the webserver pod to be ready ✅
- Creating admin user (username: admin, password: admin) ✅

Your airflow development environment is fully set up. You can now execute `airflow-devenv expose dev-brouberol` to expose the UI on your local development host.
brouberol@deploy2002:~$ airflow-devenv show
NAME                                                  READY   STATUS    RESTARTS        AGE
airflow-dev-brouberol-envoy-7fdb77b5db-v6cdf          1/1     Running   0               2m58s
airflow-dev-brouberol-gitsync-6d455457b9-6kvrm        1/1     Running   0               2m59s
airflow-dev-brouberol-hadoop-shell-864cfccddb-zkp9c   1/1     Running   0               2m58s
airflow-dev-brouberol-kerberos-6cfd6d7c56-l8grj       1/1     Running   0               2m59s
airflow-dev-brouberol-scheduler-dd4dd4fc5-lq6g7       1/1     Running   0               2m59s
airflow-dev-brouberol-statsd-55678bf84c-d8wgm         1/1     Running   0               2m59s
airflow-dev-brouberol-task-shell-6c55cf6885-fhc7f     1/1     Running   0               2m59s
airflow-dev-brouberol-triggerer-586d695f4d-dz8ln      1/1     Running   0               2m59s  # <---
airflow-dev-brouberol-webserver-86c6dd8489-wgg2p      2/2     Running   0               2m58s

kubernetes_asyncio.config.config_exception.ConfigException: Invalid kube-config file. Expected key current-context in kube-config

aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 10.67.32.1:443 ssl:default [Connect call failed ('10.67.32.1', 443)]

brouberol@deploy2002:~$ k exec -it airflow-scheduler-6b8df7cfcb-9jd29 -- bash
pairflow@airflow-scheduler-6b8df7cfcb-9jd29:/opt/airflow$ python3
Python 3.10.15 (main, Jun 23 2025, 12:27:25) [GCC 10.2.1 20210110] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import socket
>>> socket.gethostbyaddr('10.67.32.1')
('kubernetes.default.svc.cluster.local', [], ['10.67.32.1'])
>>>

brouberol@deploy2002:~$ k get pod -oyaml train-model-lanjnya
apiVersion: v1
kind: Pod
metadata:
  annotations:
    cni.projectcalico.org/containerID: 4e6a6c543d01cfd525c6990b9ce244fe1faafe4c7114b6be518bdb6a441be2f6
    cni.projectcalico.org/podIP: ""
    cni.projectcalico.org/podIPs: ""
    container.seccomp.security.alpha.kubernetes.io/base: runtime/default
  creationTimestamp: "2025-10-20T07:58:05Z"
  labels:
    airflow_kpo_in_cluster: "True"
    airflow_version: 2.10.5
    app: airflow
    component: task-pod
    dag_id: example_ml_training_pipeline
    kubernetes_pod_operator: "True"
    release: dev-kevinbazira
    routed_via: dev-kevinbazira
    run_id: manual__2025-10-20T073328.0310750000-7cfb204d7
    task_id: train_model
    try_number: "3"

Trigger emitted an error event, failing the task: Cannot connect to host 10.67.32.1:443 ssl:default [Connect call failed ('10.67.32.1', 443)]

brouberol@deploy2002:~$ kubectl edit networkpolicies.crd.projectcalico.org  airflow-dev-kevinbazira-to-kubeapi -oyaml
apiVersion: crd.projectcalico.org/v1
kind: NetworkPolicy
metadata:
  annotations:
    meta.helm.sh/release-name: dev-kevinbazira
    meta.helm.sh/release-namespace: airflow-dev
  creationTimestamp: "2025-10-20T08:27:29Z"
  generation: 2
  labels:
    app.kubernetes.io/managed-by: Helm
  name: airflow-dev-kevinbazira-to-kubeapi
  namespace: airflow-dev
  resourceVersion: "846888402"
  uid: 49fafc51-c433-4dba-8dd4-9b8ae1b7ca45
spec:
  egress:
  - action: Allow
    destination:
      services:
        name: kubernetes
        namespace: default
  selector: app == 'airflow' && release == 'dev-kevinbazira' && component in { 'scheduler', 'webserver', 'triggerer' }
  types:
  - Egress

brouberol@deploy2002:~$ k get pod -l release=dev-kevinbazira,component=triggerer -o json | jq '.items[0].spec.serviceAccount'
"airflow-dev-kevinbazira"

[2025-10-20T08:48:29.716+0000] {triggerer_job_runner.py:338} INFO - Starting the triggerer
[2025-10-20T08:49:29.765+0000] {triggerer_job_runner.py:510} INFO - 0 triggers currently running
[2025-10-20T08:49:43.777+0000] {triggerer_job_runner.py:627} INFO - trigger example_ml_training_pipeline/manual__2025-10-20T08:31:55.034415+00:00/train_model/-1/3 (ID 3) starting
[2025-10-20T08:49:43.777+0000] {pod.py:146} INFO - Checking pod 'train-model-tq54uwn' in namespace 'airflow-dev'.
[2025-10-20T08:49:43.781+0000] {crypto.py:82} WARNING - empty cryptography key - values will not be stored encrypted.
[2025-10-20T08:49:43.812+0000] {pod.py:221} INFO - Still waiting for pod to start. The pod state is Pending
[2025-10-20T08:49:52.869+0000] {triggerer_job_runner.py:631} INFO - Trigger example_ml_training_pipeline/manual__2025-10-20T08:31:55.034415+00:00/train_model/-1/3 (ID 3) fired: TriggerEvent<{'status': 'success', 'namespace': 'airflow-dev', 'name': 'train-model-tq54uwn', 'last_log_time': None}>
[2025-10-20T08:49:52.869+0000] {triggerer_job_runner.py:652} INFO - trigger example_ml_training_pipeline/manual__2025-10-20T08:31:55.034415+00:00/train_model/-1/3 (ID 3) completed