Right now alert emails coming from Airflow dev instances use the same email address configured by the DAG itself, and in doing so they're indistinguishable from regular production DAG alerts.
Override the From: email address for these alerts so that it's clear where the alert is coming from.