Jenkins job builder test command with output generates one file per job in the directory. That is deprecated and will be dropped for 3.0 in favor of having a directory for each job.
The feature flag is:
--config-xml use alternative output file layout using config.xml files
We should update jjb/diff.sh and tests/test_integration.py to use that new feature.