We have been alerting on jenkins worker instances here: https://alerts.newrelic.com/accounts/88178/policies/240841/conditions/2459827/edit?selectedField=thresholds
If possible we'd like to define environment=test and deployment={e2e,build-jenkins,test-jenkins,etc} on all of them to make alerts clearer.
I believe these alerts started happening this week and wouldn't be triggering alerts if they didn't send data to newrelic:
https://github.com/edx/configuration/pull/5169