Open issues

e2e tests should validate waffle flags before starting
TE-2335
Discovery: Add Asqatasun as optional (opt-in) Jenkins test
TE-2864
bok-choy CohortConfigurationTest.test_cohort_by_csv_unicode - update/revert test after up gradation of chrome driver
TE-2075
Fix CSRF bug in Jenkins form posts
TE-2978
Investigate pipeline jobs not running on shards
TE-2976
Add environment and deployment tags to ansible code
TE-2975
Suppress irrelevant Jenkins security warnings
TE-2974
Fix VPC issue in build packer job failures
TE-2973
Change alerting channels for DX tooling
TE-2972
Clean up/organize Jenkins maintenance docs
TE-2970
Clean up/organize docs for writing Jenkins jobs
TE-2969
Clean up staging for getting python 3 tests to run
TE-2968
Janitor should clean up untagged ec2 instances
TE-2966
Create GitLab account
TE-2964
Create a job to create confluence reports with code annotation data
TE-2956
Consider moving testing infra scripts into separate repo
TE-2950
Set up Renovate on Prospectus
TE-2948
Document feature toggle annotator
TE-2946
Ecommerce e2e cannot be run from devstack
TE-2943
Fix notifier bug
TE-2942
Prep pact pilot
TE-2941
Try libeatmydata in edx-platform tests
TE-2939
Create a job to update AMIs
TE-2937
isort not properly working in course discovery
TE-2935
Don't hit GitHub during bok-choy test runs
TE-2934
Automate cutting a new release to pypi
TE-2933
Delete Jenkins-Worker NewRelic account
TE-2932
Unpin pytest in edx-platform
TE-2931
Write an OEP on changelog management
TE-2929
Add full APM monitoring for build jenkins
TE-2925
Upgrade firefox and geckodriver in workers
TE-2923
Install npm/ python requirements in parallel
TE-2922
Seed python upgrade jobs on commits
TE-2918
Set mongo DB instance to run on Jenkins /mnt
TE-2917
Create a paver call command for management commands for bokchoy
TE-2916
Add folders to Build Jenkins
TE-2915
django-user-tasks: urllib3 < 1.24.2
TE-2914
Update make targets with oep18 fixes
TE-2913
Can't download offline installer as a complete archive
TE-2912
Clean up terraform code for old build/test jenkins boxes
TE-2909
Jenkins jobs hanging indefinitely on master
TE-2907
Codejail should conform to OEP-18
TE-2905
Write utility to clean up after deleted code
TE-2903
Enable auto-merge in auto make upgrade jobs
TE-2901
Add repositories to requires.io
TE-2899
Fix pipeline slack calls
TE-2898
System dependency update automation
TE-2891
Fix "make e2e-tests" on devstack
TE-2887
Run python-modernize on common/lib/capa
TE-2884
Jenkins docker containers have openjdm instead of oraclejdk
TE-2883
issue 1 of 267

e2e tests should validate waffle flags before starting

Description

Today, and I spent several hours debugging end-to-end tests, only to find that the culprit was a set of waffle flags that had been enabled on stage.edx.org after the last successful run.

Is there any way we could have these tests check for and validate the current values of active waffle flags before they start? That would make this sort of issue a lot easier to debug in the future.

Steps to Reproduce

None

Current Behavior

None

Expected Behavior

None

Reason for Variance

None

Release Notes

None

User Impact Summary

None

Status

Assignee

Unassigned

Reporter

Eric Fischer

Labels

None

Reach

None

Impact

None

Customer

None

Partner Manager

None

URL

None

Contributor Name

None

Groups with Read-Only Access

None

Actual Points

None

Category of Work

None

Stakeholders

None

Priority

CAT-3
Configure