Service
Business and Technical Owners (see list here )
Current MySQL Versions (best effort)
In Open edX?
5.7 DevStack Upgrade
Due November 9th if in Open edX, December 15th if not.
5.7 Travis Upgrade
Due November 9th, December 15th if not.
5.7 Sandbox Upgrade
Planned 5.7 Stage Upgrade
Due December 15
Planned 5.7 Prod Upgrade (+ Any Read Replicas)
Due Jan 1
Planned 5.7 Edge Upgrade
Maintenance Mode / Smoke Test Docs
Platform (LMS + CMS) + csmhe
Arch -Nimisha Asthagiri (Deactivated)
cc Jeremy Bowman (Deactivated)
Stage: 5.6
Yes
https://openedx.atlassian.net/browse/BOM-2059 - Muhammad Arif (Deactivated)
Upgraded on 10/29
Tests run on Jenkins instead of Travis
https://openedx.atlassian.net/browse/BOM-2059
Upgraded on 10/29
SRE will create a test sandbox once https://openedx.atlassian.net/browse/BOM-2059 is done.Muhammad Nadeem Shahzad do you think we are ready to create a test sandbox? or did we already fo this after the edx-platform changes?
https://openedx.atlassian.net/browse/PSRE-309
(dedicated aurora)https://openedx.atlassian.net/browse/PSRE-329 is done.
Upgraded on 01/26 @ 1 AM
CNAME : stage-edx-edxapp.rds.edx.org
Coordinate with Jeremy/Nimisha/Sarina/Stu/Feanil
Note: There are two databases.
(dedicated aurora)https://openedx.atlassian.net/browse/PSRE-332
Decide date after stage (SRE is ready)
https://openedx.atlassian.net/browse/PSRE-332
dev by SRE, coordinate with Jeremy
Decide date after stage (SRE is ready)
Maintenance Mode: Cloudflare? Feanil Patel Do you know?
Smoke Test: For stage Jeremy will run e2e tests. For prod - no smoke test, just monitoring. Planned for 2/2
Coordinate with Jeremy/Nimisha/Sarina/Stu/Feanil
Completed on 1/27
Maintenance Mode: See Runbook .
Smoke Test:
edxapp + csmhe Smoke Tests Run Book cc Sarina Canelake (Do Not Use) (Deactivated)
eCommerce
Engagement -Emma Green (Deactivated) Seth McCann
Stage: 5.7
Yes
https://github.com/edx/devstack/pull/639 https://github.com/edx/configuration/pull/6066 - need review by Emma Green (Deactivated) / Ben Holt (Deactivated)
https://openedx.atlassian.net/browse/PSRE-314
Travis File https://github.com/edx/ecommerce/pull/3210
https://openedx.atlassian.net/browse/REV-1568 , now ecom team helping via https://openedx.atlassian.net/browse/REV-1568
https://openedx.atlassian.net/browse/PSRE-309
(dedicated aurora)https://openedx.atlassian.net/browse/PSRE-305 Upgraded on 11/17 @ 11am
(dedicated aurora)https://openedx.atlassian.net/browse/PSRE-368 Upgraded on 11/17 @ 10pm
Not applicable (ecommerce not in Edge)
Maintenance Mode: 1: Disable ASG in AsgardEmma Green (Deactivated) would Purchase be able to put up a PR that we can merge and revert to put up a friendly maintenance page? possibly with this: https://github.com/adinhodovic/terraform-cloudflare-maintenance )Emma Green (Deactivated)
Credentials
Aperture - Former user (Deleted) Ryan O'Connell Matt Tuchfarber (Deactivated) TJ Tracy (Deactivated)
Stage: 5.7
Yes
06 Oct 2020 Matt Tuchfarber (Deactivated) https://openedx.atlassian.net/browse/MICROBA-546
08 Oct 2020
https://openedx.atlassian.net/browse/MICROBA-546
N/A
(shared aurora)https://openedx.atlassian.net/browse/PSRE-304
(dedicated aurora)https://openedx.atlassian.net/browse/PSRE-344?atlOrigin=eyJpIjoiOWM4Nzc0MmZiY2RiNDNjNGEzYWYyYWIzMGU3ZWMzMzMiLCJwIjoiamlyYS1zbGFjay1pbnQifQ Upgraded on 11/17 at 5pm
N/A
Maintenance Mode: Disable ASG in AsgardAdam Blackwell (Deactivated) will reach out to Matt Tuchfarber (Deactivated)
Demographics
Aperture - Former user (Deleted) Ryan O'Connell Matt Tuchfarber (Deactivated)
Stage: 5.7
No
Done as part of https://github.com/edx/demographics/pull/80/files
N/A
Adam Blackwell (Deactivated) ask Matt Tuchfarber (Deactivated) if demographics runs in sandbox.
(dedicated aurora)https://openedx.atlassian.net/browse/PSRE-410
(dedicated aurora)https://openedx.atlassian.net/browse/PSRE-412 Upgraded on 12/7 at 10am
N/A
Maintenance Mode: Disable in ArgoCD
Smoke Test: Adam Blackwell (Deactivated) will reach out to Matt Tuchfarber (Deactivated)
Notes
SRE -Bill DeRusha (Deactivated)
Stage: 5.7
Yes
Adam Blackwell (Deactivated)
https://github.com/edx/devstack/pull/629 https://openedx.atlassian.net/browse/PSRE-311
Travis File https://github.com/edx/edx-notes-api/pull/213 https://openedx.atlassian.net/browse/PSRE-311
https://openedx.atlassian.net/browse/PSRE-309
(shared aurora)https://openedx.atlassian.net/browse/PSRE-304
(dedicated mysql)https://openedx.atlassian.net/browse/PSRE-333 5.7 upgrade completed on 10/23
(dedicated mysql)https://openedx.atlassian.net/browse/PSRE-333 5.7 upgrade completed on 10/23
Maintenance Mode: We can’t currently put just notes in maintenance, but the LMS fails gracefully for users and we can use Cloudflare.
Xqueue
T&L -Nimisha Asthagiri (Deactivated) Marco Morales (Deactivated)
Jeremy Bowman (Deactivated)
Stage: 5.75. 7
Yes
Upgraded as of 06 Oct 2020 https://openedx.atlassian.net/browse/PSRE-322 )
UPGRADED 11/19
Travis File
https://openedx.atlassian.net/browse/PSRE-322 https://github.com/edx/xqueue/pull/783
UPGRADED 11/19
(edxapp aurora)https://openedx.atlassian.net/browse/PSRE-329
(dedicated mysql)TBD
Will be done by SRE team, need coordination with Feanil Patel
N/A
Check with Feanil Patel
Maintenance Mode: Disable ASG in Asgard
Smoke Test:
Registrar & Workers
Programs -Simon Chen Deen Abdul-Hathi (Deactivated)
Stage: 5.75. 7
No
Upgraded as of 24 Sep 2020
https://openedx.atlassian.net/browse/MST-389
No Travis Docker Tests
https://openedx.atlassian.net/browse/PSRE-309
(shared aurora)https://openedx.atlassian.net/browse/PSRE-304
(dedicated mysql)https://openedx.atlassian.net/browse/PSRE-345 Upgraded on 12/2 @ 10am
Endpoint for Stitch: prod-edx-registrar-003.cluster-ciqreuddjk02.us-east-1.rds.amazonaws.comCNAME : prod-edx-registrar.rds.edx.org
N/A
Maintenance Mode: Disable in Asgard
Smoke Test: https://openedx.atlassian.net/wiki/x/bYCCeQ
Enterprise Catalog
Enterprise -Brittney Exline (Deactivated) Joe Cassaro Brandon Baker (Deactivated)
Stage: 5.75.6 7
Yes
Upgraded as of 28 Sep 2020
https://openedx.atlassian.net/browse/ENT-3316
No Travis Docker Tests
https://openedx.atlassian.net/browse/PSRE-309
(shared aurora)https://openedx.atlassian.net/browse/PSRE-304 TBD Completed
(shared aurora) https://openedx.atlassian.net/browse/PSRE-308
TBD Completed
N/A
Maintenance Mode: Disable in AsgardBrandon Baker (Deactivated)
License Manager
Enterprise -Brittney Exline (Deactivated) Joe Cassaro Brandon Baker (Deactivated)
Stage: 5.76 7
Yes, for now
Upgraded as of 28 Sep 2020
https://openedx.atlassian.net/browse/ENT-3317
No Travis or CircleCI
(shared aurora)https://openedx.atlassian.net/browse/PSRE-304 TBD Completed
(shared aurora) https://openedx.atlassian.net/browse/PSRE-308
TBD Completed
N/A
Maintenance Mode: Disable in Asgard
Smoke Test:Brandon Baker (Deactivated)
Discovery
Engage -Jason Myatt (Deactivated) Kaitlin Ahern (Deactivated)
Stage: 5.7
Yes
Upgraded as of 06 Oct 2020
https://openedx.atlassian.net/browse/DISCO-1675
Upgraded Travis as of 06 Oct 2020
https://openedx.atlassian.net/browse/PSRE-309
(shared aurora)https://openedx.atlassian.net/browse/PSRE-304
(dedicated mysql)https://openedx.atlassian.net/browse/PSRE-336 Completed 10/29 @ 3pm
N/A
Portal Designer
Masters - Simon Chen Matt Hughes (Deactivated) ?
Stage: 5.75. 7
No
Upgraded local compose file as of 18 Sep 2020 Alison Langston https://openedx.atlassian.net/browse/MST-390
No Travis or CircleCI
https://openedx.atlassian.net/browse/PSRE-309
(shared aurora)https://openedx.atlassian.net/browse/PSRE-304
(dedicated aurora)https://openedx.atlassian.net/browse/PSRE-413 Completed on 12/9 @ 10am
N/A
Maintenance Mode: Disable in Asgard
Smoke Tests: Designer Smoke Tests Run Book
Blockstore
T&L -Marco Morales (Deactivated)
Stage: 5.76 7
Yes
https://openedx.atlassian.net/browse/TNL-7642
https://openedx.atlassian.net/browse/OSPR-5101
Done 11/6
CircleCI file
https://openedx.atlassian.net/browse/TNL-7642 Done 11/6
https://openedx.atlassian.net/browse/OSPR-5101
N/A
(shared cluster)
(shared cluster) https://openedx.atlassian.net/browse/PSRE-307
TBD Completed
N/A
Analytics Pipeline https://github.com/edx/edx-analytics-configuration )
Data Engineering - T:Brian Beggs
N/A
Yes
https://openedx.atlassian.net/browse/DEPR-119
https://openedx.atlassian.net/browse/DEPR-119
N/A
prod-edx-analyticsapi-data.rds.edx.org(pipeline001 ) & prod-edx-analyticsapi-data-readonly.rds.edx.org (not in use )
Analytics API
Data Engineering - T:Brian Beggs
Stage: 5.7
Yes
N/A (According to Brian Beggs , insights and analytics-api do not have a devstack.)
Travis doesn’t use MySQL
Doesn’t have sandboxes.
(shared aurora) https://openedx.atlassian.net/browse/PSRE-304
No action items
(analytics aurora) https://openedx.atlassian.net/browse/PSRE-335 Upgraded on 12/17 @ 10am ET CNAMES: prod-edx-analyticsapi-django.rds.edx.org
(analytics mysql) https://openedx.atlassian.net/browse/PSRE-408 Upgraded on 12/18 @ 10am ET
prod-edge-analyticsapi.rds.edx.org
Maintenance Mode: Brian Beggs will check with his team + Asgard Smoke Test: Download button in Insights
Insights and/or Analytics Dashboardanalytics-report + analytics-report-replica-001
Data Engineering - T:Brian Beggs
Stage: 5.7
Yes
N/A (According to Brian Beggs , insights and analytics-api do not have a devstack.)
Travis doesn’t use MySQL
Doesn’t have sandboxes.
(shared aurora) https://openedx.atlassian.net/browse/PSRE-304
No action items
(analytics aurora) https://openedx.atlassian.net/browse/PSRE-335 Upgraded on 12/17 @ 10am ET CNAMES: prod-edx-analyticsapi-django.rds.edx.org , prod-edx-analyticsapi-data.rds.edx.org ( reports001 ) & prod-edx-analyticsapi-data-readonly.rds.edx.org ( not in use )
(analytics mysql) https://openedx.atlassian.net/browse/PSRE-408 (we moved to 5.6.48 on 10/21 which involved 7 hours of unexpected downtime) Upgraded on 12/18 @ 10am ET prod-edge-analyticsapi.rds.edx.org
Maintenance Mode: Brian Beggs will check with his team + Asgard
Smoke Test: Download button in Insights
Notifier
ensure retirement
Simon Chen , Julie Davis (Deactivated) - repo ownership
Jeremy Bowman (Deactivated) - for deprecation
N/A
No
Done 11/13
https://openedx.atlassian.net/browse/EDUCATOR-5378 - closed in favor of https://openedx.atlassian.net/browse/DEPR-106?searchSessionId=4511027c-eb42-4c57-b290-aaec5aaf03fa&searchObjectId=186639&searchContainerId=17023&searchContentType=issue
No Travis Docker or CircleCI Tests
N/A
https://openedx.atlassian.net/browse/DEPR-106?searchSessionId=4511027c-eb42-4c57-b290-aaec5aaf03fa&searchObjectId=186639&searchContainerId=17023&searchContentType=issue
https://openedx.atlassian.net/browse/DEPR-106?searchSessionId=4511027c-eb42-4c57-b290-aaec5aaf03fa&searchObjectId=186639&searchContainerId=17023&searchContentType=issue
N/A
Video Encode Manager
Kashif Chaudhry (Unlicensed) , Dawoud Sheraz
Stage: 5.76 7
Yes
Not in DevStack: https://openedx.atlassian.net/browse/PSRE-371
N/A
N/A
(shared cluster)
(shared cluster) https://openedx.atlassian.net/browse/PSRE-307
Completed
N/A
Kashif Chaudhry (Unlicensed) Are you aware of how SRE can smoketest this service after we complete this database upgrade?
VEM Smoke Tests
Licence Manager
Stage: 5.76 7
Yes
Fred Smith (Deactivated) I just realized this row hasn’t been added, do you know if any work needs to be done for License Manager
N/A
(shared cluster)
(shared cluster) https://openedx.atlassian.net/browse/PSRE-307
Completed
N/A
Taxonomy
ensure retirement
Website:Albemarle (Deactivated)
N/A
No
Due December 15
Will be retired before by then - https://openedx.atlassian.net/browse/WS-1413 https://github.com/edx/taxonomy/pull/11
Due December 15
Will be retired before then -https://openedx.atlassian.net/browse/WS-1413
N/A
Needs to be removed from shared
Needs to be removed from shared
N/A
N/A
Enterprise Reporting
Markhors:Mike O'Connell (Deactivated)
Stage: 5.7
No
N/A
N/A
N/A
stage-edx-enterprise-reporting
prod-edx-enterprise-reporting
N/A
N/A