Open edX Developer Stack ("Devstack") Release Test Plan

Smoke tests to ensure a new devstack release is functioning properly.

LMS

Make sure you can start LMS.

CMS

Make sure you can start CMS.

Forum

Make sure you can start Forum.

TODO: Is there a better test than visiting <http://localhost:18080>?

edx-platform Unit Tests

sudo su edxapp
paver test

There is a known failure for common/lib/capa currently.

edx-platform bok-choy Tests

1. Set up the bok-choy test server. This will take about 15 minutes.

   paver test_bokchoy -r

   -r stands for --serversonly.

2. In another terminal window, run tests. The test modules are relative to common/test/acceptance/tests/.

   paver test_bokchoy -a -o -t video/test_video_events.py paver test_bokchoy -a -o -t video/test_studio_video_editor.py paver test_bokchoy -a -o -t lms/test_lms_cohorted_courseware_search.py

   -a stands for --fasttest and -o stands for --testsonly. Both options must be set while in client mode.

3. In another terminal window, run tests. The test modules are relative to common/test/acceptance/tests/.

   paver test_bokchoy -a -o -t lms/test_problem_types.py

   There are known failures for this test suite currently.

4. Make sure X11 forwarding work. You must be on the host machine (physically or via Screen Sharing). X11 forwarding doesn't work if you're SSHed into the host machine.

   1. Install XQuartz

   brew cask install xquartz

   1. Let Vagrant know you want to forward X11.

   export VAGRANT_X11=1

   1. Start the guest box and SSH into it.

   vagrant up && vagrant ssh

   1. Verify X11 forwarding is working in the guest VM.

   $ echo $DISPLAY localhost:10.0

   You can also start Firefox, for example, and it should show up on your desktop via XQuartz.

   firefox

...

We still need to have smoke tests for the following:

• ecommerce
• ecomworker
• programs
• notifier

...

Once a release is created, it needs to be tested

• Installation: each installation method must complete successfully
• Automated tests
  • For devstack: run "paver test"
• Manual tests
  • Create a sandbox installation of Native, and have the manual testers test it.

...