Useful Sandbox Operations

We often come across sandboxes for debugging and some times as proof of concept.

Summing up a few operations here.

1 SSH into Sandbox
2 Install Package on Sandbox
3 Run manage.py command
4 Set Break Point (run server using manage.py runserver)
- 4.1 If you want to use pudb instead of pdb:
5 Enable Social Auth (Google)
6 Enable Ecommerce App
7 Enable Ecommerce basket Page
8 Enable Payment Processor on Sandbox

SSH into Sandbox

ssh github_username@sandbox_link

Install Package on Sandbox

sudo su root
source /edx/app/edxapp/venvs/edxapp-sandbox/bin/activate (activates python virtual environment)
Install package
- For example:
  - pip install requests

Run manage.py command

sudo -u www-data /edx/app/edxapp/venvs/edxapp/bin/python /edx/app/edxapp/edx-platform/manage.py lms --settings production [command (shell/dbshell/migrate etc)]
- For example:
  - sudo -u www-data /edx/app/edxapp/venvs/edxapp/bin/python /edx/app/edxapp/edx-platform/manage.py lms --settings production dbshell
    - This command will get you in mysql> prompt.

Set Break Point (run server using manage.py runserver)

The Python debugger (pdb) requires real time interactive server daemon( as we run on local). On sandox this can be done as

Get into interactive supervisor console:
- sudo /edx/bin/supervisorctl
Stop the lms, cms, and edxapp workers in the interactive supervisor console:
- stop lms cms edxapp_worker:
Exit the interactive supervisor console:
- exit
Launch the lms/cms using the debug server:
- cd /edx/app/edxapp/edx-platform
- LMS runs on port 8000, for lms runserver command will be:
  - sudo -u www-data LMS_CFG=/edx/etc/lms.yml /edx/bin/python.edxapp ./manage.py lms runserver 8000 --settings production
- CMS runs on port 8010, for cms runserver command will be:
  - sudo -u www-data STUDIO_CFG=/edx/etc/studio.yml /edx/bin/python.edxapp ./manage.py cms runserver 8010 --settings production
Restart server normally after debugging:
- sudo /edx/bin/supervisorctl restart lms cms edxapp_worker:

If you want to use pudb instead of pdb:

Get into interactive supervisor console:
- sudo /edx/bin/supervisorctl
Stop the lms, cms, and edxapp workers in the interactive supervisor console:
- stop lms cms edxapp_worker:
Exit the interactive supervisor console:
- exit

Simulate a login shell:
- sudo su - www-data -s /bin/bash

Launch the lms/cms using the debug server:
- cd /edx/app/edxapp/edx-platform
- LMS runs on port 8000, for cms runserver command will be:
  - /edx/bin/python.edxapp ./manage.py lms runserver 8000 --settings production
- CMS runs on port 8010, for cms runserver command will be:
  - /edx/bin/python.edxapp ./manage.py cms runserver 8010 --settings production

Logout of the login shell:
- logout
Restart server normally after debugging:
- sudo /edx/bin/supervisorctl restart lms cms edxapp_worker:

Enable Social Auth (Google)

Following are steps to enable third party authentication.

First make project on google developer console and enable google+ api.

Authorized redirect URI while making credentials for your project will be as: {sandbox-link}/auth/complete/google-oauth2/

Note down credentials (Client ID and secret)

sudo nano /edx/app/edxapp/lms.auth.json
- Add following:
  - "THIRD_PARTY_AUTH":{
    "Google":{
    "SOCIAL_AUTH_GOOGLE_OAUTH2_KEY": "{client ID}",
    "SOCIAL_AUTH_GOOGLE_OAUTH2_SECRET": "{client secret}"
    }
    },
sudo nano /edx/app/edxapp/lms.env.json
- Set "ENABLE_THIRD_PARTY_AUTH": true
sudo -u www-data /edx/app/edxapp/venvs/edxapp/bin/python /edx/app/edxapp/edx-platform/manage.py lms --settings production dbshell
- This command will open mysql prompt, in this prompt
  - use edxapp;
  - INSERT INTO third_party_auth_oauth2providerconfig VALUES ('1', '2017-01-01 18:29:39.000000', '1', 'fa-google-plus', 'Google', '0', '0', '0', 'google-oauth2', '{client ID}', '{client secret}', '{}', NULL, '', '1', 'google-oauth2', '1');
sudo /edx/bin/supervisorctl restart edxapp:

Enable Ecommerce App

Ecommerce app needs to be enabled explicitly, following are steps.

Make sure that ecommerce was checked while creating sandbox.

Then do following:

sudo -H -u ecommerce bash
- Gets into bash prompt
source /edx/app/ecommerce/ecommerce_env
- Activates ecommerce environment
cd /edx/app/ecommerce/ecommerce/
- Gets into ecommerce repo
python manage.py create_or_update_site --site-id=1 --site-domain=ecommerce-{sandbox link} --partner-code=edX --partner-name="Open edX" --lms-url-root=https://{sandbox link} --theme-scss-path=sass/themes/edx.scss --payment-processors=cybersource,paypal --client-id="ecommerce-key" --client-secret="ecommerce-secret" --from-email="{email address}"
Example command:
- python manage.py create_or_update_site --site-id=1 --site-domain=ecommerce-credit-req.sandbox.edx.org --partner-code=edX --partner-name="Open edX" --lms-url-root=https://credit-req.sandbox.edx.org --theme-scss-path=sass/themes/edx.scss --payment-processors=cybersource,paypal --client-id="ecommerce-key" --client-secret="ecommerce-secret" --from-email="noraiz.anwar@arbisoft.com"
exit
sudo /edx/bin/supervisorctl restart ecommerce
Ecommerce app should be running now at https://ecommerce-{sandbox link} e.g https://ecommerce-credit-req.sandbox.edx.org.
(In case of ‘invalid_request’ error) --site-domain in command is URL of trusted client added by default for ecommerce app use. Make sure URL and Redirect URL of trusted client is set accordingly with this command i.e
ecommerce-{sandbox link} and ecommerce-{sandbox link}/complete/edx-oidc/. Trusted Clients are at
{sandbox link}/admin/edx_oauth2_provider/trustedclient/. You will need a superuser to access admin site.
In this case check lms.auth.json, lms.env.json and update all the redirect uri's to the sandbox link e.g. ecommerce-{sandbox link}.

Note: This guide assumes that sandbox was created with clients and trusted clients. Sandbox by default create clients and trusted clients.

Enable Ecommerce basket Page

By default edxapp does not uses the normal checkout flow. To enable ecommerce basket page and checkout do following steps

make sure staff has superuser rights
go to lms admin page (https://{sandbox_name}.sandbox.edx.org/admin/)
got to 'commerceconfiguration' in lms
add new configurations
- Check 'Enabled
- Check 'Checkout on ecommerce service'
- Single course checkout page : /basket/single-item/
- Cache Time To Live : 0
- Receipt page : /checkout/receipt/?order_number=
- Check Enable automatic refund approval
- save

Now go to lms clients (https://{sand-box-name}.sandbox.edx.org/admin/oauth2/client/)

if there is a client for ecommerce services confirm following settings else create one with following settings (Use urls according to url sandbox)

after that go to ecommerce.yml

sudo nano /edx/etc/ecommerce.yml

confirm following settings of JWT if something is missing add it.

JWT_AUTH:
    JWT_AUDIENCE: ecommerce-key  # It should be same as described in lms client.
    JWT_SECRET_KEY: ecommerce-secret  # It should be same as described in lms client.
    JWT_SECRET_KEYs:
    - ecommerce-secret
    JWT_ISSUERS:
    - ecommerce_worker
    JWT_VERIFY_EXPIRATION: False
    JWT_VERIFY_AUDIENCE: False

Now go to lms.env.json file

sudo nano /edx/app/edxapp/lms.env.json

confirm the following JWT_AUTH settings

JWT_AUTH:
JWT_AUDIENCE: ecommerce-key # It should be same as described in lms client.
JWT_SECRET_KEY: ecommerce-secret # It should be same as described in lms client.

Enable Payment Processor on Sandbox

Use the Following commands to setup the payment processor

sudo nano /edx/etc/ecommerce.yml

Search 'PayPal' in 'ecommerce.yml', Provide client_id , secret_id from your PayPal sandbox account and update mode value to 'sandbox'

Example:

client_id : 'AVhxxxxxxDm2'

secret_id : 'EMVxxxxxxGV8'

Restart the worker using the following commands:

sudo /edx/bin/supervisorctl restart edxapp: edxapp_worker: ecommerce:

*for additional paypal sandbox infromation check paypal sandbox documentation.