Measure impact of course date messages on course home

Description

To measure the impact of the course dates feature, we'd like to disable this feature from rolling out yet to a fraction of traffic. This should help us understand (after a few weeks) the impact of this change, though our analysis will likely need to be handled through a dedicated BI ticket as the analysis is complex.

Acceptance Criteria

  1. Implement test in Optimizely.

  2. Ensure the test has a custom GA dimension configured for tracking.

  3. Update partner portal post with description.

Variations
1) Enabled Course Date Messages (85%)
2) Disabled Course Date Messages (15%)

Audience

  1. All EN traffic, divided evenly between variants (3% each)

  2. Exclude Mobile traffic

Metrics

  1. Track Revenue (Revenue)

  2. Track Click Through for Upgrades

  3. Track Progression through to content

Notes:

  • check for new vs returning visitors

Steps to Reproduce

None

Current Behavior

None

Expected Behavior

None

Reason for Variance

None

Release Notes

None

User Impact Summary

None

Status

Assignee

Marco Morales

Reporter

Marco Morales

Labels

None

Reach

None

Impact

None

Customer

None

Partner Manager

None

URL

None

Contributor Name

None

Groups with Read-Only Access

None

Actual Points

None

Category of Work

None

Stakeholders

None

Components

Priority

Unset
Configure