Test shifting the hero upsell message to function as a secondary CTA instead of as a primary one on the course home page, making room for course messaging and goal setting as primary areas of focus for the course landing experience.
Determine requirements for significance.
Implement test in Optimizely.
Ensure the test has a custom GA dimension configured for tracking.
Update partner portal post with description.
Retain existing enhanced ecommerce ("promotion analytics") behaviors
1) Current Hero
2) Sidebar Upsell Hero A
3.) Sidebar Upsell Hero B
All EN traffic, divided evenly between variants (33% each)
Exclude Mobile traffic
Track Revenue (Revenue)
Track Click Through for Upgrade
Track Progression through to content
bounce rate improves by at least 5%
enrollment rate has no statistically significant change
check for new vs returning visitors
Implementation and Technical Details
how much required to reach significance => roughly how long to get an answer
people per variant (look at RET experiments)
for us - should be ok to skip because we should have this from a RET experiment
develop the experiment code
Time: .5 day or less optimizely + time for js/css implementatino.
optimizely (can develop in prod and just not publish the experiment)
optimizely-experiments (takes longer first time)
See RET DOM manipulation example to avoid pop-in effect.
script id=user-metadata has info about the user and course to fill in the banner.
implement optimizely event for upgrade
In optimizely, click button to send to GA, and need to create a session scoped custom dimension in GA for this. GA has the number. Optimizely has the name. Configure the number in Optimizely. Per experiment, everything is tagged.