Analytics Breakout Session

Insights & Analytics Pipeline sub-session

How does the Analytics Pipeline work?

• Discussed components.  See github.com/edx/edx-analytics-*, edx-analytics-pipeline-reference.readthedocs.io
• Discussed installation.  See github.com/open-craft/openedx-deployment

How can we make Analytics Pipeline near-realtime?

• Smaller hourly partitions for more frequent runs
• Streaming data using Apache Sparc (instead of hadoop, hive, sqoop..).  edX Analytics team are in the process of doing this right now!
• Use a lighter-weight solution if direct MySQL queries are sufficient

What reporting do we want?

• Dashboard for blended learning use case (small classes, many copies of "same" course")
  • Data per learner
  • Divide by class, subject, geographic, organisation
• Timeline to show learning rates/engagement/enrollment as course progresses
  • Tag significant events (course start/end, advertising events, assignment deadlines...)
• Survey data integration, e.g. to measure learner satisfaction

How has reporting improved?

• Problem Response reports in Instructor dashboard have been made more readable, easier to use. See:
  • edxchange.opencraft.com/t/xblock-reporting-tool
  • https://github.com/edx/edx-platform/pull/17824
  • https://github.com/edx/edx-platform/pull/18231
  • https://github.com/edx/edx-platform/pull/18244