Large Instances Meeting Notes 2023-06-27
Video recording: https://drive.google.com/file/d/1Dml17m_isDYFEplOuadN12QDOjbdMHHC/view?usp=sharing
Assign meeting lead and note taker.
@Felipe Montoya will lead, @Braden MacDonald will take notes.
Greetings & introductions as needed.
(We introduced ourselves as there were new people from ManpraX on the call.)
Updates from each org on the call - 2U, eduNEXT, OpenCraft, Raccoon Gang. What's new with your deployment(s)?
eduNEXT - @Moisés González (1) we deployed Harmony in one of our smaller production clusters, the one that hosts the site that the marketing group uses. It went well. Swapping out the ingress was kind of tricky. (2) A while ago Jeremy was asking about APM alternatives to New Relic (https://openedx.atlassian.net/wiki/spaces/AC/pages/3555754025). I was wondering if we can use Open Telemetry in the platform, so that we can use other APM alternatives?
@Jeremy Bowman : yeah, OpenTelemetry emerged as a common standard for all these different APMs. We are reasonably satisfied with New Relic but would like to have other options too, especially for dev environments, sandboxes, etc. We don’t have bandwidth to investigate much at the moment but we’d be supportive of moving in that direction.
[Brief discussion around whether Open Telemetry would replace the NR integration or be added alongside it. Otherwise there seems to be no downside.]
https://docs.newrelic.com/docs/more-integrations/open-source-telemetry-integrations/opentelemetry/opentelemetry-introduction/
https://github.com/openedx/wg-frontend/issues/134
OpenCraft - @Braden MacDonald . Team is looking forward to replacing parts of Grove code with Harmony, but Palm upgrade has been occupying a lot of time.
2U - @Jeremy Bowman : we’ve switched devstack to using layered images, and we’re adding ARM support too, so that there is now an alternative that people can use if they want. Arch-BOM is starting to think more about consolidating development environments and what the future direction will be.
[Discussion of Tutor and Devstack development environments - lots of people still using each within each of our orgs.] Also, 2U is investigating how to develop/test MFEs using only a stub server that knows the backend’s API contract and can be used in lieu of the full LMS, for much lighter/faster dev/test experience.
ManpraX: we have tested our deployment on minikube and are planning to do a k8s deployment this week. We are getting some issues with hostname-related errors. [The group recommended posting on discuss.openedx.org ]
Harmony project updates: Review list of PRs and issues, and assign anything un-assigned.
https://github.com/openedx/openedx-k8s-harmony/pull/40 (helm release) is ready to go, @Jhony Avella asked if @Braden MacDonald can test it one more time before we merge.
https://github.com/openedx/openedx-k8s-harmony/pull/31 : one minor issue related to the edx-search version, but otherwise this PR is ready to go.
https://github.com/openedx/openedx-k8s-harmony/pull/24 is ready, and @Gábor Boros will fix the commit lint issue and get it merged.
Open discussion/questions, if any.
@Felipe Montoya brought up the topic of adding celery beat to the platform. e.g. every six months to send usage data to Axim. For eduNEXT, it has proven difficult to have the celery beat scheduler working. @Alejandro Cárdenas has proposed some alternative solutions: https://discuss.openedx.org/t/adding-celery-beat-as-a-scheduler-to-the-core-offering/9428/9 . Please reply on that thread if you have thoughts about this!