Large Instances Meeting Notes 2024-04-16
Assign meeting lead and note taker. (@Felipe Montoya and @Braden MacDonald respectively)
Greetings & introductions as needed.
Updates from each org on the call - 2U, eduNEXT, OpenCraft, Raccoon Gang.
What's new with your deployment(s)?
eduNEXT - @Felipe Montoya investigated an issue with the MFEs and found an issue where a config setting was being set to boolean true rather than string “true” which caused the features not to work in the course authoring MFE.
@Moisés González was testing Meilisearch in their recent internal hackathon. When he backported the indexing code to nutmeg though, it wasn’t working properly.
Some people at eduNEXT are working on an issue with celery tasks - when the workers are processing a lot of tasks. In particular, the grade reports. (@Maksim Sokolskiy commented that when they had similar issues they used a variety of fixes - for example, some courses didn’t actually need grading so they disabled grades for those courses which saved a lot of resources. Another was using read replicas. Finally, they did some kind of batching of calculations, e.g. of student module updates for each answer. They also have a lot of separate queues and dedicated workers since they’re not currently using Tutor to manage these deployments. )
Also eduNEXT had a minor issue with AWS bucket policies, and friendly reminder to back up the bucket policies since they’re not normally backed up.
OpenCraft - @Farhaan Bukhsh : last time we discussed Quince support for the Tutor Harmony plugin. We tested it and it seems to be working fine, so it’s good to be merged; though maybe we’ll test the commands quickly first as mentioned by @Jhony Avella .
Raccoon Gang - Yesterday @Maksim Sokolskiy presented at BTR that Raccoon Gang is about to deploy their first tutor-based k8s deployment for a client. Wondering what people think about Helm chart support for Tutor itself, not just Harmony. We are creating a proof of concept so Tutor could use Helm charts rather than yaml manifests. (e.g. each service would provide a separate Helm plugin)
@Moisés González linked to this earlier discussion: OEP-45 :: ADR-002: Deploying Open edX on Kubernetes Using Helm by bradenmacdonald · Pull Request #372 · openedx/open-edx-proposals
(More discussion followed)
Harmony project updates: Review list of PRs and issues, and assign anything un-assigned.
chore: providing basic quince support by jfavellar90 · Pull Request #63 · openedx/openedx-k8s-harmony - assigned this to @Jhony Avella , want to get it merged soon.
Replace Terraform with OpenTofu by gabor-boros · Pull Request #69 · openedx/openedx-k8s-harmony - updating the example templates to use OpenTofu instead of Terraform.
Open discussion/questions, if any.
@Felipe Montoya proposed setting up a changelog for Harmony releases, and everyone seemed to agree with the idea.