This initiative is to investigate and, if found to be useful, help implement one or more package caching solutions for (at least) edx-platform. We are looking at options like Artifactory and DevPI to help speed up Python-related builds and testing, as well as gain some potential security benefits, and solve some problems related to forks we run off of but don't want to push to PyPI. Additional gains can be made for Node packages, Docker, etc. but are not the primary focus of this investigation (yet!).
The work for this investigation and details can be found in these Jira epics:
- PLAT-1696Getting issue details... STATUS
- PLAT-1901Getting issue details... STATUS
Findings:
- A write-up on which github.txt Python packages could move to a package cache, and which could be handled via other means is written up in - PLAT-1907Getting issue details... STATUS
- Notes on setting up Artifactory and some timing / test run information is here