Better channel restoration for local dev with content proxying

[bjester]

Summary

• Refactors restore_channel management command to be more robust and useful for restoring channels for local development:
  • No longer downloads content by default
  • Properly restores exercises if API token is provided
  • Supports making the channel public and publishing it after restoration
  • Better progress and logging of restoration
• Moves all python commands from package.json to Makefile
• Updates dev server commands to operate through make and to handle always running nginx in front of the devserver
• Updates documentation to simplify instructions and remove duplicate cruft
• Adds composite and read-only storage pass through for development like non-production server environments
• Folds presigned URL handling for uploads into storage structure to eliminate duck typing

References

Needs for building on search recommendations

Reviewer guidance

1. Restoring a channel: python contentcuration/manage.py restore_channel --editor a@a.com --source-url https://studio.learningequality.org --public --publish --token <your_studio_token> <channel_id> (the following is a small channel: d0ef6f71e4fe4e54bb87d7dab5eeaae2)
2. Start development server make devrun-services then make devrun-server
3. Log into local studio
4. Open the restored channel
5. Observe you can see the PDF and video resources without having downloaded them (proxying through nginx to the cloud)
6. Observe the channel exercises are properly restored
7. Observe new 'Download file' feature now does not simply open the file in a new tab

Notes

I simply deleted the existing tests for the channel restoration. Since it's a development only command, the tests usefulness are questionable, but I'm willing to add tests later if it's desired.

[akolson]

port 8080 here is the nginx port?

[bjester]

Yes it is. The default functionality before my changes had this command attempt to load from the local instance, so I kept that, but having this be the nginx route means that the logic for fetching the channel's SQLite database can be the same as non-local (production)

[akolson]

We surely needed this. Thanks for adding it ❤️

[bjester]

TODO changes:

• remove docker-compose alias handling from Makefile
• potentially remove docker compose handling entirely from Makefile

[rtibbles]

Maybe add an echo here to tell the actual URL to access on, to make sure people ignore the logging from the django runserver?

[bjester]

superseded by #5611