Add Habrok-to-Kapteyn data transfer guide#660
Conversation
Document how to transfer simulation results from Habrok scratch to the Kapteyn dataserver via a laptop relay, since direct SSH between the clusters is blocked. Covers two-step rsync (resumable) and single-command tar pipe approaches.
![chatgpt-codex-connector[bot]](https://avatars.githubusercontent.com/in/1144995?s=60&v=4){kind=small}
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: e0101a422d
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
There was a problem hiding this comment.
Pull request overview
Adds documentation to help users transfer PROTEUS simulation outputs from the Habrok HPC cluster to the Kapteyn dataserver (norma2) when direct SSH between clusters is blocked, using a laptop as a relay.
Changes:
- Documented a two-step
rsyncworkflow (pull to laptop, then push to Kapteyn), including a “slim transfer” option. - Added a single-command
tar-over-SSH streaming alternative (no local staging), plus transfer tips and links to Kapteyn SSH/ProxyJump setup.
- Change SSH config from habrok1/interactive1 to habrok/login1 so transfer commands work without manual alias renaming - Add mkdir -p before tar pipe examples to avoid failure on fresh Kapteyn accounts
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #660 +/- ##
==========================================
+ Coverage 69.12% 69.15% +0.02%
==========================================
Files 98 98
Lines 10123 10123
Branches 1401 1401
==========================================
+ Hits 6998 7001 +3
+ Misses 2791 2788 -3
Partials 334 334
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
Description
Add documentation for transferring PROTEUS simulation results from the Habrok HPC cluster to the Kapteyn dataserver (norma2).
Direct SSH between Habrok and Kapteyn is blocked by firewalls, so the guide documents using a laptop as a relay. Covers:
Validation of changes
Documentation-only change. Verified that all commands work in practice (tested transfer of dummy run between Habrok and Kapteyn).
Checklist
Relevant people
@EmmaPostolec