Skip to content

feat: Support secrets and DC on remote HPCs#1125

Draft
sambuc wants to merge 24 commits into
mainfrom
feat/secrets-and-dc-in-hpc-sessions
Draft

feat: Support secrets and DC on remote HPCs#1125
sambuc wants to merge 24 commits into
mainfrom
feat/secrets-and-dc-in-hpc-sessions

Conversation

@sambuc

@sambuc sambuc commented May 20, 2026

Copy link
Copy Markdown
Contributor
  • Improve session_script.sh

    • Allow setting session parameters
      • Git Proxy settings
      • rclone & wstunnnel versions to be used
    • Better separation of environment and local variables
    • Code refactor to avoid duplicated sections
    • Rely as little as possible on environment.toml to set parameters as this is not a standard srun option.
    • Improved exit / cleanup operations
  • Mount all filesystems exposed by FireCrest in the user session

    • By default use an identity mapping
    • For Users mapping use ${fsPath}:/home/${fsPath}:ro

(Will keep editing this message as we go)

sambuc and others added 20 commits May 20, 2026 14:00
Co-authored-by: Flora Thiebaut <flora.thiebaut@sdsc.ethz.ch>
Simplify the logic, as we only want to handle specifically the "Users"
fs type for now.

Also add a check on the length of secretPath and add it only if the
string is not empty.

Co-authored-by: Flora Thiebaut <flora.thiebaut@sdsc.ethz.ch>
 * Simplify version handling and allow setting the wstunnel version
 * Upgrade to self-compiled wstunnel v10.5.5
   * Regular release build for x86_64
   * Release build with `JEMALLOC_SYS_WITH_LG_PAGE=14` for aarch64
Co-authored-by: Flora Thiebaut <flora.thiebaut@sdsc.ethz.ch>
@sambuc sambuc force-pushed the feat/secrets-and-dc-in-hpc-sessions branch from 2d07f3a to 79c35a9 Compare June 22, 2026 10:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant