Add AGENTS.md for coding agent onboarding

[Copilot]

• Explore repository structure, build system, dependencies, and workflows
• Understand project architecture (dashboard, ML, Docker containers)
• Review existing documentation (README.md, dashboard/README.md, ml/README.md)
• Verify linting setup and run linter (ruff check passes cleanly)
• Create .github/copilot-instructions.md with comprehensive agent onboarding instructions
• Run code review (no issues found)
• Run CodeQL checker (no code changes to analyze — Markdown only)
• Address review feedback: remove Ruff version, format pip as inline code, remove MongoDB from NERSC services list
• Address review feedback: remove MLflow item from ML Training section (not yet set up in main)

---

🔒 GitHub Advanced Security automatically protects Copilot coding agent pull requests. You can protect all pull requests by enabling Advanced Security for your repositories. Learn more about Advanced Security.

[EZoni]

@RemiLehe

The instructions in this PR were created automatically by GitHub Copilot following the instructions at https://docs.github.com/en/copilot/how-tos/configure-custom-instructions/add-repository-instructions#creating-repository-wide-custom-instructions, using Claude Opus 4.6.

I have not reviewed the PR yet, but I think it could be interesting to compare the instructions added in this PR with the ones you added in #384, even though they may be serving different purposes.

[RemiLehe]

Yes, I fully agree.
Btw, do you know whether Copilot automatically read the AGENTS.md it finds in the root of the repository? (i.e. the one added in #384 )

[EZoni]

Yes, I fully agree. Btw, do you know whether Copilot automatically read the AGENTS.md it finds in the root of the repository? (i.e. the one added in #384 )

Yes, I think so. It's what they call "agent instructions" at https://docs.github.com/en/copilot/how-tos/configure-custom-instructions/add-repository-instructions#creating-custom-instructions, while the instructions added here is what they call "repository-wide custom instructions", which I think are used for, e.g., code reviews: