Skip to content

ci: get Avik a tpu #1940

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
avik-pal wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

ci: get Avik a tpu #1940

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
8208483
ci: get Avik a tpu
avik-pal Dec 7, 2025
83c05af
perf: generate xprof dumps
avik-pal Dec 7, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
170 changes: 85 additions & 85 deletions .buildkite/pipeline.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,94 +1,94 @@
steps:
- group: ":test_tube: Tests"
steps:
- label: ":julia: :linux: CUDA Julia v{{matrix.version}} -- {{matrix.group}} -- {{matrix.runtime}}"
matrix:
setup:
version:
- "1.10"
group:
- core
- neural_networks
- integration
runtime:
- "PJRT"
- "IFRT"
plugins:
- JuliaCI/julia#v1:
version: "{{matrix.version}}"
- JuliaCI/julia-coverage#v1:
codecov: true
dirs:
- src
- ext
- lib/ReactantCore/src
commands: |
touch LocalPreferences.toml
# steps:
# - group: ":test_tube: Tests"
# steps:
# - label: ":julia: :linux: CUDA Julia v{{matrix.version}} -- {{matrix.group}} -- {{matrix.runtime}}"
# matrix:
# setup:
# version:
# - "1.10"
# group:
# - core
# - neural_networks
# - integration
# runtime:
# - "PJRT"
# - "IFRT"
# plugins:
# - JuliaCI/julia#v1:
# version: "{{matrix.version}}"
# - JuliaCI/julia-coverage#v1:
# codecov: true
# dirs:
# - src
# - ext
# - lib/ReactantCore/src
# commands: |
# touch LocalPreferences.toml

echo "[Reactant]" >> LocalPreferences.toml
echo "xla_runtime = \"{{matrix.runtime}}\"" >> LocalPreferences.toml
# echo "[Reactant]" >> LocalPreferences.toml
# echo "xla_runtime = \"{{matrix.runtime}}\"" >> LocalPreferences.toml

cat LocalPreferences.toml
# cat LocalPreferences.toml

julia --project=. -e 'println("--- :julia: Instantiating project")
using Pkg
Pkg.develop([PackageSpec(path="lib/ReactantCore")])'
# julia --project=. -e 'println("--- :julia: Instantiating project")
# using Pkg
# Pkg.develop([PackageSpec(path="lib/ReactantCore")])'

julia --project=. -e 'println("--- :julia: Run Tests")
using Pkg
Pkg.test(; coverage="user")'
agents:
queue: "juliagpu"
cuda: "*"
env:
REACTANT_TEST_GROUP: "{{matrix.group}}"
JULIA_DEBUG: "Reactant,Reactant_jll"
CUDA_VISIBLE_DEVICES: 0
REACTANT_BACKEND_GROUP: "GPU"
if: build.message !~ /\[skip tests\]/
timeout_in_minutes: 120
# julia --project=. -e 'println("--- :julia: Run Tests")
# using Pkg
# Pkg.test(; coverage="user")'
# agents:
# queue: "juliagpu"
# cuda: "*"
# env:
# REACTANT_TEST_GROUP: "{{matrix.group}}"
# JULIA_DEBUG: "Reactant,Reactant_jll"
# CUDA_VISIBLE_DEVICES: 0
# REACTANT_BACKEND_GROUP: "GPU"
# if: build.message !~ /\[skip tests\]/
# timeout_in_minutes: 120

# - label: ":julia: :linux: AMDGPU Julia v{{matrix.version}} -- {{matrix.group}} -- {{matrix.runtime}}"
# matrix:
# setup:
# version:
# - "1.10"
# group:
# - core
# - neural_networks
# - integration
# runtime:
# - "IFRT"
# plugins:
# - JuliaCI/julia#v1:
# version: "{{matrix.version}}"
# - JuliaCI/julia-coverage#v1:
# codecov: true
# dirs:
# - src
# - ext
# - lib/ReactantCore/src
# agents:
# queue: "juliagpu"
# rocm: "*"
# commands: |
# touch LocalPreferences.toml
# # - label: ":julia: :linux: AMDGPU Julia v{{matrix.version}} -- {{matrix.group}} -- {{matrix.runtime}}"
# # matrix:
# # setup:
# # version:
# # - "1.10"
# # group:
# # - core
# # - neural_networks
# # - integration
# # runtime:
# # - "IFRT"
# # plugins:
# # - JuliaCI/julia#v1:
# # version: "{{matrix.version}}"
# # - JuliaCI/julia-coverage#v1:
# # codecov: true
# # dirs:
# # - src
# # - ext
# # - lib/ReactantCore/src
# # agents:
# # queue: "juliagpu"
# # rocm: "*"
# # commands: |
# # touch LocalPreferences.toml

# echo "[Reactant]" >> LocalPreferences.toml
# echo "xla_runtime = \"{{matrix.runtime}}\"" >> LocalPreferences.toml
# # echo "[Reactant]" >> LocalPreferences.toml
# # echo "xla_runtime = \"{{matrix.runtime}}\"" >> LocalPreferences.toml

# cat LocalPreferences.toml
# # cat LocalPreferences.toml

# julia --project=. -e 'println("--- :julia: Instantiating project")
# using Pkg
# Pkg.develop([PackageSpec(path="lib/ReactantCore")])'
# # julia --project=. -e 'println("--- :julia: Instantiating project")
# # using Pkg
# # Pkg.develop([PackageSpec(path="lib/ReactantCore")])'

# julia --project=. -e 'println("--- :julia: Run Tests")
# using Pkg
# Pkg.test(; coverage="user")'
# env:
# REACTANT_TEST_GROUP: "{{matrix.group}}"
# JULIA_DEBUG: "Reactant,Reactant_jll"
# CUDA_VISIBLE_DEVICES: 0
# if: build.message !~ /\[skip tests\]/
# timeout_in_minutes: 120
# # julia --project=. -e 'println("--- :julia: Run Tests")
# # using Pkg
# # Pkg.test(; coverage="user")'
# # env:
# # REACTANT_TEST_GROUP: "{{matrix.group}}"
# # JULIA_DEBUG: "Reactant,Reactant_jll"
# # CUDA_VISIBLE_DEVICES: 0
# # if: build.message !~ /\[skip tests\]/
# # timeout_in_minutes: 120
62 changes: 31 additions & 31 deletions .github/workflows/CI.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,32 +34,32 @@ jobs:
fail-fast: false
matrix:
version:
- "1.10"
# - "1.10"
- "1.11"
# - 'nightly'
os:
- ubuntu-24.04
# - ubuntu-24.04
# `ubuntu-22.04-arm` is considered more stable than `ubuntu-24.04-arm`:
# <https://github.com/orgs/community/discussions/148648#discussioncomment-12099554>.
- ubuntu-22.04-arm
# - ubuntu-22.04-arm
# Disable `macOS-13` until
# <https://github.com/EnzymeAD/Reactant.jl/issues/867> is resolved.
# - macOS-13
- macOS-latest
- windows-latest
# - macOS-latest
# - windows-latest
- linux-x86-ct6e-180-4tpu
test_group:
- core
- neural_networks
- integration
# - neural_networks
# - integration
runtime:
- "pjrt"
# - "pjrt"
- "ifrt"
exclude:
- os: linux-x86-ct6e-180-4tpu
version: "1.10"
- os: linux-x86-ct6e-180-4tpu
runtime: "pjrt"
# exclude:
# - os: linux-x86-ct6e-180-4tpu
# version: "1.10"
# - os: linux-x86-ct6e-180-4tpu
# runtime: "pjrt"
uses: ./.github/workflows/CommonCI.yml
with:
julia_version: ${{ matrix.version }}
Expand All @@ -86,21 +86,21 @@ jobs:
# assertions: true
# test_group: ${{ matrix.test_group }}

downgrade:
strategy:
fail-fast: false
matrix:
test_group:
- core
- neural_networks
- integration
runtime:
- "pjrt"
- "ifrt"
uses: ./.github/workflows/CommonCI.yml
with:
julia_version: "1.10"
os: "ubuntu-24.04"
runtime: ${{ matrix.runtime }}
test_group: ${{ matrix.test_group }}
downgrade_testing: true
# downgrade:
# strategy:
# fail-fast: false
# matrix:
# test_group:
# - core
# - neural_networks
# - integration
# runtime:
# - "pjrt"
# - "ifrt"
# uses: ./.github/workflows/CommonCI.yml
# with:
# julia_version: "1.10"
# os: "ubuntu-24.04"
# runtime: ${{ matrix.runtime }}
# test_group: ${{ matrix.test_group }}
# downgrade_testing: true
Loading
Loading