Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
91 commits
Select commit Hold shift + click to select a range
a9d8b42
adding fixed_sized_host_buffer
nirandaperera Feb 13, 2026
b9363cb
adding tests
nirandaperera Feb 13, 2026
9948837
adding more tests
nirandaperera Feb 13, 2026
a999ef2
private ctr
nirandaperera Feb 13, 2026
ee58be4
addressing PR comments
nirandaperera Feb 18, 2026
48091b1
addressing PR comments
nirandaperera Feb 18, 2026
566ef1a
Merge branch 'main' of github.com:rapidsai/rapidsmpf into fixed_sized…
nirandaperera Feb 18, 2026
8e7e7e6
simplifying logic
nirandaperera Feb 18, 2026
d055b34
fixing bounds block_data
nirandaperera Feb 18, 2026
ebdb514
Apply suggestions from code review
nirandaperera Feb 18, 2026
c810e13
adding copy to
nirandaperera Mar 5, 2026
fba90d6
bypass batchcpy from default stream
nirandaperera Mar 5, 2026
1f5e3e4
temp test fixes
nirandaperera Mar 5, 2026
b52c4e6
hack size
nirandaperera Mar 5, 2026
d152fed
Merge branch 'main' of github.com:rapidsai/rapidsmpf into fixed_sized…
nirandaperera Mar 5, 2026
fd17f5e
API changes
nirandaperera Mar 5, 2026
9a17f9e
Merge branch 'main' of github.com:rapidsai/rapidsmpf into fixed_sized…
nirandaperera Mar 5, 2026
6075dfb
API change
nirandaperera Mar 6, 2026
67c61c5
minor change
nirandaperera Mar 9, 2026
1c9f08b
Merge branch 'main' of github.com:rapidsai/rapidsmpf into fixed_sized…
nirandaperera Mar 9, 2026
a9a6ad2
fix cucascade build
nirandaperera Mar 9, 2026
08d4ccb
use fixed buffers in tablechunk copy
nirandaperera Mar 11, 2026
0df229f
Merge branch 'main' of github.com:rapidsai/rapidsmpf into fixed_sized…
nirandaperera Mar 11, 2026
c585aa7
fsmr from options
nirandaperera Mar 11, 2026
a1aa601
dask fro options
nirandaperera Mar 11, 2026
dbaf1d9
fix size descrepency
nirandaperera Mar 11, 2026
8657337
estimate size usage
nirandaperera Mar 11, 2026
355e7c5
Merge branch 'main' of github.com:rapidsai/rapidsmpf into fixed_sized…
nirandaperera Mar 11, 2026
d447a88
correctness fix
nirandaperera Mar 11, 2026
168ee3a
possible fix
nirandaperera Mar 11, 2026
6975951
minor change
nirandaperera Mar 12, 2026
5322bc9
minor change2
nirandaperera Mar 12, 2026
93f606a
investigation
nirandaperera Mar 12, 2026
5012417
MINOR FIX
nirandaperera Mar 12, 2026
9e7c0d7
fix danglingref
nirandaperera Mar 12, 2026
3dc7550
minor change
nirandaperera Mar 12, 2026
0d8233e
revert
nirandaperera Mar 12, 2026
2ea4806
fix block bounds
nirandaperera Mar 13, 2026
8cd7046
Merge branch 'main' of github.com:rapidsai/rapidsmpf into fixed_sized…
nirandaperera Mar 13, 2026
77bf023
revert change
nirandaperera Mar 13, 2026
fdb9d47
trying with host mr
nirandaperera Mar 13, 2026
5c32c78
switch to host mr
nirandaperera Mar 13, 2026
5d4370b
Merge branch 'main' of github.com:rapidsai/rapidsmpf into fixed_sized…
nirandaperera Mar 18, 2026
20413cc
minor bu
nirandaperera Mar 18, 2026
5bf25a9
minor fix
nirandaperera Mar 18, 2026
e90841d
set size
nirandaperera Mar 18, 2026
ec6e36e
Revert "set size"
nirandaperera Mar 18, 2026
5182515
investgation
nirandaperera Mar 18, 2026
67fcd02
investigation 2
nirandaperera Mar 18, 2026
8087c49
investigation 3
nirandaperera Mar 18, 2026
734d5a7
better errors
nirandaperera Mar 18, 2026
f88d605
trying to fix the pack error
nirandaperera Mar 18, 2026
4b743e3
reenable batchcpy
nirandaperera Mar 19, 2026
719d21d
using batch cpy
nirandaperera Mar 19, 2026
ee85b95
use sequential
nirandaperera Mar 19, 2026
ef71eab
minor
nirandaperera Mar 19, 2026
eb47413
Revert "use sequential"
nirandaperera Mar 19, 2026
7e5c857
Merge branch 'main' of github.com:rapidsai/rapidsmpf into fixed_sized…
nirandaperera Mar 19, 2026
882bf76
precommit
nirandaperera Mar 19, 2026
579e1df
dask cluster bootstrap from options
nirandaperera Mar 21, 2026
145a622
enable pinned memory by default
nirandaperera Mar 21, 2026
68844d6
fix tests
nirandaperera Mar 23, 2026
647bbf7
cython fix
nirandaperera Mar 23, 2026
e6c1161
fix dask test
nirandaperera Mar 23, 2026
cd5f989
fix test
nirandaperera Mar 24, 2026
8fa078a
add custom options
nirandaperera Mar 24, 2026
be1ac13
Merge branch 'main' of github.com:rapidsai/rapidsmpf into dask_cluste…
nirandaperera Mar 24, 2026
5a7653a
reset tests
nirandaperera Mar 24, 2026
ef80ef3
attempting to fix exception
nirandaperera Mar 24, 2026
4c816bb
Apply suggestion from @madsbk
nirandaperera Mar 24, 2026
8abe390
fix error
nirandaperera Mar 24, 2026
b2d6fca
Merge branch 'dask_cluster_bootstrap_with_options' of github.com:nira…
nirandaperera Mar 24, 2026
474e6d0
precommit
nirandaperera Mar 24, 2026
030b198
Merge branch 'main' of github.com:rapidsai/rapidsmpf into fixed_sized…
nirandaperera Mar 24, 2026
10db289
skipping for default stream
nirandaperera Mar 24, 2026
5a8613d
docs fix
nirandaperera Mar 24, 2026
91dbe8c
Apply suggestions from code review
nirandaperera Mar 25, 2026
861b212
precommit
nirandaperera Mar 25, 2026
90df014
Merge remote-tracking branch 'nira/dask_cluster_bootstrap_with_option…
nirandaperera Mar 25, 2026
6b0b4f4
adding bench
nirandaperera Mar 25, 2026
eb1d3f0
bench
nirandaperera Mar 25, 2026
30bea79
limit pinned mem
nirandaperera Mar 30, 2026
3a995a3
Merge branch 'main' of github.com:rapidsai/rapidsmpf into fixed_sized…
nirandaperera Mar 30, 2026
2b0b47b
extending bench
nirandaperera Apr 7, 2026
5178878
Merge branch 'main' of github.com:rapidsai/rapidsmpf into fixed_sized…
nirandaperera Apr 7, 2026
a26fc03
merge conflicts
nirandaperera Apr 8, 2026
822a247
adding stream pool
nirandaperera Apr 8, 2026
94ae1b2
adding threads
nirandaperera Apr 8, 2026
93ede18
extending bench
nirandaperera Apr 9, 2026
0152761
adding second bench
nirandaperera Apr 14, 2026
0343712
standalone reproducer for cccl team
nirandaperera Apr 14, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 1 addition & 12 deletions cmake/thirdparty/get_cucascade.cmake
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@ function(find_and_configure_cucascade)
rapids_cpm_find(
cuCascade 0.1.0
GLOBAL_TARGETS cuCascade::cucascade
BUILD_EXPORT_SET rapidsmpf-exports
CPM_ARGS
GIT_REPOSITORY https://github.com/NVIDIA/cuCascade.git
GIT_TAG main
Expand All @@ -40,18 +41,6 @@ function(find_and_configure_cucascade)
"CUCASCADE_WARNINGS_AS_ERRORS OFF"
EXCLUDE_FROM_ALL
)

# Create an interface library that wraps cuCascade to avoid export conflicts This target won't be
# exported but can be used internally. Link kvikio explicitly to satisfy cuDF's dependency.
if(TARGET cuCascade::cucascade AND NOT TARGET rapidsmpf_cucascade_internal)
add_library(rapidsmpf_cucascade_internal INTERFACE)
target_link_libraries(rapidsmpf_cucascade_internal INTERFACE cuCascade::cucascade)
# Link kvikio to ensure cuDF's transitive dependency is satisfied
if(TARGET kvikio::kvikio)
target_link_libraries(rapidsmpf_cucascade_internal INTERFACE kvikio::kvikio)
endif()
set_target_properties(rapidsmpf_cucascade_internal PROPERTIES EXPORT_NAME "")
endif()
endfunction()

find_and_configure_cucascade()
5 changes: 2 additions & 3 deletions cpp/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -196,6 +196,7 @@ add_library(
src/integrations/cudf/utils.cpp
src/memory/buffer.cpp
src/memory/buffer_resource.cpp
src/memory/fixed_sized_host_buffer.cpp
src/memory/host_buffer.cpp
src/memory/host_memory_resource.cpp
src/memory/memory_reservation.cpp
Expand Down Expand Up @@ -311,10 +312,8 @@ endif()
target_link_libraries(
rapidsmpf
PUBLIC rmm::rmm cudf::cudf CCCL::CCCL $<TARGET_NAME_IF_EXISTS:ucxx::ucxx>
$<TARGET_NAME_IF_EXISTS:libcoro>
$<TARGET_NAME_IF_EXISTS:libcoro> $<TARGET_NAME_IF_EXISTS:cuCascade::cucascade>
PRIVATE cuco::cuco
$<TARGET_NAME_IF_EXISTS:rapidsmpf_cucascade_internal>
$<$<NOT:$<TARGET_EXISTS:rapidsmpf_cucascade_internal>>:cuCascade::cucascade>
$<$<BOOL:${RAPIDSMPF_HAVE_NUMA}>:numa>
$<TARGET_NAME_IF_EXISTS:MPI::MPI_C>
$<$<BOOL:${RAPIDSMPF_HAVE_CUPTI}>:CUDA::cupti>
Expand Down
52 changes: 52 additions & 0 deletions cpp/benchmarks/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -122,6 +122,32 @@ install(
EXCLUDE_FROM_ALL
)

add_executable(bench_pinned_pool_fragmentation "bench_pinned_pool_fragmentation.cpp")
set_target_properties(
bench_pinned_pool_fragmentation
PROPERTIES RUNTIME_OUTPUT_DIRECTORY "$<BUILD_INTERFACE:${RAPIDSMPF_BINARY_DIR}/benchmarks>"
CXX_STANDARD 20
CXX_STANDARD_REQUIRED ON
CXX_EXTENSIONS ON
CUDA_STANDARD 20
CUDA_STANDARD_REQUIRED ON
)
target_compile_options(
bench_pinned_pool_fragmentation PRIVATE "$<$<COMPILE_LANGUAGE:CXX>:${RAPIDSMPF_CXX_FLAGS}>"
"$<$<COMPILE_LANGUAGE:CUDA>:${RAPIDSMPF_CUDA_FLAGS}>"
)
target_link_libraries(
bench_pinned_pool_fragmentation
PRIVATE rapidsmpf::rapidsmpf rmm::rmm benchmark::benchmark benchmark::benchmark_main
$<TARGET_NAME_IF_EXISTS:conda_env> maybe_asan bench_utils
)
install(
TARGETS bench_pinned_pool_fragmentation
COMPONENT benchmarking
DESTINATION bin/benchmarks/librapidsmpf
EXCLUDE_FROM_ALL
)

add_executable(bench_pack "bench_pack.cpp")
set_target_properties(
bench_pack
Expand All @@ -148,6 +174,32 @@ install(
EXCLUDE_FROM_ALL
)

add_executable(bench_driver_pool_fragmentation "bench_driver_pool_fragmentation.cpp")
set_target_properties(
bench_driver_pool_fragmentation
PROPERTIES RUNTIME_OUTPUT_DIRECTORY "$<BUILD_INTERFACE:${RAPIDSMPF_BINARY_DIR}/benchmarks>"
CXX_STANDARD 20
CXX_STANDARD_REQUIRED ON
CXX_EXTENSIONS ON
CUDA_STANDARD 20
CUDA_STANDARD_REQUIRED ON
)
target_compile_options(
bench_driver_pool_fragmentation PRIVATE "$<$<COMPILE_LANGUAGE:CXX>:${RAPIDSMPF_CXX_FLAGS}>"
"$<$<COMPILE_LANGUAGE:CUDA>:${RAPIDSMPF_CUDA_FLAGS}>"
)
target_link_libraries(
bench_driver_pool_fragmentation
PRIVATE benchmark::benchmark benchmark::benchmark_main CUDA::cudart CCCL::CCCL
$<TARGET_NAME_IF_EXISTS:conda_env>
)
install(
TARGETS bench_driver_pool_fragmentation
COMPONENT benchmarking
DESTINATION bin/benchmarks/librapidsmpf
EXCLUDE_FROM_ALL
)

if(RAPIDSMPF_HAVE_STREAMING)
add_subdirectory(streaming)
endif()
Loading