Accelerated Out of Core Shuffling(quasiben.github.io)
9 points by quasiben | 0 comments
Blog post describing RapidsMPF, a reusable out-of-core GPU data shuffler for distributed analytics that spills to avoid OOM, reaching 1.8 TiB/s.
#distributed-shuffle on Hacker News
1 story tagged distributed-shuffle, newest first.