CCCL (CUDA C++ Core Libraries) provides: - CUB: device/block/warp-level GPU primitives (reduce, scan, sort, topk) - Thrust: high-level parallel algorithms (transform_reduce, sort, scan) - libcudacxx: CUDA C++ standard library (atomics, barriers, memory) - cudax: experimental features (memory resources, allocators) - Tuning policies: per-SM hardware-specific algorithm parameters Competition optimization vectors mapped to CCCL: - Output TPS (83% weight): warp_reduce, block_reduce, device_topk - Input TPS (14% weight): device_scan, block_load, prefetch - Cache TPS (3% weight): prefix caching strategy patterns - Memory (0.9 util): pooled/cached/buddy allocators Source: https://github.com/NVIDIA/cccl (shallow clone, HEAD only) License: Apache-2.0
60 lines
2.3 KiB
Plaintext
60 lines
2.3 KiB
Plaintext
#include <thrust/device_vector.h>
|
|
#include <thrust/execution_policy.h>
|
|
#include <thrust/for_each.h>
|
|
#include <thrust/functional.h>
|
|
#include <thrust/transform.h>
|
|
|
|
#include <iostream>
|
|
|
|
// This example demonstrates how to build a minimal custom
|
|
// Thrust backend by intercepting for_each's dispatch.
|
|
|
|
// We begin by defining a "system", which distinguishes our novel
|
|
// backend from other Thrust backends.
|
|
// We'll derive my_system from thrust::device_execution_policy to inherit
|
|
// the functionality of the default device backend.
|
|
// Note that we pass the name of our system as a template parameter
|
|
// to thrust::device_execution_policy.
|
|
struct my_system : thrust::device_execution_policy<my_system>
|
|
{};
|
|
|
|
// Next, we'll create a novel version of for_each which only
|
|
// applies to algorithm invocations executed with my_system.
|
|
// Our version of for_each will print a message and then call
|
|
// the regular device version of for_each.
|
|
|
|
// The first parameter to our version for_each is my_system. This allows
|
|
// Thrust to locate it when dispatching thrust::for_each.
|
|
// The following parameters are as normal.
|
|
template <typename Iterator, typename Function>
|
|
Iterator for_each(my_system, Iterator first, Iterator last, Function f)
|
|
{
|
|
// output a message
|
|
std::cout << "Hello, world from for_each(my_system)!" << '\n';
|
|
|
|
// to call the normal device version of for_each, pass thrust::device as the first parameter.
|
|
return thrust::for_each(thrust::device, first, last, f);
|
|
}
|
|
|
|
int main()
|
|
{
|
|
thrust::device_vector<int> vec(1);
|
|
|
|
// create an instance of our system
|
|
my_system sys;
|
|
|
|
// To invoke our version of for_each, pass sys as the first parameter
|
|
thrust::for_each(sys, vec.begin(), vec.end(), cuda::std::negate{});
|
|
|
|
// Other algorithms that Thrust implements with thrust::for_each will also
|
|
// cause our version of for_each to be invoked when we pass an instance of my_system as the first parameter.
|
|
// Even though we did not define a special version of transform, Thrust dispatches the version it knows
|
|
// for thrust::device_execution_policy, which my_system inherits.
|
|
thrust::transform(sys, vec.begin(), vec.end(), vec.begin(), cuda::std::identity{});
|
|
|
|
// Invocations without my_system are handled normally.
|
|
thrust::for_each(vec.begin(), vec.end(), cuda::std::negate{});
|
|
|
|
return 0;
|
|
}
|