agray3 197c00681b Allow multiple copy function pointers for CUDA graph kernel param updates (#7565) ...

CUDA graphs require parameter updates to kernels associated with
GGML_OP_CPY nodes. Previously the implementation only checked for a
single CUDA kernel in such nodes, but this caused a bug in cases where
2 such kernels exist. This fixes the issue by using a vector to allow
multiple function pointers to be stored and checked against.

Fixes #7942

2024-05-27 19:33:42 +02:00

119 KiB

Raw Blame History

View Raw