llama.cpp/ggml/src/ggml-cuda/sumrows.cuh at b0493156fa8622694f21f42460a84da3eded0bc0 - llama.cpp - Gitea - Peisong Xiao

CS348Project/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-16 11:27:03 +00:00

Files

Aman Gupta aa064b2eb7 CUDA: add mean operation (#14313 )

* CUDA: add mean operation

* add back sum_rows_f32_cuda

* Review: early exit if col!=0

2025-06-22 12:39:54 +08:00

5 lines

212 B

Plaintext

Raw Blame History

 #include "common.cuh"
 void sum_rows_f32_cuda(const float * x, float * dst, const int ncols, const int nrows, cudaStream_t stream);
 void ggml_cuda_op_sum_rows(ggml_backend_cuda_context & ctx, ggml_tensor * dst);