CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-18 11:46:58 +00:00
Code Issues Packages Projects Releases Wiki Activity

[SYCL] Update SYCL-Rope op and Refactor (#8157)

Browse Source 
* align with rope.cu and move sycl-op to a single file
This commit is contained in:
zhentaoyu
2024-07-01 19:39:06 +08:00
committed by GitHub
parent d0a7145ba9
commit 197fe6c1d7
4 changed files with 300 additions and 303 deletions
Download Patch File Download Diff File Expand all files Collapse all files

22
ggml/src/ggml-sycl/rope.hpp Normal file
View File

@@ -0,0 +1,22 @@
//
// MIT license
// Copyright (C) 2024 Intel Corporation
// SPDX-License-Identifier: MIT
//
//
// Part of the LLVM Project, under the Apache License v2.0 with LLVM Exceptions.
// See https://llvm.org/LICENSE.txt for license information.
// SPDX-License-Identifier: Apache-2.0 WITH LLVM-exception
//
#ifndef GGML_SYCL_ROPE_HPP
#define GGML_SYCL_ROPE_HPP
#include "common.hpp"
void ggml_sycl_op_rope(
ggml_backend_sycl_context & ctx, const ggml_tensor *src0, const ggml_tensor *src1, ggml_tensor *dst,
const float *src0_dd, const float *src1_dd, float *dst_dd, const queue_ptr &main_stream);
#endif // GGML_SYCL_ROPE_HPP