1 file changed
+1
-1
lines changedSubmodule kuiper_llama updated 31 files
- CMakeLists.txt+51-3
- cmake/CPM.cmake+24
- demo/main.cpp+2-2
- imgs/me.jpg
- imgs/qa.jpg
- kuiper/include/base/alloc.h+14
- kuiper/include/base/base.h+3
- kuiper/include/model/llama2.h+4-1
- kuiper/include/model/model.h+4-1
- kuiper/include/op/embedding.h+6
- kuiper/source/base/alloc.cpp-1
- kuiper/source/model/llama2.cpp+36-8
- kuiper/source/op/kernels/cpu/rope_kernel.cpp+19-6
- kuiper/source/op/kernels/cpu/rope_kernel.h+6-3
- kuiper/source/op/kernels/cpu/scale_sum_kernel.cpp+4-6
- kuiper/source/op/kernels/cuda/matmul_kernel.cu+39-29
- kuiper/source/op/kernels/cuda/rmsnorm_kernel.cu+5-15
- kuiper/source/op/kernels/cuda/rope_kernel.cu+44-12
- kuiper/source/op/kernels/cuda/rope_kernel.cuh+6-3
- kuiper/source/op/kernels/cuda/swiglu_kernel.cu+7-6
- kuiper/source/op/kernels/kernels_interface.h+2-1
- kuiper/source/op/layer.cpp+1-1
- kuiper/source/op/rope.cpp+6-1
- readme.md+11-5
- test/test_op/test_cu_matmul.cpp+106-347
- test/test_op/test_cu_rope.cpp+135-135
- test/test_op/test_cu_scale.cpp+33-33
- test/test_op/test_load.cpp+109
- tmp/test.bin
- tools/config.json+26
- tools/model.py+343
0 commit comments