Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

鲲鹏920加载LLM报错 #3104

Open
Joker15LSN opened this issue Nov 28, 2024 · 6 comments
Open

鲲鹏920加载LLM报错 #3104

Joker15LSN opened this issue Nov 28, 2024 · 6 comments
Labels
bug Something isn't working

Comments

@Joker15LSN
Copy link

平台(如果交叉编译请再附上交叉编译目标平台):

Platform(Include target platform as well if cross-compiling): 鲲鹏920

-- MNN BUILD INFO:
-- System: Linux
-- Processor: aarch64
-- Version: 3.0.0
-- Metal: OFF
-- OpenCL: OFF
-- OpenGL: OFF
-- Vulkan: OFF
-- ARM82: ON
-- KleidiAI: OFF
-- oneDNN: OFF
-- TensorRT: OFF
-- CoreML: OFF
-- NNAPI: OFF
-- CUDA: OFF
-- OpenMP: OFF
-- BF16: OFF
-- ThreadPool: ON
-- Hidden: TRUE
-- Build Path: /root/Qwen2-VL-7B-Instruct-MNN/MNN/build
-- CUDA PROFILE: OFF

Github版本:3.0

编译方式: 源码编译

cmake ../ -DMNN_LOW_MEMORY=true -DMNN_CPU_WEIGHT_DEQUANT_GEMM=true -DMNN_BUILD_LLM=true -DMNN_SUPPORT_TRANSFORMER_FUSE=true
make -j32

编译日志:

Build Log:

[root@localhost build]# cmake ../ -DMNN_LOW_MEMORY=true -DMNN_CPU_WEIGHT_DEQUANT_GEMM=true -DMNN_BUILD_LLM=true -DMNN_SUPPORT_TRANSFORMER_FUSE=true
-- The C compiler identification is GNU 7.3.0
-- The CXX compiler identification is GNU 7.3.0
-- The ASM compiler identification is GNU
-- Found assembler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Use Threadpool, forbid openmp
-- >>>>>>>>>>>>>
-- MNN BUILD INFO:
--      System: Linux
--      Processor: aarch64
--      Version: 3.0.0
--      Metal: OFF
--      OpenCL: OFF
--      OpenGL: OFF
--      Vulkan: OFF
--      ARM82: ON
--      KleidiAI: OFF
--      oneDNN: OFF
--      TensorRT: OFF
--      CoreML: OFF
--      NNAPI: OFF
--      CUDA: OFF
--      OpenMP: OFF
--      BF16: OFF
--      ThreadPool: ON
--      Hidden: TRUE
--      Build Path: /root/Qwen2-VL-7B-Instruct-MNN/MNN/build
--      CUDA PROFILE: OFF
-- WIN_USE_ASM: 
-- Enabling AArch64 Assemblies
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE  
-- Configuring done
-- Generating done
-- Build files have been written to: /root/Qwen2-VL-7B-Instruct-MNN/MNN/build
[root@localhost build]# make -j32
make[1]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
Scanning dependencies of target MNN_Arm82
Scanning dependencies of target MNNUtils
Scanning dependencies of target MNNMath
Scanning dependencies of target MNNCV
Scanning dependencies of target checkDir.out
Scanning dependencies of target checkFile.out
Scanning dependencies of target MNNCore
Scanning dependencies of target MNNARM64
Scanning dependencies of target MNNCPU
Scanning dependencies of target MNNTransform
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[  0%] Building CXX object CMakeFiles/checkFile.out.dir/tools/cpp/checkFile.cpp.o
[  0%] Building CXX object CMakeFiles/checkDir.out.dir/tools/cpp/checkDir.cpp.o
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[  0%] Building CXX object CMakeFiles/MNNUtils.dir/source/utils/InitNet.cpp.o
[  0%] Building CXX object CMakeFiles/MNNMath.dir/source/math/Matrix.cpp.o
[  0%] Building CXX object CMakeFiles/MNNMath.dir/source/math/WingoradGenerater.cpp.o
[  0%] Building CXX object CMakeFiles/MNNUtils.dir/source/utils/JNIHelper.cpp.o
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[  1%] Building CXX object CMakeFiles/MNNCV.dir/source/cv/Matrix_CV.cpp.o
[  1%] Building CXX object CMakeFiles/MNNCV.dir/source/cv/ImageProcess.cpp.o
[  1%] Building CXX object CMakeFiles/MNNCV.dir/source/cv/ImageProcessUtils.cpp.o
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[  1%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBGRToGRAY.S.o
[  1%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBGRToBGR565.S.o
[  1%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBGRAToGRAY.S.o
[  3%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBinaryAddInt8.S.o
[  3%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBilinearLineC8.S.o
[  3%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBGRToBGR555.S.o
[  4%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBilinearSampleC8.S.o
[  4%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNAvgPoolInt8.S.o
[  4%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNAxByClampBroadcastC4.S.o
[  4%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBGRAToBGR.S.o
[  4%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBinaryMaxInt8.S.o
[  4%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNAddC4WithStride.S.o
[  4%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBinaryMulInt8.S.o
[  5%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBinarySubInt8.S.o
[  5%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBlitC1ToFloatRGBA.S.o
[  5%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBinaryMinInt8.S.o
[  5%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBinarySqdInt8.S.o
[  6%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNBlitC3ToFloatRGBA.S.o
[  6%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNC3ToC4Fast.S.o
[  6%] Building CXX object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/Arm82Backend.cpp.o
[  6%] Building CXX object CMakeFiles/MNNCore.dir/source/core/AutoTime.cpp.o
[  6%] Building CXX object CMakeFiles/MNNCore.dir/source/core/Backend.cpp.o
[  7%] Building CXX object CMakeFiles/MNNCore.dir/source/core/Execution.cpp.o
[  7%] Building CXX object CMakeFiles/MNNCore.dir/source/core/ConvolutionCommon.cpp.o
[  7%] Building CXX object CMakeFiles/MNNCore.dir/source/core/BufferAllocator.cpp.o
[  7%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNC3ToYUVFast.S.o
[  7%] Building CXX object CMakeFiles/MNNCore.dir/source/core/Interpreter.cpp.o
[  7%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNC3ToXYZFast.S.o
[  7%] Building CXX object CMakeFiles/MNNCore.dir/source/core/FileLoader.cpp.o
[  7%] Building CXX object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/Arm82Binary.cpp.o
[  8%] Building CXX object CMakeFiles/MNNCore.dir/source/core/MNNFileUtils.cpp.o
[  9%] Building CXX object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/Arm82Interp.cpp.o
[  9%] Building CXX object CMakeFiles/MNNCore.dir/source/core/MNNMemoryUtils.cpp.o
[  9%] Building CXX object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/Arm82OptFunc.cpp.o
[  9%] Building CXX object CMakeFiles/MNNCore.dir/source/core/OpCommonUtils.cpp.o
[ 10%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNConvDwF23MulTransUnit.S.o
[ 10%] Building CXX object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/Arm82Functions.cpp.o
[ 10%] Building CXX object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/Arm82Relu.cpp.o
[ 10%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNConvRunForLineDepthWiseInt8.S.o
[ 10%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNConvDwF23SourceTransUnit.S.o
[ 10%] Building CXX object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/Arm82OpRegister.cpp.o
[ 10%] Building CXX object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/Arm82Unary.cpp.o
[ 11%] Building CXX object CMakeFiles/MNNCore.dir/source/core/RuntimeFactory.cpp.o
[ 11%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNConvRunForLineDepthWiseUint8.S.o
[ 11%] Building CXX object CMakeFiles/MNNCore.dir/source/core/Pipeline.cpp.o
[ 11%] Building CXX object CMakeFiles/MNNCore.dir/source/core/Schedule.cpp.o
[ 11%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNConvRunForLineDepthwise.S.o
[ 11%] Building CXX object CMakeFiles/MNNCore.dir/source/core/Session.cpp.o
[ 11%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNConvRunForUnitDepthWiseUint8.S.o
[ 11%] Building CXX object CMakeFiles/MNNCore.dir/source/core/Tensor.cpp.o
[ 12%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNCopyC4WithStride.S.o
[ 13%] Building CXX object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/Arm82WinogradOptFunc.cpp.o
[ 13%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNCubicLineC16.S.o
[ 13%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNCubicSampleC16.S.o
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 13%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNDeconvRunForUnitDepthWise.S.o
[ 13%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUArgMax.cpp.o
[ 13%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/ConvertUtils.cpp.o
[ 13%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNDepthwiseConvFastKernel.S.o
[ 14%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNExpC8.S.o
[ 14%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNFloat2Int8.S.o
[ 14%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNGRAYToC3Fast.S.o
[ 14%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNGRAYToC4Fast.S.o
[ 15%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNGelu.S.o
[ 15%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryBatchMatMul.cpp.o
[ 15%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNGemmInt8AddBiasScale_16x4_Unit.S.o
[ 16%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryBinary.cpp.o
[ 16%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNGemmInt8AddBiasScale_16x4_Unit_FAST.S.o
[ 16%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNGemmInt8AddBiasScale_ARMV82_Unit.S.o
[ 16%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNGemmInt8AddBiasScale_ARMV86_Unit.S.o
[ 17%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNGemmint8to32_8x4_Unit.S.o
[ 18%] Linking CXX executable checkFile.out
[ 18%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNInt8ScaleToFloat.S.o
[ 18%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNLineDepthWiseInt8AddBiasScaleUnit.S.o
[ 18%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryBroadcastTo.cpp.o
[ 18%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNLineDepthWiseInt8AddBiasScale_ARMV82_Unit3X3.S.o
[ 18%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNLoadU8AndSum.S.o
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 18%] Built target checkFile.out
[ 19%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNMatrixAdd.S.o
[ 19%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNMatrixMax.S.o
[ 19%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/Arm82MNNPackForMatMul_A.S.o
[ 19%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNMatrixProd.S.o
[ 19%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNMatrixSub.S.o
[ 19%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/MNNConvRunForLineDepthwiseFP16.S.o
[ 20%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNMaxFloat.S.o
[ 20%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNMaxPoolInt8.S.o
[ 20%] Building CXX object CMakeFiles/MNNCore.dir/source/core/TensorUtils.cpp.o
[ 20%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNMinFloat.S.o
[ 20%] Linking CXX executable checkDir.out
[ 20%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNNV21ToBGRAUnit.S.o
[ 20%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNNV21ToBGRUnit.S.o
[ 21%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNNV21ToRGBAUnit.S.o
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 21%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNNV21ToRGBUnit.S.o
[ 21%] Built target checkDir.out
[ 21%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPackC2.S.o
[ 22%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUAttention.cpp.o
[ 22%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPackC4.S.o
[ 23%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPackC4ForMatMul_A.S.o
[ 23%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPackC4Int8ForMatMulA_ARM82.S.o
[ 23%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPackC4Int8ForMatMulA_ARM86.S.o
[ 23%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPackC8.S.o
[ 24%] Building CXX object CMakeFiles/MNNCore.dir/source/core/WrapExecution.cpp.o
[ 24%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPackedMatMul.S.o
[ 25%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPackedMatMulRemain.S.o
[ 25%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPackedSparseMatMulEpx1.S.o
[ 25%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/MNNConvWinoSourceTransformUnit6x6FP16.S.o
[ 25%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUBackend.cpp.o
[ 25%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPackedSparseMatMulEpx4.S.o
[ 25%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPackedSparseQuantMatMulEpx1.S.o
[ 26%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/MNNDepthwiseConvFastKernelFP16.S.o
[ 27%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPackedSparseQuantMatMulEpx4.S.o
[ 27%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNPowC8.S.o
[ 27%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/MNNExpFP16.S.o
[ 27%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNQuanToDestUint8.S.o
[ 27%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNRGBAToBGRAFast.S.o
[ 27%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/MNNGeluFP16.S.o
[ 27%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNRGBAToBGRFast.S.o
[ 28%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNRGBAToGRAYFast.S.o
[ 28%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryComputer.cpp.o
[ 28%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNRGBToBGR.S.o
[ 28%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNRGBToBGR555.S.o
[ 28%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNRGBToBGR565.S.o
[ 29%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNRGBToGRAYFast.S.o
[ 29%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNReluInt8.S.o
[ 29%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNReluWithSlopeChannel.S.o
[ 29%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNReluWithSlopeChannelInt8.S.o
[ 29%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNSamplerC1BilinearOpt.S.o
[ 30%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNSamplerC1NearestOpt.S.o
[ 30%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNSamplerC3BilinearOpt.S.o
[ 30%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNSamplerC4BilinearOpt.S.o
[ 30%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNSamplerC4NearestOpt.S.o
[ 31%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNScaleAddInt8.S.o
[ 31%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNScaleAndAddBias.S.o
[ 31%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNScaleAndAddBiasInt8.S.o
[ 31%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNSoftmax.S.o
[ 31%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNStrassenMergeCFunction.S.o
[ 32%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNTranspose16Bit8x8.S.o
[ 32%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNTranspose32Bit4x4.S.o
[ 32%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNUInt8ToInt16WithOffsetC4Common.S.o
[ 32%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNUInt8ToInt16WithOffsetC4Fast.S.o
[ 32%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNUnPackC4.S.o
[ 33%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNVectorTop1Float.S.o
[ 33%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNVectorTop1Int32.S.o
[ 33%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNWinogradMatrixProductLeft.S.o
[ 33%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/MNNWinogradMatrixProductRight.S.o
[ 34%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/low_memory/MNNAbsMaxFP32.S.o
[ 34%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/low_memory/MNNDynamicQuantFP32.S.o
[ 34%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/low_memory/MNNDynamicUpdateConvBiasScale.S.o
[ 34%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/low_memory/MNNGemmInt8AddBiasScale_16x4_w4_Unit.S.o
[ 34%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/low_memory/MNNGemmInt8AddBiasScale_ARMV82_w4_Unit.S.o
[ 35%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/low_memory/MNNGemmInt8AddBiasScale_ARMV86_w4_Unit.S.o
[ 35%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/low_memory/MNNQuantScaleFP32.S.o
[ 35%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/low_memory/MNNQuantSumFP32.S.o
[ 35%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/normal_memory/MNNPackedMatMulRemain_int4.S.o
[ 36%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/normal_memory/MNNPackedMatMulRemain_int8.S.o
[ 36%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/normal_memory/MNNPackedMatMul_int4.S.o
[ 36%] Building ASM object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/arm64/normal_memory/MNNPackedMatMul_int8.S.o
[ 36%] Building CXX object CMakeFiles/MNNARM64.dir/source/backend/cpu/arm/CommonOptFunctionNeon.cpp.o
[ 36%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryComputerUtils.cpp.o
[ 37%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryConcat.cpp.o
[ 37%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryConv2D.cpp.o
[ 37%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryConv2DBackPropFilter.cpp.o
[ 37%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryConv3D.cpp.o
[ 37%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryConvUtils.cpp.o
[ 38%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryConvert.cpp.o
[ 38%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryCosineSimilarity.cpp.o
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 38%] Built target MNNCV
[ 38%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/MNNPackC8FP16.S.o
[ 38%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/MNNPackedMatMulFP16.S.o
[ 38%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUBinary.cpp.o
[ 38%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUBinaryInt8.cpp.o
[ 39%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUCast.cpp.o
[ 39%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryCrop.cpp.o
[ 39%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUConvolution.cpp.o
[ 39%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUConvolutionDepthwise.cpp.o
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 39%] Built target MNNMath
[ 39%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUCropAndResize.cpp.o
[ 39%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUDeconvolution.cpp.o
[ 40%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUDeconvolutionDepthwise.cpp.o
[ 40%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUDepthwiseConvInt8.cpp.o
[ 41%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/MNNPackedMatMulRemainFP16.S.o
[ 41%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUDequantize.cpp.o
[ 41%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/MNNQuantizeFP16_UNIT4.S.o
[ 41%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/MNNUnpackC8FP16.S.o
[ 41%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/low_memory/MNNAbsMaxFP16.S.o
[ 42%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/low_memory/MNNCountMinMax_ARM82.S.o
[ 42%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/low_memory/MNNDynamicQuanInput_ARM82.S.o
[ 42%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/low_memory/MNNDynamicQuantAndReorder_ARM82.S.o
[ 42%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/low_memory/MNNDynamicQuantFP16.S.o
[ 42%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/low_memory/MNNGemmInt8AddBiasScale_ARMV82_Unit_FP16.S.o
[ 43%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/low_memory/MNNGemmInt8AddBiasScale_ARMV82_w4_Unit_FP16.S.o
[ 43%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/low_memory/MNNGemmInt8AddBiasScale_ARMV86_Unit_FP16.S.o
[ 43%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/low_memory/MNNGemmInt8AddBiasScale_ARMV86_w4_Unit_FP16.S.o
[ 43%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/low_memory/MNNQuantScaleFP16.S.o
[ 44%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/low_memory/MNNQuantSumFP16.S.o
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 44%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/normal_memory/MNNPackedMatMulFP16_int4.S.o
[ 44%] Built target MNNARM64
[ 44%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/normal_memory/MNNPackedMatMulFP16_int8.S.o
[ 44%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryCumSum.cpp.o
[ 44%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/normal_memory/MNNPackedMatMulRemainFP16_int4.S.o
[ 44%] Building ASM object CMakeFiles/MNN_Arm82.dir/source/backend/arm82/asm/arm64/normal_memory/MNNPackedMatMulRemainFP16_int8.S.o
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 44%] Built target MNN_Arm82
[ 44%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUDet.cpp.o
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 44%] Built target MNNUtils
[ 45%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryDepthToSpace.cpp.o
[ 45%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryDet.cpp.o
[ 46%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUDetectionOutput.cpp.o
[ 46%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUDetectionPostProcess.cpp.o
[ 46%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryDilation2D.cpp.o
[ 46%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUDynamicQuant.cpp.o
[ 46%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUEltwise.cpp.o
[ 46%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUEltwiseInt8.cpp.o
[ 46%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryELU.cpp.o
[ 46%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryFill.cpp.o
[ 47%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryGather.cpp.o
[ 47%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryImageOp.cpp.o
[ 47%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryInnerProduct.cpp.o
[ 48%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUExternalConst.cpp.o
[ 48%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUFloatToInt8.cpp.o
[ 48%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUGridSample.cpp.o
[ 48%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUHistogram.cpp.o
[ 48%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryLRN.cpp.o
[ 49%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryLSTM.cpp.o
[ 49%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryLayernorm.cpp.o
[ 49%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryOPRegister.cpp.o
[ 49%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryPermute.cpp.o
[ 49%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUImageProcess.cpp.o
[ 49%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryPoolGrad.cpp.o
[ 50%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryPooling3D.cpp.o
[ 51%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUInstanceNorm.cpp.o
[ 51%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryReduce.cpp.o
[ 51%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryReshape.cpp.o
[ 51%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUInt8ToFloat.cpp.o
[ 51%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUInterp.cpp.o
[ 51%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryReverseSequence.cpp.o
[ 52%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryScatter.cpp.o
[ 52%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometrySelect.cpp.o
[ 52%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryShape.cpp.o
[ 52%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometrySlice.cpp.o
[ 52%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUInterp3D.cpp.o
[ 52%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometrySpaceToBatchND.cpp.o
[ 53%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometrySpatialProduct.cpp.o
[ 53%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryStridedSlice.cpp.o
[ 54%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPULayerNorm.cpp.o
[ 54%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPULinSpace.cpp.o
[ 54%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUMatMul.cpp.o
[ 54%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUMatrixBandPart.cpp.o
[ 54%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryTensorArray.cpp.o
[ 54%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryThreshold.cpp.o
[ 54%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryTile.cpp.o
[ 55%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryTopK.cpp.o
[ 55%] Building CXX object CMakeFiles/MNNTransform.dir/source/geometry/GeometryUnary.cpp.o
[ 55%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeArgMax.cpp.o
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 55%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUMoments.cpp.o
[ 55%] Built target MNNCore
[ 56%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUNonMaxSuppressionV2.cpp.o
[ 56%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUOPRegister.cpp.o
[ 56%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeAttention.cpp.o
[ 56%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUOneHot.cpp.o
[ 57%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeBatchToSpaceND.cpp.o
[ 57%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUPlugin.cpp.o
[ 58%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUPool.cpp.o
[ 58%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeBinaryOp.cpp.o
[ 58%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeBroadcastTo.cpp.o
[ 58%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUPoolInt8.cpp.o
[ 58%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUProposal.cpp.o
[ 58%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeCast.cpp.o
[ 58%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeConcat.cpp.o
[ 58%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUQuanConvolutionDepthwise.cpp.o
[ 58%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUQuantizedAdd.cpp.o
[ 59%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUQuantizedAvgPool.cpp.o
[ 59%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUQuantizedLogistic.cpp.o
[ 59%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUQuantizedMaxPool.cpp.o
[ 60%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeConvTranspose3D.cpp.o
[ 60%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeConvolution.cpp.o
[ 60%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeConvolution3D.cpp.o
[ 60%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeCosineSimilarity.cpp.o
[ 60%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUQuantizedSoftmax.cpp.o
[ 61%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPURNNSequenceGRU.cpp.o
[ 62%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeCrop.cpp.o
[ 62%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUROIAlign.cpp.o
[ 62%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUROIPooling.cpp.o
[ 62%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeCropAndResize.cpp.o
[ 62%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeDeconvolution.cpp.o
[ 62%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPURandomUniform.cpp.o
[ 62%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPURange.cpp.o
[ 62%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeDepthToSpace.cpp.o
[ 63%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPURaster.cpp.o
[ 63%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUReduction.cpp.o
[ 63%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPURelu.cpp.o
[ 63%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUResize.cpp.o
[ 63%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeDequantize.cpp.o
[ 64%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUResizeCache.cpp.o
[ 64%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPURuntime.cpp.o
[ 65%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeDet.cpp.o
/root/Qwen2-VL-7B-Instruct-MNN/MNN/source/backend/cpu/CPURuntime.cpp:85:0: 警告：“__NCPUBITS”重定义
 #define __NCPUBITS (8 * sizeof(unsigned long))
 
In file included from /usr/include/sched.h:44:0,
                 from /usr/include/pthread.h:23,
                 from /usr/include/c++/7.3.0/aarch64-linux-gnu/bits/gthr-default.h:35,
                 from /usr/include/c++/7.3.0/aarch64-linux-gnu/bits/gthr.h:148,
                 from /usr/include/c++/7.3.0/ext/atomicity.h:35,
                 from /usr/include/c++/7.3.0/bits/basic_string.h:39,
                 from /usr/include/c++/7.3.0/string:52,
                 from /root/Qwen2-VL-7B-Instruct-MNN/MNN/source/backend/cpu/CPURuntime.cpp:35:
/usr/include/bits/cpu-set.h:29:0: 附注：这是先前定义的位置
 #define __NCPUBITS (8 * sizeof (__cpu_mask))
 
[ 65%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUScale.cpp.o
[ 65%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeDetectionOutput.cpp.o
[ 65%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeDetectionPostProcess.cpp.o
[ 65%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeDynamicQuant.cpp.o
[ 66%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeExpandDims.cpp.o
[ 66%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeFill.cpp.o
[ 66%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUScaleInt8.cpp.o
[ 66%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUSegmentMean.cpp.o
[ 66%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeGatherND.cpp.o
[ 66%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeGatherV2.cpp.o
[ 66%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeGridSample.cpp.o
[ 67%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeHistogram.cpp.o
[ 67%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeInnerProduct.cpp.o
[ 68%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUSelect.cpp.o
[ 68%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeInterp.cpp.o
[ 68%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUSetDiff1D.cpp.o
[ 68%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUSoftmax.cpp.o
[ 69%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUSvd.cpp.o
[ 69%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUTFQuantizedConv2D.cpp.o
[ 69%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeLSTM.cpp.o
[ 70%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeLinSpace.cpp.o
[ 70%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeMatMul.cpp.o
[ 70%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUTensorConvert.cpp.o
[ 70%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUTopKV2.cpp.o
[ 70%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeMoments.cpp.o
[ 70%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUUnary.cpp.o
[ 70%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUUnique.cpp.o
[ 70%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeNonMaxSuppressionV2.cpp.o
[ 70%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeOneHot.cpp.o
[ 71%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapePack.cpp.o
[ 72%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUUnravelIndex.cpp.o
[ 72%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapePadding.cpp.o
[ 72%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/CPUWhere.cpp.o
[ 72%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapePermute.cpp.o
[ 72%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapePlugin.cpp.o
[ 72%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/KVCacheManager.cpp.o
[ 72%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/OneDNNConvInt8.cpp.o
[ 72%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/OneDNNConvolution.cpp.o
[ 73%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/ThreadPool.cpp.o
[ 73%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapePool.cpp.o
[ 73%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/CommonOptFunction.cpp.o
[ 73%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ConvInt8TiledExecutor.cpp.o
[ 73%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ConvInt8Winograd.cpp.o
[ 74%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ConvOpt.cpp.o
[ 74%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/Convolution1x1Strassen.cpp.o
[ 75%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapePool3D.cpp.o
[ 75%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ConvolutionFloatFactory.cpp.o
[ 75%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapePriorbox.cpp.o
[ 75%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeProposal.cpp.o
[ 75%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ConvolutionGroup.cpp.o
[ 75%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ConvolutionIntFactory.cpp.o
[ 76%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ConvolutionPackFreeWinograd.cpp.o
[ 76%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ConvolutionPackWinograd.cpp.o
[ 76%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeQuantizedAvgPool.cpp.o
[ 77%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeQuantizedMaxPool.cpp.o
[ 77%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeRNNSequenceGRU.cpp.o
[ 77%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeROIAlign.cpp.o
[ 77%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ConvolutionTiledExecutor.cpp.o
[ 77%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeROIPooling.cpp.o
[ 77%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeRandomUniform.cpp.o
[ 77%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ConvolutionWinogradBridge.cpp.o
[ 78%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeRange.cpp.o
[ 79%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ConvolutionWinogradImpl.cpp.o
[ 79%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeReduction.cpp.o
[ 79%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeRegister.cpp.o
[ 79%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeReshape.cpp.o
[ 79%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/DeconvolutionWithStride.cpp.o
[ 80%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeResize.cpp.o
[ 80%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeScatterNd.cpp.o
[ 80%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeSegmentMean.cpp.o
[ 80%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/DenseConvolutionTiledExecutor.cpp.o
[ 80%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/GemmInt8Executor.cpp.o
[ 80%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeSelect.cpp.o
[ 80%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/IdstConvolutionInt8.cpp.o
[ 81%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ImageProcessFunction.cpp.o
[ 81%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/Int8FunctionsOpt.cpp.o
[ 81%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/OptimizedComputer.cpp.o
[ 81%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeSetDiff1D.cpp.o
[ 82%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeShape.cpp.o
[ 82%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeSize.cpp.o
[ 82%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/ResizeFunction.cpp.o
[ 83%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/SparseConvInt8TiledExecutor.cpp.o
[ 83%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/SparseConvolutionTiledExecutor.cpp.o
[ 83%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeSlice.cpp.o
[ 83%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/StrassenMatmulComputor.cpp.o
[ 83%] Building CXX object CMakeFiles/MNNCPU.dir/source/backend/cpu/compute/WinogradOptFunction.cpp.o
[ 83%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeSliceTf.cpp.o
[ 84%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeSpaceToBatchND.cpp.o
[ 84%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeSpaceToDepth.cpp.o
[ 84%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeSplitGelu.cpp.o
[ 84%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeSqueeze.cpp.o
[ 84%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeStridedSlice.cpp.o
[ 85%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeSvd.cpp.o
[ 85%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeTensorArray.cpp.o
[ 85%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeTensorConvert.cpp.o
[ 85%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeTile.cpp.o
[ 86%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeTopKV2.cpp.o
[ 86%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeTranspose.cpp.o
[ 86%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeUnique.cpp.o
[ 86%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeUnpack.cpp.o
[ 86%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeUnravelIndex.cpp.o
[ 87%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/ShapeWhere.cpp.o
[ 87%] Building CXX object CMakeFiles/MNNTransform.dir/source/shape/SizeComputer.cpp.o
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 87%] Built target MNNTransform
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 87%] Built target MNNCPU
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
Scanning dependencies of target MNN
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 87%] Building CXX object CMakeFiles/MNN.dir/cmake/dummy.cpp.o
[ 87%] Linking CXX shared library libMNN.so
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 87%] Built target MNN
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
Scanning dependencies of target MNN_Express
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 88%] Building CXX object express/CMakeFiles/MNN_Express.dir/MathOp.cpp.o
[ 88%] Building CXX object express/CMakeFiles/MNN_Express.dir/Expr.cpp.o
[ 88%] Building CXX object express/CMakeFiles/MNN_Express.dir/ExecutorScope.cpp.o
[ 88%] Building CXX object express/CMakeFiles/MNN_Express.dir/Executor.cpp.o
[ 89%] Building CXX object express/CMakeFiles/MNN_Express.dir/Optimizer.cpp.o
[ 89%] Building CXX object express/CMakeFiles/MNN_Express.dir/module/IfModule.cpp.o
[ 89%] Building CXX object express/CMakeFiles/MNN_Express.dir/Utils.cpp.o
[ 89%] Building CXX object express/CMakeFiles/MNN_Express.dir/NeuralNetWorkOp.cpp.o
[ 89%] Building CXX object express/CMakeFiles/MNN_Express.dir/module/WhileModule.cpp.o
[ 89%] Building CXX object express/CMakeFiles/MNN_Express.dir/module/PipelineModule.cpp.o
[ 90%] Building CXX object express/CMakeFiles/MNN_Express.dir/module/StaticModule.cpp.o
[ 90%] Building CXX object express/CMakeFiles/MNN_Express.dir/module/Module.cpp.o
[ 90%] Building CXX object express/CMakeFiles/MNN_Express.dir/module/NMSModule.cpp.o
[ 90%] Linking CXX shared library libMNN_Express.so
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 90%] Built target MNN_Express
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
Scanning dependencies of target winogradExample.out
Scanning dependencies of target timeProfile.out
Scanning dependencies of target checkInvalidValue.out
Scanning dependencies of target backendTest.out
Scanning dependencies of target testModel.out
Scanning dependencies of target testModelWithDescribe.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
Scanning dependencies of target getPerformance.out
Scanning dependencies of target llm
Scanning dependencies of target testTrain.out
Scanning dependencies of target fuseTest
Scanning dependencies of target ModuleBasic.out
Scanning dependencies of target SequenceModuleTest.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
Scanning dependencies of target testModel_expr.out
Scanning dependencies of target MNNV2Basic.out
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
Scanning dependencies of target GetMNNInfo
Scanning dependencies of target mobilenetTest.out
Scanning dependencies of target mergeInplaceForCPU
Scanning dependencies of target modelCompare.out
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 90%] Building CXX object CMakeFiles/checkInvalidValue.out.dir/tools/cpp/checkInvalidValue.cpp.o
[ 90%] Building CXX object CMakeFiles/winogradExample.out.dir/tools/cpp/winogradExample.cpp.o
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 90%] Building CXX object CMakeFiles/getPerformance.out.dir/tools/cpp/getPerformance.cpp.o
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 91%] Building CXX object CMakeFiles/testModel_expr.out.dir/tools/cpp/testModel_expr.cpp.o
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 91%] Building CXX object CMakeFiles/testTrain.out.dir/tools/cpp/testTrain.cpp.o
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 91%] Building CXX object CMakeFiles/mobilenetTest.out.dir/tools/cpp/mobilenetTest.cpp.o
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 92%] Building CXX object CMakeFiles/testModel.out.dir/tools/cpp/testModel.cpp.o
[ 93%] Building CXX object CMakeFiles/timeProfile.out.dir/tools/cpp/timeProfile.cpp.o
[ 93%] Building CXX object CMakeFiles/timeProfile.out.dir/tools/cpp/revertMNNModel.cpp.o
[ 93%] Building CXX object CMakeFiles/timeProfile.out.dir/tools/cpp/Profiler.cpp.o
[ 93%] Building CXX object CMakeFiles/llm.dir/transformers/llm/engine/src/llm.cpp.o
[ 93%] Building CXX object CMakeFiles/testModelWithDescribe.out.dir/tools/cpp/testModelWithDescribe.cpp.o
[ 93%] Building CXX object CMakeFiles/llm.dir/transformers/llm/engine/src/tokenizer.cpp.o
[ 93%] Building CXX object CMakeFiles/mergeInplaceForCPU.dir/tools/cpp/mergeInplaceForCPU.cpp.o
[ 93%] Building CXX object CMakeFiles/GetMNNInfo.dir/tools/cpp/GetMNNInfo.cpp.o
[ 94%] Building CXX object CMakeFiles/MNNV2Basic.out.dir/tools/cpp/MNNV2Basic.cpp.o
[ 95%] Building CXX object CMakeFiles/modelCompare.out.dir/tools/cpp/modelCompare.cpp.o
[ 95%] Building CXX object CMakeFiles/fuseTest.dir/tools/cpp/fuseTest.cpp.o
[ 95%] Building CXX object CMakeFiles/SequenceModuleTest.out.dir/tools/cpp/SequenceModuleTest.cpp.o
[ 96%] Building CXX object CMakeFiles/ModuleBasic.out.dir/tools/cpp/ModuleBasic.cpp.o
[ 96%] Building CXX object CMakeFiles/backendTest.out.dir/tools/cpp/backendTest.cpp.o
[ 97%] Linking CXX executable winogradExample.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target winogradExample.out
[ 97%] Linking CXX executable checkInvalidValue.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target checkInvalidValue.out
[ 97%] Linking CXX executable getPerformance.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target getPerformance.out
[ 97%] Linking CXX executable testModel_expr.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target testModel_expr.out
[ 97%] Linking CXX executable testModel.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target testModel.out
[ 97%] Linking CXX executable testTrain.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target testTrain.out
[ 97%] Linking CXX executable GetMNNInfo
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target GetMNNInfo
[ 97%] Linking CXX executable modelCompare.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target modelCompare.out
[ 97%] Linking CXX executable testModelWithDescribe.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target testModelWithDescribe.out
[ 97%] Linking CXX executable MNNV2Basic.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target MNNV2Basic.out
[ 97%] Linking CXX executable SequenceModuleTest.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target SequenceModuleTest.out
[ 97%] Linking CXX executable backendTest.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target backendTest.out
[ 97%] Linking CXX executable ModuleBasic.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target ModuleBasic.out
[ 97%] Linking CXX executable mobilenetTest.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 97%] Built target mobilenetTest.out
[ 98%] Linking CXX executable fuseTest
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 98%] Built target fuseTest
[ 99%] Linking CXX shared library libllm.so
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 99%] Built target llm
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
Scanning dependencies of target llm_demo
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
make[2]: 进入目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[ 99%] Building CXX object CMakeFiles/llm_demo.dir/transformers/llm/engine/llm_demo.cpp.o
[ 99%] Linking CXX executable llm_demo
[100%] Linking CXX executable mergeInplaceForCPU
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[100%] Built target llm_demo
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[100%] Built target mergeInplaceForCPU
[100%] Linking CXX executable timeProfile.out
make[2]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”
[100%] Built target timeProfile.out
make[1]: 离开目录“/root/Qwen2-VL-7B-Instruct-MNN/MNN/build”

运行命令：

./llm_demo /root/Qwen2-VL-7B-Instruct-MNN/Qwen2.5-0.5B-Instruct-MNN/llm.mnn

运行日志

CPU Group: [ 48  49  50  51  52  53  54  55  56  57  58  59  60  61  62  63  64  65  66  67  68  69  70  71  72  73  74  75  76  77  78  79  80  81  82  83  84  85  86  87  88  89  90  91  92  93  94  95  24  25  26  27  28  29  30  31  32  33  34  35  36  37  38  39  40  41  42  43  44  45  46  47  0  1  2  3  4  5  6  7  8  9  10  11  12  13  14  15  16  17  18  19  20  21  22  23 ], 200000 - 2600000
The device supports: i8sdot:1, fp16:1, i8mm: 1, sve2: 0
config path is /root/Qwen2-VL-7B-Instruct-MNN/Qwen2.5-0.5B-Instruct-MNN/llm.mnn
Can't open file:.tempcache
Load Cache file error.
### is_single_ = 1
load tokenizer
tokenizer_type = 3
load tokenizer Done
load /root/Qwen2-VL-7B-Instruct-MNN/Qwen2.5-0.5B-Instruct-MNN/llm.mnn ... Load Module Done!
Clone Decode Module Done!
main, 180, cost time: 2076.145996 ms
Prepare for resize opt Begin
非法指令 (核心已转储)
@jxt1234
Copy link
Collaborator

jxt1234 commented Nov 28, 2024

修改 config.json ，把 precision 设成 normal ，memory 设成low 试下

@jxt1234 jxt1234 added the bug Something isn't working label Nov 28, 2024
@Joker15LSN
Copy link
Author

修改 config.json ，把 precision 设成 normal ，memory 设成low 试下

不行，还是同样的错误

[root@localhost build]# cat /root/Qwen2-VL-7B-Instruct-MNN/Qwen2.5-0.5B-Instruct-MNN/config.json
{
    "llm_model": "llm.mnn",
    "llm_weight": "llm.mnn.weight",
    "backend_type": "cpu",
    "thread_num": 4,
    "precision": "normal",
    "memory": "low"

@jxt1234
Copy link
Collaborator

jxt1234 commented Dec 2, 2024

呃，有 crash 堆栈么? 一开始的 The device supports: 打印是什么？

@jxt1234
Copy link
Collaborator

jxt1234 commented Dec 3, 2024

先更新到 3.0.1 试试，有可能是 prepare 的 bug

@Joker15LSN
Copy link
Author

先更新到 3.0.1 试试，有可能是 prepare 的 bug

emmmmm不太行，已经更新了

-- MNN BUILD INFO:
--      System: Linux
--      Processor: aarch64
--      Version: 3.0.1
--      Metal: OFF
--      OpenCL: OFF
--      OpenGL: OFF
--      Vulkan: OFF
--      ARM82: ON
--      KleidiAI: OFF
--      oneDNN: OFF
--      TensorRT: OFF
--      CoreML: OFF
--      NNAPI: OFF
--      CUDA: OFF
--      OpenMP: OFF
--      BF16: OFF
--      ThreadPool: ON
--      Hidden: TRUE
--      Build Path: /root/Qwen2-VL-7B-Instruct-MNN/MNN-3.0.1/build
--      CUDA PROFILE: OFF

device supports 打印内容：

CPU Group: [ 48  49  50  51  52  53  54  55  56  57  58  59  60  61  62  63  64  65  66  67  68  69  70  71  72  73  74  75  76  77  78  79  80  81  82  83  84  85  86  87  88  89  90  91  92  93  94  95  24  25  26  27  28  29  30  31  32  33  34  35  36  37  38  39  40  41  42  43  44  45  46  47  0  1  2  3  4  5  6  7  8  9  10  11  12  13  14  15  16  17  18  19  20  21  22  23 ], 200000 - 2600000
The device supports: i8sdot:1, fp16:1, i8mm: 1, sve2: 0
config path is /root/Qwen2-VL-7B-Instruct-MNN/Qwen2.5-0.5B-Instruct-MNN/config.json
Can't open file:.tempcache
Load Cache file error.
### is_single_ = 1
load tokenizer
tokenizer_type = 3
load tokenizer Done
load /root/Qwen2-VL-7B-Instruct-MNN/Qwen2.5-0.5B-Instruct-MNN/llm.mnn ... Load Module Done!
Clone Decode Module Done!
main, 180, cost time: 2073.359131 ms
Prepare for resize opt Begin
非法指令 (核心已转储)

@jxt1234
Copy link
Collaborator

jxt1234 commented Dec 19, 2024

可能是 cpu feature 计算结果有问题。系统的 aux 判断不准，可以手动修改 source/backend/cpu/CPURuntime.cpp 末尾，把 i8mm / dot 设成 false 试试

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jxt1234 @Joker15LSN