-
|
hi, i have built latest master bde188d cmake -S . -B build -DGGML_RPC=ON -DLLAMA_SANITIZE_ADDRESS=ON
cmake --build build --config Release -j$(nproc)after i try to run llama-server or llama-cli i get: GGML_RPC_DEBUG=1 llama.cpp/build/bin/llama-cli -m /mnt/models/gpt-oss/Qwen3-Coder-30B-A3B-Instruct-UD-Q6_K_XL.gguf --rpc 127.0.0.1:50052[~socket_t] closing socket 3
AddressSanitizer:DEADLYSIGNAL
=================================================================
==21378==ERROR: AddressSanitizer: SEGV on unknown address 0x000000000000 (pc 0x7142d8bc2540 bp 0x7ffccfdcb7a0 sp 0x7ffccfdcb6c0 T0)
==21378==The signal is caused by a READ memory access.
==21378==Hint: address points to the zero page.
#0 0x7142d8bc2540 in send_rpc_cmd(std::shared_ptr<socket_t> const&, rpc_cmd, void const*, unsigned long) (/home/miro/gpt-oss/rpc/llama.cpp/build/bin/libggml-rpc.so.0+0x10540) (BuildId: 9e2ed7196a4d977e0c95ee9467ab0e2b1db61cd1)
#1 0x7142d8bd70e3 in ggml_backend_rpc_add_server (/home/miro/gpt-oss/rpc/llama.cpp/build/bin/libggml-rpc.so.0+0x250e3) (BuildId: 9e2ed7196a4d977e0c95ee9467ab0e2b1db61cd1)
#2 0x654f04de10a1 in common_params_parser_init(common_params&, llama_example, void (*)(int, char**))::{lambda(common_params&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)#62}::_FUN(common_params&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) (/home/miro/gpt-oss/rpc/llama.cpp/build/bin/llama-cli+0x1690a1) (BuildId: 813012a47dc35f0c513dc7f97340300cc3667f80)
#3 0x654f04df6f46 in common_params_parse_ex(int, char**, common_params_context&) (/home/miro/gpt-oss/rpc/llama.cpp/build/bin/llama-cli+0x17ef46) (BuildId: 813012a47dc35f0c513dc7f97340300cc3667f80)
#4 0x654f04e6359f in common_params_parse(int, char**, common_params&, llama_example, void (*)(int, char**)) (/home/miro/gpt-oss/rpc/llama.cpp/build/bin/llama-cli+0x1eb59f) (BuildId: 813012a47dc35f0c513dc7f97340300cc3667f80)
#5 0x654f04d90dfd in main (/home/miro/gpt-oss/rpc/llama.cpp/build/bin/llama-cli+0x118dfd) (BuildId: 813012a47dc35f0c513dc7f97340300cc3667f80)
#6 0x7142d742a1c9 in __libc_start_call_main ../sysdeps/nptl/libc_start_call_main.h:58
#7 0x7142d742a28a in __libc_start_main_impl ../csu/libc-start.c:360
#8 0x654f04da3494 in _start (/home/miro/gpt-oss/rpc/llama.cpp/build/bin/llama-cli+0x12b494) (BuildId: 813012a47dc35f0c513dc7f97340300cc3667f80)
AddressSanitizer can not provide additional info.
SUMMARY: AddressSanitizer: SEGV (/home/miro/gpt-oss/rpc/llama.cpp/build/bin/libggml-rpc.so.0+0x10540) (BuildId: 9e2ed7196a4d977e0c95ee9467ab0e2b1db61cd1) in send_rpc_cmd(std::shared_ptr<socket_t> const&, rpc_cmd, void const*, unsigned long)
==21378==ABORTINGwhen i run command without rpc param, it will happily start cli or server rpc-server waits runnong for connections: [+] Running 1/1
✔ Container gptossrpc Recreated 0.0s
Attaching to gptossrpc
gptossrpc | ✅ Using existing llama.cpp build
gptossrpc | 🚀 Starting rpc-server on port 50052...
gptossrpc | ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no
gptossrpc | ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
gptossrpc | ggml_cuda_init: found 1 ROCm devices:
gptossrpc | Device 0: AMD Radeon 780M, gfx1100 (0x1100), VMM: no, Wave Size: 32
gptossrpc | ggml_backend_cuda_get_available_uma_memory: final available_memory_kb: 92093936when building with GGML_RPC=ON i got a lot of repeating warnings: In constructor ‘std::function<_Res(_ArgTypes ...)>::function(std::function<_Res(_ArgTypes ...)>&&) [with _Res = bool; _ArgTypes = {char}]’,
inlined from ‘std::__detail::_State<_Char_type>::_State(std::__detail::_State<_Char_type>&&) [with _Char_type = char]’ at /usr/include/c++/13/bits/regex_automaton.h:149:4,
inlined from ‘std::__detail::_State<_Char_type>::_State(std::__detail::_State<_Char_type>&&) [with _Char_type = char]’ at /usr/include/c++/13/bits/regex_automaton.h:146:7,
inlined from ‘std::__detail::_StateIdT std::__detail::_NFA<_TraitsT>::_M_insert_alt(std::__detail::_StateIdT, std::__detail::_StateIdT, bool) [with _TraitsT = std::__cxx11::regex_traits<char>]’ at /usr/include/c++/13/bits/regex_automaton.h:251:24,
inlined from ‘void std::__detail::_Compiler<_TraitsT>::_M_disjunction() [with _TraitsT = std::__cxx11::regex_traits<char>]’ at /usr/include/c++/13/bits/regex_compiler.tcc:103:18:
/usr/include/c++/13/bits/std_function.h:405:42: warning: ‘*(std::function<bool(char)>*)((char*)&__tmp + offsetof(std::__detail::_StateT, std::__detail::_State<char>::<unnamed>.std::__detail::_State_base::<unnamed>)).std::function<bool(char)>::_M_invoker’ may be used uninitialized [-Wmaybe-uninitialized]
405 | : _Function_base(), _M_invoker(__x._M_invoker)
| ~~~~^~~~~~~~~~
/usr/include/c++/13/bits/regex_automaton.h: In member function ‘void std::__detail::_Compiler<_TraitsT>::_M_disjunction() [with _TraitsT = std::__cxx11::regex_traits<char>]’:
/usr/include/c++/13/bits/regex_automaton.h:246:17: note: ‘__tmp’ declared here
246 | _StateT __tmp(_S_opcode_alternative);
| ^~~~~
In member function ‘bool std::_Function_base::_M_empty() const’,
inlined from ‘std::function<_Res(_ArgTypes ...)>::operator bool() const [with _Res = bool; _ArgTypes = {char}]’ at /usr/include/c++/13/bits/std_function.h:574:25,
inlined from ‘std::function<_Res(_ArgTypes ...)>::function(std::function<_Res(_ArgTypes ...)>&&) [with _Res = bool; _ArgTypes = {char}]’ at /usr/include/c++/13/bits/std_function.h:407:6,
inlined from ‘std::__detail::_State<_Char_type>::_State(std::__detail::_State<_Char_type>&&) [with _Char_type = char]’ at /usr/include/c++/13/bits/regex_automaton.h:149:4,
inlined from ‘std::__detail::_State<_Char_type>::_State(std::__detail::_State<_Char_type>&&) [with _Char_type = char]’ at /usr/include/c++/13/bits/regex_automaton.h:146:7,
inlined from ‘std::__detail::_StateIdT std::__detail::_NFA<_TraitsT>::_M_insert_alt(std::__detail::_StateIdT, std::__detail::_StateIdT, bool) [with _TraitsT = std::__cxx11::regex_traits<char>]’ at /usr/include/c++/13/bits/regex_automaton.h:251:24,
inlined from ‘void std::__detail::_Compiler<_TraitsT>::_M_disjunction() [with _TraitsT = std::__cxx11::regex_traits<char>]’ at /usr/include/c++/13/bits/regex_compiler.tcc:103:18:
/usr/include/c++/13/bits/std_function.h:247:37: warning: ‘*(const std::_Function_base*)((char*)&__tmp + offsetof(std::__detail::_StateT, std::__detail::_State<char>::<unnamed>.std::__detail::_State_base::<unnamed>)).std::_Function_base::_M_manager’ may be used uninitialized [-Wmaybe-uninitialized]
247 | bool _M_empty() const { return !_M_manager; }
| ^~~~~~~~~~
/usr/include/c++/13/bits/regex_automaton.h: In member function ‘void std::__detail::_Compiler<_TraitsT>::_M_disjunction() [with _TraitsT = std::__cxx11::regex_traits<char>]’:
/usr/include/c++/13/bits/regex_automaton.h:246:17: note: ‘__tmp’ declared here
246 | _StateT __tmp(_S_opcode_alternative);
| ^~~~~
[ 43%] Building CXX object src/CMakeFiles/llama.dir/models/qwen3moe.cpp.o
In constructor ‘std::function<_Res(_ArgTypes ...)>::function(std::function<_Res(_ArgTypes ...)>&&) [with _Res = bool; _ArgTypes = {char}]’,
inlined from ‘std::__detail::_State<_Char_type>::_State(std::__detail::_State<_Char_type>&&) [with _Char_type = char]’ at /usr/include/c++/13/bits/regex_automaton.h:149:4,
inlined from ‘std::__detail::_State<_Char_type>::_State(std::__detail::_State<_Char_type>&&) [with _Char_type = char]’ at /usr/include/c++/13/bits/regex_automaton.h:146:7,
inlined from ‘std::__detail::_StateIdT std::__detail::_NFA<_TraitsT>::_M_insert_subexpr_begin() [with _TraitsT = std::__cxx11::regex_traits<char>]’ at /usr/include/c++/13/bits/regex_automaton.h:281:24,
inlined from ‘std::__detail::_Compiler<_TraitsT>::_Compiler(const _CharT*, const _CharT*, const typename _TraitsT::locale_type&, _FlagT) [with _TraitsT = std::__cxx11::regex_traits<char>]’ at /usr/include/c++/13/bits/regex_compiler.tcc:75:20:
/usr/include/c++/13/bits/std_function.h:405:42: warning: ‘*(std::function<bool(char)>*)((char*)&__tmp + offsetof(std::__detail::_StateT, std::__detail::_State<char>::<unnamed>.std::__detail::_State_base::<unnamed>)).std::function<bool(char)>::_M_invoker’ may be used uninitialized [-Wmaybe-uninitialized]
405 | : _Function_base(), _M_invoker(__x._M_invoker)
| ~~~~^~~~~~~~~~
/usr/include/c++/13/bits/regex_automaton.h: In constructor ‘std::__detail::_Compiler<_TraitsT>::_Compiler(const _CharT*, const _CharT*, const typename _TraitsT::locale_type&, _FlagT) [with _TraitsT = std::__cxx11::regex_traits<char>]’:
/usr/include/c++/13/bits/regex_automaton.h:279:17: note: ‘__tmp’ declared here
279 | _StateT __tmp(_S_opcode_subexpr_begin);
| ^~~~~
In member function ‘bool std::_Function_base::_M_empty() const’,
inlined from ‘std::function<_Res(_ArgTypes ...)>::operator bool() const [with _Res = bool; _ArgTypes = {char}]’ at /usr/include/c++/13/bits/std_function.h:574:25,
inlined from ‘std::function<_Res(_ArgTypes ...)>::function(std::function<_Res(_ArgTypes ...)>&&) [with _Res = bool; _ArgTypes = {char}]’ at /usr/include/c++/13/bits/std_function.h:407:6,
inlined from ‘std::__detail::_State<_Char_type>::_State(std::__detail::_State<_Char_type>&&) [with _Char_type = char]’ at /usr/include/c++/13/bits/regex_automaton.h:149:4,
inlined from ‘std::__detail::_State<_Char_type>::_State(std::__detail::_State<_Char_type>&&) [with _Char_type = char]’ at /usr/include/c++/13/bits/regex_automaton.h:146:7,
inlined from ‘std::__detail::_StateIdT std::__detail::_NFA<_TraitsT>::_M_insert_subexpr_begin() [with _TraitsT = std::__cxx11::regex_traits<char>]’ at /usr/include/c++/13/bits/regex_automaton.h:281:24,
inlined from ‘std::__detail::_Compiler<_TraitsT>::_Compiler(const _CharT*, const _CharT*, const typename _TraitsT::locale_type&, _FlagT) [with _TraitsT = std::__cxx11::regex_traits<char>]’ at /usr/include/c++/13/bits/regex_compiler.tcc:75:20:
/usr/include/c++/13/bits/std_function.h:247:37: warning: ‘*(const std::_Function_base*)((char*)&__tmp + offsetof(std::__detail::_StateT, std::__detail::_State<char>::<unnamed>.std::__detail::_State_base::<unnamed>)).std::_Function_base::_M_manager’ may be used uninitialized [-Wmaybe-uninitialized]
247 | bool _M_empty() const { return !_M_manager; }
| ^~~~~~~~~~
/usr/include/c++/13/bits/regex_automaton.h: In constructor ‘std::__detail::_Compiler<_TraitsT>::_Compiler(const _CharT*, const _CharT*, const typename _TraitsT::locale_type&, _FlagT) [with _TraitsT = std::__cxx11::regex_traits<char>]’:
/usr/include/c++/13/bits/regex_automaton.h:279:17: note: ‘__tmp’ declared here
279 | _StateT __tmp(_S_opcode_subexpr_begin);
| ^~~~~any ideas please? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
I figured it out if somebody is interested |
Beta Was this translation helpful? Give feedback.
I figured it out
I had misconfigured rpc-server
while 780M needs
AMDGPU_TARGETS="gfx1100"
HSA_OVERRIDE_GFX_VERSION=11.0.0
680M needs:
AMDGPU_TARGETS="gfx1032"
HSA_OVERRIDE_GFX_VERSION=10.3.0
if somebody is interested
gpt-oss 20b have results on mixed 780m + 680m device 13.6tps