Fedora client dumps core at startup

[valeriopaladino]

I am trying to launch the Fedora build of the gridcoinresearch GUI wallet, but it crashes every time.
This only happens after I synced the block chain up to block 1240984. If I delete the chain data the client starts correctly, but crashes again after syncing.

The dump happens after the log line "No neural network nodes online.Getting first project". The system log reports this trace:

#0  0x00007f137aec4f4b raise (libc.so.6)
#1  0x00007f137aeaf591 abort (libc.so.6)
#2  0x0000000000499b56 _ZSt20__replacement_assertPKciS0_S0_ (gridcoinresearch)
#3  0x000000000052f5e7 _ZN4CKey10SetPrivKeyERKSt6vectorIh16secure_allocatorIhEE (gridcoinresearch)
#4  0x0000000000691b70 _Z11SignMessageNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES4_ (gridcoinresearch)
#5  0x000000000069213b _Z17SignBlockWithCPIDRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES6_RS4_S7_b (gridcoinresearch)
#6  0x0000000000564afb _Z14GetNextProjectb (gridcoinresearch)
#7  0x0000000000566c90 _Z9LoadCPIDsv (gridcoinresearch)
#8  0x00000000005aaee1 _Z8AppInit2St10shared_ptrI13ThreadHandlerE (gridcoinresearch)
#9  0x00000000005ac130 _Z14ThreadAppInit2St10shared_ptrI13ThreadHandlerE (gridcoinresearch)
#10 0x00000000005225d0 _ZN5boost6detail11thread_dataINS_3_bi6bind_tIvPFvSt10shared_ptrI13ThreadHandlerEENS2_5list1INS2_5valueIS6_EEEEEEE3runEv (gridcoinresearch)
#11 0x00007f137d971961 thread_proxy (libboost_thread.so.1.66.0)
#12 0x00007f137d09c564 start_thread (libpthread.so.0)
#13 0x00007f137af8831f __clone (libc.so.6)

Which seems to point to this call: https://github.com/gridcoin/Gridcoin-Research/blob/375a78e6ac50c9615d76d12583ec8b78d0471bd0/src/rpcblockchain.cpp#L557

[tomasbrod]

More importantly: this happens in GetNextProject of thread AppInit2.
Todo: refactor that function.

[valeriopaladino]

Another note: I don't think I have published a beacon; I reached the necessary balance just before crashing.

[skjeggape]

I also have this.

Process 13061 (gridcoinresearc) of user 1000 dumped core.

Stack trace of thread 13090:
#0  0x00007f6000033f2b raise (libc.so.6)
#1  0x00007f600001e561 abort (libc.so.6)
#2  0x0000000000499b56 _ZSt20__replacement_assertPKciS0_S0_ (gridcoinresearch)
#3  0x000000000051ad7f _Z12DecodeBase64RKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE (gridcoinresearch)
#4  0x00000000006eac6e _Z23AdvancedDecryptWithSaltNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES4_ (gridcoinresearch)
#5  0x000000000054ebe2 _Z8AcidTestNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES4_P5CNode (gridcoinresearch)
#6  0x00000000005718f7 _ZL14ProcessMessageP5CNodeNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEER11CDataStreaml.isra.2621 (gridcoinresearch)
#7  0x0000000000577108 _Z15ProcessMessagesP5CNode (gridcoinresearch)
#8  0x00000000005b9628 _Z21ThreadMessageHandler2Pv (gridcoinresearch)
#9  0x00000000005b9830 _Z20ThreadMessageHandlerPv (gridcoinresearch)
#10 0x00007f6002ae0961 thread_proxy (libboost_thread.so.1.66.0)
#11 0x00007f600220b594 start_thread (libpthread.so.0)
#12 0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13063:
#0  0x00007f60000ec589 __poll (libc.so.6)
#1  0x00007f5ffae18be6 n/a (libglib-2.0.so.0)
#2  0x00007f5ffae18d10 g_main_context_iteration (libglib-2.0.so.0)
#3  0x00007f5fdd520e4d dconf_gdbus_worker_thread (libdconfsettings.so)
#4  0x00007f5ffae40f2a n/a (libglib-2.0.so.0)
#5  0x00007f600220b594 start_thread (libpthread.so.0)
#6  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13064:
#0  0x00007f60000ec589 __poll (libc.so.6)
#1  0x00007f5ffae18be6 n/a (libglib-2.0.so.0)
#2  0x00007f5ffae18d10 g_main_context_iteration (libglib-2.0.so.0)
#3  0x00007f5ffae18d61 n/a (libglib-2.0.so.0)
#4  0x00007f5ffae40f2a n/a (libglib-2.0.so.0)
#5  0x00007f600220b594 start_thread (libpthread.so.0)
#6  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13065:
#0  0x00007f60000ec589 __poll (libc.so.6)
#1  0x00007f5ffae18be6 n/a (libglib-2.0.so.0)
#2  0x00007f5ffae18fa2 g_main_loop_run (libglib-2.0.so.0)
#3  0x00007f5fdfd2f6ba n/a (libgio-2.0.so.0)
#4  0x00007f5ffae40f2a n/a (libglib-2.0.so.0)
#5  0x00007f600220b594 start_thread (libpthread.so.0)
#6  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13081:
#0  0x00007f600221187a pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
#1  0x00007f6002aec282 _ZN5boost18condition_variable13do_wait_untilERNS_11unique_lockINS_5mutexEEERK8timespec (libboost_thread.so.1.66.0)
#2  0x00007f6002ae125a _ZN5boost11this_thread6hidden9sleep_forERK8timespec (libboost_thread.so.1.66.0)
#3  0x00000000005194ec _Z10MilliSleepl (gridcoinresearch)
#4  0x00000000005d74d0 _Z19ThreadFlushWalletDBPv (gridcoinresearch)
#5  0x00007f6002ae0961 thread_proxy (libboost_thread.so.1.66.0)
#6  0x00007f600220b594 start_thread (libpthread.so.0)
#7  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13066:
#0  0x00007f60000ec589 __poll (libc.so.6)
#1  0x00007f5ffae18be6 n/a (libglib-2.0.so.0)
#2  0x00007f5ffae18d10 g_main_context_iteration (libglib-2.0.so.0)
#3  0x00007f6001244c13 _ZN20QEventDispatcherGlib13processEventsE6QFlagsIN10QEventLoop17ProcessEventsFlagEE (libQt5Core.so.5)
#4  0x00007f60011f312b _ZN10QEventLoop4execE6QFlagsINS_17ProcessEventsFlagEE (libQt5Core.so.5)
#5  0x00007f60010419c6 _ZN7QThread4execEv (libQt5Core.so.5)
#6  0x00007f600147b299 _ZN22QDBusConnectionManager3runEv (libQt5DBus.so.5)
#7  0x00007f600104611d _ZN14QThreadPrivate5startEPv (libQt5Core.so.5)
#8  0x00007f600220b594 start_thread (libpthread.so.0)
#9  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13069:
#0  0x00007f60000ec589 __poll (libc.so.6)
#1  0x00007f5ffae18be6 n/a (libglib-2.0.so.0)
#2  0x00007f5ffae18d10 g_main_context_iteration (libglib-2.0.so.0)
#3  0x00007f6001244c13 _ZN20QEventDispatcherGlib13processEventsE6QFlagsIN10QEventLoop17ProcessEventsFlagEE (libQt5Core.so.5)
#4  0x00007f60011f312b _ZN10QEventLoop4execE6QFlagsINS_17ProcessEventsFlagEE (libQt5Core.so.5)
#5  0x00007f60010419c6 _ZN7QThread4execEv (libQt5Core.so.5)
#6  0x00007f600104611d _ZN14QThreadPrivate5startEPv (libQt5Core.so.5)
#7  0x00007f600220b594 start_thread (libpthread.so.0)
#8  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13071:
#0  0x00007f60000ec589 __poll (libc.so.6)
#1  0x00007f5ffae18be6 n/a (libglib-2.0.so.0)
#2  0x00007f5ffae18d10 g_main_context_iteration (libglib-2.0.so.0)
#3  0x00007f6001244c13 _ZN20QEventDispatcherGlib13processEventsE6QFlagsIN10QEventLoop17ProcessEventsFlagEE (libQt5Core.so.5)
#4  0x00007f60011f312b _ZN10QEventLoop4execE6QFlagsINS_17ProcessEventsFlagEE (libQt5Core.so.5)
#5  0x00007f60010419c6 _ZN7QThread4execEv (libQt5Core.so.5)
#6  0x00007f600104611d _ZN14QThreadPrivate5startEPv (libQt5Core.so.5)
#7  0x00007f600220b594 start_thread (libpthread.so.0)
#8  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13092:
#0  0x00007f600221187a pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
#1  0x00007f6002aec282 _ZN5boost18condition_variable13do_wait_untilERNS_11unique_lockINS_5mutexEEERK8timespec (libboost_thread.so.1.66.0)
#2  0x00007f6002ae125a _ZN5boost11this_thread6hidden9sleep_forERK8timespec (libboost_thread.so.1.66.0)
#3  0x00000000005194ec _Z10MilliSleepl (gridcoinresearch)
#4  0x000000000059d5ef _Z10StakeMinerP7CWallet (gridcoinresearch)
#5  0x00000000005b75b0 _ZL16ThreadStakeMinerPv (gridcoinresearch)
#6  0x00007f6002ae0961 thread_proxy (libboost_thread.so.1.66.0)
#7  0x00007f600220b594 start_thread (libpthread.so.0)
#8  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13083:
#0  0x00007f60000f732f epoll_wait (libc.so.6)
#1  0x0000000000644c0b _ZN5boost4asio6detail13epoll_reactor3runElRNS1_8op_queueINS1_19scheduler_operationEEE (gridcoinresearch)
#2  0x0000000000645ae8 _ZN5boost4asio6detail9scheduler10do_run_oneERNS1_27conditionally_enabled_mutex11scoped_lockERNS1_21scheduler_thread_infoERKNS_6system10error_codeE (gridcoinresearch)
#3  0x000000000063a7d7 _Z16ThreadRPCServer2Pv (gridcoinresearch)
#4  0x000000000063aff0 _Z15ThreadRPCServerPv (gridcoinresearch)
#5  0x00007f6002ae0961 thread_proxy (libboost_thread.so.1.66.0)
#6  0x00007f600220b594 start_thread (libpthread.so.0)
#7  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13094:
#0  0x00007f600221187a pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
#1  0x00000000006fdb23 _ZN5boost12interprocess9ipcdetail15posix_condition10timed_waitINS1_19internal_mutex_lockINS0_11scoped_lockINS0_18interprocess_mutexEEEEEEEbRT_RKNS_10posix_time5ptimeE (gridcoinresearch)
#2  0x00000000006fde32 _ZN5boost12interprocess15message_queue_tINS0_10offset_ptrIvlmLm0EEEE10do_receiveENS4_7block_tEPvmRmRjRKNS_10posix_time5ptimeE (gridcoinresearch)
#3  0x00000000006fb18f _ZL10ipcThread2Pv (gridcoinresearch)
#4  0x00000000006fb370 _ZL9ipcThreadPv (gridcoinresearch)
#5  0x00007f6002ae0961 thread_proxy (libboost_thread.so.1.66.0)
#6  0x00007f600220b594 start_thread (libpthread.so.0)
#7  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13091:
#0  0x00007f600221187a pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
#1  0x00007f6002aec282 _ZN5boost18condition_variable13do_wait_untilERNS_11unique_lockINS_5mutexEEERK8timespec (libboost_thread.so.1.66.0)
#2  0x00007f6002ae125a _ZN5boost11this_thread6hidden9sleep_forERK8timespec (libboost_thread.so.1.66.0)
#3  0x00000000005194ec _Z10MilliSleepl (gridcoinresearch)
#4  0x00000000005bc517 _Z18ThreadDumpAddress2Pv (gridcoinresearch)
#5  0x00000000005bc570 _Z17ThreadDumpAddressPv (gridcoinresearch)
#6  0x00007f6002ae0961 thread_proxy (libboost_thread.so.1.66.0)
#7  0x00007f600220b594 start_thread (libpthread.so.0)
#8  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13068:
#0  0x00007f600221152c pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)
#1  0x00007f5fca80f6f3 n/a (nouveau_dri.so)
#2  0x00007f5fca80f40b n/a (nouveau_dri.so)
#3  0x00007f600220b594 start_thread (libpthread.so.0)
#4  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13088:
#0  0x00007f600221187a pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
#1  0x00007f6002aec282 _ZN5boost18condition_variable13do_wait_untilERNS_11unique_lockINS_5mutexEEERK8timespec (libboost_thread.so.1.66.0)
#2  0x00007f6002ae125a _ZN5boost11this_thread6hidden9sleep_forERK8timespec (libboost_thread.so.1.66.0)
#3  0x00000000005194ec _Z10MilliSleepl (gridcoinresearch)
#4  0x00000000005c02d4 _Z27ThreadOpenAddedConnections2Pv (gridcoinresearch)
#5  0x00000000005c0560 _Z26ThreadOpenAddedConnectionsPv (gridcoinresearch)
#6  0x00007f6002ae0961 thread_proxy (libboost_thread.so.1.66.0)
#7  0x00007f600220b594 start_thread (libpthread.so.0)
#8  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13062:
#0  0x00007f60000ec589 __poll (libc.so.6)
#1  0x00007f5ff727d04f _xcb_conn_wait (libxcb.so.1)
#2  0x00007f5ff727ecaa xcb_wait_for_event (libxcb.so.1)
#3  0x00007f5fe99f04d9 _ZN15QXcbEventReader3runEv (libQt5XcbQpa.so.5)
#4  0x00007f600104611d _ZN14QThreadPrivate5startEPv (libQt5Core.so.5)
#5  0x00007f600220b594 start_thread (libpthread.so.0)
#6  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13087:
#0  0x00007f600221187a pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
#1  0x00007f6002aec282 _ZN5boost18condition_variable13do_wait_untilERNS_11unique_lockINS_5mutexEEERK8timespec (libboost_thread.so.1.66.0)
#2  0x00007f6002ae125a _ZN5boost11this_thread6hidden9sleep_forERK8timespec (libboost_thread.so.1.66.0)
#3  0x00000000005194ec _Z10MilliSleepl (gridcoinresearch)
#4  0x00000000005c121a _Z20ThreadSocketHandler2Pv (gridcoinresearch)
#5  0x00000000005c1d00 _Z19ThreadSocketHandlerPv (gridcoinresearch)
#6  0x00007f6002ae0961 thread_proxy (libboost_thread.so.1.66.0)
#7  0x00007f600220b594 start_thread (libpthread.so.0)
#8  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13061:
#0  0x00007f60000ec589 __poll (libc.so.6)
#1  0x00007f5ffae18be6 n/a (libglib-2.0.so.0)
#2  0x00007f5ffae18d10 g_main_context_iteration (libglib-2.0.so.0)
#3  0x00007f6001244c13 _ZN20QEventDispatcherGlib13processEventsE6QFlagsIN10QEventLoop17ProcessEventsFlagEE (libQt5Core.so.5)
#4  0x00007f5fe9a7e065 _ZN22QPAEventDispatcherGlib13processEventsE6QFlagsIN10QEventLoop17ProcessEventsFlagEE (libQt5XcbQpa.so.5)
#5  0x00007f60011f312b _ZN10QEventLoop4execE6QFlagsINS_17ProcessEventsFlagEE (libQt5Core.so.5)
#6  0x00007f60011fb5b6 _ZN16QCoreApplication4execEv (libQt5Core.so.5)
#7  0x0000000000487bdf main (gridcoinresearch)
#8  0x00007f600002018b __libc_start_main (libc.so.6)
#9  0x000000000049250a _start (gridcoinresearch)

Stack trace of thread 13089:
#0  0x00007f60000ee967 __select (libc.so.6)
#1  0x000000000052be77 _ZL21ConnectSocketDirectlyRK8CServiceRji (gridcoinresearch)
#2  0x000000000052cc87 _Z13ConnectSocketRK8CServiceRji (gridcoinresearch)
#3  0x00000000005beb78 _Z11ConnectNode8CAddressPKc (gridcoinresearch)
#4  0x00000000005beda3 _Z21OpenNetworkConnectionRK8CAddressP15CSemaphoreGrantPKcb (gridcoinresearch)
#5  0x00000000005bf609 _Z22ThreadOpenConnections2Pv (gridcoinresearch)
#6  0x00000000005bfa60 _Z21ThreadOpenConnectionsPv (gridcoinresearch)
#7  0x00007f6002ae0961 thread_proxy (libboost_thread.so.1.66.0)
#8  0x00007f600220b594 start_thread (libpthread.so.0)
#9  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13070:
#0  0x00007f60000ec589 __poll (libc.so.6)
#1  0x00007f5ffae18be6 n/a (libglib-2.0.so.0)
#2  0x00007f5ffae18d10 g_main_context_iteration (libglib-2.0.so.0)
#3  0x00007f6001244c13 _ZN20QEventDispatcherGlib13processEventsE6QFlagsIN10QEventLoop17ProcessEventsFlagEE (libQt5Core.so.5)
#4  0x00007f60011f312b _ZN10QEventLoop4execE6QFlagsINS_17ProcessEventsFlagEE (libQt5Core.so.5)
#5  0x00007f60010419c6 _ZN7QThread4execEv (libQt5Core.so.5)
#6  0x00007f600104611d _ZN14QThreadPrivate5startEPv (libQt5Core.so.5)
#7  0x00007f600220b594 start_thread (libpthread.so.0)
#8  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13086:
#0  0x00007f600221187a pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
#1  0x00007f6002aec282 _ZN5boost18condition_variable13do_wait_untilERNS_11unique_lockINS_5mutexEEERK8timespec (libboost_thread.so.1.66.0)
#2  0x00007f6002ae125a _ZN5boost11this_thread6hidden9sleep_forERK8timespec (libboost_thread.so.1.66.0)
#3  0x00000000005194ec _Z10MilliSleepl (gridcoinresearch)
#4  0x00000000005bcace _Z14ThreadMapPort2Pv (gridcoinresearch)
#5  0x00000000005bcf00 _Z13ThreadMapPortPv (gridcoinresearch)
#6  0x00007f6002ae0961 thread_proxy (libboost_thread.so.1.66.0)
#7  0x00007f600220b594 start_thread (libpthread.so.0)
#8  0x00007f60000f700f __clone (libc.so.6)

Stack trace of thread 13073:
#0  0x00007f60000eec17 fdatasync (libc.so.6)
#1  0x00000000007547bd _ZN7leveldb12_GLOBAL__N_117PosixWritableFile4SyncEv (gridcoinresearch)
#2  0x000000000072dcd1 _ZN7leveldb6DBImpl26FinishCompactionOutputFileEPNS0_15CompactionStateEPNS_8IteratorE (gridcoinresearch)
#3  0x0000000000732fb3 _ZN7leveldb6DBImpl16DoCompactionWorkEPNS0_15CompactionStateE (gridcoinresearch)
#4  0x0000000000733805 _ZN7leveldb6DBImpl20BackgroundCompactionEv (gridcoinresearch)
#5  0x0000000000733e8a _ZN7leveldb6DBImpl14BackgroundCallEv (gridcoinresearch)
#6  0x0000000000752a9f _ZN7leveldb12_GLOBAL__N_18PosixEnv15BGThreadWrapperEPv (gridcoinresearch)
#7  0x00007f600220b594 start_thread (libpthread.so.0)
#8  0x00007f60000f700f __clone (libc.so.6)

[barton2526]

Do you have Boost 1.66 installed?

Our depends installation uses Boost 1.65.1. Perhaps that is the problem?

@TheCharlatan

[skjeggape]

I have reported too repository maintainer thath boost1.66 migth be the issue.
I migth get time to test for my self tomorrow.

[denravonska]

This looks similar to other decrypt issues fixed in the 3.7 series but I don't think it's a boost issue. Do you know on which block this happens?

[iFoggz]

it could be the decodebase code as it can seg fault if bad data is passed to it as mentioned along time ago by me

[tomasbrod]

Wasn't it fixed? I remember working on similar code before. Or it was the AcidTest thing.

[skjeggape]

Unfortantly I have been unable identify closer any block where it occurs, but i suspect it to be releated to recent changes inn fedora. Also theMarix repo on OBS fails to build on fedora. The opensuse works fine on boost 1.66 so its not boost, must be something els,e fedora agnistic wich breaks gridcoin for my part.

If any devs are intrested, throw med an e-mail and Ill try to help debug as instructed.

[denravonska]

I'm interested if it's still an issue. I remember reading some comments about Fedora issues (@shmoogle?) on Slack very recently so we might still have Fedora issues.

[skjeggape]

Fedora hav new repo maintainer and I hav no issues noe, except som minoriteter bug with missing items from gui, like the icon for locked/unlocked wallet Den tir. 8. jan. 2019, 19:14 skrev Marco Nilsson <notifications@github.com:

…

I'm interested if it's still an issue. I remember reading some comments about Fedora issues ***@***.*** <https://github.com/shmoogle>?) on Slack very recently so we might still have Fedora issues. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#1086 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ANQef6maGFdsIYfTwyFaO9Dx2s6HEwEBks5vBN_6gaJpZM4T3BF_> .

[jamescowens]

I think the icon issues are fixed in the dev branch with cleaned up qt resources. Given that and the report above, closing.