felskrone
daemon fails to forward events
On one of my masters the daemon stopped forwarding events, only the stat-worker kept running. After running it in a screen-session and observing the same behaviour again, stopped it with CTRL+C. It seemed to be stuck with creating and joining threads.
This needs investigating...
... [INFO ] Stats_data: {'events_hdl': 425637, 'threads_joined': 437620, 'threads_created': 442582, 'events_rec': 1169759, 'events_hdl_sec': 0.0, 'events_tot_sec': 0.0} [DEBUG ] Event-timer finished, calling reference [DEBUG ] Stat-timer finished, calling reference [INFO ] 442584# started [INFO ] 442584# Stat_Worker initiated [INFO ] Stats_data: {'events_hdl': 425637, 'threads_joined': 437620, 'threads_created': 442583, 'events_rec': 1169759, 'events_hdl_sec': 0.0, 'events_tot_sec': 0.0} [DEBUG ] Stat-timer finished, calling reference [INFO ] 442585# started [INFO ] 442585# Stat_Worker initiated [INFO ] Stats_data: {'events_hdl': 425637, 'threads_joined': 437620, 'threads_created': 442584, 'events_rec': 1169759, 'events_hdl_sec': 0.0, 'events_tot_sec': 0.0} [DEBUG ] Event-timer finished, calling reference [DEBUG ] Stat-timer finished, calling reference [INFO ] 442586# started [INFO ] 442586# Stat_Worker initiated [INFO ] Stats_data: {'events_hdl': 425637, 'threads_joined': 437620, 'threads_created': 442585, 'events_rec': 1169759, 'events_hdl_sec': 0.0, 'events_tot_sec': 0.0} [DEBUG ] Event-timer finished, calling reference [DEBUG ] Stat-timer finished, calling reference [INFO ] 442587# started [INFO ] 442587# Stat_Worker initiated [INFO ] Stats_data: {'events_hdl': 425637, 'threads_joined': 437620, 'threads_created': 442586, 'events_rec': 1169759, 'events_hdl_sec': 0.0, 'events_tot_sec': 0.0}
^C[INFO ] Received CTRL+C, shutting down [INFO ] Received signal 15 [DEBUG ] Joined worker #437622 [DEBUG ] Joined worker #437623 [DEBUG ] Joined worker #437624 [DEBUG ] Joined worker #437625 [DEBUG ] Joined worker #437626 [DEBUG ] Joined worker #437627 [DEBUG ] Joined worker #437628 [DEBUG ] Joined worker #437629 [DEBUG ] Joined worker #437630 [DEBUG ] Joined worker #437631 [DEBUG ] Joined worker #437632 [DEBUG ] Joined worker #437633 [DEBUG ] Joined worker #437634 [DEBUG ] Joined worker #437635 [DEBUG ] Joined worker #437636 [DEBUG ] Joined worker #437637 [DEBUG ] Joined worker #437638 [DEBUG ] Joined worker #437639 [DEBUG ] Joined worker #437640 [DEBUG ] Joined worker #437641 [DEBUG ] Joined worker #437642 [DEBUG ] Joined worker #437643 [DEBUG ] Joined worker #437644 [DEBUG ] Joined worker #437645 [DEBUG ] Joined worker #437646 [DEBUG ] Joined worker #437647 [DEBUG ] Joined worker #437648 [DEBUG ] Joined worker #437649 [DEBUG ] Joined worker #437650 [DEBUG ] Joined worker #437651 [DEBUG ] Joined worker #437652 [DEBUG ] Joined worker #437653 [DEBUG ] Joined worker #437654 [DEBUG ] Joined worker #437655 [DEBUG ] Joined worker #437656 [DEBUG ] Joined worker #437657 [DEBUG ] Joined worker #437658 [DEBUG ] Joined worker #437659 [DEBUG ] Joined worker #437660 [DEBUG ] Joined worker #437661 [DEBUG ] Joined worker #437662 [DEBUG ] Joined worker #437663 [DEBUG ] Joined worker #437664 [DEBUG ] Joined worker #437665 [DEBUG ] Joined worker #437666 [DEBUG ] Joined worker #437667 [DEBUG ] Joined worker #437668 [DEBUG ] Joined worker #437669 [DEBUG ] Joined worker #437670 [DEBUG ] Joined worker #437671 [DEBUG ] Joined worker #437672 [DEBUG ] Joined worker #437673 [DEBUG ] Joined worker #437674 [DEBUG ] Joined worker #437675 [DEBUG ] Joined worker #437676 [DEBUG ] Joined worker #437677 [DEBUG ] Joined worker #437678 [DEBUG ] Joined worker #437679 [DEBUG ] Joined worker #437680 [DEBUG ] Joined worker #437681 [DEBUG ] Joined worker #437682 [DEBUG ] Joined worker #437683 [DEBUG ] Joined worker #437684 [DEBUG ] Joined worker #437685 [DEBUG ] Joined worker #437686 [DEBUG ] Joined worker #437687 [DEBUG ] Joined worker #437688 [DEBUG ] Joined worker #437689 [DEBUG ] Joined worker #437690 [DEBUG ] Joined worker #437691 [DEBUG ] Joined worker #437692 [DEBUG ] Joined worker #437693 [DEBUG ] Joined worker #437694 [DEBUG ] Joined worker #437695 [DEBUG ] Joined worker #437696 [DEBUG ] Joined worker #437697 [DEBUG ] Joined worker #437698 [DEBUG ] Joined worker #437699 [DEBUG ] Joined worker #437700 [DEBUG ] Joined worker #437701 [DEBUG ] Joined worker #437702 [DEBUG ] Joined worker #437703 [DEBUG ] Joined worker #437704 [DEBUG ] Joined worker #437705 [DEBUG ] Joined worker #437706 [DEBUG ] Joined worker #437707 [DEBUG ] Joined worker #437708 [DEBUG ] Joined worker #437709 [DEBUG ] Joined worker #437710 [DEBUG ] Joined worker #437711 [DEBUG ] Joined worker #437712 [DEBUG ] Joined worker #437713 [DEBUG ] Joined worker #437714 [DEBUG ] Joined worker #437715 [DEBUG ] Joined worker #437716 [DEBUG ] Joined worker #437717 [DEBUG ] Joined worker #437718 [DEBUG ] Joined worker #437719 [DEBUG ] Joined worker #437720 [DEBUG ] Joined worker #437721 [DEBUG ] Joined worker #437722 [DEBUG ] Joined worker #437723 [DEBUG ] Joined worker #437724 [DEBUG ] Joined worker #437725 [DEBUG ] Joined worker #437726 [DEBUG ] Joined worker #437727 [DEBUG ] Joined worker #437728 [DEBUG ] Joined worker #437729 [DEBUG ] Joined worker #437730 [DEBUG ] Joined worker #437731 [DEBUG ] Joined worker #437732 [DEBUG ] Joined worker #437733 [DEBUG ] Joined worker #437734 [DEBUG ] Joined worker #437735 [DEBUG ] Joined worker #437736 [DEBUG ] Joined worker #437737 [DEBUG ] Joined worker #437738 [DEBUG ] Joined worker #437739 [DEBUG ] Joined worker #437740 [DEBUG ] Joined worker #437741 [DEBUG ] Joined worker #437742 [DEBUG ] Joined worker #437743 [DEBUG ] Joined worker #437744 [DEBUG ] Joined worker #437745 [DEBUG ] Joined worker #437746 [DEBUG ] Joined worker #437747 [DEBUG ] Joined worker #437748 [DEBUG ] Joined worker #437749 [DEBUG ] Joined worker #437750 [DEBUG ] Joined worker #437751 [DEBUG ] Joined worker #437752 [DEBUG ] Joined worker #437753 [DEBUG ] Joined worker #437754 [DEBUG ] Joined worker #437755 [DEBUG ] Joined worker #437756 [DEBUG ] Joined worker #437757 [DEBUG ] Joined worker #437758 [DEBUG ] Joined worker #437759 [DEBUG ] Joined worker #437760 [DEBUG ] Joined worker #437761 [DEBUG ] Joined worker #437762 [DEBUG ] Joined worker #437763 [DEBUG ] Joined worker #437764 [DEBUG ] Joined worker #437765 [DEBUG ] Joined worker #437766 [DEBUG ] Joined worker #437767 [DEBUG ] Joined worker #437768 [DEBUG ] Joined worker #437769 [DEBUG ] Joined worker #437770 [DEBUG ] Joined worker #437771 [DEBUG ] Joined worker #437772 [DEBUG ] Joined worker #437773 [DEBUG ] Joined worker #437774 [DEBUG ] Joined worker #437775 [DEBUG ] Joined worker #437776 [DEBUG ] Joined worker #437777 [DEBUG ] Joined worker #437778 [DEBUG ] Joined worker #437779 [DEBUG ] Joined worker #437780 [DEBUG ] Joined worker #437781 [DEBUG ] Joined worker #437782 [DEBUG ] Joined worker #437783 [DEBUG ] Joined worker #437784 [DEBUG ] Joined worker #437785 [DEBUG ] Joined worker #437786 [DEBUG ] Joined worker #437787 [DEBUG ] Joined worker #437788 [DEBUG ] Joined worker #437789 [DEBUG ] Joined worker #437790 [DEBUG ] Joined worker #437791 [DEBUG ] Joined worker #437792 [DEBUG ] Joined worker #437793 [DEBUG ] Joined worker #437794 [DEBUG ] Joined worker #437795 [DEBUG ] Joined worker #437796 [DEBUG ] Joined worker #437797 [DEBUG ] Joined worker #437798 [DEBUG ] Joined worker #437799 [DEBUG ] Joined worker #437800 [DEBUG ] Joined worker #437801 [DEBUG ] Joined worker #437802 [DEBUG ] Joined worker #437803 [DEBUG ] Joined worker #437804 [DEBUG ] Joined worker #437805 [DEBUG ] Joined worker #437806 [DEBUG ] Joined worker #437807 [DEBUG ] Joined worker #437808 [DEBUG ] Joined worker #437809 [DEBUG ] Joined worker #437810 [DEBUG ] Joined worker #437811 [DEBUG ] Joined worker #437812 [DEBUG ] Joined worker #437813 [DEBUG ] Joined worker #437814 [DEBUG ] Joined worker #437815 [DEBUG ] Joined worker #437816 [DEBUG ] Joined worker #437817 [DEBUG ] Joined worker #437818 [DEBUG ] Joined worker #437819 [DEBUG ] Joined worker #437820 [DEBUG ] Joined worker #437821 [DEBUG ] Joined worker #437822 [DEBUG ] Joined worker #437823 [DEBUG ] Joined worker #437824 [DEBUG ] Joined worker #437825 [DEBUG ] Joined worker #437826 [DEBUG ] Joined worker #437827 [DEBUG ] Joined worker #437828 [DEBUG ] Joined worker #437829 [DEBUG ] Joined worker #437830 [DEBUG ] Joined worker #437831 [DEBUG ] Joined worker #437832 [DEBUG ] Joined worker #437833 [DEBUG ] Joined worker #437834 [DEBUG ] Joined worker #437835 [DEBUG ] Joined worker #437836 [DEBUG ] Joined worker #437837 [DEBUG ] Joined worker #437838 [DEBUG ] Joined worker #437839 [DEBUG ] Joined worker #437840 [DEBUG ] Joined worker #437841 [DEBUG ] Joined worker #437842 [DEBUG ] Joined worker #437843 [DEBUG ] Joined worker #437844 [DEBUG ] Joined worker #437845 [DEBUG ] Joined worker #437846 [DEBUG ] Joined worker #437847 [DEBUG ] Joined worker #437848 [DEBUG ] Joined worker #437849 [DEBUG ] Joined worker #437850 [DEBUG ] Joined worker #437851 [DEBUG ] Joined worker #437852 [DEBUG ] Joined worker #437853 [DEBUG ] Joined worker #437854 [DEBUG ] Joined worker #437855 [DEBUG ] Joined worker #437856 [DEBUG ] Joined worker #437857 [DEBUG ] Joined worker #437858 [DEBUG ] Joined worker #437859 [DEBUG ] Joined worker #437860 [DEBUG ] Joined worker #437861 [DEBUG ] Joined worker #437862 [DEBUG ] Joined worker #437863 [DEBUG ] Joined worker #437864 [DEBUG ] Joined worker #437865 [DEBUG ] Joined worker #437866 [DEBUG ] Joined worker #437867 [DEBUG ] Joined worker #437868 [DEBUG ] Joined worker #437869 [DEBUG ] Joined worker #437870 [DEBUG ] Joined worker #437871 [DEBUG ] Joined worker #437872 [DEBUG ] Joined worker #437873 [DEBUG ] Joined worker #437874 [DEBUG ] Joined worker #437875 [DEBUG ] Joined worker #437876 [DEBUG ] Joined worker #437877 [DEBUG ] Joined worker #437878 [DEBUG ] Joined worker #437879 [DEBUG ] Joined worker #437880 [DEBUG ] Joined worker #437881 [DEBUG ] Joined worker #437882 [DEBUG ] Joined worker #437883 [DEBUG ] Joined worker #437884 [DEBUG ] Joined worker #437885 [DEBUG ] Joined worker #437886 [DEBUG ] Joined worker #437887 [DEBUG ] Joined worker #437888 [DEBUG ] Joined worker #437889 [DEBUG ] Joined worker #437890 [DEBUG ] Joined worker #437891 [DEBUG ] Joined worker #437892 [DEBUG ] Joined worker #437893 [DEBUG ] Joined worker #437894 [DEBUG ] Joined worker #437895 [DEBUG ] Joined worker #437896 [DEBUG ] Joined worker #437897 [DEBUG ] Joined worker #437898 [DEBUG ] Joined worker #437899 [DEBUG ] Joined worker #437900 [DEBUG ] Joined worker #437901 [DEBUG ] Joined worker #437902 [DEBUG ] Joined worker #437903 [DEBUG ] Joined worker #437904 [DEBUG ] Joined worker #437905 [DEBUG ] Joined worker #437906 [DEBUG ] Joined worker #437907 [DEBUG ] Joined worker #437908 [DEBUG ] Joined worker #437909 [DEBUG ] Joined worker #437910 [DEBUG ] Joined worker #437911 [DEBUG ] Joined worker #437912 [DEBUG ] Joined worker #437913 [DEBUG ] Joined worker #437914 [DEBUG ] Joined worker #437915 [DEBUG ] Joined worker #437916 [DEBUG ] Joined worker #437917 [DEBUG ] Joined worker #437918 [DEBUG ] Joined worker #437919 [DEBUG ] Joined worker #437920 [DEBUG ] Joined worker #437921 [DEBUG ] Joined worker #437922 [DEBUG ] Joined worker #437923 [DEBUG ] Joined worker #437924 [DEBUG ] Joined worker #437925 [DEBUG ] Joined worker #437926 [DEBUG ] Joined worker #437927 [DEBUG ] Joined worker #437928 [DEBUG ] Joined worker #437929 [DEBUG ] Joined worker #437930 [DEBUG ] Joined worker #437931 [DEBUG ] Joined worker #437932 [DEBUG ] Joined worker #437933 [DEBUG ] Joined worker #437934 [DEBUG ] Joined worker #437935 [DEBUG ] Joined worker #437936 [DEBUG ] Joined worker #437937 [DEBUG ] Joined worker #437938 [DEBUG ] Joined worker #437939 [DEBUG ] Joined worker #437940 [DEBUG ] Joined worker #437941 [DEBUG ] Joined worker #437942 [DEBUG ] Joined worker #437943 [DEBUG ] Joined worker #437944 [DEBUG ] Joined worker #437945 [DEBUG ] Joined worker #437946 [DEBUG ] Joined worker #437947 [DEBUG ] Joined worker #437948 [DEBUG ] Joined worker #437949 [DEBUG ] Joined worker #437950 [DEBUG ] Joined worker #437951 [DEBUG ] Joined worker #437952 [DEBUG ] Joined worker #437953 [DEBUG ] Joined worker #437954 [DEBUG ] Joined worker #437955 [DEBUG ] Joined worker #437956 [DEBUG ] Joined worker #437957 [DEBUG ] Joined worker #437958 [DEBUG ] Joined worker #437959 [DEBUG ] Joined worker #437960 [DEBUG ] Joined worker #437961 [DEBUG ] Joined worker #437962 [DEBUG ] Joined worker #437963 [DEBUG ] Joined worker #437964 [DEBUG ] Joined worker #437965 [DEBUG ] Joined worker #437966 [DEBUG ] Joined worker #437967 [DEBUG ] Joined worker #437968 [DEBUG ] Joined worker #437969 [DEBUG ] Joined worker #437970 [DEBUG ] Joined worker #437971 [DEBUG ] Joined worker #437972 [DEBUG ] Joined worker #437973 [DEBUG ] Joined worker #437974 [DEBUG ] Joined worker #437975 [DEBUG ] Joined worker #437976 [DEBUG ] Joined worker #437977 [DEBUG ] Joined worker #437978 [DEBUG ] Joined worker #437979 [DEBUG ] Joined worker #437980 [DEBUG ] Joined worker #437981 [DEBUG ] Joined worker #437982 [DEBUG ] Joined worker #437983 [DEBUG ] Joined worker #437984 [DEBUG ] Joined worker #437985 [DEBUG ] Joined worker #437986 [DEBUG ] Joined worker #437987 [DEBUG ] Joined worker #437988 [DEBUG ] Joined worker #437989 [DEBUG ] Joined worker #437990 [DEBUG ] Joined worker #437991 [DEBUG ] Joined worker #437992 [DEBUG ] Joined worker #437993 [DEBUG ] Joined worker #437994 [DEBUG ] Joined worker #437995 [DEBUG ] Joined worker #437996 [DEBUG ] Joined worker #437997 [DEBUG ] Joined worker #437998 [DEBUG ] Joined worker #437999 [DEBUG ] Joined worker #438000 [DEBUG ] Joined worker #438001 [DEBUG ] Joined worker #438002 [DEBUG ] Joined worker #438003 [DEBUG ] Joined worker #438004 [DEBUG ] Joined worker #438005 [DEBUG ] Joined worker #438006 [DEBUG ] Joined worker #438007 [DEBUG ] Joined worker #438008 [DEBUG ] Joined worker #438009 [DEBUG ] Joined worker #438010 [DEBUG ] Joined worker #438011 [DEBUG ] Joined worker #438012 [DEBUG ] Joined worker #438013 [DEBUG ] Joined worker #438014 [DEBUG ] Joined worker #438015 [DEBUG ] Joined worker #438016 [DEBUG ] Joined worker #438017 [DEBUG ] Joined worker #438018 [DEBUG ] Joined worker #438019 [DEBUG ] Joined worker #438020 [DEBUG ] Joined worker #438021 [DEBUG ] Joined worker #438022 [DEBUG ] Joined worker #438023 [DEBUG ] Joined worker #438024 [DEBUG ] Joined worker #438025 [DEBUG ] Joined worker #438026 [DEBUG ] Joined worker #438027 [DEBUG ] Joined worker #438028 [DEBUG ] Joined worker #438029 [DEBUG ] Joined worker #438030 [DEBUG ] Joined worker #438031 [DEBUG ] Joined worker #438032 [DEBUG ] Joined worker #438033 [DEBUG ] Joined worker #438034 [DEBUG ] Joined worker #438035 [DEBUG ] Joined worker #438036 [DEBUG ] Joined worker #438037 [DEBUG ] Joined worker #438038 [DEBUG ] Joined worker #438039 [DEBUG ] Joined worker #438040 [DEBUG ] Joined worker #438041 [DEBUG ] Joined worker #438042 [DEBUG ] Joined worker #438043 [DEBUG ] Joined worker #438044 [DEBUG ] Joined worker #438045 [DEBUG ] Joined worker #438046 [DEBUG ] Joined worker #438047 [DEBUG ] Joined worker #438048 [DEBUG ] Joined worker #438049 [DEBUG ] Joined worker #438050 [DEBUG ] Joined worker #438051 [DEBUG ] Joined worker #438052 [DEBUG ] Joined worker #438053 [DEBUG ] Joined worker #438054 [DEBUG ] Joined worker #438055 [DEBUG ] Joined worker #438056 [DEBUG ] Joined worker #438057 [DEBUG ] Joined worker #438058 [DEBUG ] Joined worker #438059 [DEBUG ] Joined worker #438060 [DEBUG ] Joined worker #438061 [DEBUG ] Joined worker #438062 [DEBUG ] Joined worker #438063 [DEBUG ] Joined worker #438064 [DEBUG ] Joined worker #438065 [DEBUG ] Joined worker #438066 [DEBUG ] Joined worker #438067 [DEBUG ] Joined worker #438068 [DEBUG ] Joined worker #438069 [DEBUG ] Joined worker #438070 [DEBUG ] Joined worker #438071 [DEBUG ] Joined worker #438072 [DEBUG ] Joined worker #438073 [DEBUG ] Joined worker #438074 [DEBUG ] Joined worker #438075 [DEBUG ] Joined worker #438076 [DEBUG ] Joined worker #438077 [DEBUG ] Joined worker #438078 [DEBUG ] Joined worker #438079 [DEBUG ] Joined worker #438080 [DEBUG ] Joined worker #438081 [DEBUG ] Joined worker #438082 [DEBUG ] Joined worker #438083 [DEBUG ] Joined worker #438084 [DEBUG ] Joined worker #438085 [DEBUG ] Joined worker #438086 [DEBUG ] Joined worker #438087 [DEBUG ] Joined worker #438088 [DEBUG ] Joined worker #438089 [DEBUG ] Joined worker #438090 [DEBUG ] Joined worker #438091 [DEBUG ] Joined worker #438092 [DEBUG ] Joined worker #438093 [DEBUG ] Joined worker #438094 [DEBUG ] Joined worker #438095 [DEBUG ] Joined worker #438096 [DEBUG ] Joined worker #438097 [DEBUG ] Joined worker #438098 [DEBUG ] Joined worker #438099 [DEBUG ] Joined worker #438100 [DEBUG ] Joined worker #438101 [DEBUG ] Joined worker #438102 [DEBUG ] Joined worker #438103 [DEBUG ] Joined worker #438104 [DEBUG ] Joined worker #438105 [DEBUG ] Joined worker #438106 [DEBUG ] Joined worker #438107 [DEBUG ] Joined worker #438108 [DEBUG ] Joined worker #438109 [DEBUG ] Joined worker #438110 [DEBUG ] Joined worker #438111 [DEBUG ] Joined worker #438112 [DEBUG ] Joined worker #438113 [DEBUG ] Joined worker #438114 [DEBUG ] Joined worker #438115 [DEBUG ] Joined worker #438116 [DEBUG ] Joined worker #438117 [DEBUG ] Joined worker #438118 [DEBUG ] Joined worker #438119 [DEBUG ] Joined worker #438120 [DEBUG ] Joined worker #438121 [DEBUG ] Joined worker #438122 [DEBUG ] Joined worker #438123 [DEBUG ] Joined worker #438124 [DEBUG ] Joined worker #438125 [DEBUG ] Joined worker #438126 [DEBUG ] Joined worker #438127 [DEBUG ] Joined worker #438128 [DEBUG ] Joined worker #438129 [DEBUG ] Joined worker #438130 [DEBUG ] Joined worker #438131 [DEBUG ] Joined worker #438132 [DEBUG ] Joined worker #438133 [DEBUG ] Joined worker #438134 [DEBUG ] Joined worker #438135 [DEBUG ] Joined worker #438136 [DEBUG ] Joined worker #438137 [DEBUG ] Joined worker #438138 [DEBUG ] Joined worker #438139 [DEBUG ] Joined worker #438140 [DEBUG ] Joined worker #438141 [DEBUG ] Joined worker #438142 [DEBUG ] Joined worker #438143 [DEBUG ] Joined worker #438144 [DEBUG ] Joined worker #438145 [DEBUG ] Joined worker #438146 [DEBUG ] Joined worker #438147 [DEBUG ] Joined worker #438148 [DEBUG ] Joined worker #438149 [DEBUG ] Joined worker #438150 [DEBUG ] Joined worker #438151 [DEBUG ] Joined worker #438152 [DEBUG ] Joined worker #438153 [DEBUG ] Joined worker #438154 [DEBUG ] Joined worker #438155 [DEBUG ] Joined worker #438156 [DEBUG ] Joined worker #438157 [DEBUG ] Joined worker #438158 [DEBUG ] Joined worker #438159 [DEBUG ] Joined worker #438160 [DEBUG ] Joined worker #438161 [DEBUG ] Joined worker #438162 [DEBUG ] Joined worker #438163 [DEBUG ] Joined worker #438164 [DEBUG ] Joined worker #438165 [DEBUG ] Joined worker #438166 [DEBUG ] Joined worker #438167 [DEBUG ] Joined worker #438168 [DEBUG ] Joined worker #438169 [DEBUG ] Joined worker #438170 [DEBUG ] Joined worker #438171 [DEBUG ] Joined worker #438172 [DEBUG ] Joined worker #438173 [DEBUG ] Joined worker #438174 [DEBUG ] Joined worker #438175 [DEBUG ] Joined worker #438176 [DEBUG ] Joined worker #438177 [DEBUG ] Joined worker #438178 [DEBUG ] Joined worker #438179 [DEBUG ] Joined worker #438180 [DEBUG ] Joined worker #438181 [DEBUG ] Joined worker #438182 [DEBUG ] Joined worker #438183 [DEBUG ] Joined worker #438184 [DEBUG ] Joined worker #438185 [DEBUG ] Joined worker #438186 [DEBUG ] Joined worker #438187 [DEBUG ] Joined worker #438188 [DEBUG ] Joined worker #438189 [DEBUG ] Joined worker #438190 [DEBUG ] Joined worker #438191 [DEBUG ] Joined worker #438192 [DEBUG ] Joined worker #438193 [DEBUG ] Joined worker #438194 [DEBUG ] Joined worker #438195 [DEBUG ] Joined worker #438196 [DEBUG ] Joined worker #438197 [DEBUG ] Joined worker #438198 [DEBUG ] Joined worker #438199 [DEBUG ] Joined worker #438200 [DEBUG ] Joined worker #438201 [DEBUG ] Joined worker #438202 [DEBUG ] Joined worker #438203 [DEBUG ] Joined worker #438204 [DEBUG ] Joined worker #438205 [DEBUG ] Joined worker #438206 [DEBUG ] Joined worker #438207 [DEBUG ] Joined worker #438208 [DEBUG ] Joined worker #438209 [DEBUG ] Joined worker #438210 [DEBUG ] Joined worker #438211 [DEBUG ] Joined worker #438212 [DEBUG ] Joined worker #438213 [DEBUG ] Joined worker #438214 [DEBUG ] Joined worker #438215 [DEBUG ] Joined worker #438216 [DEBUG ] Joined worker #438217 [DEBUG ] Joined worker #438218 [DEBUG ] Joined worker #438219 [DEBUG ] Joined worker #438220 [DEBUG ] Joined worker #438221 [DEBUG ] Joined worker #438222 [DEBUG ] Joined worker #438223 [DEBUG ] Joined worker #438224 [DEBUG ] Joined worker #438225 [DEBUG ] Joined worker #438226 [DEBUG ] Joined worker #438227 [DEBUG ] Joined worker #438228 [DEBUG ] Joined worker #438229 [DEBUG ] Joined worker #438230 [DEBUG ] Joined worker #438231 [DEBUG ] Joined worker #438232 [DEBUG ] Joined worker #438233 [DEBUG ] Joined worker #438234 [DEBUG ] Joined worker #438235 [DEBUG ] Joined worker #438236 [DEBUG ] Joined worker #438237 [DEBUG ] Joined worker #438238 [DEBUG ] Joined worker #438239 [DEBUG ] Joined worker #438240 [DEBUG ] Joined worker #438241 [DEBUG ] Joined worker #438242 [DEBUG ] Joined worker #438243 [DEBUG ] Joined worker #438244 [DEBUG ] Joined worker #438245 [DEBUG ] Joined worker #438246 [DEBUG ] Joined worker #438247 [DEBUG ] Joined worker #438248 [DEBUG ] Joined worker #438249 [DEBUG ] Joined worker #438250 [DEBUG ] Joined worker #438251 [DEBUG ] Joined worker #438252 [DEBUG ] Joined worker #438253 [DEBUG ] Joined worker #438254 [DEBUG ] Joined worker #438255 [DEBUG ] Joined worker #438256 [DEBUG ] Joined worker #438257 [DEBUG ] Joined worker #438258 ... [DEBUG ] Joined worker #442585 [DEBUG ] Joined worker #442586 [DEBUG ] Joined worker #442587 [INFO ] salt-eventsd has shut down
The main event-loop does a "continue" whenever it hits a "None"-event and skips the cleanup / joining of threads at the bottom of the loop on that single iteration. Since no more events are being received by the daemon (reason still unknown), the cleanup / joining of the worker-threads never gets called again leaving the threads open. Hitting CTRL-C finally cleans up the threads as seen above.
A fix for the "continue"-bug is already implemented, the "not receiving more events" still needs investigating.
Partial fix for the unjoined threads is in develop, commit https://github.com/felskrone/salt-eventsd/commit/f2b64b2b998338cb7a5a2252a0ff731f9c3d6240