Tue Sep 22 03:48:47 AEST 2026 - Log files ok

 No notable entries in /var/log/messages


Full log: /var/log/messages
<...SKIPPED...>
Sep 22 03:47:00 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017338: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 170 B/s rd, 0 op/s
Sep 22 03:47:02 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017339: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 17 KiB/s rd, 170 B/s wr, 2 op/s
Sep 22 03:47:02 cephnode01 ceph-mon[2323]: mon.cephnode01@0(leader).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104
Sep 22 03:47:04 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017340: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 17 KiB/s rd, 9.2 KiB/s wr, 2 op/s
Sep 22 03:47:06 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017341: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 54 KiB/s rd, 20 KiB/s wr, 7 op/s
<...CURRENT...>
Sep 22 03:47:07 cephnode01 ceph-mon[2323]: mon.cephnode01@0(leader) e3 handle_command mon_command({"prefix": "osd blocklist ls", "format": "json"} v 0)
Sep 22 03:47:07 cephnode01 ceph-mon[2323]: log_channel(audit) log [DBG] : from='mgr.44099 10.4.20.31:0/99874581' entity='mgr.cephnode01.kxbnqe' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch
Sep 22 03:47:07 cephnode01 ceph-mon[2323]: mon.cephnode01@0(leader).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104
Sep 22 03:47:08 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017342: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 54 KiB/s rd, 24 KiB/s wr, 7 op/s
Sep 22 03:47:10 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017343: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 54 KiB/s rd, 28 KiB/s wr, 8 op/s
<...SKIPPED...>
Sep 22 03:48:26 cephnode01 ceph-mon[2323]: cephx server client.crash.cephnode03: handle_request failed to decode CephXAuthenticate: End of buffer [buffer:2]
Sep 22 03:48:26 cephnode01 ceph-mon[2323]: cephx server client.crash.cephnode03: handle_request failed to decode CephXAuthenticate: End of buffer [buffer:2]
Sep 22 03:48:26 cephnode01 ceph-mon[2323]: cephx server client.crash.cephnode03: handle_request failed to decode CephXAuthenticate: End of buffer [buffer:2]
Sep 22 03:48:26 cephnode01 ceph-mon[2323]: cephx server client.crash.cephnode03: handle_request failed to decode CephXAuthenticate: End of buffer [buffer:2]
Sep 22 03:48:26 cephnode01 ceph-mon[2323]: cephx server client.crash.cephnode03: handle_request failed to decode CephXAuthenticate: End of buffer [buffer:2]
Sep 22 03:48:26 cephnode01 ceph-mon[2323]: cephx server client.crash.cephnode03: handle_request failed to decode CephXAuthenticate: End of buffer [buffer:2]
Sep 22 03:48:26 cephnode01 ceph-mon[2323]: cephx server client.crash.cephnode03: handle_request failed to decode CephXAuthenticate: End of buffer [buffer:2]
Sep 22 03:48:26 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017381: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 170 B/s rd, 255 B/s wr, 0 op/s
Sep 22 03:48:26 cephnode01 ceph-mon[2323]: cephx server client.crash.cephnode03: handle_request failed to decode CephXAuthenticate: End of buffer [buffer:2]
Sep 22 03:48:26 cephnode01 ceph-mon[2323]: cephx server client.crash.cephnode03: handle_request failed to decode CephXAuthenticate: End of buffer [buffer:2]
Sep 22 03:48:27 cephnode01 ceph-mon[2323]: cephx server client.crash.cephnode03: handle_request failed to decode CephXAuthenticate: End of buffer [buffer:2]
Sep 22 03:48:27 cephnode01 ceph-mon[2323]: cephx server client.crash.cephnode03: handle_request failed to decode CephXAuthenticate: End of buffer [buffer:2]
Sep 22 03:48:27 cephnode01 ceph-mgr[2360]: [balancer INFO balancer] Optimize plan auto_2026-09-21_17:48:27
Sep 22 03:48:27 cephnode01 ceph-mgr[2360]: [balancer INFO balancer] Mode upmap, max misplaced 0.050000
Sep 22 03:48:27 cephnode01 ceph-mgr[2360]: [balancer INFO balancer] do_upmap
Sep 22 03:48:27 cephnode01 ceph-mgr[2360]: [balancer INFO balancer] pools ['rbd', '.mgr']
Sep 22 03:48:27 cephnode01 ceph-mgr[2360]: [balancer INFO balancer] prepared 0/10 upmap changes
Sep 22 03:48:27 cephnode01 ceph-mon[2323]: cephx server client.crash.cephnode03: handle_request failed to decode CephXAuthenticate: End of buffer [buffer:2]
Sep 22 03:48:27 cephnode01 ceph-mon[2323]: mon.cephnode01@0(leader).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104
Sep 22 03:48:28 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017382: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 170 B/s rd, 255 B/s wr, 0 op/s
Sep 22 03:48:29 cephnode01 systemd[1]: meshagent.service: Watchdog timeout (limit 1min)!
Sep 22 03:48:29 cephnode01 systemd[1]: meshagent.service: Killing process 3415876 (meshagent) with signal SIGABRT.
Sep 22 03:48:29 cephnode01 systemd[1]: Started Process Core Dump (PID 3417287/UID 0).
Sep 22 03:48:29 cephnode01 systemd-coredump[3417288]: Removed old coredump core.meshagent.0.e9e6a7da041a4305b969d609322cb985.844467.1789863947000000.zst.
Sep 22 03:48:30 cephnode01 systemd-coredump[3417288]: Process 3415876 (meshagent) of user 0 dumped core.#012#012Stack trace of thread 3415876:#012#0  0x00007f25edb05c7d __select (libc.so.6 + 0x105c7d)#012#1  0x000000000041ed7e n/a (meshagent + 0x1ed7e)#012#2  0x00000000004cb007 n/a (meshagent + 0xcb007)#012#3  0x00000000004d4b11 n/a (meshagent + 0xd4b11)#012#4  0x00007f25eda2a610 __libc_start_call_main (libc.so.6 + 0x2a610)#012#5  0x00007f25eda2a6c0 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a6c0)#012#6  0x000000000040dd01 n/a (meshagent + 0xdd01)#012ELF object binary architecture: AMD x86-64
Sep 22 03:48:30 cephnode01 systemd[1]: systemd-coredump@62358-3417287-0.service: Deactivated successfully.
Sep 22 03:48:30 cephnode01 systemd[1]: meshagent.service: Main process exited, code=dumped, status=6/ABRT
Sep 22 03:48:30 cephnode01 systemd[1]: meshagent.service: Failed with result 'watchdog'.
Sep 22 03:48:30 cephnode01 systemd[1]: meshagent.service: Consumed 2.731s CPU time, 7.8M memory peak.
Sep 22 03:48:30 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017383: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 170 B/s rd, 255 B/s wr, 0 op/s
Sep 22 03:48:32 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017384: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 170 B/s rd, 170 B/s wr, 0 op/s
Sep 22 03:48:32 cephnode01 ceph-mon[2323]: mon.cephnode01@0(leader).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104
Sep 22 03:48:33 cephnode01 systemd[1]: meshagent.service: Scheduled restart job, restart counter is at 62359.
Sep 22 03:48:33 cephnode01 systemd[1]: Stopped meshagent background service.
Sep 22 03:48:33 cephnode01 systemd[1]: meshagent.service: Consumed 2.731s CPU time, 7.8M memory peak.
Sep 22 03:48:33 cephnode01 systemd[1]: Started meshagent background service.
Sep 22 03:48:34 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017385: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 170 B/s rd, 426 B/s wr, 0 op/s
Sep 22 03:48:36 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017386: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 85 B/s rd, 11 KiB/s wr, 1 op/s
Sep 22 03:48:37 cephnode01 ceph-mon[2323]: mon.cephnode01@0(leader) e3 handle_command mon_command({"prefix": "osd blocklist ls", "format": "json"} v 0)
Sep 22 03:48:37 cephnode01 ceph-mon[2323]: log_channel(audit) log [DBG] : from='mgr.44099 10.4.20.31:0/99874581' entity='mgr.cephnode01.kxbnqe' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch
Sep 22 03:48:37 cephnode01 ceph-mon[2323]: mon.cephnode01@0(leader).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104
Sep 22 03:48:38 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017387: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 85 B/s rd, 17 KiB/s wr, 2 op/s
Sep 22 03:48:40 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017388: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 170 B/s rd, 17 KiB/s wr, 2 op/s
Sep 22 03:48:42 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017389: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 170 B/s rd, 17 KiB/s wr, 2 op/s
Sep 22 03:48:42 cephnode01 ceph-mon[2323]: mon.cephnode01@0(leader).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104
Sep 22 03:48:44 cephnode01 ceph-mgr[2360]: [pg_autoscaler INFO pg_autoscaler] _maybe_adjust
Sep 22 03:48:44 cephnode01 ceph-mgr[2360]: [pg_autoscaler INFO pg_autoscaler] effective_target_ratio 0.0 0.0 0 48009345761280
Sep 22 03:48:44 cephnode01 ceph-mgr[2360]: [pg_autoscaler INFO pg_autoscaler] Pool '.mgr' root_id -1 using 4.6370817279403087e-07 of space, bias 1.0, pg target 0.00018548326911761235 quantized to 1 (current 1)
Sep 22 03:48:44 cephnode01 ceph-mgr[2360]: [pg_autoscaler INFO pg_autoscaler] effective_target_ratio 0.0 0.0 0 48009345761280
Sep 22 03:48:44 cephnode01 ceph-mgr[2360]: [pg_autoscaler INFO pg_autoscaler] Pool 'rbd' root_id -1 using 0.00112504157291728 of space, bias 1.0, pg target 0.45001662916691204 quantized to 32 (current 32)
Sep 22 03:48:44 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017390: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 170 B/s rd, 17 KiB/s wr, 2 op/s
Sep 22 03:48:46 cephnode01 ceph-mgr[2360]: log_channel(cluster) log [DBG] : pgmap v2017391: 33 pgs: 33 active+clean; 17 GiB data, 64 GiB used, 44 TiB / 44 TiB avail; 170 B/s rd, 17 KiB/s wr, 2 op/s