[msgs:/var/log/messages] <...SKIPPED...> Sep 22 04:25:24 cephnode02 ceph-mon[436048]: from='mgr.44099 10.4.20.31:0/99874581' entity='mgr.cephnode01.kxbnqe' Sep 22 04:25:29 cephnode02 ceph-mon[436048]: mon.cephnode02@1(peon).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104 Sep 22 04:25:34 cephnode02 ceph-mon[436048]: mon.cephnode02@1(peon).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104 Sep 22 04:25:39 cephnode02 ceph-mon[436048]: mon.cephnode02@1(peon).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104 Sep 22 04:25:44 cephnode02 ceph-mon[436048]: mon.cephnode02@1(peon).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104 <...CURRENT...> Sep 22 04:25:49 cephnode02 ceph-mon[436048]: mon.cephnode02@1(peon).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104 Sep 22 04:25:54 cephnode02 ceph-mon[436048]: mon.cephnode02@1(peon).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104 Sep 22 04:25:54 cephnode02 systemd[1]: systemd-hostnamed.service: Deactivated successfully. Sep 22 04:25:59 cephnode02 ceph-mon[436048]: mon.cephnode02@1(peon).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104 Sep 22 04:26:04 cephnode02 ceph-mon[436048]: mon.cephnode02@1(peon).osd e784 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 343932928 full_alloc: 348127232 kv_alloc: 318767104 <...SKIPPED...> Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.384880) [db/memtable_list.cc:519] [default] Level-0 commit table #96317 started Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.385102) [db/memtable_list.cc:722] [default] Level-0 commit table #96317: memtable #1 done Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.385111) EVENT_LOG_v1 {"time_micros": 1790015246385109, "job": 64205, "event": "flush_finished", "output_compression": "NoCompression", "lsm_state": [1, 0, 0, 0, 0, 0, 1], "immutable_memtables": 0} Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.385122) [db/db_impl/db_impl_compaction_flush.cc:299] [default] Level summary: base level 6 level multiplier 10.00 max bytes base 268435456 files[1 0 0 0 0 0 1] max score 0.25 Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: [db/db_impl/db_impl_files.cc:463] [JOB 64205] Try to delete WAL files size 2273949, prev total WAL file size 2273949, number of live WAL files 2. Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-cephnode02/store.db/096313.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.385419) [db/db_impl/db_impl_compaction_flush.cc:3165] [default] Manual compaction from level-0 to level-6 from '7061786F730034353238323931' seq:72057594037927935, type:22 .. '7061786F730034353238353433' seq:0, type:0; will stop at (end) Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: [db/compaction/compaction_job.cc:1995] [default] [JOB 64206] Compacting 1@0 + 1@6 files to L6, score -1.00 Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: [db/compaction/compaction_job.cc:2001] [default]: Compaction start summary: Base version 64205 Base level 0, inputs: [96317(1405KB)], [96315(13MB)] Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: EVENT_LOG_v1 {"time_micros": 1790015246385441, "job": 64206, "event": "compaction_started", "compaction_reason": "ManualCompaction", "files_L0": [96317], "files_L6": [96315], "score": -1, "input_data_size": 16026970, "oldest_snapshot_seqno": -1} Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: [db/compaction/compaction_job.cc:1588] [default] [JOB 64206] Generated table #96318: 23311 keys, 15260555 bytes, temperature: kUnknown Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: EVENT_LOG_v1 {"time_micros": 1790015246440908, "cf_name": "default", "job": 64206, "event": "table_file_creation", "file_number": 96318, "file_size": 15260555, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 15127512, "index_size": 73646, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 58309, "raw_key_size": 635624, "raw_average_key_size": 27, "raw_value_size": 14740585, "raw_average_value_size": 632, "num_data_blocks": 2562, "num_entries": 23311, "num_filter_entries": 23311, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1786355233, "oldest_key_time": 0, "file_creation_time": 1790015246, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b2875e6d-87fb-4feb-91cd-57c3ac8e37a1", "db_session_id": "UZSIHLOE2E2Q2OJ5NQZQ", "orig_file_number": 96318, "seqno_to_time_mapping": "N/A"}} Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.441104) [db/compaction/compaction_job.cc:1663] [default] [JOB 64206] Compacted 1@0 + 1@6 files to L6 => 15260555 bytes Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.441335) [db/compaction/compaction_job.cc:865] [default] compacted to: base level 6 level multiplier 10.00 max bytes base 268435456 files[0 0 0 0 0 0 1] max score 0.00, MB/sec: 288.7 rd, 274.9 wr, level 6, files in(1, 1) out(1 +0 blob) MB in(1.4, 13.9 +0.0 blob) out(14.6 +0.0 blob), read-write-amplify(21.7) write-amplify(10.6) OK, records in: 24132, records dropped: 821 output_compression: NoCompression Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.441349) EVENT_LOG_v1 {"time_micros": 1790015246441343, "job": 64206, "event": "compaction_finished", "compaction_time_micros": 55516, "compaction_time_cpu_micros": 26673, "output_level": 6, "num_output_files": 1, "total_output_size": 15260555, "num_input_records": 24132, "num_output_records": 23311, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 0, 0, 0, 0, 0, 1]} Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-cephnode02/store.db/096317.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: EVENT_LOG_v1 {"time_micros": 1790015246441504, "job": 64206, "event": "table_file_deletion", "file_number": 96317} Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-cephnode02/store.db/096315.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: EVENT_LOG_v1 {"time_micros": 1790015246442399, "job": 64206, "event": "table_file_deletion", "file_number": 96315} Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.385390) [db/db_impl/db_impl_compaction_flush.cc:1903] [default] Manual compaction starting Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.442424) [db/db_impl/db_impl_compaction_flush.cc:1903] [default] Manual compaction starting Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.442427) [db/db_impl/db_impl_compaction_flush.cc:1903] [default] Manual compaction starting Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.442428) [db/db_impl/db_impl_compaction_flush.cc:1903] [default] Manual compaction starting Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.442429) [db/db_impl/db_impl_compaction_flush.cc:1903] [default] Manual compaction starting Sep 22 04:27:26 cephnode02 ceph-mon[436048]: rocksdb: (Original Log Time 2026/09/21-18:27:26.442430) [db/db_impl/db_impl_compaction_flush.cc:1903] [default] Manual compaction starting Sep 22 04:27:26 cephnode02 ceph-mon[436048]: from='mgr.44099 10.4.20.31:0/99874581' entity='mgr.cephnode01.kxbnqe' Sep 22 04:27:26 cephnode02 ceph-mon[436048]: from='mgr.44099 10.4.20.31:0/99874581' entity='mgr.cephnode01.kxbnqe' Sep 22 04:27:26 cephnode02 ceph-mon[436048]: from='mgr.44099 10.4.20.31:0/99874581' entity='mgr.cephnode01.kxbnqe' Sep 22 04:27:26 cephnode02 ceph-mon[436048]: from='mgr.44099 10.4.20.31:0/99874581' entity='mgr.cephnode01.kxbnqe' Sep 22 04:27:26 cephnode02 ceph-mon[436048]: from='mgr.44099 10.4.20.31:0/99874581' entity='mgr.cephnode01.kxbnqe' Sep 22 04:27:26 cephnode02 ceph-mon[436048]: from='mgr.44099 10.4.20.31:0/99874581' entity='mgr.cephnode01.kxbnqe' Sep 22 04:27:26 cephnode02 ceph-mon[436048]: from='mgr.44099 10.4.20.31:0/99874581' entity='mgr.cephnode01.kxbnqe' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch Sep 22 04:27:26 cephnode02 ceph-mon[436048]: from='mgr.44099 10.4.20.31:0/99874581' entity='mgr.cephnode01.kxbnqe'