50 Commits

Author	SHA1	Message	Date
Martin Jansa	c01273e001	metadata: add whitespace around assignments ... With: https://lists.openembedded.org/g/bitbake-devel/message/17508 there are many WARNINGs from this layer will cover src_uri.inc files in next commit. Signed-off-by: Martin Jansa <martin.jansa@gmail.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2025-04-03 17:56:53 +00:00
Bruce Ashfield	62d3e94aff	ceph: update to v20.0.0 ... Bumping ceph to version v20.0.0-709-ga53e858fd7c, which comprises the following commits: b7dc6bb1ec5 rbd: print the return codes on error 20b621fceb8 doc/cephadm/services: Add mention of --zap for OSD removal 4dee7917bf0 PendingReleaseNotes; doc/rados/operations: document "rm-pg-upmap-primary-{all}" commands 1b6c0fd00cf .github/workflows,script: add test for missing .qa links 0d65d140d72 mgr/dashboard:fixed alignment of create action button 46ff6b42b5f qa: add missing .qa links 55d72f38b67 mgr/dashboard: NFS - Fix Edit NFS export request 7b5f73f4c17 doc/cephadm/services: Correct indentation in osd.rst c18a78ef58a workflows: Pin specific SHAs a74dbbe8ee1 PendingReleaseNote: add note that "volume create" accepts pool names... 3044bf7e4b6 doc/cephfs: mention new options for "fs volume create" cmd e541dca2278 mgr/nfs: NFS Cluster and Export Listing 60b1bc4cd5e rgw: radolist clean up, calculate obj info slightly earlier de2023f4fca rgw: modify radoslist to better support the rgw-gap-list tool 9d1ac190ffb rgw: fix regression in radoslist with SLO manifests 3d6de8a6698 mgr/dashboard: add types for mgr-module list f4bc03e4040 mgr/dashboard: fix access control permissions for roles e4147a0988a test/common: skip google tests which create core dumps in test_interval_set 8f7f923e945 mgr/dashboard: bucket lifecycle fixes after using xmltodict package f4c74f50fa6 mgr/dashboard: Not able to edit user display/full name in user form 058b95abe62 doc/radosgw /notifications: fix topic details 3ae193035c8 qa/cephfs: test passing pool names to "fs volume create" cmd 058769c1317 qa/cephfs: separate the tests for "ceph fs volume create" cmd e794a19fd0d mgr/vol: allow passing pool names to "fs volume create" cmd f59066195fd mgr/dashboard:fixed issue with notification icon 58cd2958307 test/unitest_bluestore_types: fix a compilation error c9382d87d64 osd: use cmd_getval_cast_or() to fetch shard-id ae1e251c5f3 common: add cmd_getval_cast_or() 3d0283a0cd6 monitoring: add SMB overview grafana dashboard 49cc45afe88 libcephfs_proxy: remove redundant unsigned >= 0 comparison ee69f521939 doc/cephadm: Add PG autoscaler advice to upgrade.rst e7bf6072693 doc/dev/developer_guide/essentials: update mailing lists c8953a03d24 doc/rados/troubleshooting/log-and-debug: add section for Monitors a7e2fab0085 doc/radosgw: Improve layout.rst 37b70581d89 doc: add clarification note on how charmap is applied ecce75132a5 qa: Edit test files to incorporate unset arguments, crush_rule, size, min_size 78a988f35db mgr/dashboard: Fix rgw user key modal not shown 84e2f2f3216 rgw: fix stacked delete marker test in test_rgw_versioning 017f3339c05 librbd: migrate from boost::variant to std::variant 6e9e2033bf0 mon, osd: add command to remove invalid pg-upmap-primary entries 82ec00ddf08 monitoring: rename NVMeoFSingleGatewayGroup alert cc66889b974 doc/rados/operations/pools: Edit Unsetting values for a stretch pool cacc5f51270 [3AZ Stretch pool]: Allow user to specify values when unsetting pools 4f3815deb96 crypto: remove unused include 98b70c149d5 cmake: make libcap REQUIRED fe171132c35 nvmeof: bump image version to 1.5 94aebfc3f7d mgr/dashboard: Add RGW topics endpoint creation for create ,delete and list in dashboard 0727321d899 common: remove deprecated get_tracked_conf_keys() 300f6435095 rgw/cloudrestore: Add Restore support from Glacier/Tape cloud endpoints 38d2c11bf24 rgw/cloud-tier: Redefining cloud tier types b1ddd68f7c7 rgw/cloud-restore: Add new tier-type & options related to S3 Glacier 826d4936896 rgw: skip replication from lock enabled buckets to lock disbaled buckets 2c4b7181621 rgw: skip versioned entries to non-versioned buckets and vice-versa 7e47deede0b rgw: reject PutBucketReplication on mismatched versioning and lock 56a21cbc03e doc/rados/troubleshooting: Improve troubleshooting-pg.rst 59a894713a9 doc/rados/operations: improve crush-map-edits.rst 62c3e5ec69f rgw/iam: add policy evaluation for Arn-based Conditions 66d2dc78720 mgr/volumes: fix issues pointed by flake8 0d6a6f528c3 mgr/volumes: correct logger names 8fd7be55f44 rgw/cloud-restore: Handle "null" instance non-current objects cef383b0a76 rgw/cloud-restore: Handle versioned objects afded137307 mgr/dashboard: add basic e2e to verify wizard 5c8fa84fe5d mgr/dashboard: fix multisite wizard form not showing 737ae7f73a8 mgr/dashboard: fix OAuth2 SSO when roles_path is empty a7a63aa3ffe rgw/iam: match_policy() treats MATCH_POLICY_ARN as case-sensitive 4cd40c7f715 rgw/iam: simplify match_policy() for colon-delimited use only 567c9e76674 mgr/dashboard: add xlmtodict import and fix lifecycle get request 1ad62cf887b qa/tasks/radosbench: make use of concurrency flag c29f531a972 qa/rgw: suppress "pool(s) full" cluster warning for rados-pool-quota 9ff036e7ed4 qa/rgw: test_rgw_rados_pool_quota expects InsufficientCapacity 7a06e841468 rgw/s3: map ENOSPC to 507 InsufficientCapacity 9d351a76ab1 rgw: rgw_init_ioctx() adds set_pool_full_try() 38929f4e17a rgw: RGWRadosRemoveCR uses rgw_init_ioctx() 7ad1937547d include/cephfs: dump optmetadata 5fc94be121f mds: set alternate_name for new fullbit dentries db2784581ec qa: test alternate_name recovery during mds failover c7c5089ff95 libcephfs: getcwd after chdir for API constraint cda2a6e6fac client: unwrap dentries for getcwd 3bfd614a358 client: refactor / optimize chdir 28bdb8e565f test/libcephfs: test getcwd with case insensitive dir d62a3795902 test/libcephfs: refactor ManyNestedDirs a33faa7c413 include/filepath: add iterators for components b4e11f75bfa script: ensure curl is always available in build containers 6b635d3ec08 script/build-with-container: fix incorrect build invocation for tests 5bcccabe7e0 crimson/os/seastore: introduce rename_omap_root() with src and dest onodes ef2b82a3bc5 crimson/os/seastore: prevent omaptree_rm_key() to be called concurrently in the same transaction c66e46f44c3 crimson/os/seastore: introduce and use omaptree_initialize() 5b97e495279 crimson/os/seastore: reuse get_omap_root() 71e094faba8 os/bluestore: Improve bluestore_blob_t::add_tail 5016925d96e os/bluestore: Make write_v2 not need to use compress_extents, addendum bfff750dc4e os/bluestore: Make write_v2 calculate affected range bda481b7b86 os/bluestore: Make write_v2 not need to use compress_extents 7a2a4720c3d mgr/dashboard: skip nfs exports check ddd01a5f7f1 mgr/dashboard: save video only on failure d8d7836e042 mgr/dashboard: fix rgw and osd regression in e2e aeee649c203 mgr/dashboard: undefined while creating rbd image a80aa1a84a3 mgr/dashboard: cypress failure after angular upgrade 09d3e67fd2f mgr/dashboard: fixing cephadm dashboard e2e failures 6cc1305cb2b mgr/dashboard: fix osd list search with id f0f863a1a54 mgr/dashboard: reorder test runs 395c49a43d2 mgr/dashboard: add custom items to combo box 0140e6d1671 crimson/os/seastore: clear an omap root for log during _omap_clear 03b90d589ca PendingReleaseNote: add note for pause_purging and pause_cloninig 1f0bfe1c599 doc/cephfs: add note for config option pause_purging and pause_cloning e7eb36e4393 qa/cephfs: add tests for mgr/vol config pause_cloning 6d6be8b41c9 qa/cephfs: extend wait for trash empty f38fcbc6109 qa/cephfs: add tests for config option pause_purging 9582b9b13a4 qa/cephfs: don't strip any whitespace for get_shell_stdout 01d37d5e1ba mgr/vol: add pause/resume mechanism for async jobs ea867b49ee1 qa/vault: create_secrets() cleanup checks for orphaned keys 5e40ec969cd doc/rados/configuration/bluestore-config-ref: Fix lowercase typos 34366f0f0d8 rgw: Try to handle unwatch errors sensibly 59220c1d538 librbd/ConfigWatcher: fix a missing 'override' f9a687a339b build: Pass `-DBOOST_ALLOW_DEPRECATED_HEADERS` to compiler b446290f441 build: Upgrade to Boost 1.87 bb3be446fbd test: add file blockdiff tests 72b6c7f3e9c libcephfs / client: wire up file blockdiff 8cc05b17255 mds: add blockdiff operation support ab05bf908fb tools/rados: include latest snapshot sequence in listsnaps 1bc67295c8b doc/monitoring: Improve index.rst cf93924c237 crimson/os/alienstore/CMakeLists: Add comment 95dcfd9d8c9 qa: test fio with multiple versions of NFS 5a8598acee5 mgr/dashboard: Disable MFA test 1f84505f123 mgr/dashboard: pin lxml to fix run-dashboard-tox-make-check failure 97c43c728dc OSDMonitor: exclude destroyed OSDs from "ceph node ls" output fe829d461ad qa/cephfs: require-osd-release should now be tentacle 96be3f122c3 common/include: Add map type election and fmt::format to interval_map af8d267e5f8 client: avoid multiple calls to path_walk b7fdda71c7c os/bluestore: Add fault_range_ex e685a333356 qa/suite/rados: exclude hybrid_btree2 from testing 35cf0f6c135 dmclock/.../dmclock_server: do not clean clients with requests 0938a592e92 test/osd/TestMClockScheduler: TestMultiClientOrderedEnqueueDequeue use client class 5562ecbcdb1 test/osd/TestMClockScheduler: create_item should pass prio < cutoff b35589f7eb3 test/osd/TestMClockScheduler: add test for very slow dequeue 8b7b0463792 osd/scheduler/mClockScheduler: add constructor to specify idle/erase/check times 35b6176d90e osd/scheduler/mClockScheduler: move constructor to header c95539ec370 src/dmclock: remove superfluous license files c625008dae9 src/dmclock: copy dmclock submodule into ceph.git 53bac4648ed common: Remove unnecessary assert checking unsigned number is 0 or greater. b6f3cda5597 */: Cleanup WITH_ALIENSTORE 2b9c79e881d os: Introduce WITH_KSTORE b0970905291 crimson/os/alienstore/CMakeLists: move alien::cflags alien::cflags is now only relevant to crimson-alienstore. 5bb1d9e1d58 crimson/os/alienstore/CmakeLists: Drop WITH_SEASTAR/ALIEN facd084b694 crimson/os/alienstore/CMakeLists: cleanup crimson-alien-common 9f3619af9ae mgr/dashboard: When configuring the RGW Multisite endpoints from the UI allow FQDN(Not only IP) e5189891b09 test: test the fmt support for bitset_set & mini_flat_map eeeb0127ae7 common: fmt support for bitset_set & mini_flat_map e5003a6af51 mgr/cepahdm: adding a message when certificates check is OK ec2b3415b95 mgr/cephadm: addressing reviewer comments f4f0de8f3c6 mgr/cepahadm: fixing certificate get_status_description output 9ffe71350e7 mgr/cephadm: adding new debug flag for testing purposes only 81c54dd9c78 mgr/cephadm: fixing docs and defaults for some options eae45d208a6 mgr/cephadm: improving individual certificates checks dd6e81be3a2 mgr/cepahadm: added some logic to avoid loading unknown certs/keys 40e5ab760af mgr/cephadm: reverting usage of Org Name 'Ceph' in self-signed certs 37869ee2936 mgr/cephadm: adding new comands to remvoe keys/certificates 70e4e1c69e0 mgr/cepahadm: adding code to store self-signed rgw certificate fa990d39db8 doc/cepahadm: adding new file for certmgr documentation 14b914fa3c1 mgr/cephadm: adding cephadm mgr-module to the gitleaks file 8be392f62b1 mgr/cepahdm: adjusting grafana custom code to handle certificates b008856bcf7 mgr/cepahdm: fixing cert user_made and pre_remove actions of mgmt-gw b1b74f74c28 mgr/cephadm: fixing oauth_proxy pre_remove action 6ce19fab002 mgr/cephadm: adding UT and adjusting existing unit-tests 5d42b73e748 mgr/cephadm: renaming cert-store cmds to certmgr, adding new cmds 3bb6c572a38 mgr/cepahdm: adding certificates validationg and management logic 2ab4e8b309a mgr/cephadm: refactor cert_store to use the same code for cert/key bef277a5ce0 Revert "os/bluestore: Add debug hooks" 6f8275c880a Revert "os/bluestore: Deferred writes unit test, replicates corruption" e1c75071b4e Revert "os/bluestore: Modify _deferred_replay" caa77ed690c Revert "os/bluestore: Split _deferred_replay into 1) apply IO and 2) remove keys" d2b49489447 Revert "test/unittest_deferred: debug code" 5ec60853cfb Revert "more debug code" 4180ff9cbd8 Revert "fixup" c2b2d33293b kernel/KernelDevice: replace obsolete get_tracked_conf_keys() 6dfc166e53e crimson/osd/recovery_backend: scan_for_backfill pass start by value 8ca4fc01b1a crimson/osd/recovery_backend: scan_for_backfill to use seastar::lambda 6533f261dc3 test/crimson/test_crimson_coroutine: add test_coroutine_loops 1f80b3840d0 crimson/osd/recovery_backend: _handle_pull_response to use obc_manager a0df2e5133c crimson/.../replicate_recovery_backend: remove unnecessary check b6095992051 crimson/osd/recovery_backend: scan_for_backfill to use obc_manager 878f3bff706 crimson/osd/recovery_backend: move scan_for_backfill to coroutine f65b00ea8a9 mgr/dashboard: Improve sso role mapping 0d0f38fb5cf osd: Make casting to/from shard_id_t require explicit casts. bf6faed0010 mgr/dashboard: fix token polling req in multi-cluster UI bedc75fff28 qa/workunits/rbd: wait for resize to be applied in rbd-nbd 8e9b08ec7f8 librbd/ConfigWatcher: replace obsolete get_tracked_conf_keys() 329043355e6 rbd/throttler: replace obsolete get_tracked_conf_keys() 4325a506351 mds: replace obsolete get_tracked_conf_keys() bb2ac3222fc nvmeof: replace obsolete get_tracked_conf_keys() 52568c35460 test/crimson/test_config: replace obsolete get_tracked_conf_keys() 27c5678fd12 mgr/dashboard: update dashboard nvmeof proto files 2290a904bd6 doc/releases: Add ordering comment to releases.yml a3f45c70a23 qa/rgw: add test for sync policy user mode c22c5c1f6b8 qa/rgw: add non-account (alt) users to multisite tests 16daa6a687c ceph-volume: allow zapping partitions on multipath devices cf0e9308836 mgr/smb: Add ceph_snapshots vfs module to share definition 32d57d77132 common: bitset_set and mini_flat_map 7b4ac886621 doc: fixup #58689 - document SSE-C iam condition key bfcb5334c2f mgr/cephadm: use ip_hash to enforce the same prometheues upstream db494081588 crimson/os/seastore/rbm: add do_with() to prevent accessing unavailable reference d8eed120044 crimson/os/seastore/rbm: create a device file if it doesn't exist afa53017330 qa/suite/crimson-rados: add seastore test with RBM b7c189b33c7 qa/rgw: bump vault version to v1.19.0 2e73c875640 os/bluestore: implemented bluestore_blob_t::get_unused_mask 088c9ed28fb RGW - Temporarily disable List2Inotify1 in the posix bucket cache unit tests, until we can find why inotify fails on CI machines 8dbcb175e46 rgw: sync fairness watcher reconnects on any error dc0c6ab5e86 crimson/osd/pg_backend: rep_op_ret_t to not return acked_peers 7462b1c06e3 crimson/osd/pg: Handle peer replies handling once received 522cc6c3c41 crimson/osd/replicated_backend: Introduce pending_shart_t::last_complete 551eb008718 crimson/osd/pg: Introduce PG peering helpers 164d76f5cc6 crimson/osd/pg: use rep_op_fut_t 81cac395a84 common/obj_bencher: include cleanup 7175fb3c13f common/cmdparse: include cleanup 19ab0fe8c3f common/Formatter: remove unnecessary include 5b589f55860 common/SloppyCRCMap: add missing include 30a9248d6ce common/ceph_time: remove unnecessary include ec52e618774 common/convenience.h: remove unnecessary includes 2b5fbc050c0 common/Finisher: remove unnecessary include 498e7271c6b include/denc: remove unnecessary include 5ca8173af56 common/TrackedOp: add missing includes b24aabad6a9 include/types.h: include cleanup be3329477b5 common/perf_counters*: add missing includes 04e285e253e common/fair_mutex: include <thread> only with CEPH_DEBUG_MUTEX 90484deb9f0 common/PriorityCache: add missing include d7467b0992e blk/kerneldevice: count ops not bytes in discard_op perf counter 814f1136cac qa: add test case for remove xattr e16820fa4a0 test/libcephfs: include inode type change test for snapdiff 33c6f232069 mds: include deleted file dentry in snapdiff readdir result 6869996f2a1 doc/radosgw: Improve layout.rst fd75679cf4b build-with-container.py: Add --rpmbuild-extra-args a5a983c7363 Dockerfile.build: Install sccache 800f5c2924d build-with-container.py: Add --ceph-version a1f607bd1be make-srpm.sh: Skip make-dist if tarball is present 8e9544fed3d build-with-container.py: Add --env-file ef84118419a cephfs-shell: Add the option to remove xattr 70eb1d64ac1 cmake/cephfs: fix options to enable client and dependencies 28d8281ad60 crimson/osd/osd_operation/client_request: remove CompletionEvent from instance_handle_t::pg_tracking_events 90ac7409279 pybind/cephfs: use legacy noexcept for cdefs for cython 3.Y.Z f2b3bc810a1 osd_type: use SERVER_TENTACLE for fixing the pg_pool_t dencoding 395263ceb2f pybind/cephfs: increment ref before calling out to c++ fd184893ac0 test/osd: Code formatting changes for plugin support in ceph_test_rados_io_support dd06be06eb2 test/osd: Added support for new plugins 4cc245e43c7 src/test/osd: Split reader classes for program options into a seperate class e66437a98d5 src/test/osd: Move ceph_test_rados_io_sequence to its own subfolder 678ed6e1b09 erasure-code: Add minimum granularity interface to EC plugins fe3bc7605c7 rgw/rados: calculate_preferred_shards takes bool is_versioned 519b8b2808c rgw: scale shards based on versioned() to cover suspended buckets b45f65615d3 rgw: trigger resharding of versioned buckets sooner 66077a8a49e tests: replace obsolete get_tracked_conf_keys() fe97d05f0de crimson/mgr/client: add Client::retry_interval() d3e0ca7ffa8 crimson/mgr/client:Introduce Client::send() ce3181ed251 mds: Fix MMDSCacheRejoin::dn_strong version check failure 693f058426a mds: Fix mdcache rejoin invented referent inode 7b2d9c4b580 qa: add more referent inode tests 43b4ef3f54c qa: referent inodes - unlink, stray_reintegration 1adfe920f28 test: ceph_test_rados_io_sequence - seq 14 - write object filling gaps 146e4d7085a test: ceph_test_rados_io_sequence - scripting enhancements ae012cce34e test: ceph_test_rados_io_sequence - add truncate fff72a05b65 test: ceph_test_rados_io_sequence - add append with gaps sequence f3ee8757f49 test: ceph_test_rados_io_sequence append sequences 03316ff4ace test: ceph_test_rados_io_sequence support appends 9911ecb683b mgr/dashboard: carbonize rgw user and bucket form 3303f86fdd5 crimson/os/seastore/linked_tree_node: set reserved_ptr to an 8-byte aligned address c2d226adb00 rgw/cloudtier: Correct option ordering in RGWZoneGroupPlacementTier a090f14fc73 os/bluestore: New unit test for BlueFS deb78a9199e Revert "pybind/mgr: Protobuffer file generation for grpc deps." 741742e3910 Revert "pybind/mgr: Generate pb2 file in src/pybind/mgr/dashboard/services/proto using the protobuf file from the gateway submodule." 9cc3fbebb7e Revert "Move proto generation code block out of if(WITH_MGR_DASHBOARD_FRONTEND)." 6e23a1e43be crimson/mgr/client: partial move to coroutines b5f7200c05b crimson/mgr/client: update logger c34d9b039c7 qa/suites/orch: add a test to verify ctdb_status doesn't include GONE node ecd24969339 qa: Disable referent inodes for a few test_strays tests f27a47ac9de qa: referent inode test - link w/ max_mds=1 5e4812cdb55 qa: Add function to fetch inode from metadata pool d4a93ce43ad tools/ceph-dencoder: Add an option stray_okay 1772dc1cdf0 mgr/dashboard: Changing SimpleGraphPanel to TimeSeries Panel in cephfs.libsonnet 5935a0f295a fixup 5a29f74454f qa/rgw: add new teuthology for cloud restore s3 tests d2c1f9953d8 qa: Fix dashboard test_health failure f6f460c1492 tools/cephfs-journal-tool: Recover referent hardlink dentry ba5df7ae75a qa/cephfs-data-scan: Validate referent hardlink recovery 4e0f7dbd558 qa/test_backtrace: Validate remote_inode xattr is stored 410dcccc79b tools/cephfs-data-scan: Recover referent_inode list 3d4ac8c82fe tools/cephfs-data-scan: Recover referent hardlink - build dentry 97650eeef18 mds: Referent hardlink Recovery - Store remote_inode f264f11f44d mds: Fix straydn race between unlink/rename linkmerge f66353d36e7 mds/rename: Handle referent inode rollback 1c8ec948f62 mds/rename: Handle source dentry being referent remote 04b1ead3e45 mds/rename: Handle existing destdn referent remote 69d401f606e mds/rename: Handle referent remote linkmerge case e6c6f52e548 multi-mds/unlink: Handle rollback of referent_inodes list 236a4b7b046 multi-mds/unlink: Referent inode - reverse link mgmt 42d88f4072f multi-mds/unlink: Unlink referent inode on dentry replicas f94c8327fac multi-mds/unlink: Remove referent inode on unlink 0779064a7c2 mds/unlink: Referent inode - reverse link management bcf2e7d9a0f mds/unlink: Remove referent inode on unlink 0ed8c2a2b1c multimds: Consistent view of referent inode list c39977ff26f multi-mds/link: Handle rollback for referent_inodes list 18165365fe6 multi-mds/link: Reverse link primary inode to hardlink d7d294e3687 multi-mds/link: Send referent inode to dentry_replicas 79c3d122d2e multi-mds/link: Create referent inode and store backtrace 8abee7d58ae mds/readdir: Handle referent inode efa6a8c75a1 mds/link: Reverse link primary inode to hardlink fb3bf789f4d mds/link: Create referent inode and store backtrace 645493bc6c4 mds/mdcache: Handle referent inode on discover a069e7a6ac8 mds/rejoin: Don't fetch the dir is already complete during rejoin 2ec2c1d63b9 mds/rejoin: Handle referent inode on MDSCache rejoin 11eddc85d5a mds/migration: Handle referent inode during subtree migration dafc07cb816 mds: Handle referent inode while trimming the dentry 1e5fca15822 mds: Handle referent remote similar to remote 1bb435d4a2a mds: Log referent_inodes list with CInode a6088f0d877 mds: Log and dump referent remote cdentry 8c624968957 mds/journal: Replay referent remote dentry 1cce52fd0d8 mds/journal: Journal referent remote dentry 72613db034c mds: Make referent inodes a optional feature 1b4d4f8e24a mds: Load referent inode from disk 8de360960af mds: Commit referent inode to disk 7822a588e8e mds: Store list of hardlinks on the inode of primary link 3c034df6794 mds: Store remote inode number in referent inode b9947bacdfd mds: Hardlink referent inode plumbing work d41f0fa01f5 test/pybind/rbd: fix read offset in write zeroes tests 54f47cc28ff librbd: add rbd_diff_iterate3() API to take source snapshot by ID e1e840628d3 more debug code 2c03fc63e9a mon: track 'mon_cluster_log_to_file' 1a06923049d auth,client: replace obsolete get_tracked_conf_keys() 2d4b4235fc2 mon,mgr: replace obsolete get_tracked_conf_keys() f858fa958a6 doc: add dump stray folder command to the docs ee2beecfe9e qa/tasks/cephfs: add test for dump stray comamnd 801951e8c0d mds: implement new asok command for dumping stray folder df404e03915 mds: move MDSContext completion handling to finish method 7193adafaea ceph-volume: Refactor is_ceph_device to simplify error handling fc085405abe ceph-volume: Introduce new `Lvm` base class to unify LVM object handling 3e9ff5cc1af ceph-volume: refactors `api.lvm.Volume._format_tag_args` 59df54e4103 test/crimson/seastore/CMakeLists: [arm64] disable omap manager 25a16116f07 crimson: bump up seastar fixes ec4edf73eec seastar: bump up seastar submodule d5e900f0aa3 mgr/cephadm: Open port 4721 while deploying cephadm agent f8c794fe857 crimson/os/seastore: group omaptree-related implementations 75be0272e84 doc/rados/operations: Clarify stretch mode vs device class d1379781d16 crimson/os/seastore: improve omaptree logs 1cb13e87ab4 crimson/os/seastore: unify omaptree interfaces 79d74bf5449 bluestore: replace obsolete get_tracked_conf_keys() ea80b5fa6eb librados,msg: replace obsolete get_tracked_conf_keys() e3755b047e4 crimson/os/seastore: pass onode as reference whenever possible 6008796799f crimson/os/seastore: unify Transaction& parameter for omap 8a7bad00428 crimson/os/seastore: introduce get_omap_root() 56c37d7035e cmake/modules/BuildISAL.cmake: set no-integrated-as on clang only ff9aa20bc35 librbd: fix a deadlock on image_lock caused by Mirror::image_disable() 7b9662628e3 crimson/os/seastore: cleanups around omap_root_t fff713965ec test/unittest_deferred: debug code a9b00cfbef5 doc/rgw: update dynamic resharding docs to reflect recent changes 313546146c4 doc: document the new container build tool and link to it in README 794e3d0b25a script/build-with-container: add support for overlay dir 4208a736652 script/build-with-container: skip dnf cache dir volume mounts on docker 612a9d6808f script/build-with-container: remove default --volume arg from ctr build f6e6188e30a script/build-with-container.py: build builder image with --pull=always 37b7d509c59 script/build-with-container: add a common packages target 30836c4ed4b script/build-with-container: support custom tag suffixes ff34bf7241f script/build-with-container: add --base-branch cli option a1d49d557cf src/script: rename CEPH_BRANCH to CEPH_BASE_BRANCH for build container c1713c5bc37 script/build-with-container: add --current-branch cli option 65f055f0d83 script/build-with-container: add more distro aliases de855aec1c7 script/build-with-container: apply black formatting to file f8571d9cf9a rgw: add radosgw-admin sub-command to set-min-shards for a bucket 5ee4a92380e rgw: allow per-bucket minimum number of shards 36f2ed56d47 msg: messenger dump: Handle name collisions 453c11fcfc8 test/msgr: use 'atomic' from 'std' explicitly 2dd0059582c PendingReleaseNotes: Add note on messenger dump 1becca76b53 doc: Add Messenger Status Section to Operations->Monitoring 75a02c25db6 qa: Test `ceph tell <target> messenger dump` 4b7d43751a8 msg: Add `messenger dump <name>` asok command b7d47bceaf5 qa/cephfs: avoid unnecessary importing in test_volumes.py 323ef5175f4 crimson/os/seastore: introduce omaptree_update_root() 2c03e77e042 crimson/os/seastore: introduce omaptree_clear() 43f9eeb1e36 crimson/os/seastore: drop unnecessary _xattr_clear() a1ef880821e qa/rgw: s3tests task adds --purge-data to 'account rm' 83bacbb4745 radosgw-admin: support 'account rm --purge-data' d41a676b494 crimson/os/seastore: various cleanups and indention adjustments 470b6fa81fa crimson/os/seastore: introduce NONE to omap_type_t 1588712b558 qa/tests: retry the api call after making the request 9b2e474e04c crimson/os/seastore: drop unnecessary _omap_set_kvs() 31333885a12 crimson/os/seastore: cleanup _omap_set_kvs() 2b2b17afc5b crimson/os/seastore: drop unnecessary do_omap_get_values() 09807250719 mgr/dashboard: Changing SimpleGraphPanel to TimeSeries Panel in pool.libsonnet cccbfe12fb1 test/test_not_before_queue: fix Signed-vs-Unsigned warnings d7f9aecd3ad osd/scrub: log scrub-queue advance_time() failures 7ba63ac2947 common/not_before_queue_t: tolerate non-monotonic cut-off values f155abe5187 mgr/dashboard: Changing SimpleGraphPanel to TimeSeries Panel in host.libsonnet 171954e7dd6 mgr/dashboard: Changing SimpleGraphPanel to TimeSeries Panel in osd.libsonnet 93fba05e46c mg/dashboard: Edit Storage Class 616fdd1ae39 client: skip unexpected command replies 56cb05775a9 mgr: indicate map message is acked instead of unhandled f060ee867f5 osdc/Objecter: convert to ms_dispatch2 for ack 2810ed0f608 client: indicate maps are acked not processed c9d0913f53b msg: add alternate statuses for ms_dispatch2 handling 3b79bdbee04 tools/cephfs_mirror: do not process maps with fast dispatch 404d7e32781 doc: add docs for volumes interface for charmap 71c57121cf6 qa: add tests for subvolume charmap settings a6eeec80d77 pybind/mgr/volumes: wire up charmap for subvol/subvolgroup f7329814c91 pybind/mgr: send MDS commands through cephfs client 72d0a76e8c5 pybind/cephfs: wire up mds_command2 b3ec7385ab2 mgr: add module method to send notifications 62601ef6420 libcephfs: add mds_command2 for asynchronous commands f20df2eb854 mgr: excise CephFS client from mgr C++ base 706b2be4162 mgr: use std namespace d862d74a098 doc: add docs for CephFS charmap config 84bf1898be5 qa: add charmap tests 6f76b22c9b0 qa: add helpful exceptions for attr changes 0e9cdbe0abc qa: ignore libicu leaks 751cf313dd5 client: add wrappings for charmap manipuluation of dentry names 0fa4a95eadf client: add dir_result_t::dentry::print e80d0bf0079 win32: add libicu Windows build db58a29a538 CMakeLists: add boost::locale dependency for client 668a556322d install-deps: unconditionally install boost libraries 292f5ac45b8 test/libcephfs: update root operation return values b8662fdb033 client: refactor all path traversals through path_walk aaaa04264a0 test/libcephfs: test parallel creates 0f2abc9bc93 test/libcephfs: add test for lookup failure after readdir 4f8d1d38a38 client: init dentry shared_gen with invalid value bac86c20d0e client: add _lookup debugging 41a3f099516 client: remove redundant check 764208ead49 client: dump InodeStat from mds 6c891f96aae mds: encode optmetadata in InodeStat sent to clients 9bbfdadd1f5 mds: check client features for charmap 4ac9776adbd mds: add client feature bit for charmap 9f0c4227261 mds: wire up vxattr for changing charmap 033d8666373 mds: inherit charmap on mkdir 1ffaa361454 mds,include: add charmap optmetadata d958bcb73c6 mds,include: add inode_t optional metadata 1e34963af11 client: hide alternate_name from API 9c276fd9b63 client: move alternate_name once f346e9a2cab client: optimize alternate_name passing to helper 45ff4994f25 client: relocate definition 5c0fa1128c4 client: print dentry with alternate_name on dump c2e551260cc client: move inode dump to print method de8ceffe2b6 mds: add debugging for encoding lease stat c48f1db6ef5 mds: make encode_lease a proper method 59405d4da16 mds: add fscrypt metadata for inode stat size ff42d860370 client: use DentryRef for ref counting in MetaRequest 3c3d56fbbad client: add DentryRef 5f53a239a44 client: add helper for determining if a perm check is necessary d27eb1aab68 client: cache client_permissions config be954e09e48 client: add debugging for conf changes a84c396e7d3 client: sort configs aeb07bb1cbf client/UserPerm: add print method 8e88fb00452 client: note mount parameters in debug log d6a5656387b client: print stat mode in octal da50c6e581f common: add missing op string e62fce4ec98 include/filepath: add empty path check 5ae53387e1c src/test/crimson/seastore/CMakeLists: disable unittest-transaction-manager 374ddbc0e87 rgw/log: Fix crash during shutdown with ops-log enable. 8137616ecf8 mgr/cephadm: Add virtual_ip as a param for mgmt-gateway apply cmd fa0598af33b doc/rbd: improve nvmeof-requirements.rst 562aad626ff osd: truncate shard object to correct size with ECSwitch. dd4248f69ac osd: test: Split unittest harness for EC into legacy and new code. 1fceb55f25d osd: Re-introduce the "optimized" IO path. e5657805f9a osd: ECBackendL should not implement PGBackend directly (only ECSwitch) and add ECLegacy namespace df7decd854c osd: Move ec_inject interface in ECCommon into ECInject.cc c9e67c9d052 osd: Move ECListener to its own file. 31a2b10cd8b osd: Add ECTypes and add ec_align_t to it 482ec835d1e osd: implement ECSwitch to switch between EC implementations 481dfb15e46 blk/kernel : skip AIO thread for zero-sized devices ab5005f7597 osd: Use #pragma once rather than ifdefs to control inclusion. d9eda192c21 osd: Re-introduce ECUtil 182473f0d0c osd: Duplicate ECUtil to ECUtilL ed0fbcf850a osd: Auto-refactor: ECTransaction -> ECTransactionL 3cad33dcbb4 osd: Auto-refactor: ExtentCache -> ECExtentCacheL 6a9ab113cdf osd: Auto-refactor: ECBackend -> ECBackendL 526dac1331f osd: Auto-refactor: ECCommon -> ECCommonL c3a4c9b440f Revert: "crimson/osd/ops_executer: prevent access to null pointers caused by gcc bug" 0e6e218215f crimson/os/seastore/omap_manager: do binary search on omap nodes 032fd3a51fe crimson/so/seastore: clean up logical_child_node.cc 642e5f2da00 container/build.sh: remove local container images 64ab3a3e49d rgw: use object ARN for InitMultipart permissions 945eb10c11d doc: PR Template - Remove non-functional trigger phrases c84a89bb56b doc: PR Template - Add Jenkins job URLs to commands 357f12f074d radosgw-admin: lower default thread pool size 2390788b890 qa/rgw: fix user cleanup in s3tests task 0a4be810899 rgw: ensure connect timeout is set to 3 seconds only in the case of notifications 1b59a154109 rgw: remove unused log op info from prepare_op f15b35d7dcc Revert "test/crimson/test_interruptible_future: disable handle_error" cb5698a0679 Revert "crimson/.../replicated_request: work around gcc 11 bug in with_pg_interruptible" 7f509578ed6 Revert "crimson/.../client_request: work around gcc bz101244 and bz102217" 4a7866aeccf monitoring: fix NVMeoFSubsystemNamespaceLimit f4360508cc3 osd_recovery_sleep_degraded, osd_recovery_sleep_degraded_ssd, osd_recovery_sleep_degraded_hdd added in the configuration to throttle the data movement while recovery when pg is degraded b7ee4a3d50b qa/.../test_rgw_rados_pool_quota: ignore cluster warnings c426a2ba610 crimson: Trigger a wake operation via acquire_throttle 3065ffeb014 mon: show count of active/total nvmeof gws in "ceph -s" e3fab2a50f1 mon: Add nvmeof group/gateway name in "ceph -s" c3b7d6f1936 doc: fix incorrect radosgw-admin subcommand 53098baf693 rgw/cksum: GetObject omits checksum headers for Range requests 66b782fcda4 qa/.../test_rgw_rados_pool_quota: add test for deleting objects with pool at quota 2efa41d860b rgw/rados: use set_pool_full_try() when deleting tail objects 2b700c6d002 rgw/rados: use set_pool_full_try() when deleting head objects 76bd3d4b5e7 rgw: reject PutBucketLifecycleConfiguration on indexless buckets fa4c5cebd2b rgw: improved error when listing indexless bucket b05a9580f8e examples/rgw: register boto extension for BucketIndex on CreateBucket 567f6086ce8 rgw/s3: CreateBucket extension for layout type and shard count cd867bc19d9 rgw/rados: create_bucket() can override index type and shards c7774831d5c rgw/rados: indexless buckets skip init_index/clean_index 184da0a83bc rgw/s3: CreateBucket's LocationConstraint is optional 0d930f2d93f mgr/vol: add a helpful comment in async_job.py 3327cc0500c os/bluestore : Refactoring Allocator Class 71f028e81e4 os/bluestore : Refactoring Allocator Class 49ac822fba5 os/bluestore : Refactoring Allocator Class 67659230bf8 mgr/dashboard: SMB - Edit Cluster Fixes: https://tracker.ceph.com/issues/69964 57137e799b2 qa: remove unreacheable/redundant code from test_data_scan.py 2bd1cc13700 doc/releases: correct squid release order 54fef6bca26 mgr/dashboard: Add GKLM(KMIP) option to SSE-KMS dropdown Menu in the Dashboard UI cd394e51c8b mgr/dashboard: SMB - Edit Share. c61c314ed64 doc/rgw: clarify path-style vs virtual-hosted-style access 05e22c76f4c doc/rbd: Improve nvmeof-requirements.rst with proxy and other info e681d372b3c mgr/cephadm: don't block matching group for identical nvmeof services eedfc17597d rbd-mirror: default <-> non-default namespace remapping a741f61b002 python-common: add ctdb port to smb service spec 38eb10e9381 cephadm/smb: add ctdb ports to smb daemon endpoint f26d160485f mgr/dashboard: Update bucket details section after making bucket lifecycle changesn 0ceefb407d6 cmake/modules/BuildISAL.cmake: use GNU assembler 6ea54929b34 src/CMakeLists.txt: -Wno-vla-cxx-extension only on clang >= 18 b340461b651 script/ceph-backport: remove upstream remote inferencing 684f1938506 os/bluestore : Assigning a named variable to ceph::time_guard to prevent immediate destruction 0f4a37dd9f2 qa/workunits/rbd: add a test for force promote with a user snapshot 3053af8b11c ceph-volume: update lvm batch unit tests 01f8f710c1a qa/cephfs: add tests for "fs subvolume create" command when... 82fc1e7cac3 mgr/vol: print proper message when subvolume metadata filename is too... 6bf46083946 rgw/cloudtier : disable sync for cloud tier objects ff1b9565511 mgr/dashboard: nvmeof trash rbd image on namespace rm a3662765e63 doc: Support to retrigger docs/readthedocs.org:ceph PR build 42990500a59 doc: fix syntax (squash this) bb41cc71c77 doc: fixup (squash this) c3c94806a7f mgr/dashboard: update openapi specification for /api/cluster/user/export 961d474efa5 src/common/options: Improve descriptions in rgw.yaml.in de8b21d7bdf install-deps.sh: enable crb repository for centos 10 stream 37a3fd46c59 do_cmake.sh: specify correct python version for centos 10 stream 90d1d6ba82e doc/cephadm/services: Re-improve osd.rst b454668983f rgw: PutObjectLockConfiguration can enable object lock on existing buckets 1c0359dcf00 qa: ignore variant of down fs acc80adde99 os/bluestore: fix fault_range for _do_write_v2 520d326ebdd rgw: add default parameter for clients to time out incase they hit wrong url this fix ensures clients gracefully time out in case endpoint url is wrongly configured. ac7789139e3 tool/ceph-bluestore-tool: Make bluefs-bdev-expand command output nicer. a70a3ced7e1 os/bluestore: do not log undecodable bdev label as an error 4f5f8483444 doc/ceph-bluestore-tool: add description for show-label-at command. bd7764bc699 os/bluestore: fix alloc update after bdev expansion in NCB mode. 2a9c776f6aa os/bluestore: be less strict in main bdev label validation. ba3e4d2c9da os/bluestore: use proper device when updating DB/WAL label while expanding. 173bbe7dba7 os/bluestore: don't use bdev.size() when dealing with bdev labels in fsck. c06ccf57de3 os/bluestore: fix bdev label.size update when expanding device. 19788291c99 tools/bluestore-tool: add "show-label-at" command e1e2fbae176 tests: add call to fscrypt_cli_setup.sh to all fscrypt YAML files abe99d04411 tests: use custom fscrypt cli for xfs tests acae8940d85 tests: add --verbose for better debugging of the custom fscript cli 09daeb666fc tests: add new script for custom fscrypt cli setup 0a76d6cd01d qa/standalone/scrub: retry in TEST_abort_periodic_for_operator() 4717fa3a9ff osdc/ObjectCacher: include cleanup e24ced86861 osdc/Objecter: include cleanup 6d0bcaa55d8 osdc/Journaler: include cleanup 50c5cb2e1d1 osdc/Striper: add missing includes d9bd0043deb osdc/Filer: include cleanup 7f904c4b6d9 crush/CrushWrapper: un-inline methods to fix linker errors a8f21ce3fe6 client/Client: add missing include and forward declaration 80b0065fd71 mds/snap: include cleanup 36aae820e91 mds/MetricsHandler: include cleanup dbba44628f4 mds/LogSegment: add missing includes 7e84be8741f mds/JournalPointer: include cleanup f5b2171e8bf mds/cephfs_features: include cleanup 00b11730975 mds/MDSMap: include cleanup 0ca2e4f0b34 mds/Migrator: include cleanup c510cdeef72 mds/MDLog: include cleanup b13022f9810 mds/SnapServer: include cleanup 7c673c33dc7 mds/MDSTableServer: include cleanup 7c48d167ff0 mds/MetricAggregator: include cleanup 614540f9e0f mds/SnapClient: include cleanup 200f81a602d mds/MDSPinger: include cleanup 5b20b7ae544 mds/flock: include cleanup 9799356a8f9 mds/MDSAuthCaps: include cleanup 4aaeefde01b mds/QuiesceAgent: include cleanup 6a1f76cac54 mds/QuiesceDb: include cleanup fe177b34960 mds/mdstypes: include cleanup 09cfb4b24fc msg/Locker: include cleanup 520a56f0fe7 mds/journal: add missing includes d2820348583 mds/Server: include cleanup b76c99bc320 mds/LogEvent: include cleanup 00ae09e7483 mds/Capability: include cleanup a660eae3c54 mds/DamageTable: include cleanup 85fad5021fc mds/StrayManager: include cleanup be2624f8ea4 mds/Mutation: include cleanup a2b3c464ab8 mds/SnapRealm: include cleanup 1bda0d4b73b mds/InoTable: add missing include 63a662f29bf mds/ScatterLock: add missing include 83d47c8e8f0 mon/MDSMonitor: add missing include 645307fa38e mon/MDSDaemon: add missing include cc36b4f78c6 os/memstore: add missing includes 31188970a4a src/libcephfs_proxy/CMakeLists.txt: add -Wno-gnu-pointer-arith 9b8e337cbad src/erasure-code/jerasure/CMakeLists.txt:: add -Wno-unused-but-set-variable 88845c2ae23 src/CMakeLists.txt: add -Wno-vla-cxx-extension to clang 0e5a51b6b8a script/run-make: bump up to clang 19 c296b7a8120 src/CMakeLists.txt: require clang16 08ae32f016e src/script/lib-build.sh: start search for clang versions with 16 rather than 14 607d011c440 test/objectstore/..ops_replayer: cleanup include std::format ad5db1feac7 script:run-make: use llvm.sh (download.ceph) mirror 6d927cb0525 cmake/modules/BuildQATzip: Disable errors 9614ad3834a src/script/run-make.sh: clang 14->16 5026c1d5e4c crimson/os/seastore: cleanup, reuse onode[op->oid] 2f5982b27a0 crimson/os/seastore: handle log_root in _rename 68e6227122e crimson/os/seastore/../fltree_onode_manager: add omap type asserts 9d5eaa0df6e crimson/os/seastore: remove d_onodes 4e727a36efa src/crimson/os/seastore: add logs to track log-related OPs in transaction 78bf7bb541a test/crimson/seastore: adjust existing test based on two omap trees 17fa54d1787 crimson/os/seastore: adjust _remove to support omap tree for LOG c84ef0986b8 crimson/os/seastore: adjust _clone to support omap tree for LOG 4690721880e crimson/os/seastore: reuse do_omap_get_values in _get_attrs 0dbbbd72227 crimson/os/seastore: reuse _omap_set_values() instead of _omap_set_kvs() dbfc5305b04 crimson/os/seastore: handle log-related interfaces depending on the type e0109bb9ac4 crimson/os/seastore: add omap_type_t to omap_context_t to allocate OMapLeafNode in omap_load_context 082c90006ec crimson/os/seastore: allocate OMapLeafNode depending on the type cd6bdd288d6 crimson/os/seastore: initailize log_root if set_all_hint is called with the corresponding flag efba0106de4 crimson/os/seastore: initialize omap tree using omap type 868b8160df4 crimson/os/seastore: adjust onode to store the two omap trees 6fae0fdf383 crimson/os/seastore: introduce two omap types (small and large) to omap_root_t 14e6ed80d66 crimson/osd: use set_alloc_hint when creating an object for PGLog 55c3ac55dce ceph-volume: migrate unit tests from 'mock' to 'unittest.mock' 140199b098b ceph-volume: refactor get_physical_osds() 7dfeceed4a6 ceph-volume: support splitting db even on collocated scenario 8d8f203caef ceph-volume: enhance BlockSysFs 50c2f0709f0 qa/standalone/scrub: fix osd-scrub-repair() b657f9f2c63 qa/standalone/scrub: expand standard_scrub_cluster() 071abe955df osd/scrub: remove config option osd_repair_during_recovery 10af90547fd mgr/dashboard: add actions to create, edit and delete smb join-auth and usersgroups resources e5127b914cb suites/rados: cache tier deprecated, no need to keep the tests for it 56cb53db963 LogMonitor: set no_reply for forward MLog commands 11677c29ee6 mgr/dashboard: disable deleting bucket with objects edd96f9b05e include/unordered_{map,set}: remove, use `std` directly instead 891225014fd cephadm/tests: update daemon_action tests with force flag 0046eaaa367 mgr/cephadm: default check ok-to-stop when restarting daemons through orchestrator d0ec2d2841d qa/cephadm: add timeouts and debug commands to rgw-ingress test 5d5cf5b4225 mgr/dashboard: Make API backward compatible with size param change b1405c3c5e1 mgr/dashboard: add smb share delete action 6b2c7422d1a libcephfs_proxy: implement client side async rw operation e23667892c5 libcephfs_proxy: implement server side async rw operation 4762223ef13 libcephfs_proxy: implement the async rw callback 03b92b19272 libcephfs_proxy: define async rw opcode and structures 5e3c983d910 libcephfs_proxy: define some helper macros for callbacks df1eff54e2a rgw: /admin/account APIs accept negative values 7d75161051d librbd: fix a crash in get_rollback_snap_id 1c1acfad5dd test/store_test: wait for collection removal before going forward with the next stage in CompressionTest a6a499ed5fc os/bluestore: preload all the compressor plugins on mount. 8009a3d78f0 qa/standalone: do not use /etc/fstab as an always-there bytes source bf8737028fe qa/rgw: configure 'iam root' accounts outside of rgw/verify f9e30c84185 crimson/osd: replace obsolete get_tracked_conf_keys() 9e73041aa30 mgr/dashboard: Rgw ratelimit feature for user and bucket fd8fbea2e73 qa/workunits/nvmeof/fio_test.sh: add more debug commands e2f3bed312a qa/suites/nvmeof: Run fio with scalability test 877c726ce7f qa/suites/nvmeof: add more asserts to scalability_test e4504065405 qa/workunits/nvmeof/fio_test: Log cluster status if fio fails 9a1ee7a3da6 rgw/lua: Update background thread to handle config changes 7ef164ebcbd crimson: fix -Wmissing-template-arg-list-after-template-kw 05ea5527c4f crimson/common/operation: fix decltype usage aca5ae65719 crimson/tools/perf_crimson_msgr: fix unused-lamda-capture d24ea15ef08 crimson/osd: move the destructor of OpsExecuter to ops_executer.cc 75a74f235e6 mgr/dashboard: tox command to generate the nvmeof proto files 70819577ba2 msg/async/Stack: include cleanup 74aea6d26f2 msg/Message: include cleanup 1b42d74a7a5 msg/async/crypto_onwire: include cleanup 36beea7a855 msg/async/ProtocolV1: add missing includes f9ca9569c40 msg/async/frames_v2: add missing includes 1a1e4eb4e81 msg/msg_types: add missing includes a98f5fe5049 erasure-code: add missing include 925bb875f23 qa/tasks/thrashosds-health: whitelist PG_BACKFILL_FULL 5cdbd8f6567 rgw/iam: add RemoveClientIDFromOpenIDConnectProvider c3dfac493d8 doc/cephadm/services: Improve osd.rst 4a6e9b0de6b doc/start: Mention RGW in Intro to Ceph c0f5359b7b4 test/rbd_mirror: clear Namespace::s_instance at the end of a test 109c75ea99a mgr/dashboard: add bucket tiering option to create lifecycle policy 9748de76e02 qa/cephfs: ignore warning that pg is stuck peering for upgrade jobs 7d9298e3de7 doc/mgr: edit grammar and formatting of rgw.rst f34243463c3 libcephfs_proxy: move pointer obfuscation functions to proxy_helpers.h 22ad8e16e8c libcephfs_proxy: negotiate and use the async cbk feature a49069748f0 libcephfs_proxy: implement asynchronous callbacks 76106dd9890 doc/mgr: Add root CA cert instructions to rgw.rst 753fcff94d1 rgw: implement ConfirmRemoveSelfBucketAccess header for bucket policy 01caaa3d376 rgw/auth: add is_root and is_root_of to identities 7055fa53c50 mds: use system error codes instead of CEPHFS_EXX codes 86a8f661519 crush/CrushWrapper: un-inline methods to fix linker errors 312ebf1d3a5 mgr/dashboard: fix Python xmlsec build issue bd3b248ab9f mds,client: change result field handling in the MClientReply message 4fe51a1afc6 mds: prepare infra to replace CEPHFS_EXXX codes to system codes b1b2716f1fd pybind/cephfs: switch CEPHFS_E error codes to system error codes 54ce97973a5 PendingReleaseNotes: add note on client/mds error codes 6866d6a3fe7 mgr/dashboard: remaning critical-confirmation-modal to delete-confirmation-modal and keeping default demetion impact as medium ed222df1090 mgr/dashboard: Add confirmation textbox for resource name on delete action 06a5ad49e92 osd/ReplicatedBackend: assert non-trivial obc existence 9efa1b97b0e rgw/cloudtier : handle multisite sync for cloud objects 153639ca7f4 common/options: fix the description of osd_max_scrubs 012ab7fbfce qa: update require-osd-release to tentacle 7e4fe061a62 tools/monmaptool: bump new cluster version to X a8148634450 doc/dev/release-checklists: remove ceph-container task 4adc8b5dc26 script/ceph-release-notes: add squid/tentacle 52efefe77e7 doc/dev/release-checklists:: mark task complete 6f6bb743c24 doc/dev/release-checklist: add nightlies task fb30a782cbc doc/dev/release-checklists: update ceph-build for tentacle 1ecb95dcefe doc/dev/release-checklists: note redmine is done b5e93dfcd22 qa: update to tentacle 0be5482fe24 doc/dev/release-checklist: question telemetry tentacle test d945d372677 osd/OSDMap: update to tentacle 816e32c8778 qa/workunits/cephtool/test: update to tentacle 995570fb345 mon/OSDMonitor: update to tentacle f276334c136 common/options/global.yaml.in: update for tentacle e30eb4f3c35 mon/MgrMonitor: update for tentacle 1d3520d1d32 qa/standalone/mon/misc: update for tentacle a8b441a1cf2 doc: update compatset for tentacle 97f1afd47ad doc: no deprecated features 9ca081cf311 include/ceph_features: add SERVER_TENTACLE feature bit 843489352bd cephadm,ceph-volume: update to tentacle a9fbfb5cf2f doc/dev/release-checklist: add backport-create-issue 7bf49d69e34 script: update backport-resolve-issue to tentacle 9fa558750c8 *: add constants and release names 4e89cc9a2d5 ceph_release: update to tentacle 586b6cfff02 librbd: bump version 2edeb88cbef CMakeLists.txt: update VERSION 115f4c4a561 doc: remove obsolete checklist item a8d535cc86f doc: reset for tentacle 15962991609 RGW - Fix POSIX bucket notify test 0c3f69deef0 qa/suites/rados/basic: ignore POOL_APP_NOT_ENABLED detail in cluster log 1881cc8778a msg: Add dump() filters to async messenger/connection 2176ec2766f msg: Add connection and messenger dump() b478ff8dbd0 msg: Add dump() to Protocol{V1,V2} f33c970da6e common: Add utility to fetch TCP_INFO for socket 3d978ca9e2f rgw: be explicit on moving rados op in APIs 0a8ceefdc20 mgr/dashboard: RGW - Create Storage Class 7b4af1f4917 mgr/cephadm/nvmeof: Add QOS timeslice field to NVMeOF configuration Fixes https://tracker.ceph.com/issues/69952 5d111e23b89 test/rbd_mirror: flush watch/notify callbacks in TestImageReplayer a9d043380b4 cephadm: ingress- Add v4v6 flag to HAProxy bind directive b783d759a9e mgr/dashboard: Add namespace counter in nvmeof namepsaces c50960c39e0 mgr/dashboard: fix image size in nvmeof namespace create/update api d9d1ab7882f librbd: add missing includes 15e09a981f8 rbd_replay: add missing include 44ae6952aba SimpleRADOSStriper: add missing include af2c4b9aba0 librados: add missing includes 9f14dab4914 nvmeofgw*: disable some tests in test_nvmeof_mon_encoding.cc since they are crashed, plan to fix this in separate commit 102d5e17bf7 nvmeofgw*: test for encode/decode of new types added for epoch-filter feature 438fdd5750c nvmeofgw*: MonClient should send a first beacon with CREATED state b35273824f9 nvmeofgw*: Add mechanism to send maps to clients that need them ba7cc3b5260 crimson: Provide an options to configure several seastar parameters edcf93a4479 crimson/osd: remove invalid argurment when printing log c7254903768 osd/scrub: clean-up scrub-store IDs generation 649f33777dd mgr/dashboard: ns update route robustness c60514087bc rbd-mirror: fix possible recursive lock of ImageReplayer::m_lock 228a5663824 qa/tasks/cephadm: don't fail if we've already cleaned up conf/keyring 3a3848678bc qa/cephadm: stop cephadm mgr module during cleanup 97bbbb11b3b tools/bluestore-tool: dump label locations with "show-label" cmd 9b718a50d63 perfglue: add missing include 5093852ae08 libcephfs_proxy: gracefully handle connection close 9caf8aeef2d cls/numops: add missing include 84ece8cb2f5 cls/rbd: add missing includes b9a18ed9bed cls/cephfs: add missing forward declaration e704ed9294f cls/2pc_queue: add missing include af2525c2568 journal: add missing includes b9ff102eaf3 libcephfs_proxy: add negotiation documentation 2d85a3537d1 libcephfs_proxy: replace legacy handshake by negotation in server side 4714e40d702 libcephfs_proxy: replace legacy handshake by negotation in client side 6704556eacf libcephfs_proxy: implement server side negotiation 1e99a25ef4a libcephfs_proxy: implement client side negotiation f9766460117 os/bluestore : Fill onode test instances with sample data 7e53cf7013a rgw: prevent data sync from replicating to buckets not owned by the user 56c8c519972 mgr/dashboard: SMB Create Share 4df368381d3 do_cmake: use Python 3.12 on ubuntu >= 24 489cc484105 common/perf_counters: use the RAII helpers when dumping c834352cc70 rgw/sts: replacing load_stats with list_buckets to correctly create a federated user in oidc namespace. 9ff058e67ac qa/suites/upgrade: ignore when pg is stuck peering 0b740052a87 common: add missing mds op names 2d389a5b94d rgw: check for duplicate rule priorities in replication configuration 4e7a682284f kv: add missing includes 938672d5d4f crush: include cleanup ef956e614c4 libcephsqlite: include cleanup 31d3275f0b8 mon/ConfigMonitor: include cleanup 379f0567932 mon/MonMap: include cleanup 8a4d9f5bf55 mon/mon_types: include cleanup 0e543469d8b mon/MDSMonitor: include cleanup d50d19a0003 mon/PGMap: include cleanup 80613fd2a8a mon/FSCommands: include cleanup a0b4583d3d7 mon/Monitor: add missing includes b7198fc6ebf mon/Paxos: include cleanup fff48287ef0 mon/ConfigMap: add missing includes f33acee3b91 mon/MonClient: add missing include ef94bac8102 mon/MgrMap: add missing includes 9d99e6bdc6f mon/Session: add missing includes c31a93cf29c mon/ElectionLogic: add missing includes 0da679061db krbd: include cleanup db6d13f55f8 doc/rgw/logging: update field description 9bc321e7433 Fix 'orch ls' to display SMB ports 1393a144274 mgr/dashboard: RGW - Delete Storage Class 8abba8b1503 doc/dev/release-process.rst: release builds cannot build containers 90101c75f25 crimson/os/seastore: only LBALeafnodes take logical extents' pointers as update parameters 4e292443361 doc: Upgrade and unpin some python versions bf101108d0b mgr/cephadm: unit test for nvmeof get_blocking_daemon_hosts function e8edf47047d mgr/cephadm: block deploying nvmeof daemons of different groups on same host 972e1eaa500 mgr/cephadm: unit test for blocking_daemon_hosts in scheduler 838b1f8df1d mgr/cephadm: add "blocking_daemon_hosts" mechanism to scheduler 60300360cc5 cephadm: fence old ranks for SMB service 7fa78e62a45 mgr/dashboard: fix image size in nvmeof namespace create/update api 4f5aa60c5d7 mgr/cephadm: use double quotes for NFSv4 RecoveryBackend in ganesha conf 3c5ae6c7d01 os/bluestore: Add libfmt to "os" 72263dbb798 os/bluestore: Add health warning for bluestore fragmentation 83a23c4c037 ceph-backport.sh: add squid to known milestones 1e7663d3825 rgw/logging: flush command should print flushed log object name 55e6f54831f script/lib-build: Use clang 14 44804a374a8 qa/workunits/rbd: use create_image_and_enable_mirror() in bootstrap tests 774016bd763 rbd: don't clone ioctx before calling get_mirror_peer_sites() f5eadfff807 librbd: fix mirror image status summary in a namespace 18d787a32b9 crimson/os/seastore: remove fixed-kv-btree parent<->child pointer codes from FixedKVNodes 6856dba3ed0 crimson/os/seastore/btree: fix fixed_kv_btree's type errors f292b670181 crimson/os/seastore: add linked tree nodes 3bd34683e79 crush/CrushWrapper: Merge weights if rule contains multiple take df496529870 pybind/mgr/mgr_module: turn off all automatic transactions fa12ce661f3 cephfs-top: exception when terminal size greater than PAD_WIDTH e58e2f553d2 os/bluestore: fix do_write_v2 extentmap compress issue d9b0e780013 qa/multisite: add a create_bucket test with tenanted user 31da2c6be83 doc/rados/operations: Improve pools.rst 7cd76660188 libcephfs_proxy: implement receiving of negotiate structure f893605c16a libcephfs_proxy: add negotiation structures 3a4232728b7 libcephfs_proxy: add support for control messages 9e0a231d8c3 libcephfs_proxy: reuse proxy_link_{read|write} b079a079ea3 script/clean-ci: allow specifying custom remote name to push/fetch 2804a59a744 script/clean-ci: do not push if there is nothing to delete f7cce293051 erasure-code: Set reed_sol_van to be the default technique for Jerasure if none is specified. Also make the erasure_code_plugin_exists function in ceph-helpers.sh differentiate between a non-existent plugin and an initialization failure. 3667f4ab795 os/bluestore: make retry_max and initial_delay configurable for aio submit_batch c36c1628315 qa: cut squid nightlies to one-per-week 7b185ecaaf7 tests/ceph_timer: Fix link error that keeps showing up 1ab250796c1 exporter: Asio deprecations b2e76314cf0 rgw: Asio deprecations 87ee31f88d8 immutable_object_cache: Asio deprecations ac1241e75b7 test/neorados: Use `asio::post` free function ed47559bca9 common/Graylog: Fix Asio resolve call da3545d5847 rgw/multisite: forwarded bucket create requests reflect empty tenants as they are requested by system user. this fix overloads SysReqApplier::get_tenant() with effective_owner's tenant to ensure proper bucket ownership when there is tenant involved. 4dbaf644980 src/common/options: improve rgw_max_chunk_size description 2c6d3ec3d8e rgw/notification/logging: add bucket as context param b73c87cf25a Revert ".github/workflows: Do not exempt PRs with milestone" 343bafc4a4d script: add bash script to cleanup ceph-ci.git 289d6045a94 mgr/smb: add threading lock for SqliteStore 4ee31d88f73 docs/mgr: fix typo 2848244e73f blk/kernel : Make bdev stop immediately f21cb07c859 mgr/cephadm: use get_dependencies to calculate daemon deps abc4a197f78 doc/cephadm: improve "Activate Existing OSDs". f0c4937c973 cephadm: orch upgrade status to return output according to the format specified 2496f2b4b21 mgr/dashboard: smb join-auth and usersgroups resources listing 42d338478b0 cephadm: add cephadmlib to tox coverage environment e4f65d58b1a cephadm: add a new set of specific tests for list_daemons 0f178e61de5 container: stop deleting python generated files bf9b8d36aba container: avoid installing docs using the dnf configuration e3a66809157 os: get rid of the Transaction::decode_bp() 37e633384b7 Move proto generation code block out of if(WITH_MGR_DASHBOARD_FRONTEND). 7f2e1910af0 pybind/mgr: Generate pb2 file in src/pybind/mgr/dashboard/services/proto using the protobuf file from the gateway submodule. 0ff89b041dc pybind/mgr: Protobuffer file generation for grpc deps. d5c882c7569 qa/suites/upgrade/telemetry-upgrade: improve ignorelist ec50fc720c4 qa/tasks: improve ignorelist for thrashing OSDs 618de5350bd qa/cephadm: start mgr-nfs-upgrade test from reef 2de592e2f0b doc/cephadm: improve "Activate Existing OSDs" 4ac2d6b536b mgr/DaemonHealthMetricCollector: include cleanup 6e7e13e07b6 mgr/DaemonServer: include cleanup aeeb15ea7d6 mgr/MgrClient: include cleanup 078d00939ea mgr/ActivePyModules: add missing include 3c2565f0966 mgr/PyOSDMap: add missing include 50c1612fdf1 mgr/TTLCache: add missing include 84fcd885090 mgr/mgr_perf_counters: add missing includes e261155a8a0 doc: Clarify that there are no tertiary OSDs 691ed012600 tools: add missing includes 55c2f49a8e8 mgr/BaseMgrStandbyModule: add missing include 2d2982e7420 mgr/DaemonState: add missing includes 5c70e38a8a0 mgr/MgrOpRequest: add missing includes 4f1f40ad614 mgr/MgrCap: add missing includes 0f367a5f9b3 mgr/ServiceMap: add missing includes 64b77fb5bb5 mgr/MDSPerfMetricTypes.h: use <iosfwd> 327b3de54ee mgr/ClusterState: move own header to the top ae5aadf538c mgr/Mgr: add missing include 8dbc5f84265 mgr/cephadm: adding the SSL cert as a dependency for ingress service bd049edb942 mgr/cephadm: adding the SSL cert as a dependency for rgw service 1991c493ca3 neorados: include cleanup 7f3ea86094f os/kstore: add missing include 0d2b588d488 os/bluestore: include cleanup a1de6d562de client/Client: add missing include and forward declaration f5ff6b95b9d rgw: add missing includes 92ceeb79fde crimson/backref_entry: add missing includes b849c636e22 mgr/dashboard: add smb share listing in UI fd42b879270 mgr/cephadm: reconfig rgw daemon when certificate changes 0c57b7116d5 interval_set: Re-introduce the original behaviour of interval_set by default. 03ed3af2a50 crimson/osd: clean up BackfillRecovery 865839faa49 osd/PeeringState: check racing with OP_BACKFILL_FINISH when defering backfill 13b9cdfccfb osd/PeeringState: set PG_STATE_BACKFILLING before calling on_backfill_reserved 48f2943dd0f crimson/osd/pg_recovery: trigger BackfillState events synchronously 88fb54e99b7 crimson: report dynamic perf stats to mgr 7c300425aa0 crimson/osd/pg: record client requests' metrics in DynamicPerfStats 89d79344f93 osd/DynamicPerfStats: remove the dependency on classic osds df83836ca92 crimson/osd/pg_recovery: avoid repeatedly updating the peering missing set for the same object 9d6eab50388 crimson/osd/recovery_backend: always set the primary osd's BackfillInterval::version to the last_update_ondisk b78aea8bbb2 doc/releases: fix heading types 5ef4376db05 doc/releases: move related tracker on new line 4b8ede82626 doc/releases: fix formatting with v19.2.1 documentation f893778ef00 mds: do not schedule quiesce for non-head imported inodes 55198cfa05b os/bluestore: Fix default base size for histogram bc03c5bac47 Revert "msg/async/ProtocolV2: call KeepAliveFrameAck::Encode() without `write_lock`" e3ed3b302c5 qa: do read checks with non-empty file 3646e2448b1 Revert "msg/async/ProtocolV[12]: unlock the `write_lock` before doing I/O" d6db6fadf8f doc/releases: Add notable changes for v19.2.1 cf0ed0a2859 script: allow relative & ~ paths in build-with-container dnf cache arg 5ee832185b1 mon,cephfs: small improvement for health warning methods 59511e65868 qa/cephfs: test that failing a FS is possible when other MDS/FS has... d53be13c04d qa/cephfs: allow detecting MDS ID from FS object for method the.. 0437952c43d mon,cephfs: don't disallow "fs fail" when other FS/MDS has health... cf68e49597d cephfs,mon: rename variable to a better name 7f5553ce434 mon,cephfs: fix indentation level for a code block 95a812a5f5c qa/cephfs: test that a MDS can be failed when other FS/MDS has a... 5a7834b6cd8 qa/cephfs: allow passing MDS ID to method that generate... 3f16e0c5931 mgr/dashboard: fixed unit tests 39b4d38a3d0 rgw/lua: Fix healthchecks requests to not goto backend storage. f7165966277 script: set execute bit on build-with-container.py b8f89327e1a rgw: handle destination bucket as an ARN in ReplicationConfiguration c4947c57562 mgr/nfs: nodeid should be numeric for RADOS_KV block in ganesha.conf file 29b5fcc62b4 qa: Remove openstack.yaml file which is no longer relevant fcf8d36e43e qa/suites/rados/verify: Allow selection of 2 or 4 node cluster b1e5da594a6 doc/rados/operations: Improve pools.rst 85d2633310c lmgr/cephadm: validate no duplicate groups and group vs. service id for nvmeof 27c9e65f57f mgr/cephadm: add function to get service specs by service type b16fc92155e mgr/cephadm: fix typo with vrrp_interfaces in keepalive setup f276cc5176f src/script: add a script to help build ceph using containers bde72fc478c build: add files needed to create a build container 4578625ce06 build: small script tweak to allow different build dirs 3046f78d69e src/script: add helper function has_build_dir 18d5cae6252 qa: remove redundant and broken test 926011ad9d3 cephadm: use get_container_image_stats in cephadm.py e965813da15 cephadm: add parsed_container_image_stats to container_engines 32fe8aacc98 cephadm: replace get_container_stats in cephadm.py 3154cd228ba cephadm: add get_container_stats to container_types cc087cf979a cephadm: add parsed_container_stats to container_engines bc61710baed cephadm: move ContainerInfo class to container_engines.py b9d1e96fba1 pybind/mgr/cephadm: fix issue with multiple nfs clusters on the same port 9bc969b34c9 mgr/dashboard: fix host form issues 8679652cced crimson/CMakeLists: cleanup BOOST_ASIO_DISABLE_CONCEPTS 4badc83940f common/ceph_fs: Enable O_DIRECTORY|O_NOFOLLOWUP flags translation under Win in ceph_flags_sys2wire() 717c1c5a084 mgr/dashboard: Storage Class Management a03d3311796 mgr/cephadm: continue in nfs service purge if grace file is already deleted 0aa73ea12ed qa/suites/orch/cephadm/smb: add cephfs proxy enablment tests 1d2057c49f9 mgr/smb: default to using the proxied vfs module de7fd2c0c88 mgr/smb: automatically enable proxy for shares with proxied provider 7dce09ae69d mgr/smb: add value 'samba-vfs/proxied' for when module is to be proxied f86a17d7beb mgr/smb: simplify share config generation function b1a3e364e46 cephadm: add a libcephfs proxy sidecar option to smb daemon 12809b6c4af mgr/cephadm: add option to pass ceph image to smb for proxy sidecar cc72a583488 python-common/deployment: add cephfs-proxy feature flag d1815c64199 mgr/cephadm: update get_container_image function 420298b80d1 cephadm: move envs_list logic back to base class ec4885cb257 common/perf-counters: replace 'assert' with 'ceph_assert' 5bf0150f608 rgw: replace obsolete get_tracked_conf_keys() 99e0e3aa5f4 qa/rados: Reorganized bluestore 3b9b290c5f6 qa/suites/nvmeof: use SCALING_DELAYS: '120' 4d6c8298dd0 common,osd: replace obsolete get_tracked_conf_keys() 7f25376e933 mgr/dashboard: Add 'Browse Dashboards' button in Grafana dashboards a612ba0e87b mgr/smb: Add profiling configuration to global definition 011b174ea09 Display comma separated ports for RGW services 798b94642da cephadm: Add pre_remove and ensure deployment values are reset and API settings are updated when removing Prometheus or Alertmanager daemons 7d99290092b Fixup for emacs/vim modes, moved to top of file. 0d8bd4d0352 mgr/cephadm/nvmeof: Add max_hosts field to NVMeOF configuration and update default values Fixes https://tracker.ceph.com/issues/69759 e5cb5db0020 monitoring: add tests for NVMeoFMaxGatewayGroups ab4a1ddcd89 monitoring: add alert NVMeoFMaxGatewayGroups c5c4b10ac12 monitoring: add NVMeoFMaxGatewayGroups 983b489e006 doc/rados/operations/stretch-mode: fix mistake in stretch mode c43e7337212 doc/rados: improve pg_num/pgp_num info ba9270dc9fe win32_deps_build.sh: pin zlib tag 76b40284a6b qa/suites/nvmeof: Remove watchdog from thrasher 01502bb23e7 src: modernize sample.ceph.conf 4ab3bed3f6a doc/cephadm: clarify "Monitoring OSD State" 00b530fc975 doc/architecture: remove sentence 6093f918259 crimson/.../replicated_recovery_backend: take excl lock while pushes commit 46d5eec6b60 crimson/.../replicated_recovery_backend: route pushes earlier 7af22ba0008 pybind/mgr/cephadm: allow setting custom monitoring_port for nfs c353b788ebe mgr/cephadm: add Server_Scope = <fsid> to NFSv4 section of ganesha conf 8666c5694eb doc/rbd: use https links in live import examples 8e5db6e09ce mgr/cephadm: create OSD daemon deploy specs through make_daemon_spec 624640cbdf2 Isolate the absl flags to ceph-mon & ceph-nvmeof-monitor-client targets only afc89fdde80 qa/workunits/rbd: add test_import_nbd_stream_disconnected() e4657cb2a2b librbd: stop filtering async request error codes e8201d3442e qa/tasks/nvmeof.py: Add teardown() method d4aec583b7e qa/tasks/nvmeof.py: Ignore systemctl_stop thrashing method 7dfd3d36e9e qa/tasks/nvmeof.py: Fix do_checks() method 5a58114498b qa/tasks/nvmeof.py: make seperate calls in do_checks() b5e6a0c24e5 qa/tasks/nvmeof.py: Do not use 'systemctl start' in thrasher 06811a48197 qa/workunits/nvmeof/fio_test.sh: fix fio filenames 0b0f450e95b qa/tasks/nvmeof.py: Add stop_and_join method to thrasher d7551f79cc5 qa: Add qa/suites/nvmeof/thrash/gateway-initiator-setup/2-subsys-8-namespace.yaml 023c20975c1 qa/tasks/nvmeof: Add --refresh flag in do_checks() cmds 744b04aea66 mgr/cephadm/nvmeof: Add verify_listener_ip field to NVMeOF configuration and remove obsolete enable_key_encryption Fixes https://tracker.ceph.com/issues/69731 8b264e6c412 tools/contrib: Add lscpu.py auxiliary module to parse the output of lscpu, rebased with updates 51806c1d5a3 tools/contrib: Add balance-cpu.py to distribute Seastar reactors to CPU cores using two strategies: OSD and NUMA socket based f83110a9add tools/contrib: Add tasksetcpu.py to show the CPU allocation grid ee2d5968d53 vstart: Add new --crimson-balance-cpu option 83c03c01fdf doc/dev/crimson: Add BalanceCPUCrimson with clarifications as per conversation/review c96f8a77e99 mgr/dashboard: Multi-site replication wizard breaks when a default realm is already present in the secondary cluster. 7853731a837 osd/scrub: discard repair_oinfo_oid() 0a17afe304d osd/scrub: remove unnecessary loop 7c8f081b2ef common: ceph_context: make use of get_tracked_keys() 21d099239e8 mds: skip scrubbing damaged dirfrag 9c83f6c9a50 tools/cephfs/DataScan: test equality of link including frag a66a68bfa53 tools/cephfs/DataScan: skip linkages that have been removed ff44ab5e63b tools/cephfs/DataScan: do not error out when failing to read a dentry 7d59db1d980 tools/cephfs/DataScan: create all ancestors during scan_inodes 593a8c50b46 tools/cephfs/DataScan: cleanup debug prints 38d4aef7e58 qa: remove old MovedDir test 4feb30b2ee2 qa: add data scan tests for ancestry rebuild 2f4a6b876ef mds: fix option mds_bal_overload_epochs bc196b7e63a qa: make the directory non-empty to force migration cb3229bf2fb qa: avoid unnecessary mds restart 9bb0de4d99f cephadm: remove some lines that are now redundant 530a81a5a63 cephadm: use parsed_container_cpu_perc in cephadm.py 1834881bd1c cephadm: add parsed_container_cpu_perc to container_engines bd93a46d8a4 cephadm: use parsed_container_mem_usage in cephadm.py 395b8d322f2 cephadm: add parsed_container_mem_usage to container_engines c20073f425c cephadm: add support for not mocking certain call methods 52b573299cd cephadm: rework with_cephadm_ctx fixture to use exitstack 531bd370377 rgw/lua: Add rgw config to enable/disable lua. dabb3bd3b36 cephadm: move get_legacy_daemon_fsid to data_utils 95137402e65 rgw: log request_id on start new request 37c1522bb39 rgw/sync: track last_update timestamp per-shard instead of per-entry 2a8d84ecf6b rgw: replace '-''s with '_''s in the sync delta counter labels 818e678d223 rgw: add labeled counters for sync deltas of shards d9e96c44f63 doc/cephadm: simplify confusing math proposition 0884e990048 RGW | bucket notifications: support cross tenant operations 7b5cc9f6525 libcephfs_proxy: implement ceph_readdir_r() 6803f28124e mgr/dashboard: upgrade angular to v18 7a4d23c474c mgr/dashboard: upgrade angular to v17 484e3105cd7 mgr/dashboard: upgrade angular to v16 6daf9eea70a crimson/.../replicate_recovery_backend: remove unnecessary check 0cda4658814 crimson/.../object_context_loader: add lock_excl_sync method d82b1cf0ef0 crimson/.../object_context_loader: add obc get_obc_manager variant 3661977a56f crimson/.../replicated_recovery_backend: move do_transaction to _handle_pull_response 3b07d56ef53 crimson/.../replicated_recovery_backend: only call _committed_pushed_object if complete c5591f5cd84 crimson/.../replicated_recovery_backend: convert handle_pull_response to coroutine cfcbb82956a crimson/.../replicated_recovery_backend: convert _handle_pull_response to coroutine 08ca60ef32e crimson/.../replicated_recovery_backend: convert submit_push_data to coroutine 99a25b38223 crimson/.../replicated_recovery_backend: convert prep_push_target to coroutine c7821d0a442 crimson/.../recovery_backend: convert to logging macros, some formatting changes 5bec3c06337 crimson/.../replicated_recovery_backend: convert to logging macros, some formatting changes 3dbc971f8b6 rgw/lua: Fix - Reset Lua background start time for accurate time limit 3fcd3536728 rgw: update to latest zpp_bits.h to compile w/gcc-14 & clang 19 4397c029ee8 nvmeofgw*: 2 fixes - for duplicated optimized pathes and fix for GW startup 1. fix duplicated optimized host's pathes - trigger process_gw_down upon fast-gw reboot, removed old fast-reboot handlers 2. fix GW startup - trigger process_gw_down when expired WAIT_BLOCKLIST timer 3243af47d60 mds: do not path traverse a damaged dirfrag c4bd8194ec4 qa: test file create on damaged directory 221700273a8 mon,cephfs: check MDS ID before aborting "mds fail" command f8cff38a5a3 mgr/dashboard: smb raise exception for unsucessful resource update ea576ccd037 doc/radosgw: s/zonegroup/pools/ af8e7523ebf mgr/dashboard: Add additional cli endpoints to align with existing nvmeof cli d3d6bd6ca1f mgr/cephadm: using service registry pattern for cephadm services c291168a04a script/ceph-debug-docker.sh: fix manifest unknown error d99367e1e03 osd/OSDCap: fix misleading grammar comments 5f3815e8002 mon/OSDMonitor: relax cap enforcement for unmanaged snapshots 3571c6dd5ff mgr/dashboard: create smb cluster 57c4e161577 nvmeofgw*: change log level of critical nvmeof monitor events to 1 154307e817a Allow passing ssl_certificate as an rgw_frontend_extra_arg. adaafdd86a9 interval_set: Improve comments 4dac20e8987 qa/workunit: update telemetry quincy/reef workunits with "basic_stretch_cluster" collection 6472b6b9f94 mgr/telemetry: add stretch_mode information 9fce4f03c40 interval_set: Fix test_interval_set.cc 757fe1c8c59 interval_set: Add back insert() 2a4f4c5269a interval_set: Review comments 679d10a7aef interval_map: Review comments d074b22c9b9 interval_set: tests to cover interval set changes eda51ac2662 interval_set: align method to extend all intervals to be aligned with a specified alignment fd67fd5f6a9 interval_set: erase and subtract enhancements c90e94b70c6 interval_set: Enhancements to improve efficiency of insert() and to allow more flexibility. c10ec8edd67 interval_set: contains() returns true if a specified interval is entirely contained within the set. 40c032a1c0c interval_map: tests. Tests to cover new function in interval map 8cd072d8e02 interval_map: contains() to determine if range is entirely contained within range. 5f8a76d4336 interval_map: Add interfaces for getting start/end and lower ranges. 6e0ae194127 mgr/dashboard: Introduce nvmeof cli 9e512e074c2 mgr/dashboard: delete smb cluster Fixes: https://tracker.ceph.com/issues/69191 https://tracker.ceph.com/issues/69605 c9d73451e74 test/libcephfs: remove warning in Windows build 7b8a86f105f libcephfs/client: pin inode/dentry for an opened directory a27ed27c2c2 test/libcephfs: reproduce an issue after client cache trimming 09c904c94b8 Abort nvme deployment with pool that doesn't exists d15f1f68694 doc/cephadm: correct note 39a12b5e0f8 osd: avoid costly md_config_t::get_val<>() when preparing stats 5670054bd05 doc/cephfs: edit disaster-recovery-experts (6 of x) 9d224ab3ab1 common: modify md_config_cacher_t to implement get_tracked_keys() 48a43f06db3 common: modify md_config_obs_impl API 67f5769ce6e doc/rados: pool and namespace are independent osdcap restrictions b8df0c023d0 doc/rbd: Update nvme documentation b4f4323e6cc container: add label ceph=True back a745e07e7ee container/build.sh: don't require repo creds on NO_PUSH 3e2332db848 RGW:fix obj by multipart upload cant get tag Fixes: https://tracker.ceph.com/issues/53016 1dee8837959 blk/KernelDevice: Introduce a cap on the number of pending discards 6e2f3fbeff6 osd/scrub: use ObjectSection & ArraySection d81d15839a2 examples/rgw: add type to HeadBucketOutput for old boto f2b33bc9719 os/bluestore: Split _deferred_replay into 1) apply IO and 2) remove keys 3b9ba9083ee rgw: add a multisite test case for stacked delete markers 65e3e9b5888 rgw: revert PR #41897 to allow multiple delete markers to be created 9af7d9786a1 doc/cephfs: edit disaster-recovery-experts (5 of x) 1fb6137afe1 container/build.sh: fix up org vs. repo naming 61baa879340 librbd: clear ctx before initiating close in Image::{aio_,}close() 21591186067 mgr/dashboard: Added unit tests and fixed minor issues c5dfb16de77 mgr/dashboard: Delete account integrated 47d74651abb mgr/dashboard: account edit functionality added 7db16e1b471 mgr/dashboard: added Create Account Functionality d12857161df mgr/dashboard: RGW user accounts UI d2b910bfef3 common/perf_counters: select_labeled_t as a parameter to dumpers 23a17e2a531 common/perf_counters: 'nullptr' instead of 'NULL' 90329537596 common/perf_counters: enabling 'find()' by logger name a5c9a884ac3 test/librbd: add unit test for flatten migration ecda6780c93 crimson: clarify RecoveryBackend::handle_backfill_op 4612195b9c3 cls/rbd: don't use read API for write-like methods 8c28695cde0 os/bluestore: Improve dout when bdev label cannot be decoded cc1bd71f4ed qa/standalone: Expand testing cases 76978bc673a os/bluestore: Fix CBT bluefs-bdev-expand a69587d3202 mgr/dashboard: revert ModalCdsService for uncarbonized pool form 2a18459eff7 neorados_pool_test: Erase a pool name from local map during delete_pool f2529d11745 doc/cephfs: edit disaster-recovery-experts (4 of x) 9b7df3a2927 RGW\logging: adding transport layer fields 5550486c778 crimson/net/io_handler: drop io_state_t::none 9f660b1e567 crimson/net/io_handler: promote and refine logs for debugging aa4b517d4ce crimson/common/smp_helpers: crosscore to return an incremented in_seq 4d18b137de3 osd/PG: add logs to PG::split_into() 6479e9e336c osd/SnapMapper: Add logs to ctor and update_bits() e736b277180 osd/SnapMapper: print *this Snapmapper instance f1c1b73567b mgr/dashboard: add warning message on smb service management 29f6929048d mgr/dashboard: fix service/daemon events not showing up in service details d602c8da3dc ceph-volume: update unit tests 8d477959d62 ceph-volume: remove duplicate code 1107f5b0e32 ceph-volume: add type annotations to devices.lvm.batch 12b1e7ed348 ceph-volume: add type annotations to devices.lvm.listing e65bc616ad2 ceph-volume: improve clarity and consistency in List.single_report 93827e8703d ceph-volume: add type annotations to devices.lvm.common 229dcb88b8b ceph-volume: add type annotations to devices.lvm.prepare d10b7cc81b4 ceph-volume: add type annotations to devices.lvm.trigger b460a1a19ef ceph-volume: add type annotations to devices.lvm.main aa26a5aa0df ceph-volume: add type annotations to devices.lvm.deactivate a9a149b8874 ceph-volume: add type annotations to devices.lvm.create 858d6d59e31 crimson/net/ProtocolV2: convert features/flags/cookies to hex format 74a62932788 ceph-volume: add type annotations to devices.lvm.activate 79acee1347f ceph-volume: fix type annotation in `objectore` a69c4142b7f doc/cephfs: edit disaster-recovery-experts (3 of x) 5d590f5b203 RGW:support x-amz-expected-bucket-owner to verify bucket ownership with bucket owner condition 20f27ee967a rgw/dbstore: Update bucket attrs as part of put_info() dceaab9a1a4 doc/cephfs: disaster-recovery-experts cleanup 3e3cb156fc5 rgw/lua: add configurable runtime limit for the lua state 4f3a69eb919 doc/cephfs: edit disaster-recovery-experts (2 of x) 504fac312cf qa/suites/upgrade/telemetry-upgrade: ignore TELEMETRY_CHANGED warning 0a3817fa9d8 qa/workunits: fix some details on telemetry workunits a3c6c6b5a8b doc/releases: edit warning for balancer issues cdb2bd5351d qa/suites/upgrade/telemetry-upgrade: replace quincy tests with squid tests 08b4ed6a45c qa/workunits: remove inaccurate reference to quincy from telemetry reef-->x test a04c88636bb qa/workunits: add new collections to telemetry upgrade workunits (reef) ca15873cfa0 rgw: Add objects expirer API to the SAL interface 51706eeaa3f doc/releases/squid: add warning for balancer issues 6652ac6729e doc/cephfs: remove link to undeveloped tool 42bac97b53e mgr/cephadm/nvmeof: Add SPDK iobuf options field to NVMeOF configuration Fixes https://tracker.ceph.com/issues/69554 e443d75b4f7 test/rgw/lua: install luarocks cc8cfeddbd2 doc/cephfs: edit disaster-recovery-experts b072c323b60 mgr/dashboard: Typo in NVMe-oF create service 786fe8f9a28 Add Abhishek Kane into peoplemap, githubmap, organizationmap, mailmap ac4c37d08f7 mgr/cephadm: After deploying nvmeof gateway group, the prometheus port 10008/tcp is not opened 14ac318c300 qa/cephadm: wait between starting and restarting osd in test_daemon_restart test 5d6b75a40a2 src/CMakeLists: require gcc13 for crimson, clarify error messages 3dab2ed3294 rgw: update attrs with replication status to reflect in response f54176f28c6 rgw: set dest bucket id in bucket sync checkpoint 0377e1cd8f3 RGW\log: adding some missing members 1e2f3758118 mon/test_mon_osdmap_prune: Use first_pinned instead of first_committed 466930b4732 rgw: S3 Delete Bucket Policy should return 204 on success fe411156c0e suite: thrash old client ignore list expend 5d92965b318 qa/tasks: Include stderr on tasks badness check. 044cd2c3dd2 rgw: RGWRados::get_olh() needs to use the correct attr a29646eebee doc/radosgw/config-ref: fix lifecycle workload tuning description f83c88077bf mgr/cephadm: Retry command when SSH connection closes 4257d11936c rgw/s3: remove local variable 'uri' that shadows member variable d913c1c97e3 os/bluestore: Fix unittest_bluefs 3eaea791cbd ceph/doc/radosgw: update list of valid admin capabilities 1280f0114dc mgr/cephadm: re-factoring the dependencies calculation code f304fba824b mgr/cephadm: Changes for creating root cert with manager cluster fsid 3d3380f5fe3 rgw: allow management of `accounts` user caps 3cec1036a58 script/ceph-backport: Remove stray `\` from grep command 4d0e0058b1e Documentation changes for updating non-ceph image service 166b605a39c mgr/cephadm: Command to upgrade non-ceph image services f292b789af8 log: ignore return value of write in unit test d8dae241040 mgr/cephadm: set service name for DaemonDescription object used during daemon removal c199a48f807 crimson/.../replicated_request: work around gcc 11 bug in with_pg_interruptible 4fccf58b4b1 service_spec: force ceph-exporter sock_dir to be unest or "/var/run/ceph/" 3b28df83624 cephadm: fix handling of ceph-exporter sock-dir 31c87445e84 osd/scrub: increase the default scrub load limit 3f6dae8d616 ceph-volume: add type annotation to api.lvm 2d45aa17c5a qa: add test checking 'journal import' from empty dump file 01db5d107c6 cephfs-journal-tool: fix segfault during 'journal import' from invalid dump file e81fbe4ebf9 client: Fix signed comparison warning 52a8984d89e test/neorados: Silence mismatched new/delete warning fdcc1d4f296 os/bluestore: Fix signed comparison warning 75bccfc6270 ceph-volume: add type annotations to util.device fc528584877 crimson/.../replicated_request: hold pg ref until complete() resolves 32113166080 crimson/.../replicated_request: fix op lifetime in with_pg finally ffaf5cb056d rgw:fix radosgw-admin use after free f6fb7df808c PendingReleaseNotes: add a note about tracker #67846 a37ebbd5547 RGW/S3: truncate S3 LastModified response (timestamp) to exact seconds 93316941a9d test/librados/asio: add test cases for deferred a546495203f test/librados/asio: add test cases for use_awaitable b735d96f684 test/librados/asio: add test cases for async_notify() 8b3479e2bd7 librados/asio: async_operate() takes ownership of ObjectOperation args 887ed45a33e librados/asio: take ref arguments as cref from async_initiate() 81ffffb0b34 librados/asio: take Executor instead of ExecutionContext 2f7a94c71d3 rgw: /admin/user api dumps account-related user info 05e24124574 rgw/lc: make lc worker thread name shorter ff04e0af192 rgw/rgw_admin.cc : Make restore attrs readable in admin cli 31231360fd7 mgr/dashboard: smb error page to enable/disable module This commit introduces a redirect to an error page when the smb module is not enabled and adds a new button to directly enable the module. To do this some logic was moved from the mgr-module-list.component.ts to the mgr-module.service.ts f28886124f7 rgw: skip on EACCES in RGWBucketSyncSingleEntryCR b18b5491bae rgw: set retcode on verify_bucket_permission in RGWObjFetchCR 3c72d3e49dd doc: squid 19.2.1 release notes https://tracker.ceph.com/issues/69234 046921e2968 ceph-volume: add typing hints to lvm.zap 4b0c3bbed37 ceph-volume: set default value for BlueStore.block_lv to None 297aa57ca5f ceph-volume: improve wipefs retry logic in lvm.zap 0e027d535b1 crimson/common/tri_mutex: use string for tri_mutex::name debug 178d312a52b crimson/common/tri_mutex: operator<< to print address dfc909d071e crimson/osd/pg: duplicate_obc to not create ObjectContext ad51353f59b rgw: use effective owner in PutBucketReplication 9a34ae55ede doc/cephfs: edit grammar in snapshots.rst 276b81a55d3 mds: avoid acquiring the wrlock twice for a single request a86ee496be9 mds: add 'mds_allow_async_dirops' opt to allow/disable async dirop 29c43371b59 osd/PeeringState: rename "cancel_backfill" to "suspend_backfill" e0b22e94f04 utils: fix a Y2038 bug by replacing Int32x32To64 with multiplication ea30bd53a3c rgwlc: non-current expiration sends LifecycleExpirationDelete 12233b15444 rgwlc: avoid duplicate notifies during transitions c046ace17d9 rgwlc: send pool transition notifications too 198b3e6d462 mon: Encapuslate all scrub related objects into a single atomic ScrubContext edb0321d454 mon/nvme: fix unused lambda capture warnings 9e04f49a2fa src/test: allow ENOENT if target object of tier_flush has snapshots 24984b704f0 rgw: add missing last_modified field to swift api ddb472136b0 do_cmake.sh: add support for Fedora 41 a02132a1f95 os/bluestore: Add 'bluefs-files' command to ceph-bluestore-tool. c10a794f726 os/bluestore: Modify _deferred_replay b2086ef0c96 os/bluestore: Deferred writes unit test, replicates corruption cbfc24dd7e9 os/bluestore: Add debug hooks 25cac0fea2d erasure-code/lrc: Change LRC default plugin from Jerasure to ISA 4d3adb5ade6 common/options: Change default erasure code profile from jerasure to isa 71d0695a8c7 vstart.sh: Change default erasure code profile from jerasure to isa 11d5616da92 test/erasure-code: Change default erasure code profile from jerasure to isa dc870530617 qa: Change default erasure code profile from jerasure to isa 0c2e056573f Containerfile: Add libcephfs-daemon package c374f2cfe98 Revert "Temporarily change the libcephfs dependencies" 005e492288b qa: fix test_cephfs_mirror_stats failure b800149243b msg/async: race condition between reset_recv_state and shutdown_connections 56688070513 rados/valgrind-leaks: add timeout value for stop command a4f0ba46067 rgw/cloud-restore: Do not send internal headers to cloud-endpoint ce99b6b5bfa qa/suites/fs/upgrade/mds_upgrade_sequence/tasks: set require-osd-release 158f7c332f5 qa/rados: add empty default.yaml for default replica read policy a6bf5a652eb qa/rados: move read-affinity/ under rados/verify subsuite 24087ec41fb librados: local affinity for exec calls is configurable 2028e4e7a82 qa/rados: add read affinity yamls ab0007299cd librados: disable local affinity for IoCtx::exec() and aio_exec() calls af176311c47 objclass: change objclass exec read calls to write ones where needed 0a2f572d4f6 objecter: weaker memory ordering for extra_read_flags 59c708c2a0e objecter: add log messages related to read policy cadc73b4066 objecter: use read policy configurable abbc9d49395 objecter: configurable for localized and balanced reads 0b12afafe68 rgw : provide multiple option for read replica policy 81ef8d57f8a librados: disable symbol versions when building statically c3da9112757 mgr/nfs: Show ingress mode in output of 'ceph nfs cluster info' 94926556086 rgw/rgw_zone : fixing inline-data default value 4e2874a8dea Update src/mon/MonClient.cc 895691ec47c common/config: make `legacy_values` static 612ea38fc5f test/objectstore: extend `#ifdef WITH_BLUESTORE` 46a0824c6ff messages/*: add missing includes 882eaa7ceec ceph-object-corpus: update the submodule fa98a781b44 workunit/tes_readable: enforce cascading backward compatibility checks ca36171c2b8 rgw/rados: resolve CopyObject crash from remote zonegroup 19ce2c69851 common/lockdep: include cleanup ec992da10db common/bit_str: include cleanup 623cda09858 common/ceph_argparse: include cleanup 120a6ccbbd4 common/str_map: include cleanup 44ca5fab653 common/OutputDataSocket: include cleanup a973d09a061 common/config: include cleanup 72bdb2996e7 common/compat: include cleanup b43412f8dab common/WorkQueue: include cleanup 30beb2f8833 common/EventTrace: include cleanup 695554fa11f common/win32: include cleanup 86e5fde9b29 common/filepath: include cleanup 9de0e6b2796 common/Throttle: include cleanup d9fd1df9608 common/map_cacher: add missing includes d7a427e00ca common/common_init: include cleanup b09e04c0872 include/Context: include <set> only if DEBUG_GATHER 7686e1d2668 common/not_before_queue: include cleanup 8eb6649d641 common/lru_map: include cleanup 201bff7e8d3 common/Finisher: add missing includes 537401f77e1 include/frag.h: include cleanup 15bf0d41c30 common/ceph_time: add missing includes e187c5b549f common/TrackedOp: add missing includes fefca2ef35d common/perf_histogram: include cleanup ebe54a10880 common/assert: add missing includes 6fa985ac895 include/ceph_features.h: add missing includes 2b178c034af common/dns_resolve: add missing includes 0a33c344225 common/fd: add missing includes 33591026c65 common/hobject: add missing includes c1b126e317a common/ceph_json: add missing includes a8606701bda common/snap_types: include cleanup 3c8917d5f75 include/fs_types: include cleanup 346a6285e06 common/numa: include cleanup c76111058c9 common/buffer: add missing includes 39bb99152a6 common/Graylog: add missing include c1b49372679 common/admin_socket: add missing includes 8017c09a59e include/util: add missing includes d23a8d880d5 common/LogClient: add missing includes 0d3417214b7 common/LogEntry.h: add missing includes 80917f011ff qa/tasks/thrashosds-health.yaml: Add osds down to ignorelist b0f469e2269 mgr/vol: use error number instead of error message 8bb28efcbdd include/types.h, tools/cephfs: remove _BACKWARD_BACKWARD_WARNING_H f0823176c41 journal/Entry: include <sstream> instead of <strstream> 9fdf5008743 mds/SimpleLock: add is_xlocked_by() fc48d88c766 mds/SimpleLock: add has_xlock_by() 1ae22591f30 common/Formatter: use emplace_back() 673d0200b20 common/Formatter: use range-based `for` e8e3b93c1ad common/Formatter: make get_attrs_str() const 4ebdd59cfe4 mds: combine several fixed-size `encode()` calls b27c8015a05 common/fs_types: combine several fixed-size `encode()` calls 605661f1092 script: ceph-backport no longer launches firefox 82d46470516 qa: add tests for fixing dangling symlink efb119eb51a mgr/volumes: handling dangling symlinks gracefully 100d164705d cephfs_mirror: do not log the previous error 1924a8f2cee rados/test_crash.sh: add PG_DEGRADED to ignorelist 701d8d0e0f0 osd: EC: Fix partial reads with LRC plugin 32f22f4d254 osd: EC: helper functions for chunk mapping ccf1229bba0 osd: further EC partial stripe read fixes 9272df1bd05 Update src/pybind/mgr/orchestrator/module.py 75f73c75ad6 cephadm: ceph orch upgrade status - Display easily understandable message 25ff18b2e4b crimson/client_request: support inject delay request 34f209f51ff crimson/mgr/client.cc: daemon_health_metrics support 46b82ed1856 mgr/dashboard: adapt kcli plan for multi-clusters 97b815c2459 doc/rados/operations/health-checks: Added NONEXISTENT_MON_CRUSH_LOC_STRETCH_MODE 9b1e75fa988 src/mon/HealthMonitor.cc: Add NONEXISTENT_MON_CRUSH_LOC_STRETCH_MODE 5c46c482dde src/mon/OSDMonitor.cc: ignore non-exist CRUSH bucket 99c40417ee2 objclass: don't do costly string formatting when not needed a07c5ef9259 client: resolve bogus self-assignment 5e3fd1e574d tools/ceph-dencoder: introduce add_crc32c command to append crc32 for the encoded buffer. Sometimes we might need to recalculate encoded object crc and this looked like a non-trivial task before this patch. f261347e9a8 client/barrier: use empty() instead of size()==0 3ee1ce7faa6 various: disable `boost::intrusive::constant_time_size` e9ca8a01323 pybind/rados: add note for reversed arguments to WriteOp.zero() 3a27c3e58fc test/pybind/test_rados.py: add test for reversed arguments offset,length in WriteOp.zero 049d7d35abe pybind/rados: fix the incorrect order of offset,length in WriteOp.zero 7ac14cac91c qa: reconfigure only the appropriate client auth caps 68c72c5dff5 systemd: use CMake install prefix in templates 22a577101e3 kv/RocksDBStore: Improve estimate_prefix_size. 612f24b41fb os/bluestore: Add unittest for BlueFS::truncate() dff84f8fc1d test/objectstore: extend `#ifdef WITH_BLUESTORE` d67934bbb05 CMakeLists.txt: build test_trans only if WITH_BLUESTORE=yes 85fac18a1cb os/bluestore: Make truncate() drop unused allocations 163d8297bd5 os/bluestore: Disable invoking unittest_deferred f98d4b3cfd2 RGW: add src/dest object info to fetch_remote_obj()'s debug log events c2d192f527b msg/async/Timeout: always round up 32dcaa949d7 msg/async/Event{Poll,Epoll}: move timeout calculation to Timeout.h cec2e4550fe blk/kerneldevice: notify_all only required when discard_drain wait for condition f8b1495949d os/bluestore: Fix CBT bluefs-bdev-expand ebd3d454d53 qa/standalone/bluefs: Fix CBT bluefs-bdev-expand 9276d24355d msg/Dispatcher: simplify and optimize the `marrival` tree 19b406f8d24 blk/CMakeLists.txt: generate interface library if `libblk` is disabled 38f52dc2755 common/options: increase `ms_tcp_prefetch_max_size` default to 64 kB 216eb2635c2 erasure-code: Increase SIMD_ALIGN from 32 to 64 e2798ecb69b msg/async/ProtocolV2: call KeepAliveFrameAck::Encode() without `write_lock` f07cd30733a msg/async/ProtocolV[12]: unlock the `write_lock` before doing I/O 23fd2cc4486 msg/DispatchQueue: wake up only one dispatch thread 9917ddcfc58 common: get rid off autovector.h 47144456944 kv/BinnedLRUCache: do not use autovector to keep entries to be deleted. 5d9ca40e980 blk: Don't forget call io_uring_unregister_files. 094bfc535eb rgw: false assumption on vault bucket key deletion 548d069a00e tools/ceph-bluestore-tool: optimize offline trim report info 006380b6e1e qa/erasure-code: add new teuthology isa configs Signed-off-by: Jamie Pryde <jamiepry@uk.ibm.com> 943c8296baa test: fix ld link errors a3d0c624232 qa/suites: Make fixed-4 an option for verify tests a4fb7b1f443 test: add encode decode test for pg_pool_t Adding some unit test for pg_pool_t to make sure encode\decode\encode doesn't failed to produce the same pg_pool_t struct a23c2ac9840 osd_type: encode new version for stretch CRUSH buckets 08112e6052e suites: set mon client hunt on resend to false for rados basic f058250b4cd monclient: try to resend the mon commands to the same monitor if available 753a8ff5d00 doc: Change default erasure code profile from jerasure to isa Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2025-03-25 03:06:54 +00:00
Bruce Ashfield	4102296af9	ceph: update to v19.3.0 ... Along with pulling in the new commits (listed below), we also: - tweak the license checksum. No change to the license. - bump the requested python to 3.13 to match oe-core - package some new .so libraries - add a new pkcfonfig file to the -dev package - disable libraries that are not in our dependencies Bumping ceph to version v19.3.0-6907-g71d130f7990, which comprises the following commits: 786fe8f9a28 Add Abhishek Kane into peoplemap, githubmap, organizationmap, mailmap 73c935db908 mon: do not show nvmeof in 'ceph versions' output 3d36a3b9bbe AsyncMessenger.cc : improve error messages 5a966ca95d9 qa/scrub: more delay when waiting for noscrub to take effect 5c098880829 common: config_cacher: use set::contains() instead of count() 9821bf8f329 qa/scrub: change 'bin/ceph' to 'ceph' 8ac04704574 common: fix md_config_cacher_t 2c4ab9c5712 doc/releases: add actual_eol for quincy 1694b8ab0bf common/io_exerciser: Reorder lines in RadosIo send_command functions fb05a2ff0f8 librbd/migration/HttpClient: Use asio::ssl::stream fe4a61424cf common/io_exerciser: Clear the stringstream in RadosIO class 7f3601089d4 os/bluestore: Fix BlueFS::truncate() fcfc50b2313 rgw/logging: clean pending objects b1e7c06430c rgw/logging: retry attribuite set in case of race b7174ca1409 rgw/logging: log bucket must not have encryption 462edf385d0 rgw/logging: source and log bucket must be different cc1a0e584ee rgw/logging: support source and destination buckets on different tenants d44b2227cdc mgr: Work around bug in Boost MPI/Python 8f5f3fa3556 rgw_attrs: fixes for 3 more iam/perms mappings dc539b3ea80 doc: improve tests-integration-testing-teuthology-workflow.rst f2b5e2fa0a9 os/bluestore: bluefs unittest for truncate bug cadb2027ebb crimson/os/seastore: refactor LBAMapping e2f09651fc5 qa/tests: removed quincy from crontab 027d1c501b2 doc/releases: remove Quincy from "Active" afa2b83687d doc/rgw: document UserName requirements for account migration 4318b188740 rgw: Don't crash on exceptions from pool listing f6ec7c543f1 rados/monthrash: add PG_DEGRADED to ignorelist f3c18818b9b monitoring: Update nvmeof alert limits in config 8cc7fdbd29e doc/rados/operations/stretch-mode: Improve doc b7ae18a292c doc/radosgw/config-ref: fix lc worker thread tuning 8de182808c5 Fix signed/unsigned warning and add parameter range checking. 43a6f123e24 rgw/multisite: the create_bucket forward request omits the the request body, thus missing some data if specified inside CreateBucketConfiguration xml on the non-master zone. also, now that we perform cksum validation against empty payloads, such a request would fail with -ERR_AMZ_CONTENT_SHA256_MISMATCH due to a zero content-length but a non-empty payload hash. this fix ensures that request body is forwarded during create_bucket 0cb0d471b7b vstart.sh: add support for launching the ceph-exporter daemon 22f91cdc652 qa/workunits/nvmeof/basic_tests.sh: fix connect-all assert 6c534ba3a0a rgw:attrs: dump marker and max_parts only if sent 2b8689eec9d rgw:attrs cap max_parts at 1000 b2462337c40 rgw: GetObjAttrs enforces MaxSize and returns correct IsTruncated f6bc276d627 rgw/rados: Object::list_parts() starts after marker cbcf0e3eb20 rgw/rados: get_part_obj_state() fixes accounted_size when uncompressed 56bf5073cf3 rgw: GetObjAttrs calls rgw_s3_prepare_decrypt() 1be4399edda rgw_cksum: return version_id in all cases bac02fc435c rgw_cksum: permit fallback to checksum-type from create-multipart, in upload-part 5c4d5942835 rgw: defensive check for part cksum in try_sum_part_cksums b164ad893ee rgw_cksum: don't display nil checksums in get-object-attributes (parts) f73e83ad8a9 rgw: GetObjectAttributes iam policy policy hooks ed6134c0b0b rgw_cksum: zero-initialize GetObjAttrs integral members eb949395465 rgw: implement GetObjectAttributes 013c1c666cd ceph-volume: fix loop devices support 8fb78290425 common/io_exerciser: Make chunksize so initial generated value is 4096 and random values are generated thereafter f50106f1c1d common/io_exerciser: Make sure Sequence 10 removes objects after finishing running d8712e67221 src/common/json: Modified JSON structures so they take advantage of ceph_json.h fully. 6804964b96e src/common/io_exerciser: Remove unneccisairy override in data_generation::SeededRandomGenerator 9c1907481ba src/common/io_exerciser: add missing override statements to JsonStructures.h 5811155de65 src/common/io_exerciser: Formatting improvements using clang format e2ef12525f5 common/io_exerciser: Add simple sequences for testing error injects 347ba63e83f common/io_exerciser: Add injecterror commands to ceph_test_rados_io_sequence interactive mode 23dd255a2c4 osd: EC error inject interfaces 4f3ef50fd8a src/common/io_exerciser: Code readability improvements de4a2a033c7 Revert "doc/dev/crimson: update SeaStore as default backend" c202195819d qa/suites/crimson-rados-exp: add Seastore/thrash b8d2681d9cd qa/suites/crimson-rados-exp: remove basic 5150dae471c qa/suites/crimson-rados: disable thrash/seastore d869ca8a00d common/options/crimson.yaml.in: Bluestore by default 1fc0edb9fa0 ceph-volume: add python hints to util.prepare.create_id() 56cf5122d97 mon/NVMeofGwMap: add delay to NVMEOF_GATEWAY_DELETING warning dfa632b4255 mgr/cephadm: mgr orchestrator module raise exception if there is trailing tab in yaml file 57359801515 rgw: migrate rgw_admin to new directory. 3075894aab6 container/Containerfile: replace CEPH_VERSION var for backward compat 340e353de68 rgw: don't use merge_and_store_attrs() when recreating a bucket 95bdcbfd813 ceph-volume: fix Zap.ensure_associated_raw() f108a373970 doc/radosgw/s3: correct eTag op match tables 7b33f7727e0 src/common/options/mon.yaml.in: add mon_nvmeofgw_delete_grace 885b1bf88ee doc: add snapshots in docs under Cephfs concepts 8e4ddcf076a rgw: fix user rate limit is not enforced w/ global rate limit set 44233b9d860 crimson/osd/replicated_recovery_backend: prevent recovery/backfills from polluting the cache of the underlying futurized store 4d53a276b13 crimson/os: all "read/get" interfaces accept op_flags b413f76b0a5 crimson/os/seastore: introduce cache_hint_t af1bc2220f6 crimson/osd/replicated_backend: make sure the check on whether to send ops to replica osds and the pg log append happens in the same continuation fa7ef62d2c6 crimson/osd/replicated_recovery_backend: ignore the recovery of delete objects 360e6503135 crimson/osd/replicate_backend: add standalone delete to the push queue if the object is deleted while it's being backfilled 14e068fdc55 crimson/osd/pg_recovery: throttle backfills together with pg-log based recoveries 59377c6eb22 crimson/osd/backfill_state: recheck whether needs to scan the primary at the end of Enqueuing::Enqueuing aa9fc357022 mgr/cephadm: Restore client file(s) default SELinux context type c0e91389b03 doc: README.md - improve "Tshooting" and "Tips & Tricks" acbb2e50783 doc: README.md - format "Troubleshooting" 571dd531663 mon/NVMeofGwMap: add healthcheck warning NVMEOF_GATEWAY_DELETING 639cfc5975e doc: README.md - format "Tips and Tricks" 26a0f9adcf9 mgr/cephadm/nvmeof: Add key verification field to NVMeOF configuration Fixes https://tracker.ceph.com/issues/69413 7989e98e1b1 crimson/common/shared_lru: rename Deleter::cache c21e0e6d148 crimson/common/shared_lru: invalidate Deleter's cache c695df47691 qa/standalone/scrub: osd-scrub-test.sh - test operator overrides 4726bebefee osd/scrub: reset m_active_target when the scrub ends 656408d3685 osd/scrub: convey 'reserving replicas' status in query results 65be7d65055 qa/standalone/scrub: add build_pg_dicts() cb439994320 doc/mgr/dashboard: Fix HAProxy TLS example cb2204e04ba test/rgw/noitifications: fix test names 46da1f631df qa: write out ESubtreeMap more frequently to find large events 821f9b7e05b doc: README.md - format admonition d3194eaf257 osd/scrub: abort reserving scrub if an operator-initiated scrub is requested ab5c5d7d1d7 osd/scrub: register for 'osd_max_scrubs' config changes 31e6bacfbf6 osd/scrub: register for 'osd_max_scrubs' config changes ae927739884 doc/cephfs: document purge queue and its perf counters 1a34cd1be9f rgw: allow bucket notification send message to kafka with multiple brokers 08963622491 doc: Fixes a typo in controllers section of hardware recommendations ef7127e8bfc osd/scrub: show reservation status in 'pg dump' output 93df0b3e32c crimson/os/seastore/cache: move committing existing blocks to prepare_record() 4a08c37da56 crimson/os/seastore/journal: hide RBM specific finish_commit() d9ff8f0419a crimson/os/seastore/cache: minor cleanup c9f4727aab6 doc: Update vstart section in readme.md 1f71671dc65 rbd: drop --pool option from "rbd group image {add,rm}" b4d7b660863 doc/radosgw: line edit uadk-accel.rst (1st half) f35e3a6e9d9 rbd: handle --{group,image}-namespace in "rbd group image {add,rm}" c21b5f7e0b1 qa/rgw: set api_name if not provided in create_zonegroup 19aa6f72440 rgw: respect location constraint in master zonegroup 53a27b4d097 PendingReleaseNotes: add note about tracker #69012 650e21dd493 rbd: open images in read-only mode for "rbd mirror pool status --verbose" 1c37f81fd85 script/ceph-backport: allow hyphen in project during ceph fork deduction ffe5bf693e9 doc/radosgw: edit uadk-accel.rst 15e746bf5b1 vstart: use crimson_osd_objectstore 41327dcf0f7 doc/dev/crimson: update SeaStore as default backend b85d61de7f4 vstart.sh: set alien cores with bluestore only 3a6ce3cadf4 qa/suites/crimson-rados: make use of crimson_osd_objectstore 58f7b6e0777 crimson/os/seastore: make the updates to backref_entry_mset be consistent with extents 60c58013c53 client: Fix a deadlock when osd is full ef942e13fa5 qa: Add async io test to nfs ganesha using fio 1f1051d91f3 crimson/osd/pg_shard_manager: discard outdated operations when the corresponding pgs are already removed 1fcc7199b2f qa/suites/crimson-rados: enable short_pg_log 65614c4ca44 rgw/notifications: Add tests for RGWPSListTopicsOp::execute() ffcd90313b9 test/librbd: add TestInternal.FlattenInconsistentObjectMap 97ed3fced13 librbd: avoid data corruption on flatten when object map is inconsistent 61b3289e41d monitoring: Add prometheus alert NVMeoFMultipleNamespacesOfRBDImage f80687256d9 src/nvmeof/NVMeofGwMonitorClient: remove MDS client, not needed 4d4e1b54d95 doc/radosgw: edit uadk-accel.rst 4a393280acb crimson/os/seastore: move backref_entry_t to a separate header be00314b93c crimson/os/seastore/cache: rework backref_batch_update() 6c7de641c78 crimson/os/seastore: introduce named factory methods for alloc/retire f1db2cbc208 crimson/os/seastore/seastore_types: use is_backref_mapped_type() 665418e471b crimson/os/seastore/cache: don't mark allocations as L_ADDR_NULL 98d693cdb63 crimson/os/seastore: misc related cleanups 8091f318106 crimson/os/seastore/cache: drop unused backref_entry_t::seq 0f55c1759d4 examples/rgw: register boto extension for HeadBucket stats cbc771a4db6 os, test: make omap_iterate obligatory for ObjectStores e3df536e591 os/kstore: bring support for omap_iterate 4e1a500f9c6 os/memstore: bring support for omap_iterate 3c2b4bbcf51 crimson, os: put AlienStore::omap_get_values() on top of OS::omap_iterate() 08508288c5f os/bluestore: reduce dependencies of omap_iterate()'s loop on Onode a7c81953d07 kv: avoid memcpy around key() in OMAP iterator of KeyValueDB 8f931cff653 Revert "ops_replayer: fix signed/unsigned warning and add parameter range checking." d2531a0baf4 os/bluestore: bring latency logging to omap_iterate() d4901af641c common/ceph_time: introduce time_guard for RAII-styled timediff calculation 87d6447079e os/bluestore: implement the lightweight OMAP iteration f348ea3cf53 kv: avoid memcpy in OMAP iterator of KeyValueDB c7407549e5a os, osd: introduce a lightweight OMAP iteration 68612d166d4 crimson/.../replicated_request: do commit in concurrent phase 6f29657c3d1 crimson/.../replicated_request: split discard check and reply send out of PG::handle_rep_op d299e46ed84 crimson/.../replicated_request: convert with_pg_interruptible to coroutine 7b88c38ac96 crimson/.../replicated_request: factor out with_pg_interruptible 02b70a62a43 crimson/.../replicated_request: call handle.complete() once in finally e5008c858a2 crimson/.../replicated_request: fix debug line ca189fb511f qa/standalone/scrub: fix TEST_periodic_scrub_replicated e03f5ca25f2 RGW\logging: convert s3_filter to key_filter ca9e0f40612 RGW/logging: add filtering for bucket logging 9a9e14db350 RGW/logging: add rest API to flush logging bucket ee66dc51cc3 nvmeofgw*: fix no-listeners ceb62c0c807 nvmeofgw* : fix publishing rebalance index d9aa164cd38 mgr/dashboard: Fix Latency chart data units in rgw overview page 0fc5aecd554 mgr/dashboard: RGW user accounts CRUD api's e717a925aea cephadm/nvmeof: fix ports when default values are overridden a2ebc00a56f rgw/posix: std::ignore return value of write() 06a56b7efb8 Fix signed/unsigned warning and add parameter range checking. c5503187af9 qa/rgw: force Hadoop to run under Java 1.8 2f47f9dc3c8 cephadm/nvmeof: support per-node gateway addresses 3181acc223d mgr/dashboard: Administration > Configuration > Some of the config options are not updatable at runtime b71ec88c13c mgr/cephadm: fixing logic in cert-store save_cert method 81023d996b0 mgr/dashboard: carbonize user management form 36541efe49c rgw: RGWAbortMultipart maps NoSuchKey to NoSuchUpload f4dee79c330 crimson: switch to SeaStore as default objectstore 3069d946639 deb: Add cephfs.pc to libcephfs-dev 85805ddf581 rpm: Add cephfs.pc to libcephfs-devel c9e19442855 cephfs: Add a pkgconfig file for libcephfs 1e22c110183 test/crimson/test_backfill: more detailed backfill cancellation tests a34b0ce2aa6 crimson/osd/backfill_state: treat Cancelled as a pause of the ongoing backfilling 3aae66611dd qa/rgw: pull Apache artifacts from mirror instead of archive.apache.org 2b2ce787157 tools/cephfs: fix flake8 f-string formatting for py3.12 dbb129cc633 doc/dev/crimson/pipeline.rst: simplify and update to reflect new stages 4c46b012760 crimson: remove now unused pipeline stages a051d32790d crimson: introduce and use repop stage 0c87de8e882 crimson/osd/object_context_loader: print obc (with refcount) upon release 9e69d0e9f21 crimson/.../pg: more debugging dc6a9fc1616 crimson/.../ops_executer: split execute_clone into prepare_cloning_ctx,complete_cloning_ctx 62b8491c5ff crimson/.../ops_executer: split osd_op_params intitialization ff55c4f8737 crimson/.../ops_executer: rework prepare_transaction/mutate_object fc029270ef4 crimson/.../ops_executer: just call submit_transaction in flush_changes_n_do_ops_effects 45cc9e96d12 crimson/.../ops_executer: rename flush_changes_n_do_effects to flush_changes_and_submit 86588d26a96 crimson/.../pg_backend: split clone into clone_for_write, set_metadata f655f7f5871 crimson: convert client_request, internal_client_request, snaptrim_event to use obc stages 64210532033 crimson/.../osd_operation*: add wait_pg_ready and get_obc 29dedef4b7a crimson: add CommonOBCPipeline bcda5524dbb crimson: expose CommonOBCPipeline via ObjectContextLoader::Orderer 854bb63ee31 rgw: allow disabling bucket stats on head bucket 9c7580a2935 doc/cephfs: edit 3rd 3rd of mount-using-kernel-driver 88557dff2fe librbd/migration/HttpClient: socket isn't shut down on some state transitions 1046d610e3d librbd/migration/HttpClient: avoid hitting an assert in advance_state() 9fa0bcc67d7 librbd/migration/HttpClient: ignore stream_truncated when shutting down SSL e305a5908bd librbd/migration/HttpClient: propagate ec to handle_handshake() 8566224e940 librbd/migration/HttpClient: drop SslHttpSession::m_ssl_enabled 331b5ea3225 librbd/migration/HttpClient: don't call disconnect() in handle_handshake() 20885b11794 librbd/migration/HttpClient: avoid reusing ssl_stream after shut down 5699e4b871c librbd/migration/HttpClient: don't shut down socket in resolve_host() d1a83f264ae librbd/migration/HttpClient: fix some error messages in handle_receive() eb773496d53 librbd/migration/HttpClient: log ec details in handle_{issue,receive}() bacd59e4def qa/suites/rados: Add ceph_test_bluefs 01acb340924 os/bluestore: duplicate unittest_bluefs -> ceph_test_bluefs 6c095f02e4d qa/config/crimson_qa_overrides: enable ms debug 0811c1b9da0 crimson/net/io_handler: minor adjustments to logs 5a886ee6ce9 doc: Fix typo. 560d66e34ed test/pybind: Test method has been renamed in unittest 3.2 aec8ca8b268 test/pybind: Clean whitespace. 31283c0b2ab mgr/cephadm/nvmeof: Rewrite NVMEoF fields validation. Fixes https://tracker.ceph.com/issues/69176 90e221d0b53 mgr: fix subuser creation via dashboard 25fde2483b8 mgr/dashboard: added ports in administration table 5d584b4badb doc/dev: instruct devs to backport 0526124b605 doc/cephfs: edit 2nd 3rd of mount-using-kernel-driver bfc8fb6aff3 mgr/cephadm/nvmeof: Add auto rebalance fields to NVMeOF configuration Fixes https://tracker.ceph.com/issues/69176 7fc0ead36ca doc/cephfs: edit first 3rd of mount-using-kernel-driver b44af183031 os/bluestore: Reduce unittest_bluefs for jenkins 1c295464836 qa/rgw: force s3 java tests to run gradle on Java 8 14855b306c4 mgr/dashboard: add a custom warning message when enabling feature 9ed81f52af1 crimson: inline InternalClientRequest::do_process 54a42bef571 crimson: manage log submission atomicity independently of pipeline stages 5021e87338c crimson/.../pg: update debugging in PG::submit_error_log fda23c94e42 crimson/.../pg: convert submit_error_log to coroutine c8f19ead527 crimson: inline SnapTrimObjSubEvent::process_and_submit adc63e283c6 crimson/.../client_request: move log line to complete_request callback 4b4473f3bd6 test/fio: remove assign-only variable 1f02262bab3 test/cls_log: remove unused variable 15136449836 qa/suites/upgrade/*-x: ignore more POOL_APP_NOT_ENABLED variants b957e9bc766 qa/suites/upgrade/reef-x: ignore more POOL_FULL variants f7adf6723cd crimson/.../internal_client_request: extend start() until stages have exited 883d0231e4f crimson/.../client_request: extend instance_handle lifetime 87c3ea23d9f crimson/.../ops_executer: emplace osd_op_params in fill_op_params bb2c45f8696 crimson/.../ops_executer: no reason to return cloning_ctx c0da4093152 crimson/osd/pg: fix tabbing in replica_clear_repop_obc 7a36f74ceab crimson: clear obcs whether referenced or not upon replica write ef6a48c8bbe msg/async/Event: make the pipe byte static 1bd5571d164 test: add missing includes c07d370c668 crimson: add missing includes 37ff5a104fc pybind/rbd: fix a type comment for p_snapshot of clone() cb6d1838acc mgr/dashboard: Show correct token expiration date in Manage Clusters page 453beeae499 doc/releases: fix formatting for the 17.2.8 release with hyperlinks (el8 CERN) 4a638e51521 crimson/osd/object_context: add formatter instance for ObjectContext 06affa6c2a4 common/intrusive_lru: add method to access use count cb2c5e3a604 qa/suites/upgrade/*-x: ignore telemetry re-opt-in nudges ad51e25d39e qa/suites/upgrade/*-x: add OSD_UPGRADE_FINISHED to log-ignorelist 8971b72c24c qa/suites/upgrade/*-x: add FS_DEGRADED to log-ignorelist 42e428e104a doc/releases: fix formatting for the 17.2.8 release (el8 CERN) 082ff952b69 test/common/test_time: add missing `using ceph::mono_clock` 69c6e9e5af7 tools/ceph-dencoder/sstring.h: use `char8_t` instead of `unsigned char` 858ed425cb0 common/bit_vector: use static_assert() instead of BOOST_STATIC_ASSERT() 2caa47b8fa7 include/random: use std::optional instead of boost::optional 92aa60e9996 mgr/PyModule: get_error_string() returns copy 2cdb67c2fe1 mgr/PyModule: do not lock in get_name() bb40fe448df test/rgw/logging: add bucket logging test suite to teuthology 790c38eacc5 rgw/logging: add support for GetBucketLogging and PutBucketLogging 8fa6cf757ec qa/suites/upgrade/*-x: add more PG states to log-ignorelist 05dca26c24e qa/suites/upgrade/*-x: add "is down" to log-ignorelist a54f5710456 doc/conf.py: try to provide real jar path cf48fddbc6a doc/_ext: mute syntax check warn E711 0e73c9dd66e radosgw-admin: bucket link/unlink support accounts 0c578a127e3 rgw: shouldn't call index_op.cancel() when rados op return ETIMEDOUT 8de984d413d rgw: append query string to redirect URL if present bb5893f15a8 qa/suites/upgrade/reef-x: sync log-ignorelist with quincy-x 3162581d2de qa/rgw: bump keystone/barbican from 2023.1 to 2024.1 dbe8c9299eb mgr/cephadm/nvmeof: Add key encryption support to nvmeof configuration caa4371a93e ceph orch <start/stop/restart> commands should work for service name osd and added a new command to updated service name for osd 41f2ded4e61 Documentation changes for 'ceph orch osd set-spec-affinity' command 48dd55a0ad4 mgr/dashboard: Update and correct zonegroup delete notification 666f8faf11c mgr/dashboard: Add ceph_daemon filter to rgw overview grafana panel queries 73109c1dcee test/objectstore: Make test idempotent 64539ed2af6 rgw: Make test idempotent. 1b5391d1a3d rgw: Remove unnecessary whitespace. c4868ff2d1e doc/dev: update link to backporter manual 8bec39b66ae doc/radosgw: edit uadk-accel.rst 91488321277 rgw: optimize bucket listing to skip past regions of namespaced entries 27fc12bfa04 qa/suites/upgrade/*-x: skip TestClsRbd.group_snap_{set,remove} cd1b41de75c cls/rbd: fix mirror_image_map_list object cc8ad9acb47 qa/suites/rados/thrash-old-clients: skip TestClsRbd.group_snap_{set,remove} 26a63205943 qa/suites/rados/thrash-old-clients: switch to cls/test_cls_rbd.sh workunit 178036924e7 doc/dev/release-process.rst: New container build/release process de9ce1e2732 rgw: fix stale entries in bucket indexes b5665cfac47 crimson/osd/ops_executer: prevent access to null pointers caused by gcc bug 97df4479d90 doc/rados: fix sentences in health-checks (3 of x) 4b3c0cb8f3f container/{Containerfile,build.sh}: use a secret to pass secrets 18d14b22f31 container/Containerfile: allow failure from curl to stop build 08432ef5421 container/Containerfile: purge .repo files with secrets before commit ce74f14de50 container/Containerfile fix boolean IS_RELEASE usage ce487613d08 qa/tasks/nvme_loop: update task to work with new nvme list format de2d9186bdd qa/workunits/mon: ensure election strategy is "connectivity" for stretch mode a3a9f188cab container/make-manifest-list.py: use LOCALMANIFEST throughout 4f050d7811f containers/make-manifest.py: Add --promote 7374b9b1114 container/Containerfile, build.sh: Add PRERELEASE_USERNAME/PASSWORD 6c8e9984253 container/build.sh: 44b2fc4d5e1 container/make-manifest-list.py fc598223583 labeler: add container labelers fb4ec711176 container/build.sh: use UTC dates for tags 256a2d6dab8 doc: fix EC overhead table m-numbering 7ee9ad0e2ae rgw: respect rgw_graceful_stop on realm reload 7a747bc5538 cephfs-mirror: remove redundant ceph_close() calls. 6f1d21c9ec4 cephfs/client: dir_reset_t::reset() - add missing fd reset. 20cb0063ebd mgr/cephadm: Add only_bind_ports_on_network spec parameter for Alertmanager ee0ef765349 doc/rados: fix sentences in health-checks (2 of x) 8522452bb64 python-common/ceph/cephadm: Change NVME image version to 1.4. Fixes https://tracker.ceph.com/issues/69099 aec87b9188a doc/rados: make sentences agree in health-checks.rst 892cf5661f2 crimson/osd/backfill_state: drop Cancelled 8f2ad5f5606 crimson/osd/backfill_state: Enqueuing doesn't last, so there should be no other events coming to it than those it generated itself 475782f3b0b crimson/osd/backfill_state: add pg infos to all backfill_state's logs 23fcab7fc6b rgw: fix data corruption when rados op return ETIMEDOUT 15cc5a68f76 crimson/os/seastore: convert offset/length in seastore logs to hex format 0c65b4130f4 crimson/os/seastore: convert offset/length in segment logs to hex format 254dad29aa9 qa/multisite: enable two zonegroup yaml 4a67cc189e1 rgw: relax RGWPutACLs_ObjStore::get_params read data log 2de973c039c doc/rbd: Add mirror snapshot schedule information 926aedfef19 mgr/dashboard: list smb Tracker: https://tracker.ceph.com/issues/69080 88ce1daae61 doc/cephadm: s/ceph/Ceph/ in mon.rst b053ad57462 crimson/os/seastore: minor cleanup 75e0b8c2aa6 crimson/os/seastore: drop unused file d68857c1e57 common/pick_address: Add IPv6 support to is_addr_in_subnet a1cec3de570 doc/glossary.rst: add "Dashboard Plugin" d2386e80bb2 mds: Fix invalid access of mdr->dn[0].back() 6b14ac1796b mgr/cephadm: fixing config files for prometheus and alertmanager 65acd39d190 PendingReleaseNotes: add note for replay completion warning 19db699ea65 qa: test to verify `MDS_ESTIMATED_REPLAY_TIME` warning 761489329c4 doc: add a note for `MDS_ESTIMATED_REPLAY_TIME` MDS warning 8db596944f1 mds: emit warning for estinated replay time 98d61fa0ade mgr/dashboard: add smb endpoints 3ae0e6d0537 mgr/dashboard: fix multisite e2e failures 45ff7e3365e doc/radosgw: update rgw_dns_name doc b6eb98cc108 os/bluestore: Improve documentation introduced by #57722 bf15ebcd594 mgr/dashboard: carbon tree component a7830814b59 crimson/os/seastore/transaction_manager: add log in get_extents_if_live() 0732a3d39a0 crimson/os/seastore/transaction_manager: fix get_extents_if_live d512f6262ef crimson/os/seastore/transaction_manager: adjust do_with for pin_list in get_extents_if_live 19581dda911 crimson/os/seastore/transaction_manager: verify type in read_pin_by_type e4efceba181 crimson/os/seastore/transaction_manager: fully read the extent before rewritting it da5e195cb4d crimson/os/seastore: convert transaction related paths with interruptor 1a76129c2bf crimson/os/seastore: split out transaction_interruptor.h 7998a03a2fe crimson/os/seastore/transaction_manager: implement and use maybe_indirect_extent_t::get_bl() 6f8ff6e9b4c crimson/os/seastore: delay setting bptr for all types of extent in case of read 0630af44bac test/crimson/seastore: add test case for partial reads 1642d487ecc crimson/os/seastore: disable seastore_max_data_allocation_size by default e29a1a4fd97 crimson/os/seastore: update lru size based on loaded extent size 2770a61059f crimson/os/seastore: implement partial reads from cached_extent to object_data_handler ff23cbf5c17 crimson/os/seastore/cached_extent: introduce BufferSpace for partial reads 090c59df755 crimson/os/seastore/cached_extent: minor adjustments to print d2a9cb13fc2 crimson/os/seastore: add missing final keywords 919d4d9eea8 crimson/os/seastore: hide the complexity of extent indirection 59d692f8f05 crimson/os/seastore/transaction_manager: fix to use direct key/length to get absent extent 6004f2639a1 crimson/os/seastore/cache: adjust logs 48d6d1d1fa0 crimson/os/seastore: misc cleanups and asserts 29d0b9025f3 crimson/os/seastore: clarify zero length is only possible for root 946edf65b1d crimson/os/seastore/cached_extent: clarify invarients in the cstors df15d59dfb3 crimson/os/seastore/cache: cleanup, use the same method to create extents 528f4206fba crimson/os/seastore/cached_extent: unify extent ptr creation e595f353b53 doc/glossary: add "DC" (Data Center) to glossary e79488912ca osd/scrub: remove the 'has_deep_errors' scheduling flag c24dc78484c doc/radosgw: Improve archive-sync-module.rst more 8f46603c7e9 doc/rados/operations/stretch-mode.rst: Added Limitations to stretch pool configurations 87df76e84f2 build/uadk: fix uadk repo's commit id b875c783ef7 docs/rgw: deprecate tenant-based IAM in favor of accounts 303ce155a34 doc/radosgw: Improve archive-sync-module.rst b564084cbfa rgw: fix bucket link operation fd05431d0e5 mgr/dashboard: Automate system user creation and restart of rgw daemons on Migrate to Multisite 09ade3db7c9 qa/suites/nvmeof/thrash: add 10-subsys-90-namespace-no_huge_pages.yaml 7ee46770f4b qa/workunits/nvmeof/basic_tests.sh: Assert number of devices 2030411aaf2 qa/workunits/nvmeof/setup_subsystem.sh: add list_namespaces() func 82118e19c4c qa/tasks/nvmeof.py: Improve thrasher and rbd image creation e1983c51020 qa/suites/nvmeof/thrasher: use 120 subsystems and 8 ns each c0ca0eb6f0f qa/suites/nvmeof/thrash: Add "is unavailable" to log-ignorelist f670916d310 qa/suites/nvmeof/basic: use default image in nvmeof_initiator.yaml 51743e6701f qa/suite/nvmeof/thrash: increase number of thrashing 9393509a5e3 qa/suite/nvmeof: add asserts to scalability_test.sh 6e15b5e5595 qa/suites/nvmeof: fix nvmeof_namespaces.yaml 74b0749b7e6 mgr/dashboard: fix total objects/Avg object size in RGW Overview Page 7d7ea8f1763 doc/releases: fix some formatting for the 17.2.8 release notes 59cc81a0c69 rgw: consider multi zonegroup for is_syncing_bucket_meta 5378cfe3c5b radosgw-admin: 'user create' rejects uids matching the account id format 69aabb39284 mgr/dashboard: update carbon-components-angular package 9701b4b157e python-common/ceph/deployment: Add key encryption support to nvmeof configuration Fixes https://tracker.ceph.com/issues/69036 aca468240f7 mgr/cephadm: Add key encryption support to nvmeof configuration Fixes https://tracker.ceph.com/issues/69036 771f16e5824 qa/rgw/sts: run s3tests against both auth orders 0601e565c5c qa/rgw/keystone: run s3tests against both auth orders 543fd1041f5 Revert "rgw/auth: Fix the return code returned by AuthStrategy," 44c9519cc3e doc/rados/troubleshooting: Improve log-and-debug.rst 6e273676ed9 doc/cephadm: Improve "Curl-based Installation" 8cf77d03a1f doc/cephadm: Clarify "Deploying a new Cluster" a8e112cf538 rgw: send self zonegroup on forward to master 49e76c23de1 qa/rgw: the rgw/verify suite runs java tests last 60797f6862f osd: optimize extent comparison in PrimaryLogPG 263a10615c3 rgw:Wrong x-rgw-quota-bucket-objects header when bucket quota is disabled 06fd8720130 mgr/dashboard: Display bucket's number of shards on the ceph dashboard 77605ce2297 cephadm: Modify the structure of the default container images b65d7492af0 qa: use a larger timeout for kernel_untar_build workunit 38a32b2212e osd/scrub: fixing reservations dump format 38513cbb5f4 cephadm/nvmeof: support no huge pages for nvmeof spdk 5c7d47af557 rgw/dbstore: correcting merge_and_store_attrs to store attrs in place of new_attrs. 8ba6c2de830 rgw: RGWAccessKey::decode_json() preserves default value of 'active' 8c78a22d2cf ceph-volume: fix importlib.metadata compat f92042853a0 common: rm the cast operator of md_config_cacher_t 71de8c0accd osd: rm all uses of the cast operator of md_config_cacher_t 3cd7d0226fe osd/scrub: cache frequently used configuration parameters a99fa1c51ee common: a simple API to extract md_config_cacher_t cached value ca3cd0e69ad librados/asio: document requirement on IoCtx's lifetime 216c3b9aece librados: document shallow copy semantics of IoCtx 3e40916227a librados/asio: forward asio cancellations to AioCompletion::cancel() 0331c2f9057 librados: expose op cancellation through AioCompletion::cancel() 5fd7d2a3694 test/librados: add test cases for aio_cancel() bae9ed83edf rgw/abortmp: Added lock for AbortMultipartUpload 258cc44b784 qa/config/crimson_qa_overrides: enable alienstore debug 1807a553f12 mgr/cephadm: Add resource limits to nvmeof configuration Fixes https://tracker.ceph.com/issues/68967 4269d7c1528 python-common/ceph/deployment: Add resource limits to nvmeof configuration Fixes https://tracker.ceph.com/issues/68967 d2ee4c1bba8 crimson: Set device class during spawn of a crimson osd 614e14654db monitoring: Add alert NVMeoFTooManyNamespaces c2f1fac3b94 doc/start: update os-recommendations.rst 0ab7bdb27cb qa/suites/rados/verify/validater: ignore OSD_DOWN dfe79fa7841 rgw/notification: Forward Topic & Notification requests to master only when notification_v2 enabled. 265e6785be0 mds: account for header size during omap commit d27dab240d5 rgw/notification: fix segmentation fault and topic listing logic 16dfa00100e doc: add pendingreleasenotes for cephfs subvolume earmarking feature 6054be59c56 .github/workflows: Do not exempt PRs with milestone 184c1861f81 crimson/osd/replicate_backend: add the skipped newly created clone object to the push queue after the clone request completes 6e0324f26b2 exporter: SIGTERM/SIGINT/SIGHUP management 63357492db3 doc: 17.2.8 Release Notes 05e207fa774 radosgw-admin: create user without credentials via cli 71c1a2967f2 osd/osd_types: perfect forwarding in pool_opts_t::set() c1fdc53bc7b osd/osd_types: use std::map::insert_or_assign() 84f87afd61e osdc/Objecter: use the erase() return value f3f5b084a99 osd: disable `boost::intrusive::constant_time_size` 3cf00cde820 ceph-volume: fix dmcrypt activation regression 00b0711188f mds: client is evicted when an export subtree task is interrupted 2e7d1ee6e7e Add multiple labels in single command to host f23bd5d0995 qa: add test for importer's unexpected client eviction after an export subtree task is interrupted 057c5b1610c mds: session in the importing state cannot be cleared if an export subtree task is interrupted while the state of importer is acking eccaf85294a qa: add test for importer's session cleanup after an export subtree task is interrupted 73d5c01ae62 qa/suites/nvmeof: add nvmeof warnings to log-ignorelist 11a4303d66f mds: the assert should be before the journal entry submit otherwise it's racy 79a33025d50 mds: add `importing_count` to session dump 489eed66cdd osd/scrub: list additional information when dumping the queue 4e130affe1a rgw: Update README for DBStore and Posix drivers d833431ea43 crimson/osd/replicated_backend: add the dedicated method to construct MOSDRepOp b75dd8d333e crimson/osd/pg: add is_missing_on_peer() b6f27f8305b crimson/osd/pg: reuse already defined methods as many as possible to improve readability 8a1fab37f2a crimson/osd/ops_executor: call OpsExecutor::apply_stats() before OpsExecutor::obc is moved out. cbd22c7ba22 crimson/osd/pg: fix dangerous lambda captures 961aef1bb4e doc/radosgw: s/Poliicy/Policy/ 22010719d7e doc/start: fix "are are" typo f1a2637c79a doc/rados: correct "full ratio" note a8784609620 monitoring: add tests for 2 new nvmeof alerts e5ff1916e3d doc/start: separate package chart from container chart 7994fea4363 monitoring: add 2 new nvmeof alerts f02e3128441 monitoring: add 2 nvmeof alerts to prometheus_alerts.yaml 8c025045332 rgw: for delete ops for a bucket, where an attr/attrs are erased from the existing attrs, call put_info() in place of merge_and_store(), to store them in the backend store. eafe4ac81b7 rgw: fix rados bucket merge and store attrs 1627e3836eb test/crimson/seastore/test_object_data_handler: always access object data based on offsets relative to the start of the object data base b6bdebe42b0 test/crimson/seastore/test_transaction_manager: take RootMetaBlock into account 8911b29fa23 crimson/os/seastore/cache: throw enospc when failed to alloc new extents 4cb1243d030 crimson/os/seastore: move the root meta out of the root block 6567e7d934d qa/vstart-runner: Only remove non-ASCII characters from string-based command outputs b8a5917f154 rgw: evaluate policies for dest object in data sync a3f40b4ec6f rgw: pass uid on fetch object in data sync 44c31faa0e7 rgw-admin: Add --format option for bucket sync status 80674a3e12d make-dist: Quiet submodule operations in Jenkins a2a4a3415c0 qa/dashboard: fix test_list_enabled_module failure c3584838cf1 mon/nvmeofgw*: monitors publish in nvme-gw show ana group responsible for namespace rebalance 64c9b53cf4a ceph.spec.in: Add option to enable sccache 1ba45628896 mgr/dashboard: update carbon-components-angular 865c66966ce crimson/.../object_context: remove unused lock helpers 7961b3714d9 crimson/osd/object_context_loader.cc: retab remaining methods 14be39509b4 crimson: InternalClientRequests require that the pg is already active bd5efa44b74 crimson/.../client_request: complete_request() only in with_pg_process 293679dbb5d crimson/.../client_request: always remove from orderer in complete_request cef3f2f9b70 crimson/.../client_request: remove unnecessary get_handle().exit() de2e92bc93c crimson: rewrite with_[clone_]obc[_only] via manager, remove other helpers 177176beabd crimson: remove unused PG::with_locked_obc fc8315a6df6 crimson: convert PG::with_locked_obc users to use obc manager 5f996662420 crimson: introduce RAII style obc lock mechanic 737676bdb5c crimson: track obcs unconditionally 1dbd7768c03 crimson: remove ObjectContextLoader::reload_obc e94ad0dfffe crimson/osd/object_context: add formatter for RWState::State cc74b76f3e7 d/control: fix lua dependencies for librgw2 ab49ca023a2 osd/scrub: fix 'schedule-deepscrub' test asok command db943eef653 Fix tuned profile to allow multiple settings ba0d989f9c9 mds: do not process client metrics message with fast dispatch edd7fe76c49 client: Gracefully handle empty pathname for statxat() 92c5ab99b8d libcephfs.h: Fix API documentation for ceph_statxat 829f3889922 client: Gracefully handle empty pathname for chownat() f6b56f9ee5d doc/cephadm: clean "Adv. OSD Service Specs" cdfa299a251 doc/cephadm: link to "host pattern" matching sect fccf7fd25e5 doc/rgw/notification: clarified the notification_v2 behavior upon upgrade 0f0089472cc TEST_backfill_grow fails after finding "num_bytes mismatch" in osd log 14b09519739 Make mon addrs consistent with mon info 34bc35a7344 doc/cephadm: Update operations.rst e4164273cf3 rgw: return MalformedXML for empty objects list in DeleteObjects 919da369666 [CVE-2024-48916] rgw/sts: fix to disallow unsupported JWT algorithms while authenticating AssumeRoleWithWebIdentity using JWT obtained from an external IDP. 141b675b0b4 hiding parquet dependencies upon parquet-select option is off 0a76ec38559 test/crimson/test_backfill: support projected log and pg log 7a2db2f46e2 crimson/osd/pg: introduce projected_log 77dd0027baf spdk: update spdk submodule to fix build with newer glibc 7ae56f4f561 mgr/dashboard: remove cherrypy_backports.py df422f9f252 include/str_list: remove unnecessary #include dcb6c4a30ba common/error_code: remove unused includes cd95497f039 common/perf_counters: forward-declare class utime_t b9ffdba1a77 common/DecayCounter: forward-declare ceph::Formatter 9615c04d7d8 common/Thread: include cleanup f7ee8b122db common/Journald: add missing include 85f9521b4e9 common/StackStringStream: remove unused includes 3d0550026fc common/{ceph_time,Throttle}: use <iosfwd> f9126e65b39 common/pick_address: add missing includes 0ea0e100680 common/options: add missing include for strict_si_cast() and std::cerr eb150432f0c common/strtol: add missing include b1bd141ca77 common/ceph_argparse: add missing forward declaration 98bf9fd9f5c common/buffer: add missing include for std::cerr 24c2b1994aa common/Graylog: add missing include a42c023b65d common/elist: add missing includes fc076a9925c common/admin_socket: add missing includes 9a4ab0089db tools/radosacl: add missing include for std::cerr a349d3ec68e test: add missing include for std::cout 881d111aa01 cepadm: update tox.init to use latest flake 8 versions a529b234a24 cephadm: mock a call to shutil.rmtree 6739a68efa0 cephadm: do not trigger rollback in bootstrap unit tests 9fbbdf7c530 cephadm: fix invalid use of mock called_with method d9acf69589e cephadm: update some type annotations 213d0b1ea2d cephadm: update some type annotations a1c7b5d9c92 cephadm: update some type annotations bb58be856a6 cephadm: update some type annotations 6405f756352 cephadm: update some type annotations 1a2346e612b cephadm: update some type annotations f0f7d9b10bc cephadm: fix f-string expression formatting a141ffb7b15 cephadm: update some type annotations 67ece5d2fa9 cephadm: update some type annotations b02cef96ca5 python-common: use tox.ini envlist defaults when run via cmake dd89369b0c6 python-common: remove unused requirements-lint.txt 894371cd36a python-common: update tox.ini linting environments bdf7d4f30c5 python-common/tests: update some type annotations 39df3c0771a python-common/deployment: disable some unused import flake8 errors d36c1dea17d python-common/deployment: fix string that should not be an f-string 9bb9819db2d python-common/deployment: rename a single letter variable 851d740d62e python-common/deployment: disable some unused import flake8 errors 9475f843b35 python-common/deployment: disable some unused import flake8 errors d34492c694a python-common/deployment: disable some unused import flake8 errors 4dd84cdf07f python-common/deployment: disable some unused import flake8 errors dc625594af7 python-common/deployment: update some type annotations 8726e214fb7 mgr/cephadm: fix invalid use of mock called_with method b77829c45e2 python-common: fix mypy errors in earmarking.py 799ff256894 pybind/mgr: fix flake8 f-string formatting for py3.12 19545eb9864 tools: respect set features when adding addresses f07c4d47f19 Revert "rgw/multisite: avoid redundant error repo entry logging" dd0c8168325 mon: emit warning during fs rm 5c5102c23fd mgr/volumes: warn about active snap-schedules when volume is deleted ec272797c4c doc/rgw/notification: add missing admin commands 153a698c31c doc/cephfs: note about volume deletion affecting snap-schedule Manager module 4d2af0c5783 mgr/snap_schedule: handle volume delete 6f5612a3a7d mgr/dashboard: improve the kcli bootstrap process 790afd27773 doc: Document which options are disabled by mClock. ab8d7095979 mgr/cephadm: orch host drain command does not return error for invalid hostname 7e5898ff413 Revert "suites: crimson basic adding wait for test" 66ca80e7d7d mon/nvmeofgw*: fix no-listeners FSM, fix detection of no-listeners condition 5cf1e93ad44 crimson/osd/replicated_recovery_backend: call on_global_recover() only when all replicas and the primary have been recovered c4274c0c3a6 doc: document balancer configurable "update_pg_upmap_activity" 62c9f152e31 mgr/balancer: tie `update_pg_upmap_activity` to a configurable 31c498da96f mgr/balancer: optimize 'balancer status detail' 55860520b3f qa/multisite: add extra checkpoints in datalog_autotrim testcase aee484425f7 doc/cephadm/services: Update monitoring.rst to add additional templates 3a4beadce9d doc/cephadm/services: [v1] Update monitoring.rst to add additional templates 88deedee942 ceph.spec.in: Add an option to disable dwz ea1a470fb48 doc: s/Whereas,/Although/ 749007f7cf9 crimson/osd/backfill_state: don't try to do object backfills when primary_bi is empty 8878619ed07 doc/cephadm: documentation for RGW spec "disable_multisite_sync_traffic" option d620ba65121 mgr/cephadm: allow disabling rgw_run_sync_thread through spec 874f12451da cephadm: update default image imports to point to common location 297f9f94b3c cephadm: add python-common/ceph to MYPYPATH and pytest PYTHONPATH b1b9cc0c84f python-common: add spot in python-common for cephadm default images b44121f4832 cephadm: add python-common/ceph to cephadm zipapp 9244f0a3030 test/pybind: update to test_fallocate for mode 0 b0690837f31 qa: test fallocate fails in mode 0 ac34dd33099 PendingReleaseNotes: add note about fallocate mode 0 98a67b65961 client: return EOPNOTSUPP for fallocate with mode 0 2b30c8e8958 cephadm/smb: convert config object to use a dataclass 66e9ef16a93 mgr/cephadm: sign generated RGW certs fd9c40465bd mon/MDSMonitor: send reply to beacons with `state=DNE` 96a2f89dc57 CODEOWNERS: let orchestration cover all of python-common 0276ab4eb9d mds/Beacon: wake up the thread in shutdown() 961757b59bf mgr/dashboard: Replacing bootstrap modal service with cds modal service dd5dcc2945a mgr/cephadm: Change NVME image version to 1.3.3. Fixes https://tracker.ceph.com/issues/68755 63c0649da42 osd: revert PR#57582 1a895c9d121 doc: mention how to initiate snapshot mirroring c29c1e7bb2d doc/dev/crimson: update index 61ebde0be2a doc/dev/crimson: Add initial BackfillMachine docs 2368dcb402e doc/start: add supported Squid distros b9e7dead3f6 doc/governance: updates based on 2024q4 election b23b0407fec librados: dont duplicate class names in member definitions 63cb345c6ad crimson/osd/osd_operations/client_request: no need to hold head's obc lock throughout the recovery of clones 314c1530519 crimson/osd/pg: fix wrong debug logs 63b9de4a3a7 crimson/osd/pg: make sure ops are sent to backfill targets if and only if the object has been pushed. b0085bf224a mgr/{restful,zabbix}: document removal 8ccb6348046 mgr/zabbix: remove deprecated module 96ec7badb85 mgr/restful: remove deprecated module 79d61bbb58c qa/dashboard: fix tasks.mgr.dashboard.test_health.HealthTest 6648d94aed5 doc/rados: add blaum_roth coding guidance 1770b177fc1 osd/scrub: improve scrub information conveyed in standard PG log line references 9c3c8d48a2d doc: improve pending release notes and CephFS cbc33e8d983 .github/check-license: correct grammar in "license check" 30b9c4b615f rgw: fix json output for bucket layout a2a989aaa5e mds: add or update MDS thread names bfe489ed19d log: cache recent threads up to a day 7de5af59c27 common: cache pthread names eb760013c2b qa/suites/orch: add a tests for testing public_addr for smb cluster create cmd 4ef8a86fa41 mgr/dashboard: Carbon Design - Create realm popup 1f40d0c06c4 log: concatenate thread names and print once per thread 4941d098e33 ceph-volume: support zapping by osd-id for RAW OSDs f1135273f33 Add API tests for nvmeof service.ts file dd04fc5339a crimson/osd/backfill_state: discard CancelBackfill events when the backfill is done 13c7c9d9988 doc/cephfs: use 'p' flag to set layouts or quotas 5818305e809 cephadm: handle "systemctl start" failures during deployment better 778218adf1b mgr/dashboard:Roles section is not aligned with column name ed3ce72fbc0 doc: explain the consequence of enabling mirroring through monitor commands a9824956d43 mgr/vol: add helpers to spawn all threads and more threads 72395884f97 mgr/vol: reuse code for spawning threads e1f33442160 rgw/lc: Fix lifecycle not working while bucket versioning is suspended 38601d0c9ea <comomon> fix buffer out-of-bounds in HTMLFormatter 207003c5123 <common> fix formatter buffer out-of-bounds 4080115739d mgr/dashboard: rm nvmeof conf based on its daemon name 5b5db8974bd mailmap, githubmap, organisationmap: Add Anuradha Gadge c323da351ec Update .githubmap 3e043a903ca doc/cephfs: edit "Disabling Volumes Plugin" 470cd133ec2 qa/suites/fs/thrash: add convolve operator for overrides fa46810b5b3 qa/cephfs: s/prefetch_dirfrags/prefetch_oft_dirfrags 69992c8f797 doc/rbd : add namespace mirroring updates a42be085bd7 doc/start: add vstart install guide 42e4b45d304 .github/check-license: add friendly name 68c9f16fab4 mgr/dashboard: carbonize Cluster > Hosts form 0092cfe3c3e mds: remove obsolete comments f54be33382a doc: remove refrences to `mds_log_major_segment_event_ratio` 718afe26ba8 mds: start a new major segment after reaching minor segment threshold 7d11c708b99 mds: make parts of mdlog reusable to be used by beacon 8403096655b added tests migration with namespace 599bdbf0a24 doc/glossary: add "PLP" to glossary c8b4155d2d2 doc/rados: standardize markup of "clean" f39c9232e18 crimson/osd/shard_services: fix dangling reference caused by rvalue reference of ShardSercies::dispatch_context() 5639030d48d test/crimson: disable stall-detector on aarch64 to fix asan failures f6cf7ae5281 doc/cephfs: rearrange subvolume group information eab096c188d rgw: fix empty storage class on display of multipart uploads cb3c475359c vstart: log faulty physical disk device dd4549238e5 mgr/dashboard: fix bucket get for s3 account owned bucket 60149ade9d5 rgw/lc: Fix issues with non-current objects with instance empty c4206676642 doc/cephadm: correct "ceph orch apply" command 16c23e03378 osd/scrub: remove the 'only_deadlined' flag 9f3e18b97cb osd/scrub: make sched-targets comparator transitive 0dcc207194b mgr/cephadm: Add namespace netmask parameters to nvmeof configuration Fixes https://tracker.ceph.com/issues/68542 dd4b357ce97 python-common/ceph/deployment: Add namespace netmask parameters to nvmeof configuration Fixes https://tracker.ceph.com/issues/68542 2f81b4d618e remove the code-lines that checking the {ofs,len} bounderies; and modifies them if necessary(invalid read) dda683b20c4 suites/rados/thrash-erasure-code/.../ec-small-objects-balanced.yaml: remove 87c8a9c1b77 qa/tasks/rados: set pct_update_delay if balance_reads is set 8ab313fb699 osd: wire up async primary->replica pct updates aee7b306196 common/intrusive_timer.h: introduce intrusive_timer 64f252c2401 radosgw-admin: allow 'sync group pipe modify' with existing user 4b084c608c1 qa/cephfs: override testing kernel with -k option 18b8277e86e mgr/cephadm: add "Enable_UDP = false;" to ganesha conf 4d795a8ea41 mgr/cephadm: add "mount_path_pseudo = true;" to generated ganesha conf 1e69ebc6cea mgr/cephadm: add NFSv3 protocol to cephadm generated ganesha conf b39be5abe03 mgr/nfs: add NFSv3 protocol to exports 575a19d2a81 RGW|Bucket notification: fix for v2 topics rgw-admin list operation 810c7068682 Add multi-cluster support (showMultiCluster=True) to alerts fdc93ad15e8 qa/suites/nvmeof: add mtls test 8f7c5f08e6f mgr/vol: add comments to explain queuing data structures 3232f6b7af1 PendingReleaseNote: add release note that mgr/volumes plugin can be... 373910de34f doc/cephfs: add doc for disabling mgr/volumes plugin 0abc227131c qa/cephfs: test enable/disable of volumes plugin 99627723580 mon/MgrMonitor: allow disabling always-on MGR modules 4374ac74d28 mon/MgrMontitor: add log entry to support debugging e830f89240e mon/MgrMonitor: improve a log message 75236e9c0be messages: add MOSDPGPCT f4b0589e3b3 osd/osd_types: add PCT_UPDATE_DELAY pool option 8e14ce00c80 osd: introduce acting set specific feature vector d20325a3908 osd/PeeringState: proc_replica_info->proc_replica_notify, pass in pg_notify_t d760935f2c6 osdc: add replica read perf counters to Objecter 990051fa1d4 osd,crimson/osd: add perf counters for replica reads 8c4c22c15b2 crimson/.../client_request: bounce replica read if missing 8c31d84692e crimson/.../client_request: minor cosmetic simplification ba246b10e73 osd,crimson/osd: remove external interfaces for mlcod a6da03104cf osd/ECBackend: simplfy pg_committed_to handling 8116c88ea1c osd/PrimaryLogPG: adjust assert in log_operation a2d4faf0f12 osd,crimson/osd: pg_committed_to rather than mlcod for submit_log_entries 407350daf1c osd,crimson/osd: roll_forward_to->pg_committed_to for MOSDPGUpdateLogMissing and related c58a40f1dd5 osd,crimson/osd: use pg_committed_to rather than mlcod for submit_transaction 6be4d397d02 osd,crimson/osd: maintain pg_committed_to on replica rather than min_last_complete_ondisk 8411911b6b9 osd: roll_forward_to->pg_committed_to in EC* 9d72303f969 osd/PeeringState: refine pg_committed_to semantics a5f66eef9d6 osd/PeeringState: rename last_update_ondisk to pg_committed_to bd4fa931912 osd: remove support for replicas without OSD_REPOP_MLCOD 7eebc628a84 osd/PeeringState: remove unused PeeringState::append_log_with_trim_to_updated f46e469d603 osd/PrimaryLogPG: cosmetic fix for long debug line 4690e8b3f2b osd/PeeringState: cosmetic fix for long line f1bc95dafe0 doc/dev: add walkthrough for CephFS kernel development 231a1c352d0 mgr/dashboard: Removing duplicate cephfs constant file & importing correct default_subvolumegroup. a2566ce4c41 mon,cephfs: fix indentation level of a code block 04757a317ac ci: fix typo in check-license 27feea13ff0 MDS/CDir: return as early as possible from CDir::should_split_fast() 4b2ba587b7d mgmt-gateway: add e2e testing da4b85c55a1 common,osd: Use last valid OSD IOPS value if measured IOPS is unrealistic 4b9d6a3ba1c doc/cephadm: adding documentation for mgmt-gateway HA setup b7ee45ab6ad mgr/cephadm: adding UT for new mgmt-gateway functionality 06fccea5cfc mgr/cephadm: fixing deps handling for mgmt-gateway Fixes: https://tracker.ceph.com/issues/68377 0392505386e mgr/cephadm: adding HA support for mgmt-gateway and ouath2-proxy d0db937cbb3 mgr/cephadm: adding md5_hash stable hash to the utils collection 87612f499f8 mgr/dashboard: fix lifecycle issues f7a379fe9bc cephadm: Added new cephadm command to list all the default images 565bb1407a9 doc/cephadm: document new flags on maintenance exit command 56a1a27a9fb doc/cephfs: add note to remind user about snap-schedule during volume delete ee9b7c0617c mgr/cephadm: add offline host handling to maintenance exit eaad13485b8 mgr/cephadm: set maintenance mode healthcheck when removing hosts 82b6a1c5786 mgr/smb: rm all `smb dump` commands 3c9b07eb87e exporter: New metric for report ceph daemons health 212c8740831 orch: disk replacement enhancement b5e7008d28a ceph-volume: address mypy errors in disk.py dd2a150f40f ceph-volume: address test_activate_dmcrypt_tpm 10d4f309f3c mgr/dashboard: Add 'Browse Dashboards' button in multi-cluster and ceph-cluster Grafana dashboards 7343be72087 os/bluestore: Fix repair of multilabel when collides with BlueFS 11e3ecabf97 crimson/osd/pg: trigger PG::wait_for_active_blocker only when the pg is going active 80d0037c251 mailmap: Add dashboard new joinees in maps 56b60c01cac mgr/dashboard: Adapt gateway group changes in nvmeof UI 67f884d39c3 CodingStyle: allow C++ forward declarations f4e165305f8 common/io_exerciser: Add assertion on failure of IO validation 163a28aa116 test/osd: Add interactive mode to ceph_test_rados_io_sequence 88917c5b8ae test/osd: Remove unnecessary whitespace c78d1ba668d rgw: add mstart-related scripts to CODEOWNERS and labeler b6cb908e0b7 rgw: document mstart.sh and related scripts 942044cc603 mds/Beacon: set a thread name 629922bf6a0 doc: update Key Idea in cephfs-mirroring.rst 0006599c9e1 mon: add warning NVMEOF_GATEWAY_DOWN 1cad0401cfc mon: add nvmeof healthchecks 2ed1a3bd70c .github: detect GPL license in PRs 3ab5d1f67f1 mgr/cephadm: disabling nginx buffering for grafana location 0be8d01c9dd log: thread name save/fetch infra 24f453dd39c client: Resolve symlink from dirfd for empty pathname 8443821073b client: Fix symlink open with O_PATH and O_NOFOLLOW e036fde7e4b mgr/dashboard: The subvolumes are missing from the dropdown menu on the "Create NFS export" page 7cd60242a96 ceph-fuse: Improve fuse mount usage message 2b562b64a64 crimson: remove unused OpsExecuter::rollback_obc_if_modified overload 7ac64b0b245 crimson: OpsExecuter no longer needs to be a lw shared ptr 8f3ac965c31 crimson: remove now unused PG::do_osd_ops* and log_reply a0efff116cd crimson: clarify ops_executer.h comment c091f3b2ab6 crimson: convert InternalClientRequest::do_request to use *_executer rather than do_osd_ops* fc41fcb9d2a crimson: factor out InternalClientRequest::do_process 304e20e9bcf crimson: switch ClientRequest::do_request to use *_executer rather than do_osd_ops 00057b45f03 crimson: introduce PG::run_executer,submit_executer 7a826eb86c4 crimson: PG::submit_error_log returns eversion_t rather than optional 5e28a3bd3b5 crimson: introduce rollback_obc_if_modified without an error argument 24b7b4f4b5d crimson: futures from flush_changes_n_do_ops_effects must not fail a43452f47ee crimson: OpsExecutor::flush_clone_metadata no longer needs to return a future 0a83d956e54 crimson: remove the eagain error from PG::do_osd_ops 7da7c3d736c crimson/osd: move pipelines to osd_operation.h 96c771383ae crimson: eliminate get_obc stage 238f3e573d4 crimson/.../internal_client_request: convert with_interruption to coroutine a091414c67b crimson/.../internal_client_request: factor out with_interruption a7812e095c1 crimson/.../internal_client_request: remove unnecessary system_shutdown guard 4bea366e5de crimson: fix typo OpsExecutor->OpsExecuter 1f99108d197 crimson: add missing field to SUBLOGDPPI and LOGDPPI 7b783876960 crimson: remove watchers upon object deletion 843daa9af72 common/async: remove unused common/async/bind_like.h c6415e14eb2 common/async: use asio::associator for Forwarding/CompletionHandler abaca8110ad common/async: SharedMutex uses append instead of bind_handler 03dfb8635ec rgw_cksum: treat mpu checksums w/o part count as valid in CompleteMultipart c4c647480ad osdc: remove unused overloads for async::Completion 56e48d4ba70 common/async: Completion removes unnecessary bind_executor() 71ed54ba772 common/async: Completion uses asio::recycling_allocator by default 2f61b2847d9 doc/governance: update my CSC email e4177406f97 mailmap: add my ibm email 022b90a7533 doc/governance: add new CSC members 88e4484acf1 mgr/cephadm: add ok_to_stop func for smb service 517ab013e2a mgr/dashboard: sync policy's in Object >> Multi-site >> Sync-policy, does not show the zonegroup to which policy belongs to b027d43e97f rgw/restore: Fixed status codes and response headers f7e2ca02110 rgw/dbstore: Cleanup - use unique_ptr instead of new/delete in DBZone cb4ff28af09 mds: add issue_seq to all cap messages da89acdc850 mgr/smb: prevent switching between clustering modes 263c0f8e730 mgr/smb: move logic validating cluster changes to handler 2f7fe668fe2 mgr/smb: split _check_cluster function body into two functions 5b0d849730c common/ceph_context: use std::atomic<std::shared_ptr<T>> 3dc091dd12c mgr/dashboard: Fix listener deletion 8ebcb2dd46e os/bluestore/ceph-bluestore-tool: Modify show-label for many devs f9b50b2e88a mgr/dashboard: fix group name bugs in the nvmeof API 86378344ab0 mgr/dashboard: introduce server side pagination for osds ad147f2e8d8 mgr/cephadm: RGW service deployment defaults to 'default' realm/zonegroup/zone despite non-default spec in service 7e03ee798f4 container/build.sh: fix arm architecture tagging 0a867d149e9 mgr/cephadm: adding more UT for mgmt-gateway service b92d14a0aa9 rgw: initialize createparams zone_placement to avoid garbage value 1a85d4df026 mds/QuiesceDbEncoding: add `inline` to work around linker error 0c4028a6a35 qa/standalone/scrub: remove TEST_recovery_scrub_2 4f1ef85c720 osd/scrub: modify ScrubStore contents retrieval 47ef574bee6 qa/standalone/scrub: test new ScrubStore implementation daf848fa5af osd/scrub: separate shallow vs deep errors storage 031580fb662 common/scrub,osd/scrub: minor cleanups to ScrubStore 283f4c25864 common: extend MapCacher API ce58c881583 osd/scrub: add dout() capability to the ScrubStore 571e2f3c193 osd/scrub: directly create or reinit the ScrubStore 38d9cf4ca76 osd/scrub: introduce ScrubStore::at_level_t e80b7ba4add mgr/cephadm: move Grafana's subpath handling logic to grafana config 47e7a24c7b9 mon/nvmeofgw*: fix HA usecase when gateway has no listeners: behaves like no-subsystems 1da6ef237fc include/ceph_fs: correct ceph_mds_cap_peer field name 655cddb7c9f include/ceph_fs: correct ceph_mds_cap_item field name 6d8a73439ed messages/MClientCaps: use correct ceph_seq_t for cap sequence types 7766d3c7249 messages/MClientCaps: dump issue_seq for debugging a72b31e2fb3 mds: remove dead code 5a1a21573b9 mgr/dashboard: unable to edit pipe config for bucket level policy of a bucket 95916c91906 doc/dev: remove "Stable Releases and Backports" 0317b5f87ac doc: SubmittingPatches-backports - remove backports team 9b7fb48c246 Add cosbench deprecation warning to qa/README 074dee9cbd6 qa/suites/tasks/cbt.py: Deprecating cosbench from Teuthology in preparation for deletion of cosbench support from CBT. The code being deleting is infrastructure code, no qa test suite uses this function. Therefore it can be safely deleted. 303f18b1aff qa/workunits/nvmeof/setup_subsystem.sh: use --no-group-append 0bab553399c qa/suites/nvmeof: use "latest" image of gateway and cli 6c419323584 cephadm/smb: Add NET_RAW capability to deploy ctdbd 67928a27357 qa/standalone/mon/mon_cluster_log.sh: retry check for log line efc96a2d134 common/Finisher: pass name as std::string_view to ctor f4bc4be0fa8 common/Finisher: add method get_thread_name() 62ade6b38d1 mgr/ActivePyModule: build thread name with fmt 9d47b164afd mgr/ActivePyModule: return std::string_view instead of std::string copy d513cc527ca labeler: add nvmeof labelers 12e0c26dd3a common/Finisher: use fmt to build strings 3717827b8bc common/Finisher: un-inline ctor and dtor a1e7ef6383e common/Finisher: add `const` to several fields cdd9bbd51e5 common/Finisher: merge duplicate field initializers 09df46644e0 common/Finisher: call notify_one() instead of notify_all() 0abad594d85 common/Finisher: wake up after pushing to the queue e30551eb86c common/Finisher: do not wake up the thread if already running 2a19a27040e common/Finisher: call logger without holding the lock 5b97c09b6f0 common/Finisher: use `std::lock_guard` instead of `std::unique_lock` c4c4b640f5c common/Finisher: merge all queue() container methods into one template 425fc4d21d3 msg/async/AsyncConnection: move the writeCallback instead of copying it c72dae9b6e4 msg/async/AsyncConnection: do not wrap writeCallback in `std::optional` 10a9914f848 msg/async/frames_v2: use zero-initialization instead of memset() 7fcb8a8afaf msg/async/Event: use zero-initialization instead of memset() 62ebf16f71f msg/Message: use zero-initialization instead of memset() 6597d773611 msg/async/ProtocolV2: eliminate redundant std::map lookups 342a25b9df1 msg/async/ProtocolV[12]: reverse the std::map sort order 988705a49b5 msg/async/ProtocolV[12]: use `auto` a1438447864 msg/async/ProtocolV[12]: use range-based `for` cae1af38601 msg/async/ProtocolV1: use zero-initialization instead of memset() 9441e9ad3a2 common/options: pass name as rvalue reference d29434c6190 common/config: use libfmt to build strings 1e391415a6e common/config: use emplace_back() instead of push_back() 2e2bcd5518a common/HeartbeatMap: pass name as rvalue reference 26858737028 common/config_obs_mgr: use the erase() return value adc0a601d87 common/SloppyCRCMap: use the erase() return value 6c1d2fc2d67 common: disable `boost::intrusive::constant_time_size` 42f7383589c CMakeLists.txt: do not compile {Objecter,Striper}.cc twice 78ae3b13509 qa/cephfs: update earmark values to valid ones in test_volumes.py 4fbb678c9c6 mds/MDCache: use `auto` f51ea0450ad mds/CDir: use the erase() return value ac30518d183 mds/MDCache: remove unnecessary empty() check e4b27678311 mds/MDCache: use the erase() return value b96998f8499 mds/MDCache: pass iterator by value a0c51d0e7f0 common/io_exerciser: Modify is_locked_by_me call in ceph_test_rados_io_sequence 1b535c011f1 doc: update 'header get' output in cephfs-journal-tool.rst 08632621d07 crimson/os/seastore: initialize oi and ss in onode_layout_t to zero 512eea1af52 doc: fix email 9fc65f160cd os/bluestore: Make truncate() drop unused allocations 256b20de486 qa: do not fail cephfs QA tests for slow bluestore ops 5506ed63c2f qa: add test for 'dump_export_states' d34f33055d2 mds: add an asok command to dump export states ad8e622fa97 suite/upgrade/quincy-x/filestore-remove-check: update ignore list 5b90117348d common/io_exerciser: Add version argument to callbacks in ceph_radios_io_sequence 97e68b20aa3 crimson/osd/backfill_state: add the object to be pushed in the peer missing set of PeeringState ec5c6c5761e crimson/os/seastore/transaction_manager: refine logs 1ee32107df9 crimson/os/seastore/transaction_manager: misc cleanups 14eacf64559 crimson/os/seastore: workaround log linkage issue under clang14 589e9cb9356 crimson/os/seastore: refine logs of seastore.h/cc d39949e8e9c crimson/os/seastore: adjust op names a49e49a1fd6 crimson/os/seastore: convert length logs to the hex format fc537c8d914 crimson/os/seastore: misc cleanups 966920e063c msg/async/ProtocolV2: pass `desc` as `std::string_view` to write() 984a76f5a3e test/rgw/lua: use stats polling instead of sleep 9f0af5d75dc doc/man: supplant "wsync" with "nowsync" as the default 0cb2636f1a6 doc/governance: revert d7c144c0d7e490bfda9715a0c8462bb67cffc764 471ebae9240 qa/suites/crimson-rados/perf: add ssh keys 8dd9e9dad6a mgr/dashboard: fix gateways section error:”404 - Not Found RGW Daemon not found: None” ea53aceb8d7 mgr/dashboard: show non default realm sync status in rgw overview page ee16b099d54 common: missing std include with GCC 14 ce5d62db0e5 mgr/vol: remove unused variable 485cb051192 mgr/dashboard: add gw_groups to all nvmeof endpoints 401e8109fc7 mgr/dashboard: Enable refresh button on Manage Clusters - Clusters List table 4d15ed813b1 mgr/dashboard: increase timeout to detect replication user in the secondary cluster 2f5dbed0cf5 doc: remove note for smb3 support 597a702874b s3select submodule 405798aeda9 qa/tasks: added "is down" warning to thrash-old-clients ingorelist 1578931220a osd/scrubber: Clean up unused function add_double 8daa791d396 test/rgw/multisite: add meta checkpoint after bucket creation cfe254758b1 doc/radosgw/multisite: fix Configuring Secondary Zones -> Updating the Period db926acb533 doc/dev/radosgw: update paths that moved under src/rgw/driver/rados/ 942474c2f5b client: Fix aio zerobyte file read 10c8330f20c client: Fix caps_ref[c]<0 assert 3ebe97484d2 client: Fix libcephfs aio metadata corruption. b5af1c1ffe8 test/client: Fix aio nonblocking test 59b996f0ed0 qa: Add libcephfs client test with objectcacher disabled 6d8f61015f2 qa: Add data read/write test for nfs-ganesha 247562fad74 script/run-make: stop args duplication ad9ff386278 mgr/vol: better to call base class __init__() at beginning 322c1a79206 doc/governance: add Zac Dover's updated email 31a5d5f2f97 doc/governance: add exec council responsibilites 5a9c1c06e8d cephadm/smb: Add a provision to specify ctdb log level 39723ff29d4 mgr/dashboard: Donot display restart gateway message on completion of Setup Multisite Replication wizard a48080af395 test/common: add death test for double !recursive lock 9eeca730fa0 global: Call getnam_r with a 64KiB buffer on the heap 9d1be68be06 mgr/smb: fix condition for smb earmark when cluster_id doesn't match 7b2085daad1 librbd/crypto/LoadRequest: clone format for migration source image 63529523f57 librbd/crypto/LoadRequest: rename m_is_current_format_cloned a92ca37b73c cephadm: use a shared smb.conf for clustered smb container sets 8d2d54f6c26 cephfs-shell: fixing the cephfs-shell test failures 80b7917cef6 json_spirit: add missing dependency on Boost::thread 1b66bc527eb RGW: Cloud Restore cli and its corresponding response for user. c49aa6aa3b1 cloud restore: completing read through 0e0222d0162 rgw/cloudtier: Restore object from cloud endpoint 5c40a5c1737 Add Containerfile and build.sh to build it. 84ebb30ea94 common/test: do not test exception raised from recursive lock 1213df95915 test/common: fix invalid vim mode bec702dad7a common,osdc: remove obsolete ceph::mutex_debugging 69baa6de257 common: assert debug mutex lock is not held if !recursive fd895dde9d6 cephadm: pull container images from quay.io c7fda7cabb0 mailmap, githubmap, organisationmap: Add Shweta Bhosale b39ee674295 qa/tasks/tox: unpin tox version 725b4e18479 src/exporter: improve usage message 3e3b7fa8ea2 mgr/cephadm: add "allow_set_io_flusher_fail = true;" to ganesha conf 0ed14dc8336 mgr/dashboard: Unable to delete realm via dashboard 1173caf7960 qa/tasks/ceph: wait for OSDs to go down before checking logs 287ff3b3603 mgr/dashboard: Allow adding all listeners unders a subsystems a71c8e8d118 PendingReleaseNotes: add a release note about confirm flag for max_mds 2d28faaeea1 doc/cephfs: update about changing max_mds FS setting variable 4d5ec87ab40 qa/cephfs: add tests for confirmationn required to change max_mds a55a75c57e7 mon,cephfs: require confirmation when changing max_mds on unhealthy cluster 417c5441ef7 mon/nvmeofgw*:fix monitor database corruption upon add gw b8516bf6b91 rgw: decrypt multipart get part when encrypted a09e6d3c2f7 README: add OpenSSF Best Practices Badge 48d1517b417 mgr/dashboard: Fix `null` gateway group c0e05bf3606 ceph-volume: drop unnecessary call to `get_single_lv()` 719fd989523 os/bluestore: log max throttle cost and txc count on slow op. c2e8c295dc4 ceph-volume: add new class UdevData ee8c7d2e3bb mgr/cephadm: adding config to check client cert for internal nginx Fixes: https://tracker.ceph.com/issues/68310 a2b2eac0367 rgw/lc: Fix a bug in LCOpAction_Transition::check() 2baa027b13c doc/rados: edit "Placement Groups Never Get Clean" 99ae9590a5b doc/releases: move Dashboard items from CephFS 84f5ace9498 doc: Adds release date. 706eb26f560 mds: do not dump empty bufptr bb7d5b62d9d doc: Document the Windows CI job 9d44eef4ae3 rgw/multisite: add zonegroup parameter to test-rgw-mulitisite.sh b4c62fe6367 ceph-volume: docstring and typing corrections ad471f553d3 mgr/dashboard: fix doc links in rgw-multisite 59e39d11779 osdc: fix mutex assert for !debug builds d31397457cc common/io_exerciser: code enhancements to ceph_test_rados_io_sequence 50ec38470fa mgr/dashboard: rbd table actions enhancements cf5b9eafb3b mon/nvmeofgw*: fix tracking gateways in DELETING state 1.Ignore subsystems of GWs in state DELETING when calculate number namespaces 2.Call tracking function always in the monitor's tick - not just if the beacon is active 3482ebcd3c7 mgr/vol: don't define progress bar ID repeatedly 829c857b9e1 crimson/os/seastore: fix data inconsistency during ool writes 012bb63b276 mailmap, githubmap, organisationmap: Add Kushal b96d714b23b mgr/mgr_util: log traceback when exception occurs in RTimer.run() 8db39bcbdb4 crimson/osd/backfill_state: do at least one time of replica scanning if necessary in the Enqueuing state c39ae16f78f qa/standalone: bugfix for wait_for_scrub 4a4fc7bad53 qa: ignore pg availability/degraded warnings 4b2e841144e script/ceph-debug-docker: add debuginfod for ubuntu dccebc7ca4c script/ceph-debug-docker: drop /ceph mount 6cdef7ad93a doc/releases: add highlights section 7769bdb9438 rgw/rados: rgw_rados_operate() takes version_t* 21cf769ae78 mgr/mgr_util: don't set event when it is already set a191f9a6d29 rgw/multisite: avoid redundant error repo entry logging 7075998a64a doc/releases: update squid release date 5cc7cf44dba librados/asio: add version_t to completion signatures 0daba18f9af doc/releases: Add warning about iSCSI bug 29e122f8754 qa/suites/rbd/iscsi: enable all supported container hosts d3f385aaed0 qa: avoid a non-standard shell construct in rbd/iscsi_client.t b66b98e76d4 qa: don't hardcode podman in rbd/gwcli_{create,delete}.t 9022ef19a58 qa/tasks/ceph_iscsi_client: don't use mpathconf 9e3449995f8 qa/cephfs: test clone progress reporter after subvol is deleted but... fdecec7349b qa/rgw: add debug log to help diagnose 'bucket check unlinked' failure 517a3458af8 Temporarily change the libcephfs dependencies 45ad72a5e4d proxy: Add the design document c7c982cdb67 proxy: Add the proxy to the deb builds b524c4c1427 proxy: Add the proxy to the rpm builds 0df9f4451f5 Initial version of the libcephfs proxy 9c65adeb23f blk/KernelDevice: using join() to wait thread end is more safe 5a11bc00e6c doc: fix typo 0f8676f04f3 doc/_ext: accomodate three active releases in the Ceph timeline 36315d48140 mds: do not duplicate journaler write heads b3025914374 mds: use Journaler getters 55652f08197 osdc: properly acquire locks for getters ce5d84d1fa4 osdc: add print method for Journaler::Header 98b7402b272 mds: do not trim segments after open file table commit b2711f655a7 mds: delay expiry if LogSegment is ahead of committed oft seq 92e50c4f533 mds: do not write journal head twice on trim 6828bd05029 mds: simplify and explain expiry finisher ctx 76eab177a13 mds: add mds_lock asserts for journal flush ddc55945ea2 mds: skip second wait_for_safe 66478ab2755 mds: trim only to the LogSegment created for flush 64ec1e2e951 mds: allow passing explicit seq to trim to 6030e748165 mds: quiet unhelpful debug message f41bb2e68c9 mds: add C_IO_Wrapper completion debugging 52070edd0f0 mds: add dout for new segment 6d010bb994d doc/releases: add fixes 8a101ef9be5 mgr/dashboard: Forbid snapshot name "." and any containing "/". c01b5b179e2 rgw/auth: fix internal server error for presigned urls ad0a7fa655e node-proxy: fix a regression when processing the RedFish API 9b9ce5369ea mgr/dashboard: adjust federate ssl code with mTLS f39c5f50544 rgw/rados: RGWRados::delete_objs_inline() uses AioThrottle e39f601295b cls/rgw: cls_rgw_obj_chain uses vector instead of list 24af1beeb54 earmarking: improve error handling when getxattr fails 2ab0103e822 mgr/nfs: earmark resolver for subvolume 51adf772719 rgw: handle http options CORS with v2 auth e40b4c56cfe mgr/dashboard: Add progress bar to rgw multisite automation wizard 358f33a148c os/bluestore: Fix ceph-bluestore-tool allocmap command f6b86bbf2fe mgr/dashboard: carbonize user management-role form 15ad2bcce8a librbd: add LIBRBD_SUPPORTS_GROUP_SNAP_GET_INFO define a88c84aa1ca crimson/osd/pg: correct log messages for ShardServices::dispatch_context_messages b0f5e1086a6 crimson/osd/pg: also trigger callbacks for empty peering transactions 597e48b857e doc/releases: add Squid target release date 22546c61e9d pybind/mgr: drop py37 test from tox.ini de90c32240e mypy-constrains.txt: bump mypy up to version 1.9 a2cbb409257 pybind/mgr/telemetry: remove misleading tox env ffcc157a694 pybind/mgr: replace imports of distutils.util 51516ba146e python-common: add a utils function to replace distutils.util.strtobool 7d9fe0a5dbc mgr/smb: use is comparisions for enum values 3ec02970325 cephadm: make bootstrap default to "global" section for public_network setting af437b4e7f1 mgr/dashboard: multisite sync policy improvements 23bc88c8684 os/bluestore: log additional txc info for slow op warning on kv_committed. 1f99b55488b kv: add a pair of informative getters to KeyValueDB::TransactionImpl 4db3bb77b64 mgr/smb: accept public_addrs on cli when creating cluster 334e79002b2 qa/tasks/fwd_scrub: remove unnecessary traceback 0b09d16f10f qa: modify `test_human_readable_quota_invalid_values` 07d5199c9d8 src/test: test to check proper handling of units by strict_iec_cast 39d1cc5fd94 src/common : proper handling of units in `strict_iec_cast` ff7aa420b1a mgr/dashboard: fix setting compression type while editing rgw zone 5b2378104a9 doc: update doc for subvolumes earmarking mentioning valid formats bc168d7eda9 mgr/smb: earmark resolver for subvolume 6850bce5543 qa/standalone/scrub: increase status updates frequency 138ac6aa182 rgw: remove rgw_data_log_obj_prefix b9f63e12572 qa/cephadm: wait a bit before checking rgw daemons upgraded w/ `ceph versions` bde621dbc52 mgr/cephadm: adding health check endpoint for mgmt-gateway 42d89dfb641 doc: revert sync_duration to seconds 46e3e28a2e8 qa: update test for last_sync_duration e1612d048a1 pybind/mgr/orchestrator/module.py: NvmeofServiceSpec service_id 4277cd29897 mds: invalid id for client eviction is to be treated as success 49ee68245b7 mgr/dashboard: fix handling NaN values in dashboard charts e4183b2fde8 mgr/rgwam: use realm/zonegroup/zone method arguments for period update a7f3b7b749a src/mon/MonMap: modify dump function 4d2f8879bed qa: Added tests for disabling stretch mode 3be430040b4 osd/scrub: disable high work-queue priority for h.p. scrub 142c96e7ca5 ceph-volume: fix OSD lvm/tpm2 activation ec2af67dba8 crimson/osd/pg: remove snapmapper objects when eventually removing collections at the last moment of pg deleting, just as pg meta objects 902a45a23c5 qa: remove all bluestore signatures on devices d257eacb05a doc: Update "Getting Started" to link to start not install 45cdd3786fc librbd: introduce rbd_group_snap_namespace_type_t enum ea3bdc6f678 mgr/dashboard: update period after migrating to multisite 14c905d0c1f test/crimson/test_backfill: set BackfillState's log level to debug bfe15f68075 crimson/osd/backfill_state: always go to Enqueuing when object is pushed during Waiting 5400aab8d92 cls/user: reset stats only returns marker when truncated 28d2fa30c25 mgr/dashboard: NFS Export form fixes Fixes: https://tracker.ceph.com/issues/67400 1889ef5db5e mgr/dashboard: fix checkbox selection and role clone modal 81c8c8c71f0 common/io_exerciser: performance, readability and safety improvements 524dabc0aaa erasure-code/isa: Handle case where data and coding buffers are not 32-byte aligned 696a41037f0 mgr/dashboard: List gateways in a group a5d0f546807 crimson/osd/backfill_state: push peer pg infos' last_backfills only when all objects before them are backfilled 7c6c16c5936 mgr/dashboard: Add group selector in subsystems views a0e88abf4ec cephfs_mirror: revert sync_duration to seconds b534f60ed5f mgr/dashboard: rm unnecessary classmethods a939c75f107 mgr/dashboard: ignore exceptions raised when no cert/key found 0680f17d7ba doc/rados/operations/stretch-mode.rst: Added Exitting Stretch Mode 78ce68de41b mon [stretch mode]: support disable_stretch_mode 52278f169fe mgr/dashboard: zonegroup level policy created at master zone did not sync to non-master zone afb6399c400 src/test/osd/ceph_test_rados_io_sequence 921d92f17e3 doc/cephadm: don't hardcode default oauth2-proxy image into docs 83108769334 mgr/cephadm: update oauth2 proxy image variable name c187b0d6e22 mgr/cephadm: add --no-exception-when-missing flag to cert-store cert/key get 3bcbe50b01f mgr/dashboard: Service form fixes for mTLS 399c53fae04 rgw_log_backing: error code not returned 95cdae7f39b COPYING,common/*s390x*: distribute under Apache 2 license for s390x 33e3f8d6362 arch/s390x: add license notices, use LGPL afd27596802 ceph.spec.in: Fix unversioned Obsoletes: rpmbuild warning a159821ddfc doc/rados: add confval directives to health-checks 0f6039f9afa doc: update nfs doc for Kerberos setup of ganesha in Ceph 91734345b61 doc/radosgw: correct RST formatting 85dff0d1918 crimson/osd: purge strays when PGs go clean 9dd0b2369f9 os/bluestore: Move reservation of bdev label to proper place. e15a9c1e711 mgr/dashboard: Fix space between the text in few sections 984780eeae1 mgr/dashboard: carbonize the wizard component ccd58786b90 mgr/vol: use pre-defined timeout period instead of hardcoded value a79e9a4e7ae doc/rgw/uadk: Add UADK document for compressor zlib d1c942a9849 pybind/mgr: attempt to fix mypy importing from python-common b360419f5f0 mon: remove duplicated NVMeofGwMap.h 9d454bd8be6 os: remove unused btrfs_ioctl.h and tests 3582e6e9d5d mailmap, githubmap, organizationmap: add Naveen Naidu a98c0d67b63 common: remove unused sync_filesystem.h bec46e941d2 rbd: set journaling feature when --mirror-image-mode is journal a8918f35941 crimson/mon/MonClient: use gates to handle multi-shards da409bb22ce crimson/mgr/client: use gates to handle multi-shards e4b5a327bf4 common/gated: enable ceph_assert on shard id 45327462e09 orch: Fix `daemon add osd` boolean param handling 528f09c04eb mgr/dashboard: fix minor issues in carbon tables 656b6cb3ff0 cephadm: update LATEST_STABLE_RELEASE to squid 48b0a20bd42 rbd: display mirror uuid for mirror pool info output 5c6c4a07d8d mgr/dashboard: Cloning subvolume not listing _nogroup subvolumegroup if there are no subvols in _nogroup Fixes: https://tracker.ceph.com/issues/67891 Signed-off-by: Dnyaneshwari talwekar <dtalweka@redhat.com> 21454d08484 mgr/dashboard: remove orch required decorator from host UI router (list) 3fdbc160bb2 rbd-mirror: allow mirroring to a different namespace 174b9d4abe6 doc: document earmark option for subvolume and new commands d2f8d102215 qa/cephfs: update tests for test_volumes & unit-test for earmarking a08ddab34ab mgr/volumes: add earmarking for subvol 876bdcf2def mds: dump next_snap when checking dentry corruption 847380958b8 crimson/osd: remove CommonClientRequest::should_abort_request, no callers 5c280d2d3dc crimson/osd: InternalClientRequests should not be repeated after interval change 9aee68a25f0 qa: correct daemon for warning conf 95e8c42f4c3 qa: print config dump after setting b895e596a88 doc: nit fixes for nfs doc daafaf7f65e client: remove hypertable 1d01d0407ee mgr/dashboard: Add mTLS support e0e467a7a20 mgr/dashboard: Adding group and pool name to service name 94418d90d2b mgr/dashboard: fix UI modal issues bda1c7fe2b7 mon/NVMeofGw*: fix issue that GW was down when last subsystem was deleted a3767525d88 mgr/dashboard: add SSO through oauth2 protocol bc830a322df mgr/dashboard: add service management for mgmt-gateway 8fccda90d5b crimson/os/seastore/rbm: add assert to check if bptr is page-aligned e3953d324bf mgr/dashboard: add service management for oauth2-proxy 3bc36d1fa8d crimson/os/seastore/rbm: remove unnecessary copy during ool write f57e99e1731 doc/rados: add osd_deep_scrub_interval setting operation 482270a8d7b doc/install: add prompts to install-storage-cluster b98a46582e5 osd/scrub: reduce osd_requested_scrub_priority default value 36c620b04f3 doc/README.md: create selectable commands e4434feafc8 test/crimson/test_messenger_thrash: fix local variable out of scope in async task 1716224760d crimson/osd/pg: make "PG::submit_error_log()" and "PG::complete_error_log" interruptible 4ed50051484 crimson/osd/ops_executer: revoke OpsExecuter::get_obc() b9ef4367229 crimson/osd/ops_executor: simplify OpsExecuter::rollback_obc_if_modified fc41513d4e9 crimson/osd/pg: rollback ops by copying obc beforehand and recover after errors e0f77686523 cephadm: Support Docker Live Restore 86a0a80cb03 mgr/dashboard: fix table filter afeaeb711fa tools/ceph-bluestore-tool: Added zap-device documentation e3d8a37ef6e orch: refactor boolean handling in drive group spec 5eee7e81051 mgr/dashboard: RGW multisite sync remove zones fix 3bb41eb33b4 mgr/dashboard: fix start time format 1a80319bbff tools/ceph-bluestore-tool: remove param zap_size b61c7616819 mgr/dashboard: fix table column pipe transform dcf743928e3 ceph-volume: add call to `ceph-bluestore-tool zap-device` 55a2ffb342c mgr/cephadm: use host address while updating rgw zone endpoints 8c56a2327fa rgw/service: remove unused metadata and metadata backend services fb7cb18df92 rgw/services: remove unused RGWSI_Role_RADOS bb2ba14dfc4 rgw/role: add rgwrados::role interface for role metadata 4ed934a2190 rgw/metadata: use raw RGWMetadataHandler for role metadata 78bbf69b57f rgw/metadata: encapsulate role metadata handler in rgw_role.cc a2b37a10f80 rgw/metadata: use raw RGWMetadataHandler for user metadata 62e95e133f4 rgw/user: remove unused 'meta backend ctx' arguments a5898734a9e rgw/user: call sysobj directly instead of 'sysobj meta backend' c83fd2e1b1b rgw/metadata: use raw RGWMetadataHandler for bucket instances b04ca1367cb rgw/metadata: use raw RGWMetadataHandler for bucket entrypoints 7fb384207f9 rgw/bucket: remove unused 'meta backend ctx' arguments 2cdf27f06ed rgw/bucket: call sysobj directly instead of 'sysobj meta backend' 7b6ef9e6455 rgw/bucket: free functions for bucket instance metadata keys 890caebdc87 rgw/services: remove otp service and metadata backend 48753d440cc rgw/metadata: remove backend stuff from otp metadata handler b017975d673 rgw/services: remove unused RGWOTPCtl 0753d678402 rgw: clear output keys in RGWMetadataLister::get_next() c83698b9714 test/rgw/posix: add missing include for cpp_strerror() 8c2ed94e9cb osd/scrub: decrease default deep scrub chunk size 816df9cb2a7 qa/rgw/multifs: add tasks/+ to concatenate tasks into same job 64f71715202 qa/rgw/multifs: factor common setup tasks into 0-install.yaml 86e737fdac5 qa/rgw/multifs: remove 'rgw relaxed s3 bucket names' overrides ed09e85a890 qa/rgw: perl tests generate valid bucket names 25e0a323ad2 mgr/cephadm: renaming whitelist_domains field to allowlist_domains 0997e4cd51e python-common/ceph/deployment/service_spec.py: Allow the cephadm deployment to determine the default addresses 589258241a4 doc/releases: add rbd-wnbd scalability note 1b431a3757e tools/ceph-bluestore-tool: Allow show-label even if OSD is running 62a4247353d pybind/mgr/cephadm/services/nvmeof.py: allow setting '0.0.0.0' as address in the spec file 128e6451d8c doc/install: Keep the name field of the created user consistent with the node name in the Start RADOSGW service command 17cc3237715 mgr/dashboard: fix indefinite loop in cephadm dashboard e2e 7a952dcbc00 qa: restrict 'perf dump' on active mds 80beab8eb2c rgw/kafka: refactor topic creation to avoid rd_kafka_topic_name() 9eb3b99b99b mgr/cephadm: Make the discovery and gateway IPs configurable in NVMEof configuration Fixes https://tracker.ceph.com/issues/68030 02bbd3cf3c1 python-common/ceph/deployment: Make the discovery and gateway IPs configurable in NVMEof configuration Fixes https://tracker.ceph.com/issues/68030 04f26b29e0c Checking for dereference of a null pointer (loaded from variable 't') b9ca3957303 doc/README.md: improve formatting e905fedfccb osd/PG: make use of SnapMapper::update_snap_map 4af51349e5e mgr/dashboard: mgr/dashboard: Select no device by default in EC profile 73231640d95 crimson/osd: more detailed debug logs 918539e9de2 crimson/os/seastore/rbm: remove duplicate code and introduce a shared routine in read() and write() c8434d67d08 mgr/dashboard: expose gw_groups list api 47f57d434d1 mgr/dashboard: add gw_groups support to nvmeof api 20da9296a23 mgr/status: Fix 'fs status' json output faa68920aab mgr/dashboard: fix context switcher and multi-cluster add cluster feature e61c0e05676 mgr/dashboard: add check if federate job is running else show reconnect message 5f31be9df25 mgr/dashboard: add ssl to prometheus federation d8cd10243d8 doc/releases: add Telemetry section 34f8306fe5c rgw/multisite: no need to capture error from callback. we are already doing that within RGWDataFullSyncSingleEntryCR() ed3312085b3 rgw/multisite: drain_all() after notify stack cancel 676479354d9 rg/multisite: if the first shard fails to sync, we must drain and return error. b01c0e9b50a test/scrub: only instruct clean PGs to scrub 447f8818bec mgr/cephadm: add command to list systemd units of dameons c939c95265c mgr/cephadm: add systemd unit to stored info about daemons 5f2604807a5 crimson/osd/ops_executer: cleanup snap_map_* b7cbd6a341c crimson/osd/osd_operations/snaptrim_event: only increase osd_osd_param_t::at_version after clone adjustments f4c82b10d8a crimson/osd/osd_operations/snaptrim_event: we do SnapMapper updates in ReplicatedBackend::submit_transaction(), drop all SnapMapper updates before that 8f969360069 qa: Add test for 'fs status' in standby-replay mds setup c00d2078651 Change code from non-PIC to PIC for ppc64 45871f73221 os/bluestore: perfect comments in hybrid_allocator fd93ecd88a5 mgr/cephadm: open ceph-exporter when firewalld is enabled 5f956e52d1b osd/scrub: remove the 'planned scrub' flag set 92b0f851261 osd/scrub: remove requested_scrub_t::need_auto ec3e4abeeb7 mgr/dashboard: service form hosts selection only show up to 10 entries c43853afd57 osd/scrub: set_op_parameters() no longer uses the 'requested' flags fcdae78c356 cephadm: bootstrap: verify orch module is running before setting cephadm backend 12a9aba43ca cephadm: add ability to continue on failure when applying multiple specs 6b34707f827 doc/man: edit ceph-bluestore-tool.rst baab1dc6463 rgw/notify: add copy ctor to token waiter 7171f73c81d doc/README.md: improve formatting 5b1f9aaf4ff mgr/cephadm: changing the nginx upstream image used by mgmt-gateway 4ccbc083e29 osd/scrub: remove requested_scrub_t::must_repair de29f25ef2a mgr/smb: stop trying to clean external store during cluster sync 162efeaeefd osd/scrub: complete on_mid_scrub_abort() refactoring 3cdde70d2aa crimson/osd: check_osdmap_features - add log 0d37bc91f4c crimson/osd/ops_executer: pass MutFunc by value ea89f46aace crimson/osd/ops_executer: avoid seastar::async comment 28f44131729 crimson/osd/osd_operations/snaptrim_event: make use of process_and_submit 38bd4e7c5c3 crimson/osd/osd_operations/snaptrim_event: introduce process_and_submit dbf7425c89e crimson/osd/ops_executer: flush_changes_n_do_ops_effects to use coroutines 24a278be8f9 crimson/osd/osd_operations/snaptrim_event: start to use coroutines 2a61d4f5811 crimson/osd/pg: make use of SnapMapper::update_snap_map dfda0c6f594 mgr/dashboard: datatable performance improvement def275e100a osd/scrub: fix scheduled_at for distinct urgencies fc925a0e4c6 osd/scrub: implement urgency_t::repairing 761873577ac osd/scrub: remove requested_scrub_t::must_deep_scrub 769790122d3 osd/scrub: remove requested_scrub_t::must_scrub 2e31563389f osd/scrub: base queue priority on the urgency of the scrub target 83b8ca54bb9 osd/scrub: remove remaining refs to the Scrubber's 'required' flag e2ffccdfc5d osd/scrub: mid-scrub-aborts logic should use the new urgency attributes 22bb6d9ed55 osd/scrub: remove flags_to_shallow_priority() 93d90ea358c doc/cephadm: add malformed-JSON removal instructions 062108efca9 tools/rbd_ggate: fix sign of errno 908dc7f14a8 qa/crontab: Add weekly crimson-rados suites d8e4be257a4 doc/releases: add Crimson/Seastore section 01306208eac src/include/uuid.h: fix for boost 1.86.0 e7139a8f438 ceph.spec.in: we need jsonnet for all distroes for make check 36a8e202a2b mgr/cephadm: stop running "true" before every command d620a51c306 doc/rados: add "pgs not deep scrubbed in time" info 6fd11c0276d librbd/migration/NBDStream: abstract out libnbd and add unit tests 3260b8fbea9 qa/suites/rbd: add snippets for migration import from NBD e1418e19757 librbd/migration/NBDStream: call nbd_shutdown() in close() 90b55cfdc25 librbd/migration/NBDStream: switch to NBD URIs d6d308003b2 librbd/migration/NBDStream: check for nbd_get_size() errors 1b12f4603e5 librbd/migration/NBDStream: introduce from_nbd_errno() d52bd80f1f9 librbd/migration/NBDStream: be more thorough around nbd_block_status() dc8eed68ce5 librbd/migration: add nbd stream 926f91c5d33 cephfs-top: fix exception on small sized windows af84f6d512a mgr/cephadm: adding spec fields for oauth2-proxy whitelist_domains c9c30bcdb07 tool/bluestore-tool: add zap_device command support 13a59272967 rbd/bench: Add ability to write a random string of bytes or a specific byte with --pattern-bytes option c266ef0f61f tools/ceph-bluestore-tool: fix "--yes-i-really-really-mean-it" option 0b277fe3809 doc/README.md: edit "Build Prerequisites" 3106f79f5b8 mon/NVMeofGw*: 1. fix blocklist bug - blockist was not called 2. originally monitor only bloklisted specific ana groups but since we allow the changing of ns ana grp on the fly for the sake of ns load balance, it is not good enough and we need to blocklist all the cluster contexts of the failing gateway Signed-off-by: Leonid Chernin <leonidc@il.ibm.com> a59f007695d cephfs-top: fix exception on large sized windows ef68253a87b qa: relocate subvol creation overrides and test e7bd4bcdd07 doc/dev: add "activate latest release" RTD step d0a83cb03ff doc/releases: move Op tracker to mgr f2350a8c7fa cls/rgw: warn about CLSRGWConcurrentIO use in asio threads 745f6f2c711 doc/releases: add more to RADOS section d011c522bb1 cls/rgw: duplicate reshard checks in all cls_rgw write operations 658098b4799 cls/rgw: remove unused cls_rgw_bi_get_vals() a86f97badcb rgw/rados: remove unused RGWRados::bi_get_vals() 6ec74a5dccc rgw/reshard: use cls_rgw_bi_put_entries() when replaying the reshard log e11480aa4c5 cls/rgw: add bulk cls_rgw_bi_put_entries() op for reshard 7ce0b5ebbda test/cls/rgw: simplify set_reshard_status() d78a2767bb0 test/cls/rgw: helpers take const strings fa7873e1917 cls/rgw: remove rgw_bucket_dir_entry_meta default ctor 5c05291b544 cls/rgw/client: expose cls_rgw_bucket_init_index2() 088f5abaff3 cls/rgw: rgw_cls_bi_entry::get_info() is const cce84124574 cls/rgw: remove rgw_cls_bi_entry default ctor 926ef939e7d cmake/ec: use ExternalProject to build isal library 3bfc1ae3d72 cmake/crypto: use ExternalProject to build isal crypto library 2e319cb30c8 rgw/notifications: free completion pointer using unique_ptr 12c7c6522ba mgr/dashboard: Increase maximum namespace count to 1024 d14d87b085e crimson/common/gated: Comment out ceph_assert for shard ID check 1071cc38868 crimson/net/io_handler: ctor add gate ctor with shard id 81f9d064f71 doc/rados: add link to messenger v2 info in mon-lookup-dns.rst 1fda7cb7e23 qa: test fetching foreign config item 529cdd34249 mgr/snap_schedule: correctly fetch mds_max_snaps_per_dir from mds 037537ed8c6 mon/NVMeofGw*: Fix issue when ana group of deleted GW was not serviced. Introduced GW Deleting state Signed-off-by: Leonid Chernin <leonidc@il.ibm.com> f78f7950dfa doc: Add Squid 19.2.0 release notes 20e2948a375 mgr/cephadm: make ssh keepalive settings configurable 461be1cd3d5 rgw/rados: guard against dir suggest during reshard 190623575e8 mgr/smb: add support for new ceph vfs module 5fc36f6463c ceph-volume: pass self.osd_id to create_id() call d7c7aa7328d osd/scrub: implement existing 'interval' as a distinct delay reason ec8f61ffa6b test/osd: fix 'recovery scrub' standalone test a84c3c45754 osd/scrub: add 'snap-trimming' as a distinct delay reason c0a52a59697 test/osd/scrub: set new scrub-related config options to test values 70691410032 osd/scrub: add configuration parameters to control length of delay a94a0ad634d mgr/dashboard: Rephrase dedicated pool helper in rbd create form 494ec06f301 osd/SnapMapper: introduce SnapMapper::update_snap_map 5929a1f5374 crimson/osd/osd_operations/snaptrim_event: encapsulate new snaps in the pglog entry 0697562bde4 crimson/osd: update snaps based on log entries on primary and replica 5963dba0a34 crimson/osd/pg: convert PG::handle_rep_op to coroutine f7504b29c72 crimson/osd/pg: convert PG::handle_rep_op to logging macros abc6a47fc92 crimson/osd/pg: skip unnecessary stopping check in PG::handle_rep_op 4811263eb81 crimson/osd/object_metadata_helper: take clone objects' clean regions into account when recovering them d6c51fe80f6 crimson/osd/ops_executer: set correct clean regions for CLONE pg log entry b2da7394ee0 qa/tests: fix test_list_enabled_modules timeout error e0d452f2c8f mgr/cephadm: bump grafana to 10.4.8 196a73cbd4c cls/rgw: add a helper function for calls to cls_cxx_map_remove_key() 2aa82539ede doc/rados/operations: Improve health-checks.rst 332804bad58 doc/mds: improve wording dfca044b646 mgr/dashboard: Fix variable capitalization in embedded rbd-details panel 710747031b7 ceph-volume: fix generic activation with raw osds 1e97d4f6447 crimson/os/seastore: update the capacity calculation for lba/backref internal/leaf nodes b3521e00093 crimson/os/seastore: validate the node capacity for lba/backref node c99f6be8091 crimson/os/seastore: backref_node_meta_le_t should use paddr_le_t as template parameter 37a6f1ca0aa crimson/os/seastore: add packed attribute to lba/backref map value 5ac01659cf8 client: fix d_reclen for readdir 0d81e721378 common/options: Change HDD OSD shard configuration defaults for mClock eda7eee9359 osd object store compaction on start wasn't working because of wrong boot sequence. More specifically compaction is called before authentication of monClient. Store compaction now is moved after authentication of monClient. da8e95c3923 qa/suites/nvmeof: wait for service "nvmeof.mypool.mygroup0" 4d97b1aa6b5 qa/suites/nvmeof: increase hosts in cluster setup f628b13f3bb crimson/osd: write require_osd_release only when needed 4594e38bf19 doc/rgw/d3n: pass cache dir volume to extra_container_args 2ed818ebd8d qa: move nvmeof shell scripts to qa/workunits/nvmeof f4906299929 rgw/notifications: update release notes with fix to principalId 7ca0d71eada mgr/dashboard: Wrong(half) uid is observed in dashboard 84a30ba6b94 doc: Correct link to Prometheus docs 6c25635be8c mgr/dashboard: carbon datatable minor bug fixes 1091a9d516e mgr/dashboard: carbonize cephfs forms 3d9ce6e1d86 crimson/os/seastore: cleanups to SeaStore::report_stats() 0dafee51788 crimson/os/seastore/cache: report cache access stats c8a7d3d9494 crimson/os/seastore/cache: minor fix in get_stats() 6bacf5e7616 crimson/os/seastore/cache: drop inaccurate cache_query_by_src 20adfb08aad crimson/os/seastore/cache: monitor cache access by extent and trans 339019377fb crimson/os/seastore/cache: add asserts c25fd3525e5 crimson/os/seastore/transaction_manager: minor cleanup befa65c8d20 crimson/os/seastore/cache: report cache index sizes 8e58a52a408 librbd/migration: don't include ImageState.h in formats d9192b5aca1 librbd/migration: prune snapshot extents in RawFormat::list_snaps() 5d64c9c5cda librbd: factor out prune_extents() from prune_parent_extents() 11de53f36cf mgr/cephadm: revert SPDK RPC fields in nvmeof configuration Fixes https://tracker.ceph.com/issues/67844 f3a774c8df7 crimson/os/seastore/rbm: write merged-able ool extents at once cb28d391d0e python-common/ceph/deployment: revert SPDK RPC fields in nvmeof configuration Fixes https://tracker.ceph.com/issues/67844 9bfcb8e17db doc: update tests-integration-testing-teuthology-workflow.rst 8e743fc6033 doc/radosgw: Improve config-ref.rst e0d8f7d363a false use-after-move on store bfbcb3c7f64 integer being interpreted as a character code when assigning to a string d7e68964d81 test/crimson: verify the backfill cancellation & resumption ae7469ae6b0 test/crimson: add event-type-checking next_round2() to BackfillFixture 9ba4cd8bc39 crimson/osd: wire up backfill resumption 8e5da475446 crimson/osd: BackfillMachine does support cancel and resume now 15df7efca5c qa/rgw/multisite: add optional --default arg to 'realm pull' 7bbaa316646 qa/rgw/multisite: fix spelling of is_default in realm configs e4157c8e98a qa/rgw/multisite: specify realm/zonegroup/zone args for 'account create' 789b5f352c5 options/rgw: raise default rgw_max_listing_results=5000 4b29809a163 options/rgw: use s3 names for listing operations 621e5ce0fc7 tests/rbd-mirror: fixes BootstrapReplayer test 7e02946a3f6 rbd: mention namespace in "rbd mirror pool" command descriptions 98618aaa1c8 doc/ceph-volume: add spillover fix procedure 0e7767a0052 cls/rbd: async methods for group snap list 4f1d97918e0 cephadm: configuring prometheus endpoint for smb 2c4096943ed cephadm: run smbmetrics as side-car container 3cc0605988f cephadm: propagate smbmetrics image via config_blobs bb6e68a7a9b cephadm: samba metrics-exporter image db130628c0c ptl-tool.py: replace regex strings with raw string literal 4f9289e11ae qa/tasks/ceph_manager: set-require-min-compat-client to squid for msr profiles e4f60eb438e mgr/dashboard: alerts module supports setting multiple email recipients 5e64748927d doc/rbd: add namespace information for mirror commands 508bba9b0d7 examples/rgw/boto3/README.md: update documentation for boto3 extension installation. Fixes: https://tracker.ceph.com/issues/67768 570adc62352 src/test/rgw/bucket_notification/README.rst: use systemctl, update rabbitmq installation process. Fixes: https://tracker.ceph.com/issues/67768 682cc90c4dd src/test/rgw/bucket_notification/README.rst: update RabbitMQ documentation. Fixes: https://tracker.ceph.com/issues/67768 1b006f47b8f mgr/dashboard: Fix banner and scroll issue ac998b58487 qa/task: update alertmanager endpoints version b8f3db5b404 mgr/nfs: add additional tests for cmount_path & user_id deletion 6b24da78abc qa: test 'ceph fs snapshot mirror ls' command e60d82ab7cf doc: update docs for 'fs snapshot mirror ls' command 1c07a39a94d cephfs_mirror: ceph fs snapshot mirror ls command 5d1ee140d05 mgr/dashboard: Update nvmeof microcopies dbebf1a3db6 qa/config/seastore: enable all subsystem debug cd7067adde3 crimson/osd/pg: fix missing priority argument 9a2c9157984 test/rgw/notifications: also verify bucket notifications are updated correctly 81fb5ae2432 forwarding reference passed to std::move() b863c93ef1a cephadm: emit warning if daemon's image is not to be used b377085c302 mgr/orchestrator: allow passing group to apply/add nvmeof commands e63d4b01e6b Revert "mgr/cephadm: migrate nvmeof specs without group field" 3e5e85aadc1 Revert "mgr/orchestrator: require "group" field for nvmeof specs" d02b94d8200 mgr/nfs: ensure user_id for create_export_from_dict a09fd4210b1 test/erasure-code: increase ceph_erasure_code_benchmark default buffer size 1e088468139 mailmap, githubmap, organisationmap: Add Shraddha Agrawal d944d320792 seastar: re-enable gate debug 9fc02b203d5 crimson: use gate per shard for AlienStore and OSD e5a9cda3267 qa/suites/nvmeof/basic: add nvmeof_scalability test 58d8be9fd83 qa: Expand nvmeof thrasher and add nvmeof_namespaces.yaml job c43542f7b9d crimson/osd: cancel ongoing pglog-based recoveries on recovery defering 277423c15a7 qa: add test for data uninlining 4e30d18a16b mds: handle mds_scrub_stats_review_period change via ScrubStack::handle_conf_change() 73c4541da3b mds: add manual and auto purging scrub stats feature 9459766868a mds: dump scrub stats during scrub status c7cd7f92e9f mds: collect and propagate individual scrub stats 10fbd2dbf4a mds: save path on uninline failure 23b0484bf52 mds: fail mds on journal failure b616159109a mds: refactor scrub and uninline accounting 56caef2ceb5 mds: collect and propagate scrub status to rank 0 eb1c04ee623 mds: move uninline failures to DamageTable 671ad4ff9aa mds: add DamageTable infra to hold uninline failures 15a4dbcc5b1 mds: add counters for uninlining 97429f0a7da mds: add inline data info to ino dump command 8970fef4ecc mds/scrub: move inline data to data pool object 5f064a52707 rbd: clarify "rbd {group,} rename" command description 76af1c0b1be mgr/dashboard: Zone details showing incorrect data for data pool values and compression info for Storage Classes 1d6b4d4a507 mon/OSDMonitor: check crush features in crush_rule_create_erasure cb157b45c71 osd: use CEPH_FEATUREMASK_CRUSH_MSR, not CEPH_FEATURE_CRUSH_MSR 2130115ec22 osd/OSDMap: require CRUSH_MSR if any rule is msr, even if used by no pool dc09d17eca9 qa/suites/orch: add test for smb with ctdb and cluster public ips 9997a648d98 doc: add documentation for (cluster_)public_addrs options e2649091777 mgr/smb: add cluster public ip information to service spec 5d5757e57aa mgr/smb: extend cluster resource type to define public ip addrs 961fa851742 mgr/cephadm: pass public addresses for a cluster to cephadm binary e2839803b26 python-common/deployment: add a cluster public ip spec for smb d46f01e9f9a test/multisite: create default realm in multisite config 782c88aa96c qa: ignore warnings variations af63b474254 doc: Update pendingreleasenotes for CephFS NFS exports d38858da360 doc: cmount_path documentation for CEPHFS nfs exports 07a1a2ffd1a crimson/osd/pg: clear backfill_state when the PG goes clean 027a7261f40 mgr/dashboard: improve prometheus service request handling 1abb4113ca1 mgr/nfs: adopt API & unit tests for nfs exports 9c70adf8080 mgr/nfs: add cmount_path 86627f8bd33 crimson/os/seastore: ensure the block size of device is always greater than laddr_t::UNIT_SIZE 2346cd912ee rbd-mirror: use correct ioctx for namespace bf694f2d89e crimson/osd/pg: add logs for repeating pulls 4b9def89f14 crimson/osd/recovery_backend: restart object pulling for recoveries that are blocked pulling from down osds 1df9dd97677 crimson/common/interruptible_future: new interruptor function `repeat_eagain` e6327c51745 cephadm: add support for cluster public ip addresses to smb daemon 8c845bd4ee8 mgr/smb: simplify orch backend enablement 574d3f8e735 doc/rgw/account: Handling notification topics when migrating an existing user into an account 0de916dc04a osd/scrub: modify deep scrub interval randomization 053e704cf43 test/rgw/notifications: integration test for migrating a topic to an account aa1ba5de6e7 test/rgw: include --rgw-realm/zonegroup/zone args for 'account create' c5a8afd56a8 test/rgw: test_multi.py creates realm with --default 902cc0a71e9 rgw: ignore zoneless default realm when not configured e946c4f5cfd radosgw-admin: add 'realm default rm' command 1fd58c769d6 test/rgw/notifications: non-functional change, remove trailing spaces 31d1a827764 test/rgw/notifications: non-functional change, addressing comment typo s/iempty/empty/ c9a6fedbfa9 qa/tasks/nvmeof.py: add nvmeof gw-group to deployment 272f72bd6ff crimson/osd/osd_operations/snaptrim_event: encode OI_ATTR without oid e397216e0cd crimson/osd: drop PGBackend::mutate_object() c6552eb9b73 crimson/osd/pg: Seperate mutate_object from submit_transaction 8d402e31f5e mon/NVMeofGw*: fixing bugs - handle gw fast-reboot, proper handle of gw delete scenarios 3c50ef6f5c0 mon/NVMeofGw*: support upgrades from prior out-of-tree nvmeofha implementation (nvmeof-reef) b9359a334f9 include/ceph_features: add NVMEOFHA feature bit 337269d337b include/ceph_features: remove stray available marker ee84f8970ab crimson: Add support for bench osd command d00d1b52d50 doc/cephadm: how to get exact size_spec from device dffbdf45ae3 test/osd/scrub: fix searched-for log string 78d0255949a osd/scrub: fix missing 'const' on some formatters 503ebee8f9d test/osd/scrub: disable tests for deleted scrub functionality 26cd41c503b test/osd: test new functionality added to the not-before queue 5ed435bffd4 osd/scrub: delay both targets on some failures 8aa48dc64ad osd/scrub: reverse OSDRestrictions flags polarity 51a593e7e2d osd/scrub: fix the conditions for auto-repair scrubs 0385fc4faf9 osd/scrub: remove requested_scrub_t::deep_scrub_on_error 709302478ed qa/standalone/scrub: disable scrub_extended_sleep test 48f2c21d4b4 osd/scrub: remove non-display usage of target's is_high_priority() 159cfd29cf1 osd/scrub: remove 'calculated_to_deep' flag 1f327081ef6 osd/scrub: modify after-repair-scrub triggering 90176a2ec8b osd/scrub: fix ReplicaReservations ctor to use correct query 8a57eb88cf3 osd/scrub: fix parameters validation on scrub start af17ae808fd osd/scrub: fix reserve_local() 3cde1421504 osd/scrub: fix initiation path of operator-commanded scrubs 75394147abd common/not_before_queue: extending the container's API 4ec5d31c7f5 osd/scrub: OSD's scrub queue now holds SchedEntry-s d70c243e7be common/not_before_queue: move status_t out of container_t a30f3969111 common/not_before_queue: some spelling fixes 63da6ea20fa common: add not_before_queue_t 673f36099ea osd/scrub: modify ScrubJob to hold two SchedTarget-s 0dc41857c77 nvmeof/NVMeofGwMonitorClient: use a separate mutex for beacons 4f309603caa qa: drop XMLSTARLET variable, use xmlstarlet directly ebb51fdce5e mon: enable nvmeof gw monitor 907e53aa852 rbd: "rbd bench" always writes the same byte d64e273de16 rgw: realm create only sets default realm on --default 0baf2e4f19b qa/tasks: add a new cephadm_from_container feature to cephadm task 451b70dedb9 rgw/multipart: use cls_version to avoid racing between part upload and multipart complete a0d604f8f37 rgw/sal: LCHead and LCEntry don't need abstraction 43057b88538 doc/glossary: add "object storage" a7090783cf8 rgw/beast: optimize for accept when meeting error in listenning 90503682082 crimson/os/seastore/onode_manager: adapt block aligned laddr_t a97269ffd73 crimson/os/seastore: adapt laddr_t/laddr_offset_t get_byte_distance 1c621b0a596 crimson/os/seastore: adapt laddr_offset_t::checked_to_laddr 73d66a62f6d crimson/os/seastore/ObjectDataHandler: handle block not alinged input b2d604e581d crimson/os/seastore: construct laddr_t explicitly 1469febff04 crimson/os/seastore: remove laddr_t alignment check f2fc9e75e56 crimson/os/seastore: make laddr_t block aligned 9f23d741fca crimson/os/seastore/onode_manager: use laddr_le_t in laddr_packed_t fb2358c0a31 crimson/os/seastore: turn laddr_t into a struct 2268923dd9f qa/rados/upgrade: ignore PG_DEGRADED daf4798086b qa: failfast mount for better performance 69484828552 crimson/os/seastore: set dirty root version to 1 during replay 7d58853d29a crimson/os/seastore/cache: report rewrite stats f74b8bb0f6a crimson/os/seastore: refine documents related to inplace rewrite 46ccac41c9a crimson/os/seastore/transaction: refine version_stat_t as rewrite_stats_t 0bd89aca384 crimson/os/seastore/onode_manager: remove hex format of laddr_t e174ece71d1 rgw: remove RGWRados::list_lc_progress() 4e5f269c01d qa/distros: reinstall nvme-cli on centos 9 nodes 190868a8f6f mds: move fscrypt_last_block to vector in mds_co mempool bf8f704e231 mds: move fscrypt_file inode_t metadata to mds_co mempool ed9481c1ac6 mds: move fscrypt_auth inode_t metadata to mds_co mempool 814245ce789 include/buffer: add helpers for uint8_t vectors 4a6800f1468 qa/workunits/rbd: exercise snap_{name,id} parsing in test_import_native_format() 175ca1e0f09 doc/rbd: clarify when image_id is expected for import-only migration 293d523ea69 librbd/migration: add external clusters support b5536d8b8d4 mgr/dashboard: Add Performance Details grafana charts for individual clusters in Manage-clusters page 1bd56a73126 rgw/sts: fix for wrong certificate getting picked during validation of a web token signature. 16d00041f6c rgw: changes to vstart.sh file - adding oidc-provider caps to user to run oidc provider iam tests in teuthology. 55d17c042bb rgw/doc: adds documentation for UpdateOpenIDConnectProviderThumbprint. fae194c0962 rgw/doc: adds documentation for AddClientIDToOpenIDConnectProvider. 37170a0d470 rgw/iam: adds implementation for iam UpdateOidcProviderThumbprint. 70e187a8c2a rgw/iam: adds implementation for iam AddClientIdToOIDCProvider. a610c147a8f doc/releases: Correct mimic.rst 344202582af crimson/os/cache: simplify lru stats data structures c068b63a044 crimson/os/cache: report dirty usage/in/out by trans and extent type e31058a295e crimson/os/seastore/cache: monitor dirty cache by extent and trans f7e4f0daa25 crimson/os/seastore/cache: extents added to dirty must be fully loaded b990397c6cf crimson/os/seastore/cache: cleanup dirty add/remove with consistent asserts fd662e5957e rgw: decrement qlen/qactive perf counters on error 2b6e1dd90b7 osd/scrub: introducing the concept of a SchedEntry 9296c2a36f4 qa: load all dirfrags before testing altname recovery 43be486375f mgr/dashboard: can't scroll to the end of the page f011cc22627 qa: Add ignorelist entries for reef-x tests 383091e89fb .gitmodules: remove shallow=true config from nvmeof/gateway 8cc3a35c2dc cephadm: mount nvmeof certs into container 1c895979579 doc: add clustering related items to smb docs daf405ea5ba qa/suites/orch: add a pair of teuthology tests for ctdb smb clusters 84d5d8b356d qa/suites/orch: old smb tests need placement count 1 to avoid using clustering 19e854cf367 mgr/cephadm: enable the smb service to prevent stray ctdb services 33e1b119569 mgr/cephadm: extend stray service detection with a general ignore hook d84c7b36cf0 mgr/cephadm: move logic determining name in stray func a64e1d57ec1 mgr/smb: enable clustering when setting up a cluster 4ef7a48e559 mgr/smb: add a cluster resource field to manage clustering 7272e5b6188 mgr/cephadm: configure ctdb cluster metadata from cephadm smb service cd2d01e9f51 mgr/smb: add a python module to help manage the ctdb cluster 6c36f61b227 mgr/smb: add function to parse rados psuedo-uri values efe6b3989b1 mgr/smb: add support for rados locks to rados store fd0812f9e56 mgr/cephadm: improve key management of smb service 3e4926a5b86 python-common: add clustering related params to SMBSpec ef3b1252101 cephadm: add ctdb support to smb daemon type 9c06ff345d5 cephadm: allow longer subcomponent names f6cab59a8f7 cephadm: add a new context getter for rank d20824272ba mgr/cephadm: change SPDK RPC fields in nvmeof configuration Fixes https://tracker.ceph.com/issues/67629 d18e6fb96ee python-common/ceph/deployment: change SPDK RPC fields in nvmeof configuration Fixes https://tracker.ceph.com/issues/67629 f01d7a8d5b8 doc/rados: document unfound object cache-tiering scenario 4722fe742c6 warn when QAT switches to software [de]compression dd7e8bbde6d doc/mgr/restful: update max_request config 7b251cad2c2 PendingReleaseNotes: Adding note about rest module change and adding max_request option 58281c19171 mgr/rest: Trim request array and limit size c90cf8460e0 mgr/dashboard: Add group field in nvmeof service form db9825d3142 qa: make all replayer threads busy and query 'syncing' status bd78bdca3d7 cephfs_mirror: Fixes 'Bad file descriptor' showing during test_cephfs_mirror_cancel_mirroring_and_readd execution 66620ccb32b crimson/osd/pg: add PGLogEntryHandler::remove() 32c9183b1f8 crimson/osd/pg: add PG::remove_object_maybe_snapmapped() 9f27bde0b99 qa/cephfs: add test to verify backtrace update failure on deleted data pool d1d3a8c7c80 mds: batch backtrace updates by pool-id when expiring a log segment e5728c40b37 mds: dump log segment in segment expiry callback 5639fa298dc mds: dump log segment end along with offset f956fbcf960 crimson/common/tri_mutex: also wake up waiters when demoting 82bc7eb02ba rgw/multisite: initialize sync_status in RGWDataFullSyncSingleEntryCR ctor 064b524815c test/rgw/notifications: don't check for full queue if topics expired 04330f5df92 mgr/cephadm: add "original_weight" parameter to OSD class 75ff2b8b552 rgw: d3n: set access permissions for the D3N cache directory when creating it bbcb820c779 qa: barbican: restrict python packages with upper-constraints bed40e67482 crimson/osd/osd_operations/client_requests: add the actual unfound oid into PGRecovery::unfound, instead of heads c37ad2b4373 client: calls to _ll_fh_exists() should hold client_lock da6f3c4523d Revert "crimson/os/seastore: wait ool writes in DeviceSubmission phase" 79866621574 librbd/migration: move away from util::create_ioctx() in NativeFormat 57a8c535cca common/config: export CEPH_CONF_FILE_DEFAULT df2189acc5d librbd: RefreshParentRequest::m_parent_snap_id is unused 23cd20e0d55 librbd: assert on parent in ImageCtx destructor 409d36c7087 qa/tasks/qemu: remove hard-coding of cluster name 4f8dc834cc6 qa/tasks/rbd: support non-default ceph clusters 1ee644d9710 librbd/migration: don't clone when flattening fda2db5ac7b doc: Harmonize 'mountpoint' f2fdffa6863 crimson/osd/replicated_backend: mark all pglog entries as unrollbackable when submitting transactions a0f81cfb509 doc/cephfs: s/mountpoint/mount point/ 57ed73eaa69 doc/cephfs: s/mountpoint/mount point/ cdd75b499f7 test/rgw/notification: use real ip address instead of localhost 8a71aea942d rgw: load copy source bucket attrs in putobj c307a91f258 rgw/auth: Remove Keystone v2.0 API support 0761463250a rgw/sts: correcting the error message returned for an sts key to indicate that the key needs to be alphanumeric. b5bfc4526a2 client: flush the caps release in filesystem sync dee230c26d4 rgw/notify: process_queue() constructs wait tokens when spawning 0e000937710 rgw/http: finish_request() after logging errors db433a62e6b crimson/osd/backfill_state: support backfilling cancellation 0c1ec1a1fac crimson/osd/pg_recovery: reset backfill_state when backfill finished 24336088078 crimson/os/seastore/cache: report lru usage/in/out with trans and extent type b9c2fb78149 crimson/os/seastore: cleanup periodical reporting 800b3528bba crimson/os/seastore/cache/lru: renames 2dddd07193c crimson/os/seastore/cache: refine lru logics bd6e6f00306 crimson/os/seastore: move counter_by_extent_t definition 280dd13df01 crimson/os/seastore/seastore_types: unify checks to the extent types b480ac99551 crimson/osd/osd: update heartbeat peers after committing osdmaps 71d38e415e8 crimson/osd/osd: mark down connections of the new down osds 9a45a0bb635 crimson/net/Messenger: add the "mark_down" interface 1ca89e6ca3d doc/glossary: add "flapping OSD" 8f226fdc770 mgr/dashboard: carbon datatables impr and cleanups ed0caa4ad13 CMakeLists: set FMT_INSTALL OFF 5c3dddf5e71 mds: add compile time checks for sortedness 6e257b5618d mds: sort conf keys d12ba11741d doc/rgw/notification: persistent notification queue full behavior 677affcbf54 mgr/cephadm: adding oauth2-proxy cephadm service 24d98f4842b rgw/notifications: fixing radosgw-admin notification json a6b95a5a69f qa/cephfs: update a test in test_volumes.py d6c51a72211 ceph.spec.in: spec files comments 21fe5264f70 osd: use an hex-only format for snap_id when creating snapmapper entries 4e3146c61ff test/common/test_hobject: fmt fixes 63594b2824e crimson: fmt 11 fixes 755767fe956 seastar: cherry-pick fmt 11 fixes bafdf390313 osd/scrub: missing 'const' in scrubber_common.h formatter 0e8da230413 osd: fix scrub_backend formatters 3db48acaa49 osd,common: add explicit formatter for shard_id_t 7f77d50baa4 common,include,msg: fmt 11 fixes e5af3c65efd fmt: bump up version to 11.0.2 645cc6e6a83 doc/cephfs: add release notes and docs for clone progress report e0c85b86ae4 qa/cephfs: add tests for clone progress 92aecabdb21 qa/cephfs: return size of data generated in _do_subvolume_io() db0e736d4a2 qa/cephfs: use safe_while in test_volumes.py 9f60848df49 qa/cephfs: add method to run and get shell cmd stdout 10949bf68d2 qa/cephfs: improvements for helper methods for clone state 65b789edfb5 mgr/vol: show clone progress in "ceph status" output d7bc8282c86 mgr/vol: show progress in "fs clone status" output 96ca322c62e crimson/os/seastore/cache: pass missing src to touch_extent() aa86e49c841 crimson/os/seastore/cache: cleanup add_extent() 0d924258b36 crimson/os/seastore/cache: cleanup remove_from_dirty() dba31242e73 crimson/os/seastore: drop duplicated calls to touch_extent() af75b2fc3ae crimson/os/seastore/cached_extent: rename primary_ref_list 9a46c52387f qa: do the set/get attribute on the remote filesystem 57cf4d424d1 mgr/dashboard: fix multi-cluster usage bar error after carbon changes 2d5715c00f0 crimson/os/seastore/btree: fix minor corner case issue 729fd8e25ff ceph-volume: add "packaging" to install_requires e225b127eaf qa/suites/upgrade: ignore MON_DOWN and PG_AVAILABILITY warnings in upgrade tests 42721c03ee6 mgr/orchestrator: fix encrypted flag handling in orch daemon add osd 9ea03123a16 rbd: fix CLI output of `rbd group snap info` command f38429b857d qa/s3tests: configure tenant name for 's3 tenant' section cd03946a931 mgr/dashboard: replace ngx-datatable by carbon a66b9df483e test/store_test: fix assertions due to unclosed collection refs. 41c5dbe9420 qa/cephadm: add group param when applying nvmeof 2a6b105b8ae mgr/cephadm: make nvme-gw adds be able to handle multiple services/groups d7b00eab08b mgr/cephadm: migrate nvmeof specs without group field f6d552d7c77 mgr/orchestrator: require "group" field for nvmeof specs ce28c8ecefb mgr/cephadm: add ability for cephadm to create self-signed cert for RGW be725040bdf ceph-volume: switch over to new disk sorting behavior by default 2e80471cf7c mgr/cephadm: bump DEFAULT_NVMEOF_IMAGE to 1.2.17 de4b649fc31 osd/config: fix non zero return code when needed during early config 157c7083254 mgr/dashboard: replace individual cluster's capacity info with Usage bar in Multi-Cluster 8074a0abe54 common/version: ceph-osd --version to specify crimson a6f311a5f3b doc/radosgw: improve qat-accel.rst 3f48bcdb617 mds: encode quiesce payload on demand 7f2324fb5f2 python-common/service_spec: fix zonegroup_hostnames type 2c9e7f5a48b mds: print quiesce message name in debug log 53df1639020 mds: fix spelling typo 240a328ae86 rgw: increase log level for enoent caused by clients 1de14a5e30c client: use vectors for context lists aa3bdae2314 doc/cephfs: improve cache-configuration.rst d7377dac503 rgw: revert account-related changes to get_iam_policy_from_attr() 0949b410433 doc/cephfs: improve "layout fields" text 2e0e469195f mon/thrasher: set stopping 0c423e1d81a test: test_rados_tools compare output without trimming newline d58f32726be uadk: add unit tests e93c7e09fab uadk: move numactl dependency 2b78a5b3147 client: Prevent race condition when printing Inode in ll_sync_inode 317465c07b3 uadk: add uadk support 180378b5ade doc:update e-mail addresses governance fec896b301f ceph-volume: refactor device path handling for LVM lookups 88836135fd0 ceph-volume: add TPM2 token enrollment support for encrypted OSDs ce10e5e424d doc: mention the peer status failed when snapshot created on the remote filesystem. db65867f776 qa: add test_cephfs_mirror_remote_snap_corrupt_fails_synced_snapshot 8055255c73f cephfs_mirror: update peer status for invalid metadata in remote snapshot f446f4c1d46 blk/kerneldevice: add perfcounter for block async discard d51e251be1e src/mon/PGMap: raise POOL_APP_NOT_ENABLED after some time for new pool 857a63f2080 rgw/rados: zero-init shard_count in RGWBucket::check_index_unlinked() 24f34caf9e7 compressor: switch out of get_current_ptr() for the sake of const-stricter bufferlist e8126bf2f64 qa: cover a custom object size in krbd_discard_granularity.t 144270eb737 qa: adjust expected io_opt in krbd_discard_granularity.t d8ce3dae808 mgr/dashboard: fix ceph-users api doc dd10b32b61e crimson/osd/pg: fix wrong lambda capture of transactions in `PG::submit_error_log()` 5fb45e5fb83 mgr/nfs: scrape nfs monitoring endpoint bf26274ae47 doc/cephfs: add cache pressure information 4de57e904cf PGMap: remove pool max_avail scale factor f6cf38cd630 doc: doc/dev/osd_internals/erasure_coding/enhancements.rst 90835d66b0c os/bluestore: passing device type name parameter to kernel device f90af12de37 crimson/osd/osd_operations/client_request: check already complete in the "check_already_complete_get_obc" phase a7e8779be73 doc/README.md - add "tip" alert styling 65734ae92b6 crimson/.../alien_store: clear coll_map in umount rather than stop a2f85f0588a crimson/osd/osd.cc: convert fmt::print to INFO in OSD::mkfs dc6825e81ad crimson/osd/osd.cc: convert OSD::mkfs to a coroutine aa1d8cf4fa3 docs/rados/operations/stretch-mode: warn device class is not supported ebf66af8278 qa: wait for file creation before changing mode cd50b3fec18 mgr/dashboard: fix typo in Multi-Cluster > Manager Cluster to Manage Clusters 943e9024f60 crimson/osd/osd_operations/client_request: merge recover_missing, recover_missing_lock_obc and recover_missing_snaps into a single OrderedConcurrentPhase 1b2e4d9ab06 crimson/osd/osd_operations: make the "recover_missing" phase concurrent 59857a78fa4 os/bluestore: Write_v2 changes 1b24c7cb53f os/bluestore: Write_v2 changes 7b0d27e12ef tests/bluestore_types: Fixed data generation bluestore_blob_t::release_extents 8bd233bef5a qa/bluestore: Add write_v1/v2 selection 7de8a6c42b9 os/bluestore: Add conf.bluestore_write_v2_random 3b5b7fa4fce os/bluestore: Add compression fallback 5326fed8328 os/bluestore: Writer, fix find_mutable_blob 938a0f183ce os/bluestore: Writer, improved calculation of need_size d2fda6c852d os/bluestore: Writer, fix for clang 255ad42da48 crimson/alienstore: New write path & debug c989d743a64 os/bluestore: Add Writer::_crop_allocs_to_io 1c5fd0fc47a os/bluestore: Fix after rebase 96065b1f59f os/bluestore: Review fixes to Writer 22fa03e93cb os/bluestore: Add perf counters to Writer 9e847a917f4 os/bluestore: Writer, fix _try_reuse_allocated_l/r 83d6a4e8dd5 os/bluestore: Cleanup on bluestore_blob_t::release_extents d19b998dd71 os/bluestore: Writer, rename _deferred_decision -> _defer_or_allocate bf824f790b1 os/bluestore: Review fixes of Writer 55004549f8e os/bluestore: Fix _try_reuse_allocated_r in Writer.cc 3f4bb3ff9d5 os/bluestore: Modify _write_expand_l/r df43f472268 os/bluestore: Add bluestore_write_v2 conf variable f0c82b37201 os/bluestore: Added new write path with BlueStore 03bac5d64ce os/bluestore: Add "write_lat" perf counter ad11abee6d4 os/bluestore: Add unit test for BlueStore::Writer 193c8fb1537 os/bluestore: Introducing BlueStore::Writer 21454afa688 os/bluestore: Functions to manipulate Blob ca0d589b0cd os/bluestore: Add csum_type to WriteContext 42cb03425bb tests/bluestore_types: Fix % 0 in tests 00b98788028 os/bluestore: Unit tests for punch_hole_2 93bb26360a6 os/bluestore: Refactor of write path. New punch_hole_2 function. 1f6fc570abb os/bluestore: Add ExtentMap::split_at and ExtentMap::maybe_split_at 8e62d0c89a6 os/bluestore: Add bluestore_blob_use_tracker_t::put_simple 5ef9d11cb5b include/intarith: add p2remain e51ec4bdb14 os/bluestore: New variant of bluestore_blob_t::release_extents f400cb19a3a os/bluestore: Fix debug after rebase c4fa859535b os/bluestore: Add ability to partially print Onode 55c6182cd45 os/bluestore: Move OBJECT_MAX_SIZE 93a8ab11fb7 os/bluestore: Blob, Onode debug printout c435cd260a7 os/bluestore: small improvement for printers 66e3aa7369a os/bluestore: Add improved printer for Onode d47103376c0 os/bluestore: Add printing buffers to Blob 03dbd42c564 os/bluestore: Add improved printer for Extent 89c211281b0 os/bluestore: Add improved printer for Blob 0000c344740 librbd/migration: make ImageDispatch handle encryption for non-native formats b20a897061f librbd: don't make an extra copy of image_extents in C_ImageReadRequest ctor 82d26909cb1 qa/workunits/rbd: perform cleanup in test_clone_encryption() 830cbee7a5f qa/workunits/rbd: no need to chmod in luks-encryption.sh 100d1b63bd5 rgw/beast: spawn a cancellable coroutine for the accept loop b6f8f83470f qa: enable the git clone debug logs 1d25782903e qa: increase the http.maxRequestBuffer to 100MB ae3faac004e qa/cephfs: fix TestRenameCommand and unmount the clinet before failing fs 42358c6b1af doc/cephadm/smb: Add missing user_sources option to service spec 19dbe686dcf crimson/os/seastore: report outstanding requests per phase c9e423facea crimson/os/seastore: wait ool writes in DeviceSubmission phase 140e77638dc doc: documenting the feature that scrub clear the entries from damage table on repair c105a45c900 doc/README.md - allocate information correctly 103d65ea678 doc/dev/peering: Change acting set num 9b8d72f15a9 RGW - Zipper: pull in upstream fix for zpp_bits 5c5e6724c63 script/: add cpu-map.sh to aid manual selection of CPU cores for threads for profiling 9f355b681b3 mgr/vol: improvements and cleanup for "list_volumes()" 8c536f78907 mgr/vol: move reusable parts from async_cloner a035b5a22fb thrashers: standardize stop and join method names 21b4b89e528 qa/tasks: watchdog terminate thrasher bc45e9a77cf cls/rbd: add functions to get group snap orders c2ca0561bcb crimson/os/seastore/transaction: cleanup, drop unused getters a6cac66baa7 crimson/os/seastore/transaction: rename ool_block_lists 1c9112091ce crimson/os/seastore/epm: RandomBlockOolWriter to update extents upon submitting writes 382357dcd4f qa: simplify postmerge construction 126184fcc98 qa/crontab: force priority for main rados nightlies fe4f03dfcc5 rgw/notify: visit() returns copy of owner string 6c7253be6f6 qa/mgr/dashboard: fix test race condition 7f723017454 cephfs: Fixed a bug that read operation hung in Client::get_caps when the Fc caps is wanted but revoked by the mds, and the Fc cap refs is no-zero 56feeb4373e os/bluestore: BluestoreRepairTest ch cleanup bdcc7dab995 blk/kernel: Fix uninitialized discard_stop 3662bc7b3dc cls/rbd: save max group snap order a71990f70f5 tools/rados: Fix extra NL in getxattr ec6224db3e5 cls/rbd: save group snapshot creation order in a new key 1f21057e416 doc/README.md - add ordered list e26545f86f9 PeeringState.cc: Only populate want_acting when num_osds < bucket_max d595505eea3 librbd: Reduce use of atomics in librbd throttling 03c839e14fa test/cls_2pc_queue: prevent list+remove race between consumers 8c6cedea0af crimson/os/seastore/cache: introduce maybe_add_to_read_set() 6933f4c9980 crimson/os/seastore/cache: verify pending extents in get_extent_viewable_by_trans() a5329cbbaa2 crimson/os/seastore: consider segment_header_t::modify_time as the segments' modify_time for no-tail OOL segments 48ff8f0e73b crimson/os/seastore/epm: SegmentedOolWriter to update ool paddr upon submitting writes bcbc069ae03 crimson/os/seastore/record_submitter: return record-base immediately upon submit 8c494150bb0 crimson/os/seastore/record_submitter: cleanup around write_base ab608c0fa24 crimson/os/seastore/record_submitter: minor cleanups 73a7ecfe265 crimson/os/seastore/record_submitter: refactor to make write base available 6c4e50a8bf0 crimson/os/seastore/record_submitter: refactor JournalAllocator::write() dc366fafec0 crimson/osd: send empty transactions to backfill targets that haven't backfilled the objects yet 484e9d2b9d8 doc/glossary: add "ceph-ansible" 8164efe5d09 qa/cephadm: use cephadm ceph-volume directly to zap devs 4fa39268921 cephadm: limit mounts for shell and ceph-volume commands 4424f55c760 rgw/rados: RGWRados::Object::Read::read() uses rgw_rados_operate() 4475fcbbe69 rgw/rados: delete_objs_inline() uses rgw_rados_operate() 19399def5bd mgr/cephadm: add SPDK log level to nvmeof configuration Fixes https://tracker.ceph.com/issues/67258 d3cc2377f4f python-common/ceph/deployment: add SPDK log level to nvmeof configuration Fixes https://tracker.ceph.com/issues/67258 a24f3cf1e90 src/osd: pg stat are not synced between osds after deep-scrub. So if primary osd is killed, next primary osd has wrong stats. Reason behind it is PeeringState::proc_primary_info does not process or update any pg stats. 214328d9daa common/Formatter: dump inf/nan as null c052e12f35a os/bluestore: remove unused functions d95e8511eb6 mgr/cephadm: fixing Grafana domain handling c30cdbd14dd qa/cephfs: update ignorelist f4b3943fb2e mgr/dashboard: Dashboard not showing Object/Overview correctly. a81d36caadf crimson/os/seastore/cache: adjust get_extent_viewable_by_trans() 2bb39c50f3a crimson/os/seastore/cached_extent: cleanups and comments 3d056148d5d crimson/os/seastore/cache: add comments about the correct usage 563950f8b0d crimson/os/seastore: fix names get_extents_if_live c69f860ffee mgr/dashboard: make multi-cluster context switcher scrollable if we have many entries in it 9607b66e97f doc/cephfs: edit "Layout Fields" text d5e013f5928 mon/NVMeofGwSerialize.h: tabbing, bracing, line length fixes e0f0469f14e mon/NVMeofGwTypes.h: tabbing, bracing, line length fixes bff9dd47068 mon/NVMeofGwMon.cc: tabbing, line length, formatting 1f470f0388b mon/NVMeofGwMon.h: tabbing, line length, formatting 58d16c73845 mon/NVMeofGwMap.h: tabbing, line length, formatting 8bf309ecd7b mon/NVMeofGwMap.cc: tabbing, line length, formatting 5890a156524 doc: Improve doc/radosgw/placement.rst 89a547822d6 submodule: remove the boost_redis submodule again (again) 9dc630b00db mgr/cephadm: add SSL support to ceph-exporter 862a38e3386 mgr/cephadm: adding mTLS support 039bd045563 rgwlc: fix typo in getlc (ObjectSizeGreaterThan) beb4d2286ac osd: fix partial reading during multi-region EC reads 30921272dde workunit/dencoder: fix corpus test for backword and forward compability 02496a86650 corpus: update forward incompat for cls_rgw_reshard_* ceph-object-corpus submodule Fixes: https://tracker.ceph.com/issues/67263 Signed-off-by: NitzanMordhai <nmordech@redhat.com> 6911df2c834 nvmeof gw monitor: disable by default d0c4182bf57 qa/suites/rbd/nvmeof: add multi-subsystem setup and thrash test 2946b195edf mgr/cephadm: ceph nvmeof monitor support bb75ddee819 mon: add NVMe-oF gateway monitor and HA doc 5843c6b04ba mon: add NVMe-oF gateway monitor and HA 80edcd40e80 debian pkg: record python3-packaging dependency for ceph-volume cb421a46636 RGW|BN: fix lifecycle test and http server issue 0596664c402 mgr/cephadm: introducing new cmd to generate self-signed certs 25a4f2adada mgr/cephadm: introducing cert_mgr new class to centralize certs mgmt 7e08760a0e5 mds: add the event when creating the batch head 5d8aa5245cb mds: print the path depth to help debug mds issue 1a76464999c doc/glossary: add "Prometheus" 6e7bc284e63 bluestore: record omapiter init latency if one object has many `internal keys` at its omap beginning, it maybe very slow for the underlying seek to reach the first `user key` when initializing a omapiter. this may stuck osd when build_push_op, seek recovering object's first omap key again and again. 62562ec65e3 doc/rados/operations: remove vanity cluster name reference from crush-map.rst b6c7f69b804 librbd/migration: make FormatInterface::read() void again 63159d6b431 librbd/migration: close source image in OpenSourceImageRequest cacf7ca9418 librbd/migration: don't instantiate NativeFormat, handle it via dispatch 3bbf1f5ddba librbd/migration/NativeFormat: refactor source spec parsing 1ba9a32598f librbd/migration/NativeFormat: do pool lookup instead of creating io_ctx f172fb97be9 librbd/migration: make SourceSpecBuilder::parse_source_spec() static c14356b1f9e librbd/migration/OpenSourceImageRequest: rename io_ctx -> dst_io_ctx e99fc5c82fd doc/cephadm: edit "Using Custom Images" b81d6af1b48 doc/dev: improve basic-workflow.rst 2e2adb2719c client: Fix leading / issue with mds_check_access 983f893fb93 qa: Add mds caps test for testing fs read and a path rw 789df2ce38f librbd/migration: massage some error messages b92ad49a355 librbd/api: clean up leftovers in Migration::prepare_import() 872adf5ac5e qa/standalone/scrub: fix the searched-for text for snaps decode errors 4f321056dec RGW - Add Multipart and Versioned to POSIXDriver 091625e6fee doc: update 'sync_bytes' in peer status 3fd00ebc578 doc: update current_syncing_snap in peer status 7c32d159965 doc: document labelled perf metrics for mds/cephfs-mirror 6efe049dfc9 mgr/dashboard: carbonize block forms 5535e72364f qa: check last successful snapshot sync metrics in perf counters fb985c4830a cephfs_mirror: provide metrics for last successful snapshot sync cc721a55bd3 cephfs_mirror: show 'sync_bytes' in peer status 2c8802a3dd5 qa: some test set `refuse_client_session`, so the cluster log is expected ccb292c818b osdmon: Remove any pg_upmap_primary mapping during remove a pool d1c049d24be doc/glossary: add "ceph-fuse" entry 66fb04fa55f mgr/dashboard: carbonize breadcrums 7d55db51b44 mgr/dashboard: carbonize general components and styles d14119e37e0 doc/cephfs: edit "Dynamic Subtree Partitioning" 5925880d178 tools/ceph_objecstore_tool: cleanup collection handle on exit cbdecc1f34d crimson/osd: clear ondisk temp objects on startup 1251345231f crimson/common/tri_mutex: avoid hobject_t formatting 12f98a23598 crimson/os/seastore/circular_journal_space: cleanup, write_ertr vs submit_ertr ff17a966aed crimson/os/seastore/epm: add checks in ool writes about the writer type a5cea810cce crimson/os/seastore/epm: fix an incorrect type 724f52cc15e crimson/os/seastore/block: fix log 74b03a8cb2f doc/cephfs: fix "OSD capabilities" link c5a6226f06c script/backport-create-issue: handle ResourceAttrError when getting CF_TAGS f5a581b9806 mgr/dashboard: support rgw user level NFS export 8452eb88904 test/store_test: Make ceph_test_objectstore run faster f8becaaedb2 test: add a test for `fs set down` on online cluster 6bfce64f7e9 mon: fix `fs set down` to adjust max_mds only when cluster is not down e2fb2c63ea2 reshard: limiting the number of log to be recorded 98723d51b96 doc/radosgw/qat-accel: Update and Add QATlib information 1f82dc8b8f1 mgr/dashboard: Add initiators add/update in dashboard b827fe706a3 crimson/os/seastore/lba_manager: correct the range end of lba mappings 039377fa290 mgr/dashboard: Changes for Sign out text 6bb5ce94c6a doc/cephfs: fix "file layouts" link 50390af720b mon/scrub: print detail if get error from store cec5e83d8ee test/rgw: add test for logrecord reshard 72997836c2f reshard: guarantee no duplicated index entries exist before starting reshard ab3d3aca8a0 rgw/posix: name the lock_guard in BucketCacheEntry::reclaim() 6bfa726fafe mds: only authpin on wrlock when not a locallock 2872c75f184 rgw/async/notifications: use common async waiter in pubsub push 2e83b77c9f6 doc/rbd/rbd-exclusive-locks: mention incompatibility with advisory locks fcae1041c58 cephadm: do not hard code samba debuglevel 6 64f6b5d1d7e os/bluestore: Fix unbalanced new[]/delete[] in read_bdev_label functions 1ec999cd473 mds: remove the misleading and redundant logs 3f62db0393b qa/crontab: update frequency and priority for rados nightlies f03d0cec0fc common/async: spawn_throttle wraps call to asio::spawn() 21a25f41240 doc/releases: add release note about thread creation incompatibility 7e5d28f4423 common/async: add parallel_for_each() algorithm 3c62daf69e9 common/async: add co_spawn_group template for fork-join parallelism d192ca79862 common/async: implement max_concurrent_for_each() for awaitable 9217fcc5558 common/async: add co_throttle for bounded concurrency with c++20 coroutines 057c2a2a8a1 script/backport-create-issue: add debug messages for retry ba7b6ec2157 mgr/dashboard: use grafana server instead of grafana-server in grafana 10.4.0 d8e1567cec0 crimson/osd/recovery_backend: set interruption to recovery related promises, instead of system_error 80be0ae0aae crimson/osd/osd_operations/client_request: hang client requests when the object is missing in the whole cluster 4ddae3a7928 librbd: Modify locks and atomics in AioCompletion to improve performance 2a9f92f2347 qa/suites/krbd: override extra_system_packages directly on install task 8fee41da8b8 qa/suites/krbd: stress test for recovering from watch errors for -o exclusive d3dd910f13e cls/rbd: make group_snap_list return error if it failed 2e8c0c23e37 script/backport-create-issue: retry without if assignee is invalid 6dfb20b2c3c mgr/zabbix: fix invalid escape sequence 6b91f8ecede mgr/rook: fix ivalid escape sequence 1458405b898 mgr/osd_perf_query: fix ivalid escape sequence e12e92c50fd crimson/osd: execute PGListener async operations in order 8389471b3a9 crimson/.../alien_store: access coll_map under coll_map_lock 924384f5da8 crimson/.../alien_store: clear coll_map on stop() e2b75b56010 crimson/.../alien_store: update coll_map from alien tp 618bef54243 crimson/.../alien_store: factor out get_alien_coll_ref 443040bc66f crimson/.../alien_store: add comment explaining coll_map 4d707415ab9 qa: suppress __trans_list_add valgrind warning ee52b19adc5 crimson/.../shard_services: add logging to local and remote reservers 2b3a1783843 crimson/.../pg: add logging to most PeeringState::Listener implementations cdef41d9081 qa: generate valgrind suppressions 627c466915a test/allocsim: replayer merge files by timestmap 8476a02bed8 cls/rgw: define lc ops in terms of ObjectOperation instead of IoCtx 3f11eb905f9 rgw/sal: add dpp and optional_yield to lifecycle ops 32f58e70d4c cls/rgw: gc_list uses ObjectOperation instead of IoCtx 00063a964ad kv/RocksDBStore: add kv_stats function to print all CF info 01a9cfba444 shrink the object-size used for orphan-list test by a factor of 100 from 5100MB -> 51MB 6f9f52033b0 test/cls_2pc_queue: fix multi-threaded access to non-atomic variables 6be7a9cc77a blk/aio: fix compile issue when HAVE_LIBURING isn't defined 4a4f9a3e994 qa/rados/dashboard: Add PG_DEGRADED to ignorelist e5ccce14c4b rbd: add group snap info command da784bc14ef Fixes: https://tracker.ceph.com/issues/67070 56504d2ad92 kv/rocksdb: return error for dump_objectstore_kv_stats asok command if relevant config settings result in no output. 02d5a6a3371 doc/dev_guide: add needs-upgrade-testing label info 92fea64c1f2 doc/dev/crimson: clarify and rearrange for userability 8ee137f662b qa/suites/rados: Reduced BlueStore log levels 811f2979f53 os/bluestore: Modify read_meta() 721482adc0d os/bluestore: fix fsck fixing multiple bdev label (superblock) 4adb942a648 os/bluestore: Review fixes 3c2574c3aa1 test/store_test: Add double check for repair 4927876f7a4 ceph-bluestore-tool: Fix set-label-key and rm-label-key 7bbf2a897a0 os/bluestore: multiple bdev label (superblock) fixes 6acad6d19e9 os/bluestore: Adapt unittest for multi bdev label eac365cd1a7 os/bluestore: Small fix to mkfs fe764c4fd8d os/bluestore: Made read/write_meta bdev aware 9b30da39a0d os/bluestore: Add read/write_bdev_label functions 8a825e133a7 os/bluestore: Modify bdev-label functions operate on bdev 0891702f23a os/bluestore: Bluefs, expand api for getting BlockDevice on BD/WAL e1cc40b133b os/bluestore: Minor fixes b89fb919160 os/bluestore: Update test for resilience of bdev label against bad UUID 82b2ec7c2dd os/bluestore: Only accept bdev labels with our UUID a3b044bb9df os/bluestore: Split check* and set* _main_bdev_label 66070915479 os/bluestore: Adapt multi bdev label tests for !bdev->supported_bdev_label() c8d6ab7edd0 os/bluestore: Make bdev multi label compatible with !bdev->supported_bdev_label() 12236c37351 os/bluestore: Fix of bdev label fsck b53a6d04295 os/bluestore: Tests for multi bdev label feature f6f5f898f15 os/bluestore: Fix of funny constructor misuse 9ab22a84ccd os/bluestore: Fix problem with marking unavailable bdev label positions 140dc2e74d7 os/bluestore: Fix repair for multi label b24a4945a6c os/bluestore: Add ability to upgrade into multi label 733a4513e56 os/bluestore: Hack for fsck with multi label c7b4bcbaec6 os/bluestore: Fix bdev_label_main_try_reserve 28dbacf1745 os/bluestore: Fix write_bdev_label 12e8c32299f os/bluestore: fix DB_SUPER_RESERVED->SUPER_RESERVED 7e1d04345d9 os/bluestore: Small fix to check_or_set_bdev_label d48f2c6f99c os/bluestore: Fix write_meta; increase epoch with each write 86f3aad2db4 os/bluestore: Fix fsck() for multi label b4a0365741d os/bluestore: Fix _check_or_set_main_bdev_label 408ff2378cf os/bluestore: Fix _main_bdev_label_try_reserve 019a88b766c os/bluestore: minor fix in _check_or_set_main_bdev_label c4f212ee1fc os/bluestore: Fix read_main_bdev_label 7c4a8642f6c os/bluestore: Fix write_bdev_label c0bd6fff41b os/bluestore: Fix read_meta and write_meta 7ecaede175a os/bluestore: Add fsck procedure for bdev multi labels f955c66290b os/bluestore: Adapt read_meta / write_meta aed1e686b3e os/bluestore: Give label multiple positions to replicate to 75b1a22b959 os/bluestore: Create read_bdev_main_label function 8e7b9deb653 os/bluestore: Modify read/write_bdev_label functions 3b904283f33 os/bluestore: Remove bluestore_debug_prefill 22c3eb548bf os/bluestore: Make read_meta / write_meta cached 6241be164dc Fixes: https://tracker.ceph.com/issues/67074 71ba42693e7 crimson/osd/recovery_backend: fix RecoveryBackend::temp_contents usage 92b07ddece5 doc/start/os-recommendations: remove 16.2.z support for CentOS 7 9485f9723fc doc/start: add tested container host oses 8d7cea5b1a1 mgr/dashboard: use assertEqual in test_iscsi 876ceab888c crimson/osd/osd_operation/client_request: requeue client requests from a temporary queue other than ClientRequest::Orderer::list 98f2da079b4 crimson/os/seastore/btree: drop unused lines a6cf5bba4a4 crimson/os/seastore/cached_extent: add the "refresh" ability to lba mappings 077cedff6e1 crimson/os/seastore: rename PhysicalNodeMapping::is_parent_valid() to PhysicalNodeMapping::is_parent_viewable() b87f6141a88 crimson/os/seastore/btree: add copy_source->pending links to FixedKVNode 07d066346fc crimson/os/seastore/cbj: skip crc calculation for cbj header if device supports the checksum offload e92273a4f15 crimson/os/seastore: disable crc calculation if end to end data protection is enabled 169a81ee51b crimson/os/seastore/rbm: add handle_exception() to pass_through_io() cc5b4a25155 crimson/os/seastore: remove multistream related codes 5f86c84118e crimson/os/seastore: add nvme_read and nvme_write to be used when end to end data protection is enabled 71398e2d4fe crimson/os/seastore/rbm: turn on end-to-end-data-protection during mkfs if possible 364fb38669f crimson/os/seastore: replace rbm_metadata_header_t with rbm_superblock_t 8f68b3fdaec reshard: small fix and cleanup 5e7de76407c rgw/reshard: Backward Compatibility f19347d43b7 rgw/reshard: stop recording logs when reshard failed 4d288ac31ce common/async: fix duplicate definition errors from SharedMutexImpl 4990864eab1 erasure-code/clay: cleanup unused but set variable count_retrieved_sub_chunks 5194bb6bdd3 rgw/reshard: take into account the object stats of dest shards 55b404afeb6 rgw/reshard: copy the index entries to dest shards. 14318e4210a make-dist: replace all '-' for '.' for rpm release 3b647ec17fb msg/async/rdma: cleanup unused variables 3b0360bc2ea doc: Amend dev mailing list subscribe instructions. 59b37e0ec85 rgw/reshard: record a duplicated index entry copy together with version bucket writting operations. be852cd8417 rgw/reshard: record a duplicated index entry copy together with prepare and complete. 14727dd19e3 rgw/reshard: Define the operation to record a duplicated index entry. b952558adcf rgw/reshard: Add logrecord phase in resharding 3c054a140d2 doc/rgw: add design doc for noblock resharding 55bd03de42d rgw: add support sse-c to bucket policy conditions 9e1c0342e99 qa/workunits/rbd: avoid caching effects in luks-encryption.sh aeaeaae7f5b test/rgw: address potential race condition in reshard testing ddbe2c06fd7 rgw/auth: RemoteApplier respects implicit tenants 019aaa4d101 rgw: donot check for NotPrincipal in IsPublicStatement fbb7c3df31e rgw: donot allow NotPrincipal with Allow Effect 9c77963300f doc/cephadm/upgrade: ceph-ci containers are hosted by quay.ceph.io 90bc35499eb mgr/test_orchestrator: add apply_mds command in the test_orch 0a4dda59ca3 mon/osdmonitor: cleanup the code for preprocess_mark_me_dead 8a20dff09f9 rgw: fixup compressor_message didn't store in some cases 855c5d6826d compressor: Change data formt to QZ_DEFLATE_GZIP_EXT for QAT zlib a242fe3d940 doc/start: update mailing list links 16b4a892941 osd/scheduler: fix unittest_mclock_scheduler failed 8036426fe3f osd/scheduler: add mclock queue length perfcounter 9ae2c89511b qa/cephfs: ignore when specific OSD is reported down during upgrade fe644c795ac qa: suppress Leak_StillReachable mon leaks cd2042b1ad0 rgw/iam: CreateRole ignores EEXIST after forwarded request b45eb557961 mgr/dashboard: Add namespaces views in dashboard 63f63662483 erasure-code/isa: Use isa/raid's xor_gen() instead of the region_xor() optimisation ca4759b8f48 mgr/dashboard: rgw sync policy routing fixes abdcc51aa41 test/rgw/amqp: skip TestAMQP.MaxConnections test 820f8ead891 doc/cephfs: streamline a paragraph 08347be0b73 Revert "qa/config/crimson_qa_overrides: adjust mgr_stats_period" 49c9dad15e5 mgr/client: validate connection before sending d034fec4633 qa: Restrict rados api tests to large clusters and increase timeout ed7f4e8829e qa: Added mon connection score tests c05d4e27160 src/mon/ConnectionTracker.cc: fix dump 7b41aff3f00 qa/suites/rados: 3-az-stretch-cluster-netsplit test fb0011a692c doc/rados/operations/pools.rst: Added docs for stretch pool set|unset|show 4ca1320727d qa/suites/rados/singleton/all: init mon-stretch-pool.yaml 661e8e22cff Allow setting peering_crush_bucket_{count|target|barrier} a4f2eefe21f mgr/dashboard: Create and delete listeners d451b4d1795 mgr/dashboard: RGW multisite sync pipe f433e2ff456 rgw/rados: set_attrs() falls back to existing attrs for index update c0b2db74b2a mgr/dashboard: add NFS export route from subvolume/subvolume grp 2e54c9a01e5 mgr/dashboard: Add a new chart for replication delta per shard in rgw sync overview grafana dashboard f6e65edf9b4 librbd: get rid of AIO_STATE_CALLBACK in AioCompletion 3a103f2f87b rgw: set correct requestId and hostId on s3select error d56779e521c crimson/os/seastore/transaction_manager: consider inconsistency between backrefs and lbas acceptable when cleaning segments 063d100526e msg: insert PriorityDispatchers in sorted position 331f1af2803 mon, osd, *: expose upmap-primary in OSDMap::get_features() 36a4a72959c mgr/dashboard: nvmf apis broken for insecure channel 699dd28ad5c osd/scrub: fix job requeue conditions 2187c494a66 test/osd: delete test_scrub_sched (for now) 58cce757a92 osd/scrub: making osd_scrub_sched.cc compatible with Clang-14 24647e87e8f qa/standalone/scrub: fix osd-scrub-test.sh 8a8fa48b8b0 osd/scrub: scheduling the next scrub following scrub completion 75b8ecbc2a2 osd/scrub: improve update_scrub_job() c55c6479f96 osd/scrub: passing the scrub-job copy through the scrubber 54168d28094 osd/scrub: fix adjust_target_time() 473177f8f99 osd/scrub: modify scrub registration implementation details 3edb4317fd8 osd/scrub: the scrub queue now holds a copy of the ScrubJob 16ad488d27d osd/scrub: Modify osd_scrub_sched.h high-level diagram e63101650d4 Fix the handling of HEAD requests that do not comply with RFC standards 6143b80ef7f include/denc.h: Review fixes eb538ebd595 tools/objectstore: check for wrong coll open_collection 08d985933c5 cephadm/smb: Determine samba version within container b687e2eeafc doc: reef 18.2.4 release note f1ca0c79de1 qa/upgrade: use staggered upgrade features for reef-x/stress-split 61a48c5cedd qa/upgrade: fix checks to make sure upgrade is still in progress 4c4063a0975 doc/dev: add formatting to basic workflow 67dbd062731 mgr/nfs: Do not ignore clusters from rados pool conf objects 617c9364bc2 blk/KernelDevice: Unify discard thread management decf32e8234 qa: add test for ceph tell with unknown cephtype 2811bb0dfe3 pybind/ceph_argparse: fixing error message for ceph tell command a9de8be0f46 suites: crimson basic adding wait for test 74297e6abac crimson/osd: adding osdmap subscribe ed082dbd127 librbd: fold complete_event_socket() into notify_callbacks_complete() db0c7daede9 os/bluestore: remove not used zone_adjustments 111c54a19dc RGW - Fix copy_obj handling of obj_ctx d496d20c803 Fixes: https://tracker.ceph.com/issues/66286 Improve display of ref_count in the rados commandline utility 5cd1746c750 qa: agetty entry in selinux allowlist is redundant now 26ee0696a61 common/async: add co_waiter class template dc4bd3ea08d qa: improve and add commit ID to comment for context c6e2c97c6e9 cephfs: disallow removing root_squash via "fs authorize" cmd 9a7645e9d6f client: fix file cache cap leak which can stall async read call 204101c452f qa/multisite: add copy_object tests 46eef5fb5c0 rgw/multisite: remove source object's RGW_ATTR_OBJ_REPLICATION_TRACE during copy_object. if a copy_object is executed on a replicated object, it fails to sync the copied object to the original source zone where the source object was first written and replicated from. this is because copy_object retains source attrs by default. when a get_obj() is issued from a fetch_remote_obj() call during sync, we check for this RGW_ATTR_OBJ_REPLICATION_TRACE and if that destination zone is already present in the trace, we return NOT_MODIFIED error, thus failing to replicate the copied object. b49f82a18b2 crimson/.../pg_interval_interrupt_condition: clarify member, add comments 252801a0280 crimson/.../pg_interval_interrupt_condition: remove IOInterruptCondition(Ref<PG>& pg); constructor eec5d0bfacd crimson/osd: convert remaining IOInterruptCondition users to specify epoch 61826ec15b7 crimson/.../background_recovery: use epoch_started for interruption 238f15e42df crimson/.../internal_client_request: record epoch at construction and use for interruption cf36ba98177 os/bluestore: fix valgrind's "Invalid read" error in hybrid btree2 allocator. 97119edd8b1 doc/mgr/smb: Fix a typo in options for cluster resource 770016d3acd doc/mgr/smb: Add missing option for standalone mode 48d8279dc77 mgr/smb: Replace "clusters" with "shares" in error status 0e3400d5dd5 os/bluestore: refactor allocator's ExtentCollectionTraits 55f65bda78c os/bluestore: refactor allocator histogram to use ExtentCollectionTraits 3db0e22083b os/bluestore: move and rename ExtentCache to Allocator class. 54b6d243389 os/bluestore: uniform allocator's error handling c448a06ee8e os/bluestore: introduce new allocator hybrid_btree2 4e44500cd1d include/intarith: introduce p2aligned() 7b588d3b3ad test/objecstore/store_test: be more specific with the desired allocator. f74820cb969 os/bluestore: make hybrid allocator implementation reusable 5caa16dd81f os/bluestore: Allocator's cosmetic cleanup/improvement. d7a2cd5d671 test/allocator_replay: print elapsed time for try_alloc command 82ae96fa86b crimson/osd/pg: update PG stats on handle_rep_op Fixes: https://tracker.ceph.com/issues/61761 Signed-off-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io> 8e17e9b6752 cephadm: update shared folder python packages dir 38ab28739e3 crimson/.../peering_event: complete_rctx under the PGPeeringPipeline::process stage 816c9e9e850 crimson/.../pg: factor out PG::complete_rctx 0f32fc60800 crimson/osd/pg: limit usage of async for peering state machine 4f80036480b ptl-tool: Fix token file name and variable names a926a4a54ce os/bluestore: assert CollectionRef count is 1 on umount acb66c16659 crimson/osd/pg_recovery: push the iteration forward after finding unfound objects when starting primary recoveries d25fe4e7860 qa/suites/fs/workload: drop mgrmodules stanza 8b5e7cc5b5d qa/tasks/ceph: fix "ceph mgr module enable" command d77139e74b6 qa/suites/orch: enable cephadm single_host_defaults for smb tests 0c48ae3af6f mgr/smb: improve error handling for generic exceptions 96b9564f99f pybind/mgr: add a specific exception for the mgr_pool disabled case f9c962a60f0 pybind/mgr: add a log line to hint why mgr sqlite3 db not ready 28a7ee81280 test/crimson/seastore/test_seastore.cc: should not return a value 37f772172f4 src/crimson/osd/scrub: fix the null pointer error 2539c6f3215 CMakeLists: Seastar_DEPRECATED_OSTREAM_FORMATTERS OFF 220669abbb0 CMakeLists: Crimson - remove Seastar_STD_OPTIONAL_VARIANT_STRINGVIEW 9328060a1c9 labeler: label seastar submodule as crimson 425f3338dfd crimson: use get instead of deprecated get0 9fddade5a9e seastar: update submodule 91b0207ed8d os/bluestore: improve ExtentMap::reshard readabilty 859f920e964 os/bluestore: improve ExtentMap::update readabilty 958ecba9e90 rgw/amqp: lock erase and create connection before emplace 949f25e1ea0 mon/scrub: add mon scrub latency e6468f3db17 crush: avoid out-of-bound access and simplify enlarging buckets cc8c7662a7b test/allocsim: don't join caches e2203385ea0 test/allocsim: string cache as set of ptrs ec604e725da test/allocsim: performance improvements, gotta go fast 111e1636631 corpus: update submodule with mark cls_rgw_reshard_entry forward_incompat 8178667fc67 mgr/smb: use the sqlite mirroring store by default b1cbf7c9dd3 mgr/smb: filter out password fields in sqlite store 30ed498e0a1 mgr/smb: add function for setting up sqlite mirroring store 4d5066832a8 mgr/smb: add SqliteMirroringStore class da7ebd543d7 mgr/smb: add transactions to handler funcs underlying show command 80eed4846e3 mgr/smb: make the new sqlite store our default internal store 615cd84f105 mgr/smb: add a new sqlite db backed store 25930c1a52b mgr/smb: add store transactions to parts of the handler 29ab71466be mgr/smb: add TransactingConfigStore protocol 11f299f535e mgr/smb: add a unit test to verify the new name in use check 028fe052bd6 mgr/smb: validate that a share name is unique per-cluster fd6d4a77c85 mgr/smb: add find_in_store function to config_store.py d28d0c41c73 mgr/smb: add ObjectCachingEntry class to config_store.py 2d35e4cfda6 mgr/smb: add a new protocol for a FindingConfigStore 2a82d9b1564 pybind/mgr: add convenient context mgrs for accessing module db 6472b9bc2a6 mgr/smb: Use the default for minimum protocol version 5ac43ef8af8 mgr/smb: Add acl_xattr configuration to share definition 729c5de4f85 ceph-volume: do not convert LVs's symlink to real path 71ca41dbaa5 include/denc: Not use fmt::format 867be2c3f59 crimson/.../peering_event: use peering event epoch for interruption 45b7aafd090 crimson/.../scrub_events: use epoch at which operation was scheduled for interruption 7a1b91ac5e0 crimson/.../pg_interval_interrupt_condition: allow specifying epoch 5ad0df3beed mds: generate correct path for unlinked snapped files 61381768ba9 qa: add test for cephx path check on unlinked snapped dir tree 9397f464310 mds: add debugging for stray_prior_path 02e9a4c77a2 clang tidy generates use-after-move warning d4a83b71706 test/encoding.cc: Harmonize expected text with exception 3d4a899d6c5 blk/KernelDevice: Fix several issues with stopping discard threads 8ffe35e85f2 blk/KernelDevice: React to bdev_enable_discard changes in handle_conf_change() d17efaf388b test: Create ParallelPGMapper object before start threadpool 6ae002460b8 mgr/vol : shortening the name of function 3ac8b61aaa1 suites: thrash old client missing SLOW_OPS in the ignore-list 4c58cb58725 osd/PGLog,crimson/osd/pg: remove support for rebuild_missing_set_with_deletes_crimson 1a56293f2c8 build: split ceph_ver.h d8c3c45e00c cephfs-shell: excute cmd 'rmdir_helper' reported error Fixes: https://tracker.ceph.com/issues/66735 Signed-off-by: teng jie <tengjie5@asiainfo.com> 99a554671d0 qa/suites/fs: pull compiled cephadm for squid branch in mds_upgrade_sequence 4e54a9034c8 qa: ceph.py mkfs.ext4 has no -f 0b52d0f8151 qa: ignore container checkpoint/restore related selinux denials for centos9 bfbfbbfed6c mon/MonClient: handle ms_handle_fast_authentication return a4123d08a79 script/ceph-backport: only fetch the merge sha1 97c49d67eaf script/ceph-backport: do not assume ref layout for checkout 165869fe8f3 test/librbd: add TestLibRBD.FormatAndCloneFormatOptions 74eee542ba1 rbd: add the validate of the format and clone_format e5cd5469b26 suites/ec-rados-plugin=jerasure-k=8-m=6-crush: roles set with overrides 2ef093a32dc suites/upgrade/quincy-x: update the ignore list 9b26784b24b rgw: log bucket name to req done line d6d9a3e3d60 rgw: log op name in req done line 548426630e1 rgw: log x-amz-request-id along with the request 89d695fb8b6 suites: check for host thrasher 66b42c3f5c0 suites: host thrasher should check min_in before thrashing host afb531019f7 mds/QuiesceDbManager: get requested state of members before iterating through each quiesce set members 73b80a9a2c3 Warning added for slow operations and stalled read in BlueStore. User can control how much time the warning should persist after last occurence and maximum number of operations as a threshold will be considered for the warning. 4c5d0e30d2c qa/suites/rados: Cancel injectfull to allow cleanup ebd8283e2f2 include/encoding.h: Fix message on compat failure c94c8baf012 include/denc: Add protection against bumping up compat 62aba6df38d include/denc: Add missing check for compat 2140fbf72d2 mds: use intrusive set for ClientLease tracking 0a4a5d34929 mds: optimize sending cap messages 575f5d46170 rgw: delay the RGW process exit until all actice requests have completed 59eab456911 qa/cephfs: ignore variant of MDS_UP_LESS_THAN_MAX 2c65f1da969 suites: test should ignore osd_down warnings f7bc4e45478 PrimaryLogPG: Keep soid before erase entry cf448e83c01 anotated rgw_auth.cc d699e23f172 common: MemoryModel: do not discard memory mappings marked [stack] 705e60f77a1 common: MemoryModel: do not store measurements bdc5782a276 common: MemoryModel: speed-up and clean get_mapped_heap() cf62ba80110 common: MemoryModel: do not issue error messages directly 6ed303881c4 common: MemoryModel: use charconv to parse /proc/status 7752ceed3ca mds/MDCache: avoid using static variables in check_memory_usage a6e2a7c53dc common: MemoryModel: keep /proc files open e97223399d0 common: rename MemoryModel::snap to mem_snap_t e08126880e0 common/MemoryModel: make MemoryModel::snap accessors const a1f3c99eb4e client: eliminate duplicate lokups wherever possible 95b64a65bc9 mon: fix inconsistencies in class param 9e0744f8592 refactored the code to remove use-after-move warning generation. bl length would be stored before moving f17f2d6fee1 qa/suites: drop --show-reachable=yes from fs:valgrind tests b931251b259 AsyncMessenger: l_msgr_active_connections numerical anomaly df0073598ea mds: put ClientLease in map container b6c79ab6480 mds: reduce Capability size by using elist::item d2645fd157b qa/cephfs: add test_session_evict_non_blocklisted test case c5a61107b3f mds: cleanup the debug logs to make it to be more readable e63b967aeb0 doc/mgr/dashboard: fix TLS typo bbce02800b2 qa/standalone: bugfix for latecy repair after scrub 98c9c8cf157 qa: set debug_ms=2 for cephfs tests 2ea33487c98 msg: decrease the level to print the sending msgs from the protocol 41eba3e370c neorados: Fix use-after-move in Builder::build_ c3fd1deec2d mon: validate also mons and osds on {rm-,}pg-upmap-primary 3840b2c41c2 rgw/notification: add logic to prevent logging password associated with topics. 4d1dacf87e6 crc32c optimized for s390x arch d37f0943561 test/pybind/test_rados.py: fix warnings 81382acd1ee tool/ceph_dedup: move signal_handler into SampleDedupGlobal to remove a gobal variable 59c48b1202b test/denc: Add check for compat 54516b75782 tool/ceph_dedup: rename make_crawling_daemon to run_crawling_daemon 111c94e05ba tool/ceph_dedup: refactor globals to put them into automatic variable 6855b049fb3 mon/OSDMonitor: Add force-remove-snap mon command 63508ccb96a rgw: eliminate vault token perm for group read a4374ab5380 mgr/dashboard: adapt dashboard e2e for grafana aae02b6af46 qa/suites/rados/verify/validater: increase heartbeat grace timeout 55d9682a90e osd: make the chunking in e.g. PG deletion controlable c719d8ac2d7 mgr/cephadm: bump monitoring stacks versions 3163be345c1 test/client: test contiguous read for a non-contiguous write a7bd91dafb5 Test: osd-recovery-space.sh extends the wait time for "recovery toofull". 9eb14fc01c3 qa/rados: Adapt bluestore tests to new naming in ceph_test_objectstore c594bb5635a tests/store_test: Split matrix tests into separate test cases bd8d7e96956 src/pybind/mgr/pg_autoscaler/module.py: fix 'pg_autoscale_mode' output b1ea37c5a6c mds: always make getattr wait for xlock to be released by the previous client 34b086e702f osd: add watch ping timeout count in osd acf7f153afe bli/aio: replace inappropriate aio_read() with aio_write for POSIXAIO 8e3235975af test/store_test: add a simplified test for readv. 8238b608696 blk/aio: fix incomplete patch to get rid off aio_size 8564caf393a bluestore/bluestore_types: avoid heap-buffer-overflow in another way to keep code uniformity 7b52409ed70 osd: Remove aios_size argument from submit_batch Due to aios_size being a uint16 and the source value for the actual call being an int there was a possible overflow. This was "fixed" with an assert, however that still causes a crash. 62c1ed82828 blk/kernel: always use ceph_assert ccb66145a4e test/store_test: add a case for reading an object with 64+K extents. 09f3c879f2f ceph-dencoder: MDS - Add missing types d3c0a3d0b6b qa/rgw: enable valgrind in rgw/notifications suite 78d7668dccf osd/OSD: improve var naming identify_splits_and_merges ddd741b393f osd/OSD: Add pg_num_history comment 791614e6eb0 osd/OSD: fix track_pools_and_pg_num_changes on mapgaps 8e61af9614e tools/rados: allow to read setomapheader value from file 5f552357af2 osd/OSD: introduce track_pools_and_pg_num_changes 51acf34e7d0 osd/OSD: handle_osd_map rename i and j 482e5b85f08 test/store_test: get rid off explicit offset specifications in shared blob repair test case. b01453b1c1b osd: remove unnecessary return statements 78d6bfe54c3 osd: add clear_shards_repaired command 92fde258bbb qa/cephadm: extend iscsi teuth test 5b9c08eadcb crimson/osd/backfill_state: set backfill_infos when the last round of scan doesn't produce any object that needs to be backkfilled 3d712181966 crimson/osd/backfill_state: consider backfills as complete when all replicas have acknowledged the finish of the backfill 1d99222ffce TrackedOp: Make history_slow_op_threshold a float e1a02841973 common/TrackedOp: rename and raise prio of slow op perfcounter 7830383a1bf doc/dev/developer_guide/testing_integration_tests: Document the random selection operator 33037eccf07 tool/ceph-bluestore-tool: fix wrong keyword for 'free-fragmentation' command. Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2025-01-17 19:17:09 +00:00
Bruce Ashfield	6c52d3e88b	ceph: fix gcc14 and 19.0.0 packaging issues ... To fix the final gcc14 errors, we temporarily disable incompatible type warnings on two python modules. We also package a new systemd file and account for WORKDIR being replaced by UNPACKDIR for patches. Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2024-07-22 22:14:24 +00:00
Bruce Ashfield	4e8568e32e	ceph: build rocksdb, disable QAT, use bundled dependencies (no pip) ... By building rocksdb out of the tree, we can avoid incompatiblity issues in the API with a dependency. QAT doesn't build well, so disable it. Ensure that we are using our python dependencies otherwise pip will be run at build / package time. Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2024-07-22 22:14:24 +00:00
Bruce Ashfield	498cb48b05	ceph: convert to git and tox ... Waiting for ceph releases means a lot of backported patches and missing bundled dependencies. We switch to gitsm to make our updates easier. Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2024-07-22 22:14:24 +00:00
Bruce Ashfield	9c90d73dbc	ceph: initial gcc14 fixes ... Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2024-07-22 22:14:24 +00:00
Bruce Ashfield	9668868174	ceph: update to 18.2.3 ... Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2024-07-22 22:14:24 +00:00
Mingli Yu	c07eefe02f	ceph: Add the missing Upstream-Status Field ... Fixes: INFO: Traceback (most recent call last): File "/build/layers/oe-core/scripts/lib/checklayer/cases/common.py", line 87, in test_patches_upstream_status self.assertEqual(len(patches), 0 , \ AssertionError: 1 != 0 : Found following patches with malformed or missing upstream status: /build/layers/meta-virtualization/recipes-extended/ceph/ceph/0001-delete-install-layout-deb.patch Signed-off-by: Mingli Yu <mingli.yu@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2024-05-02 17:49:26 +00:00
Bruce Ashfield	c20d158524	ceph: update to 18.2.2 ... Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2024-03-15 17:17:20 +00:00
Chen Qi	21b439042b	ceph: fix do_compile/do_install failures ... 1. OECMAKE_C/CXX_COMPILER needs to have sysroot setting in it, because ceph's cmake files are using it to construct PY_CC. Without it, files such as stdlib.h cannot be found. 2. re2 is added to deps. Seems no way to disable it. 3. 0001-ceph-fix-build-errors-for-cross-compile.patch is dropped. It's useless and problematic for new version. 4. 0001-cmake-add-support-for-python3.11.patch is dropped as it's not needed anymore. 5. 0001-avoid-to_string-error.patch is added to fix build error, maybe caused by boost version incompatibility. 6. Some cleanups. 7. A few more options are set. 8. BUILD_DOC=1 is exported so that check_sanity() causes compilation error. This is a workaround and may need further visit in the future. 9. Delete the conditional check for /etc/debian_version which adds '--install-layout deb' and causes the following error. error: option --install-layout not recognized The patch is 0001-delete-install-layout-deb.patch. 10. ceph-volume[-systemd] are now in sbin. 11. cephfs-mirror units are added to avoid package QA issue. 12. cephfs-top is seded to fix incorrect shebang. 13. Ensure libcephsqlite.so is packaged into ceph instead of ceph-dev. 14. Add bash to RDEPENDS as rbdmap needs it. 15. Skip buildpaths QA. 16. Add ceph user/group, because ceph-crash needs it in drop_privilege function call. 17. Patch the build.py which creates the cephadm zipapp to ensure it uses the correct interpreter. We cannot simply use 'sed' against the cephadm as it's zip format. Runtime tests: cephfs-top --help cephadm --help systemctl status rbdmap systemctl --failed Signed-off-by: Chen Qi <Qi.Chen@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2024-03-15 17:17:20 +00:00
Bruce Ashfield	3e1ee1fda7	ceph: initial update to 18.2.0 ... The ability to detected our python is fixed, but we are now failing in the compilation phase on some of the applications. Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2024-03-15 17:17:20 +00:00
Martin Jansa	f6d4c34ac9	ceph: fix build with gcc-13 ... * this isn't complete fix as there are still issues from new boost as in: https://github.com/boostorg/phoenix/issues/111 http://errors.yoctoproject.org/Errors/Details/702743/ TOPDIR/tmp-glibc/work/core2-64-oe-linux/ceph/15.2.15-r0/recipe-sysroot-native/usr/bin/x86_64-oe-linux/../../libexec/x86_64-oe-linux/gcc/x86_64-oe-linux/13.1.0/ld: CMakeFiles/common-objs.dir/mon/MonCap.cc.o:/usr/include/boost/preprocessor/iteration/detail/limits/local_256.hpp:43: multiple definition of `boost::phoenix::placeholders::uarg10'; common/CMakeFiles/common-common-objs.dir/ConfUtils.cc.o:/usr/include/boost/preprocessor/iteration/detail/limits/local_256.hpp:43: first defined here * probably easiest fix for above would be to upgrade to newer ceph, but I'm not using it, so couldn't properly test it (I was just looking at bitbake world failures in mickledore Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2023-05-08 18:41:38 -04:00
sakib.sajal@windriver.com	d2cfa7fac8	ceph: support python 3.11 ... python3 has been upgraded to 3.11 in oe-core causing ceph do_configure to fail with the error: | Could NOT find Python3 (missing: Python3_LIBRARY Python3_INCLUDE_DIR | Development) (found suitable version "3.6.9", minimum required is "3") Support python 3.11 to fix the issue Upstream-Status: sent to upstream (https://github.com/ceph/ceph/pull/48947) Signed-off-by: Sakib Sajal <sakib.sajal@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2022-11-22 23:32:02 -05:00
sakib.sajal@windriver.com	5bc9ecc2a7	ceph: fix compile issue ... rocksdb has been updated to 7.5.3 in meta-oe causing ceph compilation to fail. Backport necessary patches to allow ceph to work with newer versions rocksdb. Signed-off-by: Sakib Sajal <sakib.sajal@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2022-10-04 16:39:50 -04:00
Joe Slater	dccd964570	ceph: Fix CVE-2021-3979 ... Ceph-volume does not properly control key sizes. Cherry-pick from github.com/ceph/ceph.git. Signed-off-by: Joe Slater <joe.slater@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2022-08-20 23:23:08 -04:00
Chen Qi	d9189db0aa	ceph: fix gcc-12 compile failure ... Add two patches to fix gcc-12 compile failure. Signed-off-by: Chen Qi <Qi.Chen@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2022-05-25 11:39:13 -04:00
sakib.sajal@windriver.com	e7516708fe	ceph: set CXXFLAGS and CFLAGS ... commit a83623a54a375d3ae9198a135b94379881a2b7a5 was added to oe-core which removes CXXFLAGS and CFLAGS causing compilation for ceph to fail. Set CXXFLAGS and CFLAGS to resolve the issue. Signed-off-by: Sakib Sajal <sakib.sajal@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2022-03-22 15:59:52 -04:00
Bruce Ashfield	108e089f7e	global: update licence values to SPDX values ... These changes are the result of running the convert-spdx-licenses.py oe-core script. There's no impact to the build, but we will avoid issues when interacting with core QA by the alignment. Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2022-02-18 13:07:10 -05:00
Kai Kang	f71bedc29d	ceph: 15.2.12 -> 15.2.15 ... Update ceph to latest 15.x version: * remove 0001-add-missing-include-for-atomic-bool.patch which has been fixed in upstream * update patch to support python 3.10 * add gawk to RDEPENDS that script 'rgw-gap-list-comparator' requires it Signed-off-by: Kai Kang <kai.kang@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2021-10-28 15:30:19 -04:00
Kai Kang	03cd8aa82e	ceph: inherit pkgconfig.bbclass ... According to oe-core commit 8e26252b45 layer.conf: Extend recipes not to install without explict dependencies pkgconfig-native is not deployed in sysroot by default any more. Inherit pkgconfig.bbclass to make it available for ceph. Signed-off-by: Kai Kang <kai.kang@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2021-10-18 23:02:30 -04:00
Bruce Ashfield	1fae6921b6	Revert "ceph/libibverbs: replace libibverbs with rdma-core" ... meta-cloud-services still has users of libibverbs, so we'll keep it around a bit longer. But this library has been replaced by rdma-core, and won't get more updates, so it should be considered depreciated and slated for removal. This reverts commit 513f05926a.	2021-09-17 08:27:13 -04:00
Bruce Ashfield	513f05926a	ceph/libibverbs: replace libibverbs with rdma-core ... libibverbs is no longer developed, and its functionaty is provided by the rdma-core projects. rdma-core is part of meta-networking, so we drop libibverbs and update our dependency to rdma-core. Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2021-09-16 18:01:55 -04:00
Bruce Ashfield	d876cfc5bf	global: overrides syntax conversion ... OEcore/bitbake are moving to use the clearer ":" as an overrides separator. This is pass one of updating the meta-virt recipes to use that syntax. This has only been minimally build/runtime tested, more changes will be required for missed overrides, or incorrect conversions Note: A recent bitbake is required: commit 75fad23fc06c008a03414a1fc288a8614c6af9ca Author: Richard Purdie <richard.purdie@linuxfoundation.org> Date: Sun Jul 18 12:59:15 2021 +0100 bitbake: data_smart/parse: Allow ':' characters in variable/function names It is becomming increasingly clear we need to find a way to show what is/is not an override in our syntax. We need to do this in a way which is clear to users, readable and in a way we can transition to. The most effective way I've found to this is to use the ":" charater to directly replace "_" where an override is being specified. This includes "append", "prepend" and "remove" which are effectively special override directives. This patch simply adds the character to the parser so bitbake accepts the value but maps it back to "_" internally so there is no behaviour change. This change is simple enough it could potentially be backported to older version of bitbake meaning layers using the new syntax/markup could work with older releases. Even if other no other changes are accepted at this time and we don't backport, it does set us on a path where at some point in future we could require a more explict syntax. I've tested this patch by converting oe-core/meta-yocto to the new syntax for overrides (9000+ changes) and then seeing that builds continue to work with this patch. (Bitbake rev: 0dbbb4547cb2570d2ce607e9a53459df3c0ac284) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2021-08-02 17:17:53 -04:00
Saul Wold	8ded083436	ceph: Fix compile error with snappy ... snappy changed a data type in the last update, this is a known issue in ceph. Signed-off-by: Saul Wold <saul.wold@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2021-06-01 08:52:18 -04:00
Saul Wold	638d31de13	ceph: update to 15.2.12 to address CVEs ... Updated sha* Fixes: CVE-2021-3509 Fixes: CVE-2021-3524 Fixes: CVE-2021-3531 Signed-off-by: Saul Wold <saul.wold@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2021-05-21 23:18:04 -04:00
Zqiang	2e5f311548	ceph: uprev from 15.2.8 to 15.2.9 ... Notable Changes: 1. progress module can now be turned on/off, using the commands: ceph progress on and ceph progress off. 2. PG removal has been optimized in this release. Signed-off-by: Zqiang <qiang.zhang@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2021-03-30 16:42:52 -04:00
sakib.sajal@windriver.com	b8aa31c8c9	ceph: uprev v15.2.0 -> v15.2.8 ... Removed patches that are contained in newer version. Contains fixes to CVES: CVE-2020-27781 CVE 2020-25660 CVE-2020-10753 CVE-2020-10736 CVE-2020-1759 CVE-2020-1760 Built and run tested. Signed-off-by: Sakib Sajal <sakib.sajal@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2020-12-28 22:54:19 -05:00
Yanfei Xu	9fe997733d	ceph: add support for python3.9 ... Add support for python3.9, or it will do_configure failed. Signed-off-by: Yanfei Xu <yanfei.xu@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2020-11-14 23:07:20 -05:00
sakib.sajal@windriver.com	6687be2233	ceph: add missing include for atomic<bool> ... ceph do_compile failed with error: src/tools/rbd/action/Bench.cc:20:26: error: aggregate 'std::atomic<bool> terminating' has incomplete type and cannot be defined Add missing include to fix it. Signed-off-by: Sakib Sajal <sakib.sajal@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2020-11-14 23:07:13 -05:00
sakib.sajal@windriver.com	83a75c6410	ceph: fix do_compile error: 'sys_siglist' was not declared ... glibc 2.32 has deprecated sys_siglist, oe-core commit 7c19f30849e9a73a7497d8e6c4719a2e57017086, causing ceph build to fail with error: ceph-15.2.0/src/global/signal_handler.h:24:26: error: 'sys_siglist' was not declared ceph has support for using reentrant strsignal, hence use it. See commit 82c40b67f5843162a93ebb2c1a006572d8f256a5 in upstream ceph. Signed-off-by: Sakib Sajal <sakib.sajal@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2020-08-16 21:20:12 -04:00
jason.lau	3bfea241d0	ceph: fix CVE-2020-10736 ... An authorization bypass vulnerability was found in Ceph versions 15.2.0 before 15.2.2, where the ceph-mon and ceph-mgr daemons do not properly restrict access, resulting in gaining access to unauthorized resources. This flaw allows an authenticated client to modify the configuration and possibly conduct further attacks. Upstream patches: [master] c7e7009a69 [v15.2.2] f2cf2ce1bd CVE: CVE-2020-10736 Signed-off-by: Liu Haitao <haitao.liu@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2020-07-06 16:28:54 -04:00
sakib.sajal@windriver.com	3b217da980	ceph: backport CVE fixes ... Fix CVE-2020-1759 and CVE-2020-1760 PR for fix: https://github.com/ceph/ceph/pull/34482 Signed-off-by: Sakib Sajal <sakib.sajal@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2020-05-02 11:02:58 -04:00
hongxu	d5953299e2	ceph: fix host library paths were used ... ... |ERROR: ceph-15.2.0-r0 do_package_qa: QA Issue: ceph: The compile log indicates that host include and/or library paths were used. | Please check the log 'tmp-glibc/work/corei7-64-wrs-linux/ ceph/15.2.0-r0/temp/log.do_compile' for more information. [compile-host-path] |ERROR: ceph-15.2.0-r0 do_package_qa: QA Issue: ceph: The install log indicates that host include and/or library paths were used. | Please check the log 'tmp-glibc/work/corei7-64-wrs-linux/ ceph/15.2.0-r0/temp/log.do_install' for more information. [install-host-path] ... While python setup, test var-LIBPL contains recipe-sysrooot prefix, add it back if lost Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2020-04-14 17:05:54 -04:00
hongxu	f5a31e3ecd	ceph: fix installed-vs-shipped QA issue ... ... |ERROR: ceph-15.2.0-r0 do_package: QA Issue: ceph: Files/directories were installed but not shipped in any package: | /lib/systemd/system/ceph-immutable-object-cache@.service | /lib/systemd/system/ceph-immutable-object-cache.target ... Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2020-04-14 17:05:54 -04:00
sakib.sajal@windriver.com	40f79e8d17	ceph: uprev ceph from 14.2.7 to 15.2.0 ... ceph uprev to v15.2.0 Refreshed oe-specific patch: ceph/0001-ceph-fix-build-errors-for-cross-compile.patch Removed merged patches: ceph/0001-common-rgw-workaround-for-boost-1.72.patch ceph/0001-rgw-add-executor-type-for-basic_waitable_timers.patch ceph/0001-rgw-beast-handle_connection-takes-io_context.patch Signed-off-by: Sakib Sajal <sakib.sajal@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2020-04-08 23:06:09 -04:00
Kai Kang	cac0cdf86d	ceph: 14.2.6 -> 14.2.7 ... Update ceph from 14.2.6 to 14.2.7. * Backport patch to fix compile error * Replace python with python3 in the script files that /usr/bin/python not exists * Replace runtime dependency python3 with python3-core - /usr/bin/python3 is provided by python3-core - packagee python3 is provided by python3-modules which in RDEPENDS already This has been build-only tested. Signed-off-by: Kai Kang <kai.kang@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2020-02-13 17:21:52 -05:00
Bruce Ashfield	7e9c4e6a46	ceph: update and make python3 safe ... Updating the ceph version and making python2 -> python3 subsitutions. This has been build-only tested. We can drop one patch, since it is already part of this newer version. Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2020-01-22 15:53:49 +00:00
Chen Qi	0e01ab3f52	ceph: backport patch to fix compilation failure of boost 1.72 ... Backport a patch to fix compliation failure caused by boost upgrading to 1.72. Signed-off-by: Chen Qi <Qi.Chen@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2020-01-08 16:20:32 -05:00
Hongzhi.Song	85f7376fa4	ceph: fix ceph-crash failed with /var/lib/ceph/crash/posted not found ... root@intelx86-64: journalctl -xe ceph-crash[854]: ERROR:_main_:directory /var/lib/ceph/crash/posted does not exist; please create Create the directory for both of systemd and sysvinit Signed-off-by: Hongzhi.Song <hongzhi.song@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2019-09-14 23:51:10 -04:00
He Zhe	624c5a0621	ceph: Upgrade to 14.2.3 ... Upgrade to the latest stable version and backport two patches from master branch to fix the following two build failures which are introduce by upgrading boost to 1.71.0. f1651b8c509d ("rgw: add executor type for basic_waitable_timers") for: src/rgw/rgw_dmclock_async_scheduler.h:45:30: error: could not convert 'boost::asio::basic_waitable_timer<Clock, WaitTraits, Executor>::get_executor() 064f142746ae ("rgw: beast handle_connection() takes io_context") for: src/rgw/rgw_asio_frontend.cc:155:38: error: 'class boost::asio::basic_socket<boost::asio::ip::tcp, boost::asio::executor>' has no member named 'get_io_context'; did you mean 'io_control'? Signed-off-by: He Zhe <zhe.he@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2019-09-09 13:29:47 -04:00
Chen Qi	e87e6fdcbc	ceph: remove fuse related services as WITH_FUSE is OFF ... We have WITH_FUSE to set to OFF. We should not install any ceph-fuse units as they are using ceph-fuse. Signed-off-by: Chen Qi <Qi.Chen@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2019-08-30 00:28:36 -04:00
Chen Qi	2c6f451aa2	ceph: set CVE_PRODUCT ... Signed-off-by: Chen Qi <Qi.Chen@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2019-05-06 15:47:02 -04:00
Dengke Du	ed9045b143	ceph: upgrade to 14.1.0 ... 1. set the cross compile sysroot to find the rocksdb library 2. correct the install path for library in Distutils.cmake Signed-off-by: Dengke Du <dengke.du@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2019-03-17 00:18:31 +00:00
Dengke Du	b513fda519	ceph: disable ccache ... When enable ccache for ceph, error occurs: ----------------------------------------------------- ccache: invalid option -- 'E' ... Unable to determine C++ standard library, got . ----------------------------------------------------- This is because variable "CXX_STDLIB" was null in CMakeLists.txt line: 637, The "CXX_STDLIB" come from: ----------------------------------------------------- execute_process( COMMAND ./librarytest.sh ${CMAKE_CXX_COMPILER} ${CMAKE_CXX_FLAGS} WORKING_DIRECTORY ${CMAKE_SOURCE_DIR} OUTPUT_VARIABLE CXX_STDLIB ) ----------------------------------------------------- The script librarytest.sh in ceph accept argument: compile and flags, but when enable ccache, the compile replace by ccache, so that script failed. So we disable ccache for ceph now. Signed-off-by: Dengke Du <dengke.du@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com>	2019-02-14 14:03:49 +00:00
Dengke Du	ccdf4ef7b8	ceph: fix rbd create operation not supported ... When using qemu-img to create rbd based image: qemu-img create -f rbd rbd:libvirt-pool/libvirt-image 2G Output errors: qemu-img: rbd:libvirt-pool/libvirt-image: error rbd create: Operation not supported Accroding to upstream's advice: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2018-November/031014.html This is because the system can't find libcls_rbd.so, this library was packaged in ceph-dev, we should package it in ceph. Signed-off-by: Dengke Du <dengke.du@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com>	2018-11-08 14:53:15 -05:00
Dengke Du	2519e5b16d	ceph: fix Distutils.cmake installation for cross compile ... 1. Remove the detection for build host and correct the install destination for cross compile. 2. Delete the build host information in the results files. Signed-off-by: Dengke Du <dengke.du@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com>	2018-10-30 13:41:16 -04:00
Dengke Du	f33c8698fd	ceph: upgrade to 13.2.2 ... 1. upgrade to 13.2.2 2. install systemd service files 3. add pybind support testing steps: # ceph -h outputs: -------------------------------------------------------------------------- General usage: ============== usage: ceph [-h] [-c CEPHCONF] [-i INPUT_FILE] [-o OUTPUT_FILE] [--id CLIENT_ID] [--name CLIENT_NAME] [--cluster CLUSTER] [--admin-daemon ADMIN_SOCKET] [-s] [-w] [--watch-debug] [--watch-info] [--watch-sec] [--watch-warn] [--watch-error] [--watch-channel {cluster,audit,*}] [--version] [--verbose] [--concise] [-f {json,json-pretty,xml,xml-pretty,plain}] [--connect-timeout CLUSTER_TIMEOUT] [--block] [--period PERIOD] Ceph administration tool optional arguments: -h, --help request mon help -c CEPHCONF, --conf CEPHCONF ...... -------------------------------------------------------------------------- Signed-off-by: Dengke Du <dengke.du@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com>	2018-10-25 06:31:52 -04:00
Dengke Du	4be88e8390	ceph: only support x86-64 ... Signed-off-by: Dengke Du <dengke.du@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com>	2018-10-09 23:25:37 -04:00
Dengke Du	a49ca99d06	ceph: add support for ceph ... Ceph is a distributed object, block, and file storage platform, ceph depends on oath-toolkit, so add the oath-toolkit also. Signed-off-by: Dengke Du <dengke.du@windriver.com> Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com>	2018-09-30 21:31:21 -04:00