ON THIS PAGE
Check Storage Utilization
Purpose
Check utilization of local storage PVC, Ceph-based storage PVC, and the S3 bucket. When a health-check shows abnormal disk pressure or pods crash due to disk issues, you can check storage utilization to pinpoint the issue.
Action
Log in to the Linux root shell of a cluster node and use the following commands:
-
For the local storage PVC—
paragon-local-volume-check
-
For Ceph-based storage PVC and S3 bucket—
paragon-ceph-usage-check [-h] [-s] [-c] [-b]
Where:
-
-h
or--help
displays command usage information. -
-c
or--cephfs
checks Ceph-based storage usage. -
-s
or--s3
checks S3 bucket usage. -
-b
or--both
checks both Ceph-based storage and S3 bucket usage.
-
Sample Output
- paragon-local-volume-check
- paragon-ceph-usage-check -h
- paragon-ceph-usage-check -s
- paragon-ceph-usage-check -c
- paragon-ceph-usage-check -b
paragon-local-volume-check
root@pa1:~# paragon-local-volume-check ======================================================= Get local volume usage. ======================================================= pv-name pvc-claim local-path disk-usage node-name echolocal-pv-36c71c79 foghorn-dbserver-6nrhq4nc /export/local-volumes/pv16 107M pa1 local-pv-49d4aff9 data-zookeeper-0 /export/local-volumes/pv3 996K pa1 local-pv-aa9c4410 data-kafka-2 /export/local-volumes/pv11 142M pa1 local-pv-c747791f vmstorage-db-vmstorage-victoria-metrics-cluster-2 /export/local-volumes/pv9 68K pa1 local-pv-ead7ada4 opensearch-cluster-master-opensearch-cluster-master-2 /export/local-volumes/pv20 1.5M pa1 local-pv-22f5300c pgdata-atom-db-2 /export/local-volumes/pv5 519M pa2 local-pv-37c26b76 foghorn-dbserver-9d9nd1l2 /export/local-volumes/pv3 106M pa2 local-pv-53c4d5b foghorn-agent-hiknywjh /export/local-volumes/pv15 8.2M pa2 local-pv-80a32482 vmstorage-db-vmstorage-victoria-metrics-cluster-0 /export/local-volumes/pv12 68K pa2 local-pv-92b5cf80 data-zookeeper-2 /export/local-volumes/pv14 996K pa2 local-pv-a5c36300 vmstorage-db-vmstorage-victoria-metrics-cluster-0 /export/local-volumes/pv1 140K pa2 local-pv-3abab0b0 pgdata-atom-db-1 /export/local-volumes/pv17 519M pa3 local-pv-4961bb7d foghorn-agent-hpvuvjh9 /export/local-volumes/pv5 8.2M pa3 local-pv-6b46253c opensearch-cluster-master-opensearch-cluster-master-0 /export/local-volumes/pv13 2.3M pa3 local-pv-7358834e foghorn-dbserver-ddxwbr01 /export/local-volumes/pv11 134M pa3 local-pv-7e53b8bc data-kafka-1 /export/local-volumes/pv6 142M pa3 local-pv-b788099 vmstorage-db-vmstorage-victoria-metrics-cluster-1 /export/local-volumes/pv9 140K pa3 local-pv-269c69f0 data-zookeeper-1 /export/local-volumes/pv7 996K pa4 local-pv-3d6bab16 vmstorage-db-vmstorage-victoria-metrics-cluster-2 /export/local-volumes/pv10 72K pa4 local-pv-40e3ef1 opensearch-cluster-master-opensearch-cluster-master-1 /export/local-volumes/pv20 2.0M pa4 local-pv-4eb12e61 pgdata-atom-db-0 /export/local-volumes/pv15 581M pa4 local-pv-866f53aa data-kafka-0 /export/local-volumes/pv9 142M pa4 local-pv-abda8deb vmstorage-db-vmstorage-victoria-metrics-cluster-1 /export/local-volumes/pv17 68K pa4 local-pv-c101544f foghorn-agent-wldughyr /export/local-volumes/pv13 8.2M pa4
paragon-ceph-usage-check -h
root@pa1:~# paragon-ceph-usage-check -h usage: paragon-ceph-usage-check [-h] [-s] [-c] [-b] Helper command to check S3 and Ceph usage options: -h, --help show this help message and exit -s, --s3 Check S3 bucket usage -c, --cephfs Check CephFS usage -b, --both Check usage for both S3 and CephFS
paragon-ceph-usage-check -s
root@pa1:~# paragon-ceph-usage-check -s Checking S3 bucket usage Listing top-level directories and checking usage: S3 Directory list : ['devicesoftware', 'usw2-jcloud-dev-paa-plugin-service-plugins-storage'] Usage for: devicesoftware Total Objects: 0 Total Size: 0 Bytes Usage for: usw2-jcloud-dev-paa-plugin-service-plugins-storage Total Objects: 0 Total Size: 0 Bytes
paragon-ceph-usage-check -c
root@pa1:~# paragon-ceph-usage-check -c Checking CephFS usage PV to PVC , Volume and Size mapping +------------------------------------------+----------------------------------------+----------+------------------------------------------------------------------------------------------------+-----------------------+ | PV | Claim | Capacity | Volume location | Gb Used | +------------------------------------------+----------------------------------------+----------+------------------------------------------------------------------------------------------------+-----------------------+ | pvc-3eed5171-5efe-4c6b-8629-613844711362 | paa/timescaledb-data-paa-timescaledb-0 | 32Gi | /volumes/csi/csi-vol-c96deb77-7145-403e-8da1-e971883ce6c1/0ba12eb7-e93d-47d4-afa1-21b8dc998971 | 0.0723346984013915 | | pvc-42fec79a-fbf0-40bd-9dc5-066ff2f479e3 | common/redis-data | 10Gi | /volumes/csi/csi-vol-0f8878fa-eeb5-4ce5-8396-2ee2766e9413/d8810464-bf81-4008-98e1-da295a579e35 | 2.360902726650238e-06 | | pvc-46209d4a-2283-4fc2-aa55-2b9a4f9af6a1 | common/opensearch-backup | 32Gi | /volumes/csi/csi-vol-9c5ace5e-d133-40aa-954d-fd51cceb2d80/3a8d0c37-4cfc-4ae7-8a82-a5deca1225b7 | 1.773890107870102e-05 | | pvc-5ae0fd7f-b53d-4b78-ba7d-4b0297ed6e30 | healthbot/insights-data | 10Gi | /volumes/csi/csi-vol-d51fa0b1-5432-4e6e-97b9-17d0df1bdf47/43435330-12b4-4a50-9ca7-efee19b94e96 | 0.0024269744753837585 | | pvc-697325c2-4c93-4a1c-b60a-feb1d5b5b611 | license-client/license-client-data | 8Mi | /volumes/csi/csi-vol-fc9ff7c8-e4a1-42f2-9f96-5c34f2cd559b/9f364508-9d15-4d13-8d83-c64da1bb7c25 | 0.0 | | pvc-99cf22c0-33f3-44b1-ad53-2a898b3247b4 | common/opensearch-cephfs-pvc | 10Gi | /volumes/csi/csi-vol-d3ba7888-09f3-45c6-8378-028f78d8b318/5b21acb7-6e02-428c-aacf-7ec78efd9932 | 0.0 | | pvc-cdef057b-21ea-4481-9504-e8ff9f9094a0 | paa/orchestrator-volume | 10Gi | /volumes/csi/csi-vol-f606b8f9-f705-498e-b0ee-f3afa4ed0d14/0ee7375d-908b-4230-a513-b6c6c872f73a | 0.2804222572594881 | | pvc-e160c14c-8832-4ad8-bd39-9ca43c1f1dca | airflow/airflow | 10Gi | /volumes/csi/csi-vol-2b8e1186-650e-4489-b1cd-697c38511c01/a9c8d233-ea01-4d4d-9497-fa8f73b5875c | 0.6222417075186968 | +------------------------------------------+----------------------------------------+----------+------------------------------------------------------------------------------------------------+-----------------------+
paragon-ceph-usage-check -b
root@pa1:~# paragon-ceph-usage-check -b Checking S3 bucket usage Listing top-level directories and checking usage: S3 Directory list : ['devicesoftware', 'usw2-jcloud-dev-paa-plugin-service-plugins-storage'] Usage for: devicesoftware Total Objects: 0 Total Size: 0 Bytes Usage for: usw2-jcloud-dev-paa-plugin-service-plugins-storage Total Objects: 0 Total Size: 0 Bytes Checking CephFS usage PV to PVC , Volume and Size mapping +------------------------------------------+----------------------------------------+----------+------------------------------------------------------------------------------------------------+-----------------------+ | PV | Claim | Capacity | Volume location | Gb Used | +------------------------------------------+----------------------------------------+----------+------------------------------------------------------------------------------------------------+-----------------------+ | pvc-3eed5171-5efe-4c6b-8629-613844711362 | paa/timescaledb-data-paa-timescaledb-0 | 32Gi | /volumes/csi/csi-vol-c96deb77-7145-403e-8da1-e971883ce6c1/0ba12eb7-e93d-47d4-afa1-21b8dc998971 | 0.0724263722077012 | | pvc-42fec79a-fbf0-40bd-9dc5-066ff2f479e3 | common/redis-data | 10Gi | /volumes/csi/csi-vol-0f8878fa-eeb5-4ce5-8396-2ee2766e9413/d8810464-bf81-4008-98e1-da295a579e35 | 2.360902726650238e-06 | | pvc-46209d4a-2283-4fc2-aa55-2b9a4f9af6a1 | common/opensearch-backup | 32Gi | /volumes/csi/csi-vol-9c5ace5e-d133-40aa-954d-fd51cceb2d80/3a8d0c37-4cfc-4ae7-8a82-a5deca1225b7 | 1.773890107870102e-05 | | pvc-5ae0fd7f-b53d-4b78-ba7d-4b0297ed6e30 | healthbot/insights-data | 10Gi | /volumes/csi/csi-vol-d51fa0b1-5432-4e6e-97b9-17d0df1bdf47/43435330-12b4-4a50-9ca7-efee19b94e96 | 0.0024269744753837585 | | pvc-697325c2-4c93-4a1c-b60a-feb1d5b5b611 | license-client/license-client-data | 8Mi | /volumes/csi/csi-vol-fc9ff7c8-e4a1-42f2-9f96-5c34f2cd559b/9f364508-9d15-4d13-8d83-c64da1bb7c25 | 0.0 | | pvc-99cf22c0-33f3-44b1-ad53-2a898b3247b4 | common/opensearch-cephfs-pvc | 10Gi | /volumes/csi/csi-vol-d3ba7888-09f3-45c6-8378-028f78d8b318/5b21acb7-6e02-428c-aacf-7ec78efd9932 | 0.0 | | pvc-cdef057b-21ea-4481-9504-e8ff9f9094a0 | paa/orchestrator-volume | 10Gi | /volumes/csi/csi-vol-f606b8f9-f705-498e-b0ee-f3afa4ed0d14/0ee7375d-908b-4230-a513-b6c6c872f73a | 0.2804222572594881 | | pvc-e160c14c-8832-4ad8-bd39-9ca43c1f1dca | airflow/airflow | 10Gi | /volumes/csi/csi-vol-2b8e1186-650e-4489-b1cd-697c38511c01/a9c8d233-ea01-4d4d-9497-fa8f73b5875c | 0.6234864285215735 | +------------------------------------------+----------------------------------------+----------+------------------------------------------------------------------------------------------------+-----------------------+
Meaning
The paragon-local-volume-check
command lists all the PVCs, the
local path, disk usage, and size of a PVC, as well as the node on which the PVC is located.
The paragon-ceph-usage-check
command displays a detailed view of the Ceph
filesystem with the usage, capacity, claim name, and PV name, as well as the volume
location.