We're bumping up into space limitations with our ostree storage. I just started pruning operations, which are working now. For example the run I did tonight got us 1.2T back:
1.2T
2022-12-14 20:19:34,240 INFO fedora-ostree-pruner - Running command: ['ostree', 'prune', '--repo', '/mnt/koji/compose/ostree/repo', '--refs-only', '--keep-younger-than=90 days ago'] Total objects: 10773089 Deleted 7439624 objects, 1.2 TB freed
The problem with this is that the snapshotting on the netapp means that we don't get any reduction in usage until any snapshots that contain the 1.2T roll off, which could take months.
I think this means we need to increase our storage again so we can continue to compose OSTrees until the snapshots roll off. Can we increase it by 500G until we have a better understanding of when the space will actually be recovered?
500G
When do you need this? (2022-12-16)
When is this no longer needed or useful? (N/A)
If we cannot complete your request, what is the impact?
No more OSTree derived editions composing (excludes IoT).
I've added 500G. :)
Here's the current snapshots:
ntap-iad2-c02::> snapshot show fedora_ostree_content ---Blocks--- Vserver Volume Snapshot Size Total% Used% -------- -------- ------------------------------------- -------- ------ ----- ntap-iad2-c02-fedora01 fedora_ostree_content weekly_sun_0035.2022-09-04_0035 9.65GB 0% 0% weekly_sun_0035.2022-09-11_0035 10.39GB 0% 0% weekly_sun_0035.2022-09-18_0035 11.12GB 0% 0% weekly_sun_0035.2022-09-25_0035 4.75GB 0% 0% weekly_sun_0035.2022-10-02_0035 7.56GB 0% 0% weekly_sun_0035.2022-10-09_0035 7.73GB 0% 0% weekly_sun_0035.2022-10-16_0035 12.63GB 0% 0% weekly_sun_0035.2022-10-23_0035 16.18GB 0% 0% weekly_sun_0035.2022-10-30_0035 6.26GB 0% 0% weekly_sun_0035.2022-11-06_0035 4.19GB 0% 0% weekly_sun_0035.2022-11-13_0035 6.66GB 0% 0% weekly_sun_0035.2022-11-20_0035 10.83GB 0% 0% weekly_sun_0035.2022-11-27_0035 9.64GB 0% 0% daily_0035.2022-12-02_0035 3.06GB 0% 0% daily_0035.2022-12-03_0035 30.47GB 1% 1% weekly_sun_0035.2022-12-04_0035 1.33MB 0% 0% daily_0035.2022-12-04_0035 3.67GB 0% 0% daily_0035.2022-12-05_0035 1.90GB 0% 0% daily_0035.2022-12-06_0035 1.87GB 0% 0% daily_0035.2022-12-07_0035 2.23GB 0% 0% daily_0035.2022-12-08_0035 4.72GB 0% 0% daily_0035.2022-12-09_0035 3.03GB 0% 0% daily_0035.2022-12-10_0035 3.58GB 0% 0% weekly_sun_0035.2022-12-11_0035 668KB 0% 0% daily_0035.2022-12-11_0035 3.31GB 0% 0% daily_0035.2022-12-12_0035 4.09GB 0% 0% daily_0035.2022-12-13_0035 3.45GB 0% 0% daily_0035.2022-12-14_0035 1.79GB 0% 0% 2hour_even_35.2022-12-14_0435 424.9MB 0% 0% 2hour_even_35.2022-12-14_0635 357.8MB 0% 0% 2hour_even_35.2022-12-14_0835 64.84MB 0% 0% 2hour_even_35.2022-12-14_1035 333.5MB 0% 0% 2hour_even_35.2022-12-14_1235 130.8MB 0% 0% 2hour_even_35.2022-12-14_1435 166.8MB 0% 0% 2hour_even_35.2022-12-14_1635 75.57MB 0% 0% 2hour_even_35.2022-12-14_1835 784.5MB 0% 0% 2hour_even_35.2022-12-14_2035 785.2GB 14% 18% 2hour_even_35.2022-12-14_2235 404.1GB 7% 10% daily_0035.2022-12-15_0035 380KB 0% 0% 2hour_even_35.2022-12-15_0035 356.0MB 0% 0% 2hour_even_35.2022-12-15_0235 12.46MB 0% 0% snapmirror.46ae8357-e29c-11e4-b894-123478563412_2155398288.2022-12-15_024000 55.87MB 0% 0% 42 entries were displayed.
Metadata Update from @kevin: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)