We are a national public broadcaster that produce a lot of video, which is stored on powerscale.

Most of this is only relevant for a short time, then it needs to be deleted.

We use a pretty advanced bash script on a server that has dozens of volumes exported from the powerscale clusters via nfs.

For scale there is some 14 million folders and tens of PB of data.

Anyhow it's become a pain to maintain this script, the guy who wrote it left almost a decade ago. There are literally thousands of different settings for thousands of folders. Yet we're running into more and more limitations of what it can and cannot do.

So... we're looking for some "autodelete"/file management product that can be bought and supported by and established vendor. So far haven't found any...

Suggestions?