If I have a bucket with a very large number of files, what is the best way to recursively delete the objects so I can delete the bucket?
With s3cmd, it's so large recursive delete fails. For one of the smaller buckets I'm doing s3cmd ls + s3cmd del using gnu parallel. But the larger bucket is 100,000,000+ objects and this method doesn't work.
I can’t view that page as it says dell internal only.
“
If you are an External user and require access to inside Dell then please contact your Dell representative for more information. Please note External User access is limited to Dell approved customers, partners, and suppliers.
“
--
John Daniels
Research IS Systems Engineer III
Children's Hospital of Philadelphia Research Institute
The Roberts Center for Pediatric Research
2716 South Street
Philadelphia, PA 19104
danielsj1@email.chop.edu
Office: 267-425-0155
Need faster service?
Try placing your request at http://cirrus.research.chop.edu before opening a manual service request.
Otherwise, you can submit an adhoc request here (general->other), include ‘please route to research IS’
We used the CAS API to delete all the CLIP-IDs in our ECS bucket, however over 17,000 objects still remain. Is there a similar tool to the bucket-wipe JAR that takes a PEA file? That is only method we have to connect to the bucket.
danielsj1
3 Posts
5098
0
Posted October 23rd, 2018 12:00
I can’t view that page as it says dell internal only.
“
If you are an External user and require access to inside Dell then please contact your Dell representative for more information. Please note External User access is limited to Dell approved customers, partners, and suppliers.
“
--
John Daniels
Research IS Systems Engineer III
Children's Hospital of Philadelphia Research Institute
The Roberts Center for Pediatric Research
2716 South Street
Philadelphia, PA 19104
danielsj1@email.chop.edu
Office: 267-425-0155
Need faster service?
Try placing your request at http://cirrus.research.chop.edu before opening a manual service request.
Otherwise, you can submit an adhoc request here (general->other), include ‘please route to research IS’