Unsolved
1 Message
0
940
November 8th, 2021 06:00
compress folders through cli or ssh efficiently at cluster level
Hi we want to compress some folders into .zip o .tar or .tar.gz.
We can just log into ssh in one of our nodes and perform this operation using linux scripts, but we want to perform this operation efficiently, I mean not just using only one node but all the cluster nodes.
Is it possible to perform this operation at cluster level? through cli? isi compress folder1 folder2 folder3 or something like that?
Thanks.
DELL-Sam L
Moderator
•
7.7K Posts
0
November 8th, 2021 16:00
Hello Alex_val,
What is your current Onefs version?
Peter_Sero
4 Operator
•
1.2K Posts
0
November 11th, 2021 10:00
Please do not attempt do run CPU-intensive software directly on the cluster. For CPU-bound applications like file compression there is barely a benefit in read/write efficiency; but stealing CPU cycles from OneFS may put the cluster's predictable work performance at a risk.
Newer/newest PowerScale node models running latest OneFS releases do have inline compression built in, so that all CPU usage happens in a controlled way.
(Of course this inline compression is invisible to the user: file.dat will stay file.dat and not become file.dat.gz. This may or may not be desirable; e.g. where compressed files should be read in compressed form in order to save network bandwidth.)
hth
-- Peter