Isilon FSA 'data usage' details from API

Question

hello! I have an Insigthiq server in my environment. I wont to export report for all directories (recursively) in my OneFs system. with the following information: Directory name, number of directories inside, number of files inside, logical directory size, physical directory size. from insigthiq GUI I can navigate to: File System Reporting > File System Analytics > Report Type 'Data Usage' > view report.  and I can see all the information I wrote above and export it to csv file. The problem is that from GUI I can do it just from one specific path, and not recursively. I want to run it automatically for multiple path and export custom report to csv. I try with 'iiq_data_export fsa export -c -d directories -o -r directory: ' command, but this command working just for one  path. and the depth of the path limited (by directory filter path squash) compared to the GUI where the depth not limited. so I try to do this from API with http request:  GET 'https:// :8080/platform/3/fsa/results/ /directories/?path= ' and there are the same limitations. I tried with several other requests and did not find solution. I say: if it possible from GUI and without a depth limit, there must be away with API!!! I tried query the fsa results.db with the following command: 'sqlite3 -column -header /ifs/.ifsvar/modules/fsa/pub/latest/results.db 'select * from disk_usage'  ' and that's not output nothing.   Can anyone help me find a way to get the above information out of the API in a simple way? I attaching a picture from the GUI to bring an example of the information I want thanks

DELL-Sam L · Answer

Hello Shai Viente, It is best to open a support case for this.

cadencep45 · Answer

the fact that you see dirs beyond 5 levels is interesting. As far as I know, the default is restricted to a depth of 5 to;

stop fsa growing unbounded
for performance reasons to keep the creation time of a fsa reasonable

Are you sure you are seeing answers to a depth greater than 5 dirs ?

tchstnut · Answer

What was the out come of the support case?  Curious as I am having the same issues.   When making the api calls if a folder is more than 5 deep, the file and directory count are blank.

htek808 · Answer

Curious if there was any outcome for this thread. I'm also trying to use the API or the isilon_sdk_python.v9_4_0 module to extract the FSA results for a InsightIQ like report, # of directories, # of files, logical/physical size.

fskrot · Answer

@cadencep45​ It's easily doable We have a 10Pb cluster, with Billions of files of lots of nodes and run our depth at a base Minimum of 10 across all 10 clusters and some we go deeper.  Yes setting it to something crazy like 40 is a node CPU killer but possible.  Just go into the Settings and I'd recommend creeping the depth crawling up and watch the impact.  FSA does gather the subtotals of evertything lower just not in detail if you stop at say 12.  on out large cluster we go to 15 and have the number of files/folder per directory set to like 5K to get what we need across all our shares, job runs for 5-6 hours on low but works just fine.

Isilon

Was this post helpful?