You can set the HDFS block size on Isilon, I believe the default is 64MB. You can view your current settings with: 'isi hdfs settings view' and change it with 'isi hdfs settings modify --default-block-size=128MB'.
I did some work last summer on Hadoop with Isilon and saw some definite advantages/efficiencies to using larger HDFS block sizes if your files are as large or larger than the selected HDFS block size.
jason_f1
8 Posts
0
March 24th, 2015 10:00
You can set the HDFS block size on Isilon, I believe the default is 64MB. You can view your current settings with: 'isi hdfs settings view' and change it with 'isi hdfs settings modify --default-block-size=128MB'.
I did some work last summer on Hadoop with Isilon and saw some definite advantages/efficiencies to using larger HDFS block sizes if your files are as large or larger than the selected HDFS block size.