Unsolved
This post is more than 5 years old
21 Posts
0
7705
file size differences ONEFS and Windows
Hello All,
We are in the process of implementing a new Isilon Cluster (20 x X400 10xNL) looks like we have the default level block size of 1k but when we look at a test migration file size of 1K are showing windows as 1.22Mb anyone else seen this issue ?
OneFS Version 7.0.2.1
Cheers
Paul
ryderpaul
21 Posts
0
June 26th, 2013 04:00
Hi Mark,
Its show as size on disk, all looks good from OneFs but windows explorer properties shows as 1.22MB on disk, dont believe its related to snaps as believe the snaps are meta data so just pointers back to the source unless I'm mistaken with that. ?
cincystorage
467 Posts
0
June 26th, 2013 04:00
Is it a difference of "Size" and "Size on Disk" which accounts for snapshotting?
cincystorage
467 Posts
0
June 26th, 2013 20:00
If the data has changed, you'll see an increased "Size on Disk" to account for the snapshots delta..
But I think this has more to do with the protection (N+M) the cluster is running.. Also you have two options for protection the data: Erasure Codes and Data Mirroring.. Data Mirroring takes up more space..
The Isilon Admin Guide has a nice table on the overhead caused by each protection level based on number of nodes... Its on page 144..
Jim_Hegner
212 Posts
0
June 26th, 2013 23:00
Hi all
When looking at the file in Windows Explorer, should the file not be reported at the size the file actually has, and not as a total sum of what capacity OneFS is using to store all the copies of the file due to the Flex Protection settings for the file/ cluster ???
Jim Ekberg-Hegner
osaddict
110 Posts
0
June 26th, 2013 23:00
Correct, this is related to he overhead of the file. However, that seems really large. Can you do an "isi get -DD /ifs/pathtofile" on the cluster and attach the output. This will be a lot of details about how the cluster is storing and protecting the file.
Thanks,
Jason Sturgeon
Isilon Corporate Systems Engineer
EMC²| Isilon Storage Division
ryderpaul
21 Posts
0
June 27th, 2013 02:00
Here is the isi get results
POLICY W LEVEL PERFORMANCE COAL ENCODING FILE IADDRS
default 16+2 concurrency on UTF-8 SCOM_Template.tpl <1,35,280930304:512>, <6,33,1924032000:512>, <7,34,237381120:512> ct: 1354270819 rt: 0
*************************************************
* IFS inode: [ 1,35,280930304:512, 6,33,1924032000:512, 7,34,237381120:512 ]
*************************************************
*
* Inode Version: 6
* Dir Version: 2
* Inode Revision: 5
* Inode Mirror Count: 3
* Recovered Flag: 0
* Recovered Groups: 0
* Link Count: 1
* Size: 346
* Mode: 0100770
* Flags: 0x130000e0
* Physical Blocks: 3
* LIN: 1:15cd:1a74
* Logical Size: 8192
* Shadow refs: 0
* Restripe Cursor: None
* Abort Cursor: None
* Layout cursor: None
* Last Modified: 1354270819.805201300
* Last Inode Change: 1372167284.939138070
* Create Time: 1354270819.633328500
* Rename Time: 0
* Write Caching: Enabled
* Parent Lin 1:162e:0249
* Parent Hash: 199619
* Snapshot IDs: None
* Last Paint ID: 2329
* Domain IDs: { 65542 }
* LIN needs repair: False
* Manually Manage:
* Access False
* Protection False
* Protection Policy: Diskpool default
* Current Protection: 16+2
* Future Protection: 0x
* Disk pools: policy x400_66tb_1.2tb-ssd_48gb(2) -> data target x400_66tb_1.2tb-ssd_48gb:4(4), metadata target x400_66tb_1.2tb-ssd_48gb:1(1)
* SSD Strategy: metadata-write
* SSD Status: complete
* Layout drive count: 0
* Access pattern: 0
* Data Width Device List:
* (d: 11, mar:00001000
* (d: 16, mar:80000000
* (d: 19, mar:00001000
* Meta Width Device List:
*
* File Data (77 bytes):
* Metatree Depth: 1
*
* Dynamic Attributes (91 bytes):
*
ATTRIBUTE OFFSET SIZE
Domains 0 11
NTFS ACL entries 11 15
NTFS Extended Owner/Group26 36
Disk pool policy ID 62 5
Last snapshot paint time 67 9
v5 Data wdl 76 15
PROTECTION GROUPS
lbn 0: 16+2
19,12,164405248:8192#1
0,0,0:8192#255
11,12,10672193536:8192#1
0,0,0:8192#15
16,31,9874186240:8192#1
0,0,0:8192#15
Metatree logical blocks:
zero=255 shadow=0 ditto=0 prealloc=0 block=1
3 allocated blocks
0/0 (0%) of possible blocks contiguous
*************************************************
SECURITY DESCRIPTOR OWNER/GROUP
* Owner - SID:S-1-5-21-2414399092-292161696-3476272628-23394
* Group - SID:S-1-5-21-2414399092-292161696-3476272628-513
*************************************************
*
*************************************************
cincystorage
467 Posts
0
June 27th, 2013 18:00
Well, he said files of 1k are showing up as 1.22 mb... that is what a 98x mirror data protection?
Peter_Sero
1.2K Posts
0
June 27th, 2013 23:00
I would be interested in interpreting the isi get -DD output, too. Nowhere it explicitly says 3x...
Peter
ryderpaul
21 Posts
0
June 28th, 2013 00:00
Hi Gents,
Thanks for the interest in this we just to confirm all looks good on the ofs side however when we look at the file properties from windows is shows as 1.22mb on the disk. So have raised an incident with EMC and they are saying its a possible bug between windows and samba which was seen in previous versions of ofs. So once I get confirmation of this will also be testing if the quota has any issues with this as assuming this is done from the ofs side.
Thanks again for the interest and discussions so far
osaddict
110 Posts
0
June 28th, 2013 01:00
What version of 1fs and windows client?
Sent from my iPad
ryderpaul
21 Posts
0
June 28th, 2013 04:00
OFS - Version 7.0.2.1
Windows XP
nate_anth
20 Posts
0
June 28th, 2013 08:00
I have noticed this too, and appears to be an issue in the way Windows reports the Size on Disk. The values for Size on Disk do not seem to correlate to any actual statistic of the file you are looking at.
MRWA
83 Posts
0
July 9th, 2013 08:00
Hello ryder,
What did you find out in the ticket you opened with support? I am curious about this issue.
PankajGovil
2 Posts
0
June 8th, 2019 07:00
I am curious as well :-) This is an old thread but I am researching a similar anomaly where File explorer shows the file as 25.4gb
# isi get -DD Big | grep Size
* Size: 12598398464
* Logical Size: 12598403072
# du -sh Big
14G Big
# ls -ltr Big
-rwxrwx--- + 1 root wheel 27303558656 May 30 21:39 Big