Highlighted
8 Krypton

isi_vol_copy output statistics

Jump to solution

Wanted to see if anyone knew how the checkpoint statistics are calculated in the isi_vol_copy output - and if the last reported (Checkpoint 6) is supposed to be reflective of the total migrated or if this is simply the last checkpoint and additional data is being migrated for some period after the checkpoint returns the status - which would explain the discrepancy below:

Below is the output from a test migration using isi_vol_copy. The command output states that 1135 files were transferred and 6295886 KB were transferred.

But looking at the actual directory from within an SSH session on the Isilon box, the true file count is 1771 files and 9317723 KB.

Starting MigrationContext 0: Created
Migration 3_69185_1416601607: Saving Checkpoint 0: ino=0 files=0 pos=0 KB rolls=0 file= where=0 off=0 KB
Migration 3_69185_1416601607: Saved Checkpoint 0 State=Starting
Started Migration\nLogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: creating \"/vol/KeithTestVol2/../snapshot_for_backup.20767\" snapshot.
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: Using Full Volume Dump
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: Using single-pass walkthrough
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: Dumping to remote NDMP server.
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: Date of this level 0 dump: Fri Nov 21 14:26:47 2014.
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: Date of last level 0 dump: the epoch.
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: Dumping /vol/KeithTestVol2 to NDMP connection
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: mapping (Pass I)[regular files]
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: mapping (Pass II)[directories]
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: estimated 6889086 KB.
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: dumping (Pass III) [directories]
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: dumping (Pass IIIa) [ACLfile]
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: dumping (Pass IIIb) [File Offset Information]
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: dumping (Pass IV) [regular files]
} {associated_msg 0} {associated_msg_seq 0}
Migration 3_69185_1416601607: Saving Checkpoint 1: ino=42681 files=232 pos=1050470 KB rolls=0 file=./After Earth (2013)/After Earth (2013).mkv where=1 off=984064 KB
Migration 3_69185_1416601607: Saved Checkpoint 1 State=Running
Migration 3_69185_1416601607: Saving Checkpoint 2: ino=42681 files=232 pos=2099555 KB rolls=0 file=./After Earth (2013)/After Earth (2013).mkv where=1 off=2031104 KB
Migration 3_69185_1416601607: Saved Checkpoint 2 State=Running
Migration 3_69185_1416601607: Saving Checkpoint 3: ino=42681 files=232 pos=3148640 KB rolls=0 file=./After Earth (2013)/After Earth (2013).mkv where=1 off=3078144 KB
Migration 3_69185_1416601607: Saved Checkpoint 3 State=Running
Migration 3_69185_1416601607: Saving Checkpoint 4: ino=42681 files=232 pos=4197725 KB rolls=0 file=./After Earth (2013)/After Earth (2013).mkv where=1 off=4125184 KB
Migration 3_69185_1416601607: Saved Checkpoint 4 State=Running
Migration 3_69185_1416601607: Saving Checkpoint 5: ino=201363 files=1135 pos=5246801 KB rolls=0 file=./Colombiana/Colombiana .mp4 where=1 off=166912 KB
Migration 3_69185_1416601607: Saved Checkpoint 5 State=Running
Migration 3_69185_1416601607: Saving Checkpoint 6: ino=201363 files=1135 pos=6295886 KB rolls=0 file=./Colombiana/Colombiana .mp4 where=1 off=1213952 KB
Migration 3_69185_1416601607: Saved Checkpoint 6 State=Running
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: dumping (Pass V) [ACLs]
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: 6891239 KB
} {associated_msg 0} {associated_msg_seq 0}
LogMessage {type NDMP_LOG_NORMAL} {msg_id 0} {msg DUMP: DUMP IS DONE
} {associated_msg 0} {associated_msg_seq 0}
Migration 3_69185_1416601607: Saving Checkpoint 6: ino=201363 files=1135 pos=6295886 KB rolls=0 file=./Colombiana/Colombiana .mp4 where=1 off=1213952 KB
Migration 3_69185_1416601607: Saved Checkpoint 6 State=Finishing
Waiting for restore to finish
Migration 3_69185_1416601607: Saving Checkpoint 6: ino=201363 files=1135 pos=6295886 KB rolls=0 file=./Colombiana/Colombiana .mp4 where=1 off=1213952 KB
Migration 3_69185_1416601607: Saved Checkpoint 6 State=Completed
Context 0: Deleted
Migration 3_69185_1416601607: Deleting Checkpoint
Migration 3_69185_1416601607: Deleted
Migration 3_69185_1416601607 completed successfully
Elapsed time: 0 hours, 2 minutes, 6 seconds.

Thanks,

JohnMc......

Labels (1)
0 Kudos
1 Solution

Accepted Solutions
8 Krypton

Re: isi_vol_copy output statistics

Jump to solution


The output that you are referencing is related to isi_vol_copy working with the NDMP Backup Restartable Extension (BRE) functionality that NetApp implemented. During a NDMP backup and for isi_vol_copy, the NetApp periodically takes restartable checkpoints. The checkpoints provide a way to restart a transfer that may have been interrupted.

0 Kudos
2 Replies
8 Krypton

Re: isi_vol_copy output statistics

Jump to solution


The output that you are referencing is related to isi_vol_copy working with the NDMP Backup Restartable Extension (BRE) functionality that NetApp implemented. During a NDMP backup and for isi_vol_copy, the NetApp periodically takes restartable checkpoints. The checkpoints provide a way to restart a transfer that may have been interrupted.

0 Kudos
8 Krypton

Re: isi_vol_copy output statistics

Jump to solution

Thanks Scott - that confirms what we suspected.

0 Kudos