Start a Conversation

Unsolved

This post is more than 5 years old

M

1231

July 5th, 2010 03:00

How to find the rate of changed data on a volume

Hi,

I'm working on a  replication solutions for DR.  I need to know the delta changes on a volume to estimate the bandwidth requirements.  As on now, the chekpoints are set at every half-an-hour on the volume.

How to get the delta between two checkpoints?

BR

Murali

366 Posts

July 5th, 2010 06:00

Hi,

Please, see the following solution :

https://community.emc.com/docs/DOC-7340

If you simply do a server_df, you will see the difference between the checkpoints :

[root@CS_NS40_1_MSS nasadmin]# server_df server_2 |grep fs01_
fs01_ckpt5      64019696     21496632     42523064   34%    /fs01_ckpt5
fs01_ckpt4      64019696     39398480     24621216   62%    /fs01_ckpt4
fs01_ckpt3      64019696     37806448     26213248   59%    /fs01_ckpt3
fs01_ckpt2      64019696     38800664     25219032   61%    /fs01_ckpt2
fs01_ckpt1      64019696     43595360     20424336   68%    /fs01_ckpt1


The above output shows the capacity of the production file system (PFS) when each checkpoint was taken or refreshed.

Gustavo Barreto.

8.6K Posts

July 5th, 2010 14:00

note that this is the capacity at the time the ckpt was taken and not exactly the change rate

366 Posts

July 5th, 2010 16:00

Hi Rainer,

Yes, you are correct.

These values can be used as "estimated change rate" between the checkpoints.

Gustavo Barreto.

4 Posts

July 6th, 2010 00:00

Hi,

thank you for the solution.  However, I have seen no changes between the checkpoints generated.  Here is the output (I have put that in excel to format and also added date and time for reference)

Check Point Name Allotted Size Used Size Free Size % Mounted on Date Time
ckpt_data1_ckpt_Schedule_30mins_Past_Hour_028 309772784 126651728 183121056 41% /root_vdm_2/ckpt_data1_ckpt_Schedule_30mins_Past_Hour_028 04-Jul 3:30
ckpt_data1_ckpt_Schedule_30mins_Past_Hour_037 309772784 126701968 183070816 41% /root_vdm_2/ckpt_data1_ckpt_Schedule_30mins_Past_Hour_037 05-Jul 0:30
ckpt_data1_ckpt_Schedule_30mins_Past_Hour_004 309772784 126704096 183068688 41% /root_vdm_2/ckpt_data1_ckpt_Schedule_30mins_Past_Hour_004 05-Jul 3:30
ckpt_data1_ckpt_Schedule_30mins_Past_Hour_013 309772784 126710208 183062576 41% /root_vdm_2/ckpt_data1_ckpt_Schedule_30mins_Past_Hour_013 06-Jul 0:30
ckpt_data2_ckpt_Schedule_30mins_Past_Hour_028 309772784 144441616 165331168 47% /root_vdm_2/ckpt_data2_ckpt_Schedule_30mins_Past_Hour_028 04-Jul 3:30
ckpt_data2_ckpt_Schedule_30mins_Past_Hour_037 309772784 144420984 165351800 47% /root_vdm_2/ckpt_data2_ckpt_Schedule_30mins_Past_Hour_037 05-Jul 0:30
ckpt_data2_ckpt_Schedule_30mins_Past_Hour_004 309772784 144425848 165346936 47% /root_vdm_2/ckpt_data2_ckpt_Schedule_30mins_Past_Hour_004 05-Jul 3:30
ckpt_data2_ckpt_Schedule_30mins_Past_Hour_013 309772784 149275232 160497552 48% /root_vdm_2/ckpt_data2_ckpt_Schedule_30mins_Past_Hour_013 06-Jul 0:30
ckpt_data3_ckpt_Schedule_30mins_Past_Hour_028 309772784 155783992 153988792 50% /root_vdm_2/ckpt_data3_ckpt_Schedule_30mins_Past_Hour_028 04-Jul 3:30
ckpt_data3_ckpt_Schedule_30mins_Past_Hour_037 309772784 155853152 153919632 50% /root_vdm_2/ckpt_data3_ckpt_Schedule_30mins_Past_Hour_037 05-Jul 0:30
ckpt_data3_ckpt_Schedule_30mins_Past_Hour_004 309772784 155930992 153841792 50% /root_vdm_2/ckpt_data3_ckpt_Schedule_30mins_Past_Hour_004 05-Jul 3:30
ckpt_data3_ckpt_Schedule_30mins_Past_Hour_013 309772784 155935696 153837088 50% /root_vdm_2/ckpt_data3_ckpt_Schedule_30mins_Past_Hour_013 06-Jul 0:30
ckpt_data4_ckpt_Schedule_30mins_Past_Hour_028 309772784 182972344 126800440 59% /root_vdm_2/ckpt_data4_ckpt_Schedule_30mins_Past_Hour_028 04-Jul 3:30
ckpt_data4_ckpt_Schedule_30mins_Past_Hour_037 309772784 182975456 126797328 59% /root_vdm_2/ckpt_data4_ckpt_Schedule_30mins_Past_Hour_037 05-Jul 0:30
ckpt_data4_ckpt_Schedule_30mins_Past_Hour_004 309772784 182602552 127170232 59% /root_vdm_2/ckpt_data4_ckpt_Schedule_30mins_Past_Hour_004 05-Jul 3:30
ckpt_data4_ckpt_Schedule_30mins_Past_Hour_013 309772784 182646592 127126192 59% /root_vdm_2/ckpt_data4_ckpt_Schedule_30mins_Past_Hour_013 06-Jul 0:30
ckpt_data5_ckpt_Schedule_30mins_Past_Hour_013 309772784 162643624 147129160 53% /root_vdm_2/ckpt_data5_ckpt_Schedule_30mins_Past_Hour_013 04-Jul 0:30
ckpt_data5_ckpt_Schedule_30mins_Past_Hour_024 309772784 162675048 147097736 53% /root_vdm_2/ckpt_data5_ckpt_Schedule_30mins_Past_Hour_024 04-Jul 3:30
ckpt_data5_ckpt_Schedule_30mins_Past_Hour_033 309772784 166013952 143758832 54% /root_vdm_2/ckpt_data5_ckpt_Schedule_30mins_Past_Hour_033 05-Jul 0:30
ckpt_data5_ckpt_Schedule_30mins_Past_Hour_044 309772784 166037904 143734880 54% /root_vdm_2/ckpt_data5_ckpt_Schedule_30mins_Past_Hour_044 05-Jul 3:30
ckpt_data5_ckpt_Schedule_30mins_Past_Hour_005 309772784 166146264 143626520 54% /root_vdm_2/ckpt_data5_ckpt_Schedule_30mins_Past_Hour_005 06-Jul 0:30
ckpt_data6_ckpt_Schedule_30mins_Past_Hour_013 309772784 204556376 105216408 66% /root_vdm_2/ckpt_data6_ckpt_Schedule_30mins_Past_Hour_013 04-Jul 0:30
ckpt_data6_ckpt_Schedule_30mins_Past_Hour_024 309772784 204605296 105167488 66% /root_vdm_2/ckpt_data6_ckpt_Schedule_30mins_Past_Hour_024 04-Jul 3:30
ckpt_data6_ckpt_Schedule_30mins_Past_Hour_033 309772784 204615608 105157176 66% /root_vdm_2/ckpt_data6_ckpt_Schedule_30mins_Past_Hour_033 05-Jul 0:30
ckpt_data6_ckpt_Schedule_30mins_Past_Hour_044 309772784 205013280 104759504 66% /root_vdm_2/ckpt_data6_ckpt_Schedule_30mins_Past_Hour_044 05-Jul 3:30
ckpt_data6_ckpt_Schedule_30mins_Past_Hour_005 309772784 205089264 104683520 66% /root_vdm_2/ckpt_data6_ckpt_Schedule_30mins_Past_Hour_005 06-Jul 0:30

I have 6 volumes in total accessed by about 500 users 24 x 7, each volume of size 300 GB.  Data may be updated as per their requirements.  As per the above table - there are no changes at all between the checkpoints?

BR

Murali

366 Posts

July 6th, 2010 10:00

Hi,

Let's take these two ones as examples :

ckpt_data6_ckpt_Schedule_30mins_Past_Hour_033 309772784 204615608 105157176 66% /root_vdm_2/ckpt_data6_ckpt_Schedule_30mins_Past_Hour_033 05-Jul 0:30
ckpt_data6_ckpt_Schedule_30mins_Past_Hour_044 309772784 205013280 104759504 66% /root_vdm_2/ckpt_data6_ckpt_Schedule_30mins_Past_Hour_044 05-Jul 3:30

When ckpt_data6_ckpt_Schedule_30mins_Past_Hour_033 was created or refreshed, the PFS had 204615608 used.

When ckpt_data6_ckpt_Schedule_30mins_Past_Hour_044 was created or refreshed, the PFS had 205013280 used.

There are changes between the checkpoints.

You can see when they were created or refreshed with :

# nas_fs -i ckpt_data6_ckpt_Schedule_30mins_Past_Hour_033 |grep checkpt_of

# nas_fs -i ckpt_data6_ckpt_Schedule_30mins_Past_Hour_044 |grep checkpt_of

As previously said, this is not the precise change rate, but you can use the difference as a reference.

Gustavo Barreto.

190 Posts

July 8th, 2010 05:00

A much less-granular but another way to look at the volumes is to check your "level 1" backups - it won't pick up temporary "things" but it will show you what is being added and modified for the day.  Depending upon the workload (i.e. it is a file server for end users that don't create tons of temporary/transient files) this might be a good indicator for the total adds/modifies for a day.  The checkpoints pick up deletes and while they are "replicated" I don't think they would make you consume a lot of bandwidth.  Of course, looking at it this way doesn't show you the highs and lows you may experience throughout the day...

Dan

4 Posts

July 12th, 2010 05:00

Hi,

I have started calculating the difference between the checkpoints and found to be a good base to understand the rate of data change. I thank you all for the help.

Murali

No Events found!

Top