Start a Conversation

Unsolved

This post is more than 5 years old

3332

August 3rd, 2015 12:00

Use SyncIQ to copy data within a cluster.

We have a small Isilon cluster running OneFS 7.1.0.6 and we are using SyncIQ to replicate data from our production site to a DR site. One of the replicated file systems has a special requirement. The Business Unit would like to use the replicated data at our DR site to refresh a test environment. Thinking I could use SyncIQ, I setup a manual policy to replicated the data to a new location on the same cluster. The process worked fine except the test directory is now Read-Only. I know this is because I have a SyncIQ policy defined with this directory as a target. Once I delete the policy, the directory becomes Read-Write. Is there a way to get around deleting the SyncIQ job? Is there another option within OneFS to make a copy so I can refresh the environment?

254 Posts

August 3rd, 2015 12:00

If you are making a 3rd copy, then breaking the second SyncIQ relationship shouldn't be a problem.  The 2nd copy is still replicating according to the A->B schedule (although it should be noted that A->B and B->C cannot run at the same time).  If you want to write the data, you can't have it replicating at the same time.  Too many potential clashes there, especially when you consider things like file locking.  It would be very messy.

However, it sounds like you are replicating A->B, then B->C.  Once B->C completes, you can break that relationship and C is r/w.  This also works if you did A->C.

Perhaps we need to better understand the situation.

7 Posts

August 3rd, 2015 13:00

Adam,

We are replicating our SharePoint environment from site A to site B on a 10 minute interval. Our SharePoint data size is ~ 8TB. The Business Unit would like to refresh the QA environment once a month with data from production. I have found that I can create a policy to replicate the B data to a new directory (C) on the same cluster. Once complete, I have to delete the policy in order for the directory to become read/write. I was hoping to find a process or procedure which would not require me to re-create the policy every month. Should I be location at Snapshots or File Clones instead of SyncIQ? Or is there another method I am missing?

1 Rookie

 • 

20.4K Posts

August 3rd, 2015 13:00

Adam,

OP is looking for a way to refresh the C copy from time to time without performing a full copy if a refresh of the environment is needed.   You break B->C replication to make C read/write ..that's it. Next time you must do full copy.

254 Posts

August 3rd, 2015 15:00

If you don't want to keep the changes, you should not have to delete the policy, although I don't think this option is in the GUI or if it is, I haven't found it. 

So you "allow writes" on the destination C.  Then do your testing.

Then when you're ready to go back, try the CLI:

isi sync recovery --revert

Try this on some test data first, just to be sure.  I just did it in my lab.  I set up a policy running every 10 mins from Cluster A to Cluster B.  Then I set up a second policy to sync locally on cluster B to a different directory.  Then under "Local Targets", I selected "Allow Writes".  Then I touched a new file.  Then on Cluster B I issued the command above.  When the job finished, my 2nd copy was r/o again, and my newly touched file was gone.

Like I said, try it on some test data to be sure, but I think this does it.

254 Posts

August 3rd, 2015 15:00

Small update.  So the --revert command appears to simply puts the target back to the state when you broke it.  Then it updated at the next run of the job (mine was manual).

1 Message

August 3rd, 2015 15:00

I would write a script to:

*Create the policy

*Sync the data

*Delete the policy

You can cron it, or run it manually every time your users request a refresh.

1 Rookie

 • 

20.4K Posts

August 3rd, 2015 20:00

AdamFox wrote:

Small update.  So the --revert command appears to simply puts the target back to the state when you broke it.  Then it updated at the next run of the job (mine was manual).

if files on target were deleted or modified while it was in "Allow Writes" state, do they get re-copied ?

1 Rookie

 • 

20.4K Posts

August 3rd, 2015 20:00

bnajera wrote:

I would write a script to:

*Create the policy

*Sync the data

*Delete the policy

You can cron it, or run it manually every time your users request a refresh.

you are missing the point of what we are trying to do here.

254 Posts

August 3rd, 2015 21:00

I didn't try that, but it should as long as your job is of type "Sync" and not "Copy"

No Events found!

Top