UNSOLVED

Andrey_ALexeev

updated

16 years ago

0

8021

October 15th, 2010 04:00

Problem with Celera NDMP over IP backup.

Hi All,

Hope I can get a help here. I have a problem last 3 days with NDMP backup one of 2 directory.

BackUp software Symantec BackUpExec 2010, last OK backup 10 OCT 2010. All backUp later finished with error

Backup set #60 on storage media #20

NDMP Log Message: Medium error

NDMP Log Message: Write failed on archive volume 1

NDMP Log Message: server_archive: emctar vol 1, 1097662 files, 0 bytes read, 1344562659328 bytes written

NDMP Data Halted: Internal Error

NDMP Log Message: Mover: Data connection socket read error.

NDMP Mover Halted: Internal Error

================ NDMP ENVIRONMENT ================

FILESYSTEM=/Dept

LEVEL=0

DUMP_DATE=-1

UPDATE=Y

HIST=Y

SNAPSURE=Y

TYPE=dump

=============== NDMP ENVIRONMENT END ===============

I have secondary File System /Users in this Job with the same param and this FS backuped ok without any errors.

  • 1520

    0

    Posted October 15th, 2010 04:00

    It is so huge

    2010-10-15 06:41:26: NDMP: 4: Session 152 (thread ndmp152) tape service is on a remote side, CALLER_ADDRESS 0x11ef61f.
    2010-10-15 06:41:26: NDMP: 4: Thread ndmp152 uses a set of Pax threads with handle 0.
    2010-10-15 06:41:26: NDMP: 6: Thread ndmp152 filterDialect could not be set - prereqs not met [pax_cmd_thread::setFilterDialect]
    2010-10-15 06:41:26: NDMP: 4: Thread ndmp152 fsSize of /automaticNDMPCkpts/automaticTempNDMPCkpt66-43-1287110480 is 2205971881984 (../pax_ndmp.cxx: 1184)
    2010-10-15 06:41:26: ADMIN: 6: Command succeeded : serverMount ckpt ro /automaticNDMPCkpts/automaticTempNDMPCkpt66-43-1287110480 289=174 ro
    2010-10-15 06:41:27: PAX: 6: Thread nasa00 dedup backup ratio threshold of /Dept is 90%
    2010-10-15 06:41:27: DEDUPE: 6: Domain initialized for fsid 174
    2010-10-15 07:12:30: LGDB: 6: Restricted Groups enforced for msk-fps63
    2010-10-15 08:47:31: LGDB: 6: last message repeated 1 times
    2010-10-15 09:27:28: NDMP: 3: Session 152 (thread nasw00) remoteWriteMsg network timeout! timeout =30
    2010-10-15 09:27:28: NDMP: 3: Session 152 (thread nasw00) NdmpdSession::ndmpdApiWrite fails in local or remote wirte msg, moverAddressType=1, mp=0x262a9a8
    2010-10-15 09:27:28: NDMP: 3: Thread bkup028 Medium error
    2010-10-15 09:27:28: NDMP: 3: < LOG type: 2, msg_id: 0, entry: Medium error, hasAssociatedMsg: 0, associatedMsgSeq: 0 >
    2010-10-15 09:27:28: NDMP: 4: Thread bkup028 Write failed on archive volume 1
    2010-10-15 09:27:28: NDMP: 4: < LOG type: 3, msg_id: 0, entry: Write failed on archive volume 1, hasAssociatedMsg: 0, associatedMsgSeq: 0 >
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 Backup root directory: /Dept
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 write count 193113817088
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 time used 9963 sec
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 write rate 18927 KB/Sec
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 read rate 0 KB/Sec
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 average file size: 2290KB
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 dir  or   0  size file processed: 9583
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00   1B -- 8KB  size file processed: 5462
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00  8KB -- 16KB size file processed: 2010
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 16KB -- 32KB size file processed: 7837
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 32KB -- 64KB size file processed: 9515
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 64KB -- 1MB  size file processed: 30032
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00  1MB -- 32MB size file processed: 16760
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 32MB -- 1GB  size file processed: 1145
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00    1G more   size file processed: 9
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 Dedup files processed: 25531
    2010-10-15 09:27:28: NDMP: 6: Thread nasa00 server_archive: emctar vol 1, 82353 files, 0 bytes read, 193113817088 bytes written

    2010-10-15 09:27:28: NDMP: 4: Got stat buffer with data pointer=NULL at 1557, abort=1
    2010-10-15 09:27:28: NDMP: 4: Thread nasa00 cifs_ea new count: 31000998, delete count: 31000998, freeListCount: 129

  • Rainer_EMC

    6 Operator

    •

    8645 Posts

    1520

    0

    Posted October 15th, 2010 04:00

    I would suggest to look at the data mover log via server_log to see if there are any errors there at the time the backup fails

    Rainer

  • 1520

    0

    Posted October 15th, 2010 06:00

    We have a problem with dedube on this FS, problem with SaVolCapacity. Maybe it is also impct on BackUp?

  • bergec

    275 Posts

    1520

    0

    Posted October 15th, 2010 10:00

    Have you checker for bad tapes (media errors) ?

    Claude

  • 1520

    0

    Posted October 15th, 2010 13:00

    I'll also chime in - on a busy system (control station too busy, slow SATA disks, etc.), you may not be able to create checkpoints before the timeout expires.  This can also cause the backup to fail.

    Karl

  • Rainer_EMC

    6 Operator

    •

    8645 Posts

    1520

    0

    Posted October 15th, 2010 13:00

    Yes, if you are using NDMP with integrated checkpoints than a savvol at capacity could cause the checkpoint to go inactive and the backup to fail

    Rainer

  • 900

    0

    Posted October 18th, 2010 00:00

    Understand. What is recommendation?

    Also. I have another problem last weekend. At last Friday I just create snapshot on problem FS and remove it from main backup. During weekend all my backup jobs finished ok and when NS120 was idle new NDMP job with problem FS was started. Job finished OK, but I have one notification something about - Backup finished ok but system can`t cound and enumerate files thus you can see zero in job size. Something like this. When I opened jobs I saw that all files which name in cyrilic chars is unrecognized, it seems like in diferent code page! I never saw this before.

  • Rainer_EMC

    6 Operator

    •

    8645 Posts

    900

    0

    Posted October 18th, 2010 00:00

    I would suggest to open a service request and let customer service investigate

    Rainer

  • 900

    0

    Posted October 18th, 2010 01:00

    Case was opened last Friday before lunch, still have not help ))

    I have only EMC document described my problem with deduplication 210954, I think problem with deduplication abd backup it is a consequences reason is SavVol prblem.

  • DanJost

    190 Posts

    1332

    0

    Posted October 18th, 2010 08:00

    Was this set in the initial release or has this changed?  Also, wouldn't this still contribute to savvol issues by using all of the available space and the next "snapshot" (be it replication, integrated snapsure backup, etc) could potentially need more space to be allocated?