ERROR: 0001 Message exceeded retry count in retry.cpp 6773 count=39

Question

Hi guys, I am trying to find out if i am having network problems or if there is a problem with my Grid. I am getting the following error in some of my backup logs. The error code in the event guide for Avamar 5 Claims it's obsolete. I have repatched this solution to a single fabric backed bone blade on our Cisco 6500 series switch. It should have 'Plenty' of bandwidth. The solution has 9 physical nodes in the grid and 7 are productive servers. CODE : 303GENERATED BY : DPN:UNKNOWNSUMMARY : *** OBSOLETE *** MESSAGE EXCEEDED RETRY COUNT IN RETRY.CPP %D COUNT=%DCATEGORY : SYSTEMTYPE : ERRORSEVERITY : 2:PROCESSDESCRIPTION :FOR WHOM : FIELD SUPPORT PERSONNELREMEDY : CONTACT PRODUCT SUPPORTNOTES : 2011-04-16 18:21:37 avtar Info <5548>: 2011-04-16 18:21:37 AUS Eastern Standard Time: Automatic cache flush of c:\Program Files\avs\var\f_cache.dat2011-04-16 18:21:37 avtar Info <5069>: - Writing cache file c:\Program Files\avs\var\f_cache.dat2011-04-16 18:22:15 avtar Info <5546>: - Cache update complete c:\Program Files\avs\var\f_cache.dat (352.0MB of 511MB max)2011-04-16 18:30:07 avtar Info <5100>: Status 2011-04-16 18:30:07, 175,865 files, 24,264 folders, 82.78 GB (136 files, 653.0 KB, 0.00% new) 478MB 29% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 18:45:07 avtar Info <5100>: Status 2011-04-16 18:45:07, 181,934 files, 25,372 folders, 84.46 GB (136 files, 653.0 KB, 0.00% new) 478MB 1% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 18:47:24 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (300 seconds)2011-04-16 18:52:25 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (600 seconds)2011-04-16 18:57:25 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (900 seconds)2011-04-16 19:00:06 avtar Info <5100>: Status 2011-04-16 19:00:06, 224,189 files, 28,810 folders, 98.04 GB (136 files, 653.0 KB, 0.00% new) 478MB 9% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 19:02:26 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (1200 seconds)2011-04-16 19:07:26 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (1500 seconds)2011-04-16 19:12:27 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (1800 seconds)2011-04-16 19:15:07 avtar Info <5100>: Status 2011-04-16 19:15:07, 224,189 files, 28,810 folders, 98.04 GB (136 files, 653.0 KB, 0.00% new) 478MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 19:17:27 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (2100 seconds)2011-04-16 19:22:28 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (2400 seconds)2011-04-16 19:24:12 avtar Info <7645>: Server(My_Avamar_Grid) is back (2503 seconds)2011-04-16 19:30:06 avtar Info <5100>: Status 2011-04-16 19:30:06, 224,190 files, 28,811 folders, 98.07 GB (136 files, 653.0 KB, 0.00% new) 478MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 19:36:59 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (300 seconds)2011-04-16 19:37:31 avtar Info <7645>: Server(My_Avamar_Grid) is back (331 seconds)2011-04-16 19:45:06 avtar Info <5100>: Status 2011-04-16 19:45:06, 224,190 files, 28,811 folders, 98.07 GB (136 files, 653.0 KB, 0.00% new) 478MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 20:00:06 avtar Info <5100>: Status 2011-04-16 20:00:06, 224,195 files, 28,813 folders, 98.07 GB (136 files, 653.0 KB, 0.00% new) 478MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 20:15:07 avtar Info <5100>: Status 2011-04-16 20:15:07, 224,195 files, 28,813 folders, 98.07 GB (136 files, 653.0 KB, 0.00% new) 478MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 20:30:07 avtar Info <5100>: Status 2011-04-16 20:30:07, 224,214 files, 28,813 folders, 98.07 GB (136 files, 653.0 KB, 0.00% new) 479MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 20:45:07 avtar Info <5100>: Status 2011-04-16 20:45:07, 224,214 files, 28,813 folders, 98.07 GB (136 files, 653.0 KB, 0.00% new) 479MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 20:50:26 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (300 seconds)2011-04-16 20:50:57 avtar Info <7645>: Server(My_Avamar_Grid) is back (330 seconds)2011-04-16 20:55:58 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (300 seconds)2011-04-16 21:00:06 avtar Info <5100>: Status 2011-04-16 21:00:06, 224,232 files, 28,818 folders, 98.08 GB (136 files, 653.0 KB, 0.00% new) 479MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 21:00:58 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (600 seconds)2011-04-16 21:02:13 avtar Info <7645>: Server(My_Avamar_Grid) is back (674 seconds)2011-04-16 21:15:07 avtar Info <5100>: Status 2011-04-16 21:15:07, 224,232 files, 28,818 folders, 98.08 GB (136 files, 653.0 KB, 0.00% new) 479MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 21:25:22 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (300 seconds)2011-04-16 21:27:14 avtar Info <7645>: Server(My_Avamar_Grid) is back (411 seconds)2011-04-16 21:30:07 avtar Info <5100>: Status 2011-04-16 21:30:07, 224,232 files, 28,818 folders, 98.08 GB (136 files, 653.0 KB, 0.00% new) 479MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 21:33:57 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (300 seconds)2011-04-16 21:38:57 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (600 seconds)2011-04-16 21:43:58 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (900 seconds)2011-04-16 21:45:07 avtar Info <5100>: Status 2011-04-16 21:45:07, 224,233 files, 28,818 folders, 98.08 GB (136 files, 653.0 KB, 0.00% new) 479MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 21:48:58 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (1200 seconds)2011-04-16 21:53:59 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (1500 seconds)2011-04-16 21:55:41 avtar Info <7645>: Server(My_Avamar_Grid) is back (1601 seconds)2011-04-16 22:00:06 avtar Info <5100>: Status 2011-04-16 22:00:06, 224,233 files, 28,820 folders, 98.08 GB (136 files, 653.0 KB, 0.00% new) 479MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 22:00:41 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (300 seconds)2011-04-16 22:02:12 avtar Info <7645>: Server(My_Avamar_Grid) is back (390 seconds)2011-04-16 22:09:54 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (300 seconds)2011-04-16 22:10:52 avtar Info <7645>: Server(My_Avamar_Grid) is back (357 seconds)2011-04-16 22:15:07 avtar Info <5100>: Status 2011-04-16 22:15:07, 224,233 files, 28,820 folders, 98.08 GB (136 files, 653.0 KB, 0.00% new) 479MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011-04-16 22:18:23 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (300 seconds)2011-04-16 22:18:42 avtar Info <7645>: Server(My_Avamar_Grid) is back (318 seconds)2011-04-16 22:23:43 avtar Info <7644>: Server(My_Avamar_Grid) not responding (possible network congestion?) (300 seconds)2011-04-16 22:24:12 avtar Info <7645>: Server(My_Avamar_Grid) is back (328 seconds)2011-04-16 22:30:07 avtar Info <5100>: Status 2011-04-16 22:30:07, 224,233 files, 28,820 folders, 98.08 GB (136 files, 653.0 KB, 0.00% new) 479MB 0% CPU D:\Users\boyerf\HISP ests\si-wo-complete-pid-production-http-v3-soapui-project.xml2011/04/16-12:31:19.72600 [retry] ERROR: <0001> Message exceeded retry count in retry.cpp 6773 count=392011/04/16-12:32:58.82699 [retry] ERROR: <0001> Message exceeded retry count in retry.cpp 6780 count=362011-04-16 22:32:58 avtar Error <5774>: Internal Error: backtree: ADD_HASH timeout error2011-04-16 22:32:58 avtar Info <5726>: Aborting backup due to error (1:EXC_TIMEOUT)2011-04-16 22:32:59 avtar FATAL <5397>: Server timeout: Communication failure with server, aborting2011-04-16 22:32:59 avtar Info <7833>: Finished at 2011-04-16 22:32:59 AUS Eastern Standard Time, Elapsed time: 0004h:32m:52s2011-04-16 22:32:59 avtar Info <6149>: Error summary: 4 errors: 5397, 5774, 1(2)2011-04-16 22:32:59 avtar Info <8418>: Sending wrapup message to parent2011-04-16 22:32:59 avtar Info <5314>: Command failed (4 errors, exit code 10007: Miscellaneous error)2011-04-16 22:32:59 avtar Warning <5887>: Possible Windows Domain Controller issue: Windows Security ID lookups: Good: 1769 in 9.44 secs = 5.3ms avg, Bad: 268 in 1.38 = 5.1ms avg2011-04-16 22:33:18 avtar Warning <6830>: Sent partial encrypted buffer in ssl_sspi::sendfunc ------------------------------------------------------------------------------------------------------------- END avtar log 2011-04-16 22:33:18 AUS Eastern Standard Time (2 warnings, 4 errors, 1 fatal error)--------------------------------------------------------------------------------------------------------

Sandeep_Sinha · Answer

Hi Scott, Please check this article : http://solutions.emc.com/EMCSolutionView.asp?id=esg116165&usertype=C Thanks, Sandeep.

Avamar

Was this post helpful?