Highlighted
tolejniczak
1 Nickel

RMAN cannot find Networker save sets

(Follow up from the previous questions: Recovering rman data from Networker, Restoring expired save set information into client index with scanner).

I'm trying to add save sets that were expired to RMAN catalog.

I managed to make them browsable by running scanner -i -S on them:

mminfo -avot -s bdlbkp -q "client=sdbkp"

volume        client           date     time         size ssid      fl   lvl name

...

SD56LT         sdbkp         09/06/15 01:08:39  362 GB 1961587746 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sdbkp         09/06/15 01:08:40  300 GB 1877702207 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sd1-bak       09/06/15 01:08:51  850 MB 1944810534 cE incr /opt/oracle

SD34LT         sd1-bak       09/06/15 01:09:36  167 KB 1928033363 cE incr /home

SD34LT         sd1-bak       09/06/15 01:09:41  521 MB 1911256152 cE incr /var

SD34LT         sd1-bak       09/06/15 01:10:31   32 MB 1894478986 cE incr /

SD34LT         sdbkp         09/06/15 03:18:30  141 GB 1676382857 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 03:25:14  130 GB 1659606044 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 04:05:35  122 GB 1642831250 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sdbkp         09/06/15 04:06:52  124 GB 1626054111 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 04:44:41  123 GB 1592501947 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sdbkp         09/06/15 04:49:39  113 GB 1575725030 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 05:21:07  117 GB 1558949702 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sdbkp         09/06/15 05:26:33  113 GB 1542172812 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 05:59:13  106 GB 1525397555 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sdbkp         09/06/15 06:04:00   96 GB 1508620626 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 06:26:58   84 GB 1491844789 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sdbkp         09/06/15 06:37:06   84 GB 1475068180 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 06:56:14   77 GB 1458292112 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sdbkp         09/06/15 07:05:42   75 GB 1441515465 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 07:21:40   77 GB 1424739206 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sdbkp         09/06/15 07:30:47   66 GB 1407962538 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 07:48:45   59 GB 1391186399 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sdbkp         09/06/15 07:56:23   62 GB 1374409641 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 08:08:10   60 GB 1357633132 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sdbkp         09/06/15 08:15:28   55 GB 1340856354 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 08:27:35   59 GB 1324079865 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sdbkp         09/06/15 08:34:23   51 GB 1307303057 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 08:47:40   45 GB 1290526637 cb full RMAN:/home/scripts/sddb_backup.rcv

SD34LT         sdbkp         09/06/15 08:55:56 5973 MB 1273749918 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 08:59:32   20 MB 1256972918 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 09:00:07  665 MB 1240195907 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 09:00:08  526 MB 1223418691 cb full RMAN:/home/scripts/sddb_backup.rcv

SD56LT         sdbkp         09/06/15 09:03:27   20 MB 1206641505 cb full RMAN:/home/scripts/sddb_backup.rcv

...

nsrinfo -vV -n oracle -s bdlbkp sdbkp

...

UNIX file `c-3276482839-20150906-01', size=21496640, off=0, app=oracle(25), date=1441523007 Sun Sep 06 09:03:27 2015, (unknown fid), file size=0

UNIX file `al_SDDB_200610_889693204', size=538984688, off=0, app=oracle(25), date=1441522808 Sun Sep 06 09:00:08 2015, (unknown fid), file size=0

UNIX file `al_SDDB_200609_889693204', size=681595376, off=0, app=oracle(25), date=1441522807 Sun Sep 06 09:00:07 2015, (unknown fid), file size=0

UNIX file `c-3276482839-20150906-00', size=21496640, off=0, app=oracle(25), date=1441522772 Sun Sep 06 08:59:32 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200607_889692954', size=6116792792, off=0, app=oracle(25), date=1441522556 Sun Sep 06 08:55:56 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200606_889692458', size=46307053760, off=0, app=oracle(25), date=1441522060 Sun Sep 06 08:47:40 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200605_889691660', size=52246107320, off=0, app=oracle(25), date=1441521263 Sun Sep 06 08:34:23 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200604_889691253', size=60539810144, off=0, app=oracle(25), date=1441520855 Sun Sep 06 08:27:35 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200603_889690525', size=57064198928, off=0, app=oracle(25), date=1441520128 Sun Sep 06 08:15:28 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200602_889690088', size=61785032144, off=0, app=oracle(25), date=1441519690 Sun Sep 06 08:08:10 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200601_889689380', size=64345732880, off=0, app=oracle(25), date=1441518983 Sun Sep 06 07:56:23 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200600_889688923', size=60664594496, off=0, app=oracle(25), date=1441518525 Sun Sep 06 07:48:45 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200599_889687845', size=67712551016, off=0, app=oracle(25), date=1441517447 Sun Sep 06 07:30:47 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200598_889687298', size=79842324056, off=0, app=oracle(25), date=1441516900 Sun Sep 06 07:21:40 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200597_889686340', size=77282409776, off=0, app=oracle(25), date=1441515942 Sun Sep 06 07:05:42 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200596_889685772', size=78866070008, off=0, app=oracle(25), date=1441515374 Sun Sep 06 06:56:14 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200595_889684624', size=86706774176, off=0, app=oracle(25), date=1441514226 Sun Sep 06 06:37:06 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200594_889684017', size=86992782008, off=0, app=oracle(25), date=1441513618 Sun Sep 06 06:26:58 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200593_889682638', size=98760260984, off=0, app=oracle(25), date=1441512240 Sun Sep 06 06:04:00 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200592_889682351', size=108800420432, off=0, app=oracle(25), date=1441511953 Sun Sep 06 05:59:13 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200591_889680392', size=116098732112, off=0, app=oracle(25), date=1441509993 Sun Sep 06 05:26:33 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200590_889680065', size=120126697592, off=0, app=oracle(25), date=1441509667 Sun Sep 06 05:21:07 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200589_889678176', size=116582664704, off=0, app=oracle(25), date=1441507779 Sun Sep 06 04:49:39 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200588_889677879', size=126425423696, off=0, app=oracle(25), date=1441507481 Sun Sep 06 04:44:41 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200587_889675609', size=127053015584, off=0, app=oracle(25), date=1441505212 Sun Sep 06 04:06:52 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200586_889675532', size=125651288840, off=0, app=oracle(25), date=1441505135 Sun Sep 06 04:05:35 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200585_889673111', size=133951021160, off=0, app=oracle(25), date=1441502714 Sun Sep 06 03:25:14 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200584_889672694', size=144908974760, off=0, app=oracle(25), date=1441502310 Sun Sep 06 03:18:30 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200583_889664916', size=307744951712, off=0, app=oracle(25), date=1441494520 Sun Sep 06 01:08:40 2015, (unknown fid), file size=0

UNIX file `db_SDDB_200582_889664916', size=370854899888, off=0, app=oracle(25), date=1441494519 Sun Sep 06 01:08:39 2015, (unknown fid), file size=0

6828 objects found

However when I try to add them to catalog RMAN is unable to find them:

RMAN> catalog device type 'SBT_TAPE' backuppiece 'db_SDDB_200582_889664916';

starting full resync of recovery catalog

full resync complete

allocated channel: ORA_SBT_TAPE_1

channel ORA_SBT_TAPE_1: sid=166 devtype=SBT_TAPE

channel ORA_SBT_TAPE_1: NMO v4.2.0.0

allocated channel: ORA_SBT_TAPE_2

channel ORA_SBT_TAPE_2: sid=195 devtype=SBT_TAPE

channel ORA_SBT_TAPE_2: NMO v4.2.0.0

allocated channel: ORA_SBT_TAPE_3

channel ORA_SBT_TAPE_3: sid=84 devtype=SBT_TAPE

channel ORA_SBT_TAPE_3: NMO v4.2.0.0

allocated channel: ORA_SBT_TAPE_4

channel ORA_SBT_TAPE_4: sid=119 devtype=SBT_TAPE

channel ORA_SBT_TAPE_4: NMO v4.2.0.0

allocated channel: ORA_SBT_TAPE_5

channel ORA_SBT_TAPE_5: sid=77 devtype=SBT_TAPE

channel ORA_SBT_TAPE_5: NMO v4.2.0.0

allocated channel: ORA_SBT_TAPE_6

channel ORA_SBT_TAPE_6: sid=145 devtype=SBT_TAPE

channel ORA_SBT_TAPE_6: NMO v4.2.0.0

ORA-19870: error reading backup piece db_SDDB_200582_889664916

ORA-19507: failed to retrieve sequential file, handle="db_SDDB_200582_889664916", parms=""

ORA-27029: skgfrtrv: sbtrestore returned error

ORA-19511: Error received from media manager layer, error text:

   Could not locate the LNM save file 'db_SDDB_200582_889664916' on server 'bdlbkp'. (2:9:0)

RMAN-00571: ===========================================================

RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============

RMAN-00571: ===========================================================

RMAN-03002: failure of catalog command at 02/26/2016 13:35:49

RMAN-06209: List of failed objects

RMAN-06211: ==========================

RMAN-06212:   Object Type   Filename/Handle

RMAN-06213: --------------- ---------------------------------------------------

RMAN-06214: Backup Piece    db_SDDB_200582_889664916

The same error occured for:

RMAN> catalog device type 'SBT_TAPE' backuppiece 'db_SDDB_200595_889684624';

RMAN> catalog device type 'SBT_TAPE' backuppiece 'c-3276482839-20150906-00';

Is there anything more I should do on Networker side, or is this an RMAN problem?

I would appreciate any hints.

0 Kudos
1 Reply
ble1
5 Iridium

Re: RMAN cannot find Networker save sets

nsrinfo seems to show backup piece in question (db_SDDB_200582_889664916) so I would expect that perhaps some kind of permissions are blocking rman from reading it (add oracle user you are using from that host to admin list).

0 Kudos