Start a Conversation

This post is more than 5 years old

Solved!

Go to Solution

4278

December 3rd, 2010 06:00

Import BTP files into SPA, Is that possible!

Is there any way to import old performance data into SPA?

I'm "always" copying all our BTP file to my local drive where I can start Performance Manager and analyze data really quickly, So now when we are starting to use SPA I was thinking if there was anyway to populate SPA with old performance data....

/Lars

1 Rookie

 • 

20.4K Posts

December 3rd, 2010 13:00

highly unlikely. SPA uses mySQL database and BTP is a binary file. Maybe you can figure out which tables in the mySQL database correspond to fields in a ttp file and import that data.

46 Posts

December 7th, 2010 01:00

I was hoping that some EMC'er would have built a import routine for this :-)

5 Practitioner

 • 

274.2K Posts

December 8th, 2010 11:00

Lars,  Dynamox is correct.  SPA does not understand .btp files.  I wish it did too or at least provided some files that could be dowloaded and worked offline.

46 Posts

December 9th, 2010 01:00

....

I might try to find out the structure of the mySQL DB... and  write an import routine from BTP to the mySQL.... But time and  knowledge might be an issue... :-)

Is there a standard connection name and password for the SPA DB (a jdbc connection URL :-) ?

e.g. .... jdbc:mysql://localhost:3306/database

I use Crystal Reports for Eclipse quite much for reporting from StorageScope, DPA and custom DB's... would like to find out the mySQL DB structure to se if any useful reports might be built :-)

Any way need to tackle the time issues, there is so many things that are fun and so little time :-)

5 Practitioner

 • 

274.2K Posts

December 9th, 2010 06:00

Sorry Lars, I do not have an answer to your question, and would not even know who to contact for this information.  Hopefully someone else can provide some insight.

40 Posts

December 9th, 2010 07:00

On page 7 in the Tools section of the Symmetrix Performance Workshop Student Guide, it reads:

Performance Manager, you can import the older Performance Manager to preserve the history of
your existing arrays. The data will be read from Performance Manager’s BTP files into the
Symmetrix Performance Analyzer MySQL database. Once you import the old archives, you
should configure Symmetrix Performance Analyzer to collect its own data on the existing arrays
so that data will be updated automatically.

You can only import archives from arrays that have already been discovered by Symmetrix
Performance Analyzer. In other words, the Symmetrix ID in the BTP file must match an array
already in Symmetrix Performance Analyzer. When read, the large number of Performance
Manager metrics will be reduced to just the key performance indicators that Symmetrix
Performance Analyzer records."

That is the only reference to this that I can find.  I am scheduled for this class on Monday and I will see what the instructor says about it and let you know.

46 Posts

December 9th, 2010 20:00

:-) .... now I'm happy ... need to se if it's still there in 2.x.. than's "the_san_man" for triggering me to look deeper!

From SPA Installation Guide 1.0 pn 300-007-397 ....

--- cut ---

The SPA Metric Import Tool (SMIT) is a Symmetrix Performance
Analyzer CLI application used to extract metric data from ECC
Performance Manager daily files, convert them to Key Performance
Indicators (KPIs) and store them in the SPA database.

The SMIT application is intended as a resource to jump start a new
SPA installation by using pre-existing customer performance data in
BTP format to populate the SPA database using the existing SPA
server functionality.

--- paste ---

/Lars

46 Posts

December 13th, 2010 01:00

Well half way there BUT....

  1. I don't belief that the jar file called smit.jar can handle V-MAX as it "bails out" ~indicating 8G, and as the FA "G" is unique to V-MAX my simple conclusion is that smit.jar is only built for DMX'es
  2. The export workes fine for DMX I used this command:
    C:\WLA>java -Xms256M -Xmx768M -jar smit.jar EXPORT ..\Archive\Symmetrix\000290101917 -symmids 000290101917 -out c:\wla
  3. The import command failed (after a wile), sorry i lost the log of that...:
    X:\000290101917>D:\"Program Files"\EMC\SPA\litewave\jre\bin\java -Xms256M -Xmx768M -jar ..\smit.jar IMPORT -symmids 000290300232 -dir x:\000290101917

The IMPORT did not result in more data showing up in SPA :-( and I don't known if the IMPORT did any population of the mySQL DB or not ... But during the import both the SPA process and the mySQL DB process consumed much CPU cycles so I assume that some this happened..

Is there any EMC'er that can awnser if the smit.jar file should word in SPA 2.x or not?

/Lars

40 Posts

December 22nd, 2010 11:00

The instuctor of the class I attended directed me to the user guide of SPA 1.x.  The guide lists using smit.jar as Lars has posted. I was unsuccessful in getting data imported running the pre-SMAS version of SPA. I will be trying to import again here shortly when time is available.

Good luck.  If anyone has sucess in getting BTP data imported into SPA/SMAS, please let us know what you did.

Mike

21 Posts

January 10th, 2011 10:00

I was also unsuccessful at importing WLA data into SPA.  The export operation seemed to work okay (took about 20 minutes, generated about 400MB of data across 1,273 _ .dcf.gz files), but I haven't been able to import the data into SPA.  I'm running SPA v2.1, SMC v7.2 and SE v7.2 from the same system (Windows Server 2008) and have copied the WLA SMIT-exported files locally to this server in c:\temp\wla\000 .

When I try importing (command below) I see it adding each of the hourly dcf.gz files, then I receive receive an error after it starts the import.

c:>java -jar c:\temp\wla\smit.jar IMPORT -symmids 000 -dir c:\temp\wla\000

Smit V1.00
----------
01/10/2011 13:24:48.2448 [com.emc.smit.cli.Smit]Spa Metric Import Tool
01/10/2011 13:24:48.2448 [com.emc.smit.cli.Smit]Thread: 1. Data IMPORT started...
01/10/2011 13:24:48.2448 [com.emc.smit.engine.SendSpaFiles]Thread: 1. Adding:201011120900_000 .dcf.gz

...

...
01/10/2011 13:24:48.2448 [com.emc.smit.engine.SendSpaFiles]Thread: 8. Starting IMPORT...
01/10/2011 13:24:49.2449 [com.emc.smit.engine.SendSpaFiles]Thread: 8. Error in Connection: Software caused connection abort: socket write error
01/10/2011 13:24:49.2449 [com.emc.smit.cli.Smit]Thread: 1. Data IMPORT completed.

EDIT: The data is for a DMX-3 system

46 Posts

January 11th, 2011 00:00

Hi MR R

Have you tried to increase the java memory ?

I had some error when I tried (that I don't recall) but after increasing the Java memory parameters to "-Xms256M -Xmx768M" it worked all the way, BUT no reaction within SPA for the imported data....

21 Posts

January 11th, 2011 05:00

I just tried setting the java memory values and receive the same error.  The updated command to import data I used was:

c:>java -Xms256M -Xmx768M -jar c:\temp\wla\smit.jar IMPORT -symmids 000 -dir c:\temp\wla\000

165 Posts

April 29th, 2014 13:00

In what path can i find BTP files on a linux server

12 Posts

October 5th, 2014 14:00

Hi Dynamox, so if btp is mysql binary file it should be decoded into readable format ?

Thanks

No Events found!

Top