UNSOLVED

wo2

updated

17 years ago

W

wo2

10 Posts

0

2696

September 17th, 2009 18:00

FPClip open performance

Hi,

I am using the 3.2 SDK against a legacy Gen2 Centera server, which is running on an old 2.3 OS.

I need to open clips to gather the metadata ( just the clip attributes, I don't care about the Tag/blob data at this point ). I am currently using the API:

FPClip fpClip = new FPClip( fpPool, clipId, FPLibraryConstants.FP_OPEN_FLAT );

I am seeing some pretty inconsistent response time from the server. I tested fetching about 100000 clips ( with 10 threads shared a single Pool Connection ). In one test it took about 50 mins, but in the other one with same set of clipIds, it took 6 hours to finish...

So just want to see if you can comment/advise on if this is the efficient way to open the clip to get the metadata?

In my other tests with more clipIds to fetch, I noticed the response time degrades over time... that is, the first 50000 clips-open returned pretty fast, but after 100000 clips ( which got fetched in under an hour ), the clip open response time degrades quite significantly... that is, it took about 2 hours to open the next 60, 000 clips, and another 6 HOURS to open the next 150000 clips...

So in total, it took 9 hours to open ~300,000 clips ( with 10 threads )

thanks for any advice/comments.

P.S., the clip processing is fast and trivial. It just prints out some attributes like name, creationDate, etc.. and a clip is always closed after processed. I'd been monitoring the memory usage too, and it's very stable...