Data Domain file system may run into dead lock condition during index merge causing frequent restarts.

Summary: This Knowledge Base article explains a defect in some DDOS 5.7.x and 6.0.x versions by which an internal index merge may deadlock, causing the FS process to timeout and eventually restart. ...

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.
Check out other resources

Symptoms



Data Domain file system may run into dead lock condition during index merge causing frequent restarts.  

System either panic with "Hmon: PANIC: abort due to timeout in "SegStore Comp Thread" error message as follows:

04/20 12:09:58.307 (tid 0x7f0b9838fe80): NOTICE: MSG-SEGSTO-00006: Merging /vol1/col1/cp1 index level [-1] to level [1].
04/20 12:10:16.165 (tid 0x7f0b9838fe80): NOTICE: MSG-SEGSTO-00008: Growing index filesystem [/../stack:/../vpart:/vol1/col1/cp1/full_indices/.../], new size [5276386721792].
04/20 12:10:16.203 (tid 0x7f0b9838fe80): ssim_grow_by_tpp_size_inc: growth failed errno=5005 (fixed sized blkset is full), calling cm_compact and retrying.
04/20 12:10:16.203 (tid 0x7f0b9838fe80): NOTICE: /../vpart:/vol1/col1/cp1/cset: CSET compact waiting for background compact to finish, cms_id:418944908c7c452d:73df60418d38434d
.
.
04/20 12:17:06.962 (tid 0x7f0b983868f0): Hmon: SegStore Comp Thread exceeded failure threshold.
04/20 12:17:09.005 (tid 0x7f0b983868f0): Hmon: PANIC: abort due to timeout in "SegStore Comp Thread".

Or "FM remote server RPC time out" with error message as follows:

05/14 13:19:36.995 (tid 0x7f14b5788650): NOTICE: MSG-SEGSTO-00006: Merging /vol1/col1/cp1 index level [-1] to level [1].
05/14 13:20:13.940 (tid 0x7f14b5788650): NOTICE: MSG-SEGSTO-00008: Growing index filesystem [/../stack:/../vpart:/vol1/col1/cp1/full_indices/.../], new size [6686423646208].
05/14 13:20:13.985 (tid 0x7f14b5788650): ssim_grow_by_tpp_size_inc: growth failed errno=5005 (fixed sized blkset is full), calling cm_compact and retrying.
05/14 13:20:13.985 (tid 0x7f14b5788650): NOTICE: /../vpart:/vol1/col1/cp1/cset: CSET compact waiting for background compact to finish, cms_id:418944908c7c452d:73df60418d38434d
.
.
05/14 13:37:35.443 (tid 0x7f0565c54d00): ERROR: MSG-INTRNL-00002: stackdump -v "6.0.1.10-561375" ddfs dd_version_checksum=96c61085ec66f78c502e139b375eae5d 0x1871980 0x18717df 0x188bf91 0x188bf78 0x7bf42c 0x190a336 0x18b215d 0x190a5d4 0x1879ccc 0x187a303 0x7f14bffdc7bb 0x7f14bed42cdd
05/14 13:37:35.443 (tid 0x7f0565c54d00): ERROR: MSG-INTRNL-00001: PANIC: ddr/fm/fm_remote_server.c: fmr_cl_timedout: 1543: FM remote server RPC time out 4
05/14 13:37:35.844 (tid 0x7f0565c54d00): ddr/fm/fm_remote_server.c: fmr_cl_timedout: 1543: FM remote server RPC time out 4

Cause

There is a defect in some DDOS versions where a deadlock during a regular internal index merge may occur. The affected versions are:
  • DDOS 5.7.4.10 and earlier
  • Any DDOS 6.0.1.x versions
The fix will be available for the following releases:
  • DDOS 5.7.5.0 and later
  • DDOS 6.0.2.0 and later
  • DDOS 6.1.0.0

Resolution

If the Data Domain file system is restarting frequently with any one of the above error messages, and is running any vulnerable DDOS version, contact DELL EMC support hotline to implement workaround until fixed DDOS releases are made available to customers.

Affected Products

Data Domain

Products

Data Domain
Article Properties
Article Number: 000061945
Article Type: Solution
Last Modified: 16 Jun 2025
Version:  3
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.