AppSync: AppSync CLI command intermittently fails
Summary: AppSync: AppSync CLI command intermittently fails
This article applies to
This article does not apply to
This article is not tied to any specific product.
Not all product versions are identified in this article.
Symptoms
This issue occurs when multiple AppSync CLI logins are attempted simultaneously. The issue is highly intermittent.
User is running AppSync CLI to run a service plan, list all copies and mount/unmount a copy but it intermittently fails.
Run a service plan fails with:
List all copies that are created for a service plan or application object fails with:
The AppSync cas.log located in C:\EMC\AppSync\apache-tomcat\bin shows the following:
User is running AppSync CLI to run a service plan, list all copies and mount/unmount a copy but it intermittently fails.
Run a service plan fails with:
C:\EMC\AppSync\appsync-cli\appsync-cli.bat -login server=xxxxxx port=8445 user=admin password=xxxxxxxx
INFO: Successfully authenticated AppSync!
C:\EMC\AppSync\appsync-cli\appsync-cli.bat -runSP app=filesystem service_plan=xxxxxxx
ERROR: Failed to run SP!
INFO: Successfully authenticated AppSync!
C:\EMC\AppSync\appsync-cli\appsync-cli.bat -runSP app=filesystem service_plan=xxxxxxx
ERROR: Failed to run SP!
List all copies that are created for a service plan or application object fails with:
C:\EMC\AppSync\appsync-cli\appsync-cli.bat -login server=xxxxxx port=8445 user=admin password=xxxxxxxx
INFO: Successfully authenticated AppSync!
C:\EMC\AppSync\appsync-cli\appsync-cli.bat -listCopies app=filesystem service_plan=xxxxxx age=all
ERROR: Could not locate copies!
INFO: Successfully authenticated AppSync!
C:\EMC\AppSync\appsync-cli\appsync-cli.bat -listCopies app=filesystem service_plan=xxxxxx age=all
ERROR: Could not locate copies!
The AppSync cas.log located in C:\EMC\AppSync\apache-tomcat\bin shows the following:
2017-01-05 10:20:18,330 INFO [com.emc.archway.cas.auth.CASAuthenticationAdaptor] - CASAuthenticationAdaptor constructor
2017-01-05 10:20:18,330 INFO [com.emc.archway.cas.auth.CASAuthenticationHandler] - CASAuthenticationManager::authenticateUsernamePasswordInternal username = admin
2017-01-05 10:20:18,330 INFO [com.emc.archway.cas.auth.CASAuthenticationAdaptor] - CASAuthenticationAdaptor::authenticate
2017-01-05 10:20:18,330 INFO [com.emc.archway.cas.auth.CASAuthenticationAdaptor] - CASAuthenticationAdaptor::authenticate Using CST...
2017-01-05 10:20:18,330 INFO [com.emc.archway.cas.auth.CSTInterface] - Checking for LDAP authority: PSO-AD-Authority
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - obtainCredentials: authority = PSO-AD-Authority
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - found choice authority = PSO-AD-Authority (PSO-AD-Authority)
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.CSTInterface] - CST authentication failure com.emc.csp.error.SystemException: Error decrypting data
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.ArchwayAuthentication] - OS Login disabled
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - obtainCredentials: authority = LocalDirectoryTest
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - found choice authority = LocalDirectoryTest
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.CASAuthenticationAdaptor] - CASAuthenticationAdaptor constructor
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.CASAuthenticationHandler] - CASAuthenticationManager::authenticateUsernamePasswordInternal username = admin
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.CASAuthenticationAdaptor] - CASAuthenticationAdaptor::authenticate
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.CASAuthenticationAdaptor] - CASAuthenticationAdaptor::authenticate Using CST...
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.CSTInterface] - Checking for LDAP authority: PSO-AD-Authority
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - obtainCredentials: authority = PSO-AD-Authority
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - found choice authority = PSO-AD-Authority (PSO-AD-Authority)
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.CSTInterface] - CST authentication failure com.emc.csp.error.SystemException: Error decrypting data
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.ArchwayAuthentication] - OS Login disabled
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - obtainCredentials: authority = LocalDirectoryTest
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - found choice authority = LocalDirectoryTest
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.CSTInterface] - Authentication succeeded...
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.CSTInterface] - Storing roles in lockbox ...
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.CSTInterface] - Storing userRole1 = DataAdministrator
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.CSTInterface] - Storing userRole2 = ResourceAdmin
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Storing userRole3 = SecurityAdmin
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Storing userRole4 = ServicePlanAdministrator
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Authentication succeeded...
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Storing roles in lockbox ...
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Total roles = 4
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.ArchwayAuthentication] - Authentication succeeded - token
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.attributes.rolePersonAttributeDao] - getPerson called for admin
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.attributes.rolePersonAttributeDao] - retrieved cstIF ....com.emc.archway.cas.auth.CSTInterface@16ea70b
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Accesing roles in lockbox ...
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Accesing roles in lockbox ...
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - CSTInterface authenticat - storing roles - exception The Lockbox item already exists
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Total roles found = 4
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - CSTInterface authenticat - storing roles - exception The Lockbox item already exists
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Accessed role DataAdministrator
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - CSTInterface authenticat - storing roles - exception The Lockbox item already exists
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Accessed role ResourceAdmin
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - CSTInterface authenticat - storing roles - exception The Lockbox item already exists
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Accessed role SecurityAdmin
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Total roles = 4
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.ArchwayAuthentication] - Authentication succeeded - token
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.attributes.rolePersonAttributeDao] - getPerson called for admin
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.attributes.rolePersonAttributeDao] - retrieved cstIF ....com.emc.archway.cas.auth.CSTInterface@16ea70b
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Accesing roles in lockbox ...
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Accesing roles in lockbox ...
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Total roles found = 4
2017-01-05 10:20:18,408 INFO [com.emc.archway.cas.auth.CSTInterface] - Accessed role ServicePlanAdministrator
2017-01-05 10:20:18,408 INFO [com.emc.archway.cas.auth.CSTInterface] - Accessed role exception
2017-01-05 10:20:18,408 ERROR [com.emc.archway.cas.auth.CSTInterface] - The item name does not exist in the Lockbox
com.emc.csp.error.ObjectNotFoundException: The item name does not exist in the Lockbox
at com.emc.cst.cstBridge.cstBridgeJNI.LockboxService_retrieveItemAsText(Native Method)
at com.emc.cst.cstBridge.LockboxService.retrieveItemAsText(LockboxService.java:153)
at com.emc.csp.services.lockbox.LockboxService.retrieveItemAsText(LockboxService.java:509)
2017-01-05 10:20:18,330 INFO [com.emc.archway.cas.auth.CASAuthenticationHandler] - CASAuthenticationManager::authenticateUsernamePasswordInternal username = admin
2017-01-05 10:20:18,330 INFO [com.emc.archway.cas.auth.CASAuthenticationAdaptor] - CASAuthenticationAdaptor::authenticate
2017-01-05 10:20:18,330 INFO [com.emc.archway.cas.auth.CASAuthenticationAdaptor] - CASAuthenticationAdaptor::authenticate Using CST...
2017-01-05 10:20:18,330 INFO [com.emc.archway.cas.auth.CSTInterface] - Checking for LDAP authority: PSO-AD-Authority
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - obtainCredentials: authority = PSO-AD-Authority
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - found choice authority = PSO-AD-Authority (PSO-AD-Authority)
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.CSTInterface] - CST authentication failure com.emc.csp.error.SystemException: Error decrypting data
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.ArchwayAuthentication] - OS Login disabled
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - obtainCredentials: authority = LocalDirectoryTest
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - found choice authority = LocalDirectoryTest
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.CASAuthenticationAdaptor] - CASAuthenticationAdaptor constructor
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.CASAuthenticationHandler] - CASAuthenticationManager::authenticateUsernamePasswordInternal username = admin
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.CASAuthenticationAdaptor] - CASAuthenticationAdaptor::authenticate
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.CASAuthenticationAdaptor] - CASAuthenticationAdaptor::authenticate Using CST...
2017-01-05 10:20:18,345 INFO [com.emc.archway.cas.auth.CSTInterface] - Checking for LDAP authority: PSO-AD-Authority
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - obtainCredentials: authority = PSO-AD-Authority
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - found choice authority = PSO-AD-Authority (PSO-AD-Authority)
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.CSTInterface] - CST authentication failure com.emc.csp.error.SystemException: Error decrypting data
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.ArchwayAuthentication] - OS Login disabled
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - obtainCredentials: authority = LocalDirectoryTest
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.ArchwayAuthCredentialProvider] - found choice authority = LocalDirectoryTest
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.CSTInterface] - Authentication succeeded...
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.CSTInterface] - Storing roles in lockbox ...
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.CSTInterface] - Storing userRole1 = DataAdministrator
2017-01-05 10:20:18,361 INFO [com.emc.archway.cas.auth.CSTInterface] - Storing userRole2 = ResourceAdmin
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Storing userRole3 = SecurityAdmin
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Storing userRole4 = ServicePlanAdministrator
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Authentication succeeded...
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Storing roles in lockbox ...
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Total roles = 4
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.ArchwayAuthentication] - Authentication succeeded - token
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.attributes.rolePersonAttributeDao] - getPerson called for admin
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.attributes.rolePersonAttributeDao] - retrieved cstIF ....com.emc.archway.cas.auth.CSTInterface@16ea70b
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Accesing roles in lockbox ...
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Accesing roles in lockbox ...
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - CSTInterface authenticat - storing roles - exception The Lockbox item already exists
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - Total roles found = 4
2017-01-05 10:20:18,377 INFO [com.emc.archway.cas.auth.CSTInterface] - CSTInterface authenticat - storing roles - exception The Lockbox item already exists
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Accessed role DataAdministrator
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - CSTInterface authenticat - storing roles - exception The Lockbox item already exists
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Accessed role ResourceAdmin
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - CSTInterface authenticat - storing roles - exception The Lockbox item already exists
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Accessed role SecurityAdmin
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Total roles = 4
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.ArchwayAuthentication] - Authentication succeeded - token
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.attributes.rolePersonAttributeDao] - getPerson called for admin
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.attributes.rolePersonAttributeDao] - retrieved cstIF ....com.emc.archway.cas.auth.CSTInterface@16ea70b
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Accesing roles in lockbox ...
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Accesing roles in lockbox ...
2017-01-05 10:20:18,392 INFO [com.emc.archway.cas.auth.CSTInterface] - Total roles found = 4
2017-01-05 10:20:18,408 INFO [com.emc.archway.cas.auth.CSTInterface] - Accessed role ServicePlanAdministrator
2017-01-05 10:20:18,408 INFO [com.emc.archway.cas.auth.CSTInterface] - Accessed role exception
2017-01-05 10:20:18,408 ERROR [com.emc.archway.cas.auth.CSTInterface] - The item name does not exist in the Lockbox
com.emc.csp.error.ObjectNotFoundException: The item name does not exist in the Lockbox
at com.emc.cst.cstBridge.cstBridgeJNI.LockboxService_retrieveItemAsText(Native Method)
at com.emc.cst.cstBridge.LockboxService.retrieveItemAsText(LockboxService.java:153)
at com.emc.csp.services.lockbox.LockboxService.retrieveItemAsText(LockboxService.java:509)
Cause
The AppSync sever is designed to collect the list of roles assigned to the user once authenticated.
The AppSync server gathers the role information after authentication and writes it to a lockbox (this is similar to a file) to retrieve it later.
Once AppSync server retrieves the stored information, it is deleted. However, if multiple logins were tried simultaneously, one session would delete the information before it's retrieved by another session.
To put it simply this is a concurrency issue due to multiple logins(more than one) at the same time
The AppSync server gathers the role information after authentication and writes it to a lockbox (this is similar to a file) to retrieve it later.
Once AppSync server retrieves the stored information, it is deleted. However, if multiple logins were tried simultaneously, one session would delete the information before it's retrieved by another session.
To put it simply this is a concurrency issue due to multiple logins(more than one) at the same time
Resolution
Workaround:
A solution to this issue exists but it requires the assistance of EMC Customer Support.
Contact EMC Customer Support and reference this article for the hotfix
A solution to this issue exists but it requires the assistance of EMC Customer Support.
Contact EMC Customer Support and reference this article for the hotfix
Affected Products
AppSyncProducts
AppSyncArticle Properties
Article Number: 000059230
Article Type: Solution
Last Modified: 10 Sept 2025
Version: 4
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.