Dell NativeEdge: Blueprints deployment error "libcrypto error"

Overview

When using NativeEdge Blueprints, you might encounter errors related to the SSH key during execution, particularly a "libcrypto" error. This error typically occurs due to formatting issues with the private SSH key, such as extra spaces, carriage returns, or newline characters. This article aims to help you figure out and resolve this issue by checking your SSH key in the NativeEdge Secrets UI.

Symptoms

When the blueprint execution fails due to an incorrect private SSH key, you may see an error message similar to the following:

Failed to connect to the host via ssh: Load key "/opt/manager/resources/deployments/default_tenant/someid/tmp2id/f2fffff-ffff-ffef-ffff-ffffffffff": error in libcrypto

This error indicates that the SSH key used by the blueprint is not in the correct format. The most common cause is the presence of extra characters, such as extra spaces, newline characters, or carriage returns, which can occur when the key is copied and pasted into the Secrets UI.

Cause

The error may appear because of improperly formatted SSH keys. This can happen due to:
1. Extra Spaces: Unintended spaces before or after the key
2. Carriage Returns: Extra carriage return symbols, which are invisible in some text editors, but can disrupt the key's structure
3. Newline Characters: Extra or missing newline characters that alter the intended format of the key

These formatting issues prevent the key from parsing correctly, leading to the "libcrypto" error during blueprint execution.

Solution

To resolve the issue, follow these steps:

1. Verify the SSH Key in NativeEdge Secrets

• Log in to the NativeEdge Manager UI.
• Navigate to the Secrets section.
• Find the secret that stores the SSH key.
• Carefully inspect the SSH key for any of the following:

   - Extra spaces: Check both before and after the key text.
   - Carriage returns: These may not be visible, but you can detect them by checking the key's format in a plain text editor.
   - Newline characters: Ensure that the key begins and ends correctly, without unintended line breaks.

2. Correct the SSH Key Format

If you find any issues, edit the key directly in the Secrets UI:

• Remove any extra spaces, carriage returns, or newline characters.
• Ensure that the key is formatted exactly as it was when generated.
• Save the changes.

3. Validate the Key

To ensure that the key is valid:

• Use an SSH client to test the key. For example, you can try logging in to a remote server using the key:

    ssh -i /path/to/your/key user@hostname

• If the key works without issues, it should be correctly formatted.
• Re-run the Blueprint

Note: We are using OpenSSH format and to use same key for validation using PuTTY utility user should convert the key to the PuTTY compatible key.

After correcting the key in the Secrets UI, re-run the blueprint that was previously failing. The "libcrypto" error should no longer appear.

Preventative Measures

- Double-Check Before Saving: Always double-check your SSH key for extra characters before saving it in the Secrets UI. For example, click into the edit box with a key and navigate to the end of the key. There should not be any extra-line in the end of the key.
- Use a Plain Text Editor: When copying SSH keys, use a plain text editor to avoid any hidden formatting that might be introduced by other text editors.
- Automate Formatting Checks: Consider using automated scripts to validate SSH key formatting before uploading them to NativeEdge.
- Look at the example below to verify the format of your private key looks similar:

-----BEGIN OPENSSH PRIVATE KEY-----
b3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAACFwAAAAdzc2gtcn
NhAAAAAwEAAQAAAgEAs89vY4y4cIobH1AHSQ6lxaaam2LvfH+m1ourQP9SYwAqStU2EZ0H
RegXVDrBZpPQiJhCiCiwtK76CMTSh9qwKNZEOQ7iphjbyD+cGCQA8hanaClZw8kN3ItV87
eluqhjaruhtF35DA5jUG52BrHqu05azjCKqI6mtQYs1ZD/RVB6yhFpJZUOm63KBP+1Cqkc
6/TPGA0MxRuLczUusI3ho+DebneJijTWdAT4Qifa+k902tlK85L6MUVVs1tjTzmCFn3+wq
1tIu3ZXEsVJLg6KguQ3K8iqQ2yYae2xemc4pBLFIvsDgaJaSpusktWpHSdPs0xyEirRPvU
GXoks/rS7KiQolM7uHdiY4FkmiqZOynbEIw5KEvAg+pigFwkF5RMg0U/M/VtUHfBiYFU9b
AvJSRRzcZhbwY37kNoNkBVMn53ioT6V3NUlPimQVYFcQ4OkjvGRZyZ9RQnl2wOsq6rX6sX
A1LzXaQzcHhhHD6cGUuUNd1Uc9CSOiVXC6iQLmMc6Qj4/nDm/uIX7cnPgW1AfcG98bElUa
3EpI4MvY35S3vmagHOwRCu1KZzWCw3rFtvGUT4Qi4rJSmgLhOYg79tRdA+eMyfqso1EROW
1i4GSsHY9pfiD/wesKAeg3hatcuBRSVaZ/guYaYVBYKYTTeolaugZslAugHIUiPkzNGKly
sAAAdQ2juk69o7pOsAAAAHc3NoLXJzYQAAAgEAs89vY4y4cIobH1AHSQ6lxaaam2LvfH+m
1ourQP9SYwAqStU2EZ0HRegXVDrBZpPQiJhCiCiwtK76CMTSh9qwKNZEOQ7iphjbyD+cGC
QA8hanaClZw8kN3ItV87eluqhjaruhtF35DA5jUG52BrHqu05azjCKqI6mtQYs1ZD/RVB6
yhFpJZUOm63KBP+1Cqkc6/TPGA0MxRuLczUusI3ho+DebneJijTWdAT4Qifa+k902tlK85
L6MUVVs1tjTzmCFn3+wq1tIu3ZXEsVJLg6KguQ3K8iqQ2yYae2xemc4pBLFIvsDgaJaSpu
sktWpHSdPs0xyEirRPvUGXoks/rS7KiQolM7uHdiY4FkmiqZOynbEIw5KEvAg+pigFwkF5
RMg0U/M/VtUHfBiYFU9bAvJSRRzcZhbwY37kNoNkBVMn53ioT6V3NUlPimQVYFcQ4OkjvG
RZyZ9RQnl2wOsq6rX6sXA1LzXaQzcHhhHD6cGUuUNd1Uc9CSOiVXC6iQLmMc6Qj4/nDm/u
IX7cnPgW1AfcG98bElUa3EpI4MvY35S3vmagHOwRCu1KZzWCw3rFtvGUT4Qi4rJSmgLhOY
g79tRdA+eMyfqso1EROW1i4GSsHY9pfiD/wesKAeg3hatcuBRSVaZ/guYaYVBYKYTTeola
ugZslAugHIUiPkzNGKlysAAAADAQABAAACADv1qjFKFZ8BjrXMXAGSrtjQC7JRNYcQkjPs
8ziDa5ez0GaP3q3U7T30fQMLbL6l/93s2BLLbtFxn9MYvxOqax/TA4D7Y7z7gR6vh3/NUb
torn5fe518B/FJTWouDUfHKw/Gbc/VnlzU121UyGrHHX1ETaeALFy05QZsfrrg1R7qDWgg
ki2EHRDwzPMJyfc6GXjdc8mTYHTCEKhkTaN2TI33SHURy32YzQJ3PcnhvHXH1TG9T+8VTf
TsJ/3dNaqPhL+3WCLW7hO9uMO8DdrmzA6FONM+W5KADMHfyWUJ19T9ROwfFKJAr8Wv7qXp
1YSVlnIAvt8IzIP+beXpAyA5Peg53ANqWpTO0Oh+d0y8Xdev17D82kMww80IWRRYJsc4hn
HagQuGZ4e7phzfbHqTAh6MBgWkRR6HaTb/CkekJIH8MueH55+PZ0NZjPcFc7FwwuLMisci
TfZLVHSLFTTC1OT+pbZ9skjdj90hUCT9VWH9cMmjVkVfEu3BDTo3pMaJk9KYLHghMug+ts
iX1AbV8W55LEvgowWQIgzsLQOJkcRVN7KN6br12hWZ85qFbccSrwh2lEZlnyMi28MJ3Okl
zp2uWyPSfdJc44ZM7pSyyV0rhETLM8HqIP6K4TuLlrv7KfwcRwF3Hnps9A3x5EFb0+YSm5
VPJmhpBo3sIFEwiUphAAABAEcBQqnRq11pzcnDT2RFhE+ob2MBUkZdpw8wY6RKzrMzgC3S
u5TvAeIH6x1m+VVe07DteMhh7ihaaIbRyIpJL8IbtNxQI1tzSRX7fWFpRaZImnA+SOCsi/
uMBS15zOA+8a3OREE356lyr/4Y87vscIdr/rznC+46unWAkB8DDcxsX8XOae+uo6DAdUEn
Gn3p4ulzbXflt21HDEPPMYn/nOYi9sUJghmWvaiYnv10FHI/zNIdDZCLUTeQZUUOn4v1Ug
iPGABNYSBOIw628WOtHTT7FlxRNxqvOByjPFnJ+b3nRDohZQmgsxlb9jgfeps7Us08vHyX
Z67dw+MpRdlSfoYAAAEBANPyyBgHJzBT/qdFNZMTkamc/lIgrRKLDJzhqqJ8SXsSovLNTM
wYos2YCRFZ3j+XNnZ5cqgf2WaER6R3K+q6eO8gzupkS8OQdnR8ZRxPYoa1zImNIFyKpZIC
dA3G7yQGWDUo5sj65DBmvazUu6Mj3IixfGIWNDUpcOj8YksBltCB8ztwFPYK5opp4Pa5yu
RbQTmo70/FqHH9Ocun9zotYwtxrw+ZPkxfZniD+sA1cTTjyJWlMYfrpB6OWUc6RRlSLUar
Vdo5XeKXyKQThdvc0seyvn7+cf6f1Qfc8uzABspEgAkCgS50pWu/r6sZwjDSjVazuufLVI
vye/bOI6Hs0SkAAAEBANkuq7LUbY59/ZZ84X3WiSB5qa8U2XaOQuRhLN0c1hiA8/eabvUw
zuU/9pdfCUuRnKe/RKuo8LrbqVXmoVj/7uXNSF/cjCGkFYKjEjL6mOPuY9HhMydmhtql5q
vUo7PD4tkF7LSZ0WFUYvAg1p8MwbTpz4ahXWpY3l5ERdUNeiSJDxr52xlQ5CYd/4iZayqk
Aeg475R7xcdqZQpLqbzzULrpE9BaGG5dBnBdAN5PucZMxZidKDIqsOI5SRmui3YmrOWXU/
yGVxZy3S0Ja89Ek1q6GCW4qQC3zcwI+wRTlYQhlAyKKHSuirsQ0hsJFTSNnfw0ttAmANfA
/3La20/3DDMAAAAXZW9hZG1pbkBzcmUwODA4Ni15YWViejIBAgME
-----END OPENSSH PRIVATE KEY-----

References:

Follow related article to understand all the step during generation of public and private key for NativeEdge deployments: Dell NativeEdge: How to generate private and public keys for NativeEdge deployments