ECS: Test S3 MPU

Zusammenfassung: Test S3 MPU

Dieser Artikel gilt für Dieser Artikel gilt nicht für Dieser Artikel ist nicht an ein bestimmtes Produkt gebunden. In diesem Artikel werden nicht alle Produktversionen aufgeführt.
Andere Ressourcen ansehen

Symptome

Issue with MPU

Ursache

Application logic

Lösung

Attempt to reproduce the issue using basic s3curl: ECS: How to perform basic S3 operations using the s3curl.pl script

The examples below shows how to properly perform MPU using s3curl:

Checksum for test file:

admin@g1-ecs1:/usr/share/s3curl> sudo vi /home/admin/test_file_10-25-17.txt

...

admin@g1-ecs1:/usr/share/s3curl> md5sum /home/admin/test_file_10-25-17.txt
72372a46100020b8642a41b59ce2fa57  /home/admin/test_file_10-25-17.txt

...

admin@g1-ecs1:/usr/share/s3curl> cat /home/admin/test_file_10-25-17.txt
Test #1

...

admin@g1-ecs1:/usr/share/s3curl> stat /home/admin/test_file_10-25-17.txt
  File: '/home/admin/test_file_10-25-17.txt'
  Size: 8               Blocks: 8          IO Block: 4096   regular file
Device: fe01h/65025d    Inode: 4214979     Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2017-10-25 20:05:38.712837105 +0000
Modify: 2017-10-25 20:05:29.560599490 +0000
Change: 2017-10-25 20:05:29.560599490 +0000
 Birth: -

Initiate MPU:

admin@g1-ecs1:/usr/share/s3curl> sudo ./s3curl.pl --id=jason --post -- "http://10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploads" | xmllint --format -
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   287  100   287    0     0   4759      0 --:--:-- --:--:-- --:--:--  4783
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<InitiateMultipartUploadResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
  <Bucket>jk_bkt6</Bucket>
  <Key>home/admin/test_file_10-25-17.txt</Key>
  <UploadId>d64df3fe33754c3d8edb48c900fc0bde</UploadId>
</InitiateMultipartUploadResult>

...

dataheadsvc.log.20171025-230840.gz:2017-10-25T20:12:33,942 [qtp972598720-431184]  INFO  RequestLog.java (line 83) 10.241.218.184 POST //10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploads HTTP/1.1 200 60 - 287

Upload file over MPU:

admin@g1-ecs1:/usr/share/s3curl> sudo ./s3curl.pl --id=jason --put /home/admin/test_file_10-25-17.txt -- "http://10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploadId=d64df3fe33754c3d8edb48c900fc0bde&partNumber=1"
admin@g1-ecs1:/usr/share/s3curl>

...

dataheadsvc.log.20171025-230840.gz:2017-10-25T20:16:51,438 [qtp972598720-431200]  INFO  RequestLog.java (line 83) 10.241.218.184 PUT //10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploadId=d64df3fe33754c3d8edb48c900fc0bde&partNumber=1 HTTP/1.1 200 231 8 -

Get the Etag:

admin@g1-ecs1:/usr/share/s3curl> sudo ./s3curl.pl --id=jason -- "http://10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploadId=d64df3fe33754c3d8edb48c900fc0bde" | xmllint --format -
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   720  100   720    0     0  84180      0 --:--:-- --:--:-- --:--:-- 90000
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<ListPartsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
  <Bucket>jk_bkt6</Bucket>
  <Key>home/admin/test_file_10-25-17.txt</Key>
  <UploadId>d64df3fe33754c3d8edb48c900fc0bde</UploadId>
  <Initiator>
    <ID>jkusr</ID>
    <DisplayName>jkusr</DisplayName>
  </Initiator>
  <Owner>
    <ID>jkusr</ID>
    <DisplayName>jkusr</DisplayName>
  </Owner>
  <StorageClass>STANDARD</StorageClass>
  <PartNumberMarker>0</PartNumberMarker>
  <NextPartNumberMarker>0</NextPartNumberMarker>
  <MaxParts>1000</MaxParts>
  <IsTruncated>false</IsTruncated>
  <Part>
    <PartNumber>1</PartNumber>
    <LastModified>2017-10-25T20:16:51.214Z</LastModified>
    <ETag>"72372a46100020b8642a41b59ce2fa57"</ETag>
    <Size>8</Size>
  </Part>
</ListPartsResult>
admin@g1-ecs1:/usr/share/s3curl>

...

dataheadsvc.log.20171025-230840.gz:2017-10-25T20:17:22,399 [qtp972598720-431028]  INFO  RequestLog.java (line 83) 10.241.218.184 GET //10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploadId=d64df3fe33754c3d8edb48c900fc0bde HTTP/1.1 200 7 - 720

Complete the MPU:

admin@g1-ecs1:/usr/share/s3curl> cat /home/admin/test_file_10-25-17.txt_complete
<CompleteMultipartUpload>
  <Part>
    <PartNumber>1</PartNumber>
    <ETag>"72372a46100020b8642a41b59ce2fa57"</ETag>
  </Part>
</CompleteMultipartUpload>

...

admin@g1-ecs1:/usr/share/s3curl> sudo ./s3curl.pl --id=jason --post /home/admin/test_file_10-25-17.txt_complete -- "http://10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploadId=d64df3fe33754c3d8edb48c900fc0bde" | xmllint --format -
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   527  100   372  100   155   3616   1507 --:--:-- --:--:-- --:--:--  3647
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<CompleteMultipartUploadResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
  <Location>http://10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt</Location>
  <Bucket>jk_bkt6</Bucket>
  <Key>home/admin/test_file_10-25-17.txt</Key>
  <ETag>"05515dda1c6c7531f9682c15a6012eb3-1"</ETag>
</CompleteMultipartUploadResult>

...

dataheadsvc.log.20171025-230840.gz:2017-10-25T20:20:16,690 [qtp972598720-431225]  INFO  RequestLog.java (line 83) 10.241.218.184 POST //10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploadId=d64df3fe33754c3d8edb48c900fc0bde HTTP/1.1 200 102 155 372

Copy the object back and confirm that the checksum matches the original:

admin@g1-ecs1:/usr/share/s3curl> sudo ./s3curl.pl --id=jason -- http://10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt -o /home/admin/test_file_10-25-17.txt_ORIGINAL-10-25-17
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100     8  100     8    0     0    839      0 --:--:-- --:--:-- --:--:--   888

...

admin@g1-ecs1:/usr/share/s3curl> md5sum /home/admin/test_file_10-25-17.txt_ORIGINAL-10-25-17
72372a46100020b8642a41b59ce2fa57  /home/admin/test_file_10-25-17.txt_ORIGINAL-10-25-17

Weitere Informationen

If there are issues running the test, reach out to ECS technical support for assistance.

Betroffene Produkte

ECS Appliance

Produkte

ECS Appliance, ECS Appliance Hardware Gen1 U-Series, ECS Appliance Software with Encryption, ECS Appliance Software without Encryption
Artikeleigenschaften
Artikelnummer: 000030771
Artikeltyp: Solution
Zuletzt geändert: 12 Sept. 2025
Version:  4
Antworten auf Ihre Fragen erhalten Sie von anderen Dell NutzerInnen
Support Services
Prüfen Sie, ob Ihr Gerät durch Support Services abgedeckt ist.