ECS: S3 MPU 테스트

기본 s3curl을 사용하여 문제를 재현해 봅니다. ECS: s3curl.pl 스크립트를

사용하여 기본 S3 작업을 수행하는 방법아래 예에서는 테스트 파일에 s3curl:

Checksum을 사용하여 MPU를 올바르게 수행하는 방법을 보여줍니다.

admin@g1-ecs1:/usr/share/s3curl> sudo vi /home/admin/test_file_10-25-17.txt

...

admin@g1-ecs1:/usr/share/s3curl> md5sum /home/admin/test_file_10-25-17.txt
72372a46100020b8642a41b59ce2fa57  /home/admin/test_file_10-25-17.txt

...

admin@g1-ecs1:/usr/share/s3curl> cat /home/admin/test_file_10-25-17.txt
Test #1

...

admin@g1-ecs1:/usr/share/s3curl> stat /home/admin/test_file_10-25-17.txt
  File: '/home/admin/test_file_10-25-17.txt'
  Size: 8               Blocks: 8          IO Block: 4096   regular file
Device: fe01h/65025d    Inode: 4214979     Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2017-10-25 20:05:38.712837105 +0000
Modify: 2017-10-25 20:05:29.560599490 +0000
Change: 2017-10-25 20:05:29.560599490 +0000
 Birth: -

MPU 시작:

admin@g1-ecs1:/usr/share/s3curl> sudo ./s3curl.pl --id=jason --post -- "http://10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploads" | xmllint --format -
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   287  100   287    0     0   4759      0 --:--:-- --:--:-- --:--:--  4783
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<InitiateMultipartUploadResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
  <Bucket>jk_bkt6</Bucket>
  <Key>home/admin/test_file_10-25-17.txt</Key>
  <UploadId>d64df3fe33754c3d8edb48c900fc0bde</UploadId>
</InitiateMultipartUploadResult>

...

dataheadsvc.log.20171025-230840.gz:2017-10-25T20:12:33,942 [qtp972598720-431184]  INFO  RequestLog.java (line 83) 10.241.218.184 POST //10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploads HTTP/1.1 200 60 - 287

MPU를 통해 파일 업로드:

admin@g1-ecs1:/usr/share/s3curl> sudo ./s3curl.pl --id=jason --put /home/admin/test_file_10-25-17.txt -- "http://10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploadId=d64df3fe33754c3d8edb48c900fc0bde&partNumber=1"
admin@g1-ecs1:/usr/share/s3curl>

...

dataheadsvc.log.20171025-230840.gz:2017-10-25T20:16:51,438 [qtp972598720-431200]  INFO  RequestLog.java (line 83) 10.241.218.184 PUT //10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploadId=d64df3fe33754c3d8edb48c900fc0bde&partNumber=1 HTTP/1.1 200 231 8 -

Etag 가져오기:

admin@g1-ecs1:/usr/share/s3curl> sudo ./s3curl.pl --id=jason -- "http://10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploadId=d64df3fe33754c3d8edb48c900fc0bde" | xmllint --format -
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   720  100   720    0     0  84180      0 --:--:-- --:--:-- --:--:-- 90000
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<ListPartsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
  <Bucket>jk_bkt6</Bucket>
  <Key>home/admin/test_file_10-25-17.txt</Key>
  <UploadId>d64df3fe33754c3d8edb48c900fc0bde</UploadId>
  <Initiator>
    <ID>jkusr</ID>
    <DisplayName>jkusr</DisplayName>
  </Initiator>
  <Owner>
    <ID>jkusr</ID>
    <DisplayName>jkusr</DisplayName>
  </Owner>
  <StorageClass>STANDARD</StorageClass>
  <PartNumberMarker>0</PartNumberMarker>
  <NextPartNumberMarker>0</NextPartNumberMarker>
  <MaxParts>1000</MaxParts>
  <IsTruncated>false</IsTruncated>
  <Part>
    <PartNumber>1</PartNumber>
    <LastModified>2017-10-25T20:16:51.214Z</LastModified>
    <ETag>"72372a46100020b8642a41b59ce2fa57"</ETag>
    <Size>8</Size>
  </Part>
</ListPartsResult>
admin@g1-ecs1:/usr/share/s3curl>

...

dataheadsvc.log.20171025-230840.gz:2017-10-25T20:17:22,399 [qtp972598720-431028]  INFO  RequestLog.java (line 83) 10.241.218.184 GET //10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploadId=d64df3fe33754c3d8edb48c900fc0bde HTTP/1.1 200 7 - 720

MPU를 완료합니다.

admin@g1-ecs1:/usr/share/s3curl> cat /home/admin/test_file_10-25-17.txt_complete
<CompleteMultipartUpload>
  <Part>
    <PartNumber>1</PartNumber>
    <ETag>"72372a46100020b8642a41b59ce2fa57"</ETag>
  </Part>
</CompleteMultipartUpload>

...

admin@g1-ecs1:/usr/share/s3curl> sudo ./s3curl.pl --id=jason --post /home/admin/test_file_10-25-17.txt_complete -- "http://10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploadId=d64df3fe33754c3d8edb48c900fc0bde" | xmllint --format -
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   527  100   372  100   155   3616   1507 --:--:-- --:--:-- --:--:--  3647
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<CompleteMultipartUploadResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
  <Location>http://10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt</Location>
  <Bucket>jk_bkt6</Bucket>
  <Key>home/admin/test_file_10-25-17.txt</Key>
  <ETag>"05515dda1c6c7531f9682c15a6012eb3-1"</ETag>
</CompleteMultipartUploadResult>

...

dataheadsvc.log.20171025-230840.gz:2017-10-25T20:20:16,690 [qtp972598720-431225]  INFO  RequestLog.java (line 83) 10.241.218.184 POST //10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt?uploadId=d64df3fe33754c3d8edb48c900fc0bde HTTP/1.1 200 102 155 372

오브젝트를 다시 복사하고 체크섬이 원본과 일치하는지 확인합니다.

admin@g1-ecs1:/usr/share/s3curl> sudo ./s3curl.pl --id=jason -- http://10.241.218.184:9020/jk_bkt6/home/admin/test_file_10-25-17.txt -o /home/admin/test_file_10-25-17.txt_ORIGINAL-10-25-17
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100     8  100     8    0     0    839      0 --:--:-- --:--:-- --:--:--   888

...

admin@g1-ecs1:/usr/share/s3curl> md5sum /home/admin/test_file_10-25-17.txt_ORIGINAL-10-25-17
72372a46100020b8642a41b59ce2fa57  /home/admin/test_file_10-25-17.txt_ORIGINAL-10-25-17

테스트를 실행하는 데 문제가 있는 경우 ECS 기술 지원 팀에 지원을 요청하십시오.