ECS: Writing large files failing with 500 errors for S3 Protocol

Writing large files (multiple GB or larger) using the S3 protocol failing with 500 errors.

Using "HTTP PUT" or "HTTPS PUT" to write the files to the ECS. The S3 PUT command does not add an object partially, the request is either a successful or failed write (all or nothing).

As an 'all or nothing' operation, any disruption during the data transfer of a large file results in a complete failure of that write. The only resource for that failure is to retry the entire write operation and hope it succeeds on the next attempt.

For large files (GB or larger) it is recommended that Multi Part Uploads (MPU) should be used instead of the PUT operation. The recommendation is made in order to avoid long write completion times (100MB or larger, per AWS best practice).

Example:
An 80GB file would be chunked and each chunk is sent to the ECS. If any part upload fails, only the upload of the single part would be retried rather than the full object.  
The performance of MPUs is expected to be better than a single large PUT because MPU operations can be multithreaded. As a result, usage of MPUs make better use of multiple connections and bandwidth. That means more than one part can be sent concurrently, improving overall performance on writing large files.

Resources for application developers switching from PUT to an MPU usage:
TransferManager (AWS SDK for Java - 1.12.588) (amazon.com)

AWS MPU overview: (includes MPU best practices)
Uploading and copying objects using multipart upload - Amazon Simple Storage Service