ECS: List of migrated objects from transformation migration report is getting a UI timeout when downloading

curl -X GET "http://$(sudo netstat -nl | grep 9101 | head -1| awk '{print $4}')/diagnostic/TT/0/DumpAllKeys/TRANSFORMATION_ENUMERATION_ENTRY" | tee /tmp/migrated_objects | awk 'BEGIN{b=c=0} /contentId.+e/{c=c+1}/contentId.+x/{b=b+1}END{print("Clips " c " blobs " b)}'


Create the clip list from the output file using below command:   

admin@ecs01:~> grep contentId /tmp/migrated_objects | cut -d'"' -f6 | sort > /tmp/final_clip_list

Parallel-bucket-dump can also be used for dumping the bucket. The current version at time of creation of this article is 2.1.2.

Open a Service request with ECS Support for getting the latest version of parallel-bucket-dump script provided, if needed.

Usage:   

java -jar parallel-bucket-dump-2.1.2.jar
Missing required options: endpoint, namespace, bucket, output-file
usage: java -jar parallel-bucket-dump-{version}.jar
    --bucket <arg>          The bucket to dump. This is required.
    --dump-owner-zone       Include object owning zone in the output file
                            result.
    --end-time <arg>        Get only clips not modified after this time,
                            formatted as '2017-01-30T13:00:00Z'.
    --endpoint <url>        URL to dtQuery, e.g. http://10.10.10.10:9101
    --filter-clips          Turn on clip filtering for a CAS bucket.  When
                            enabled, only ClipIDs will be output, no blob
                            IDs.
    --max-page-size <arg>   Maximum number of items per page (defaults to
                            100000).
    --max-retries <arg>     Maximum number of retries when reading each
                            page (defaults to 10).
    --namespace <arg>       Namespace of the bucket to dump. This is
                            required.
    --output-file <path>    Path to the output file
    --remote-vdc-id <arg>   Get clips from the remote vdc with this id.
    --retry-seconds <arg>   Number of seconds between retries (defaults to
                            30).
    --start-time <arg>      Get only clips modified after this time,
                            formatted as '2017-01-30T13:00:00Z'.
    --threads <arg>         Number of threads to use (1-128).  Should be a
                            power of 2 since there's 128 DTs to dump.

Dumping CAS clips:   
When dumping CAS clips in a pool (bucket), use the --filter-clips option to only include the ClipIDs in the pool. If you omit this option, you will get both clips and blobs.