"./operations.test -test.v -test.timeout 30m0s -remote TestS3Wasabi: -verbose -fast-list" - Starting (try 1/5) === RUN TestDoMultiThreadCopy --- PASS: TestDoMultiThreadCopy (0.00s) === RUN TestMultithreadCalculateChunks === RUN TestMultithreadCalculateChunks/{size:1_streams:10_wantPartSize:65536_wantStreams:1} === RUN TestMultithreadCalculateChunks/{size:1048576_streams:1_wantPartSize:1048576_wantStreams:1} === RUN TestMultithreadCalculateChunks/{size:1048576_streams:2_wantPartSize:524288_wantStreams:2} === RUN TestMultithreadCalculateChunks/{size:1048577_streams:2_wantPartSize:589824_wantStreams:2} === RUN TestMultithreadCalculateChunks/{size:1048575_streams:2_wantPartSize:524288_wantStreams:2} --- PASS: TestMultithreadCalculateChunks (0.00s) --- PASS: TestMultithreadCalculateChunks/{size:1_streams:10_wantPartSize:65536_wantStreams:1} (0.00s) --- PASS: TestMultithreadCalculateChunks/{size:1048576_streams:1_wantPartSize:1048576_wantStreams:1} (0.00s) --- PASS: TestMultithreadCalculateChunks/{size:1048576_streams:2_wantPartSize:524288_wantStreams:2} (0.00s) --- PASS: TestMultithreadCalculateChunks/{size:1048577_streams:2_wantPartSize:589824_wantStreams:2} (0.00s) --- PASS: TestMultithreadCalculateChunks/{size:1048575_streams:2_wantPartSize:524288_wantStreams:2} (0.00s) === RUN TestMultithreadCopy === RUN TestMultithreadCopy/{size:131071_streams:2} 2020/03/09 05:24:55 INFO : S3 bucket rclone-test-simizoc1xexayaw8periviy9: Bucket "rclone-test-simizoc1xexayaw8periviy9" created with ACL "private" 2020/03/09 05:24:55 DEBUG : file1: Starting multi-thread copy with 2 parts of size 64k 2020/03/09 05:24:55 DEBUG : file1: multi-thread copy: stream 2/2 (65536-131071) size 63.999k starting 2020/03/09 05:24:55 DEBUG : file1: multi-thread copy: stream 1/2 (0-65536) size 64k starting 2020/03/09 05:24:56 DEBUG : file1: multi-thread copy: stream 2/2 (65536-131071) size 63.999k finished 2020/03/09 05:24:56 DEBUG : file1: multi-thread copy: stream 1/2 (0-65536) size 64k finished 2020/03/09 05:24:56 DEBUG : file1: Finished multi-thread copy with 2 parts of size 64k === RUN TestMultithreadCopy/{size:131072_streams:2} 2020/03/09 05:24:56 DEBUG : file1: Starting multi-thread copy with 2 parts of size 64k 2020/03/09 05:24:56 DEBUG : file1: multi-thread copy: stream 2/2 (65536-131072) size 64k starting 2020/03/09 05:24:56 DEBUG : file1: multi-thread copy: stream 1/2 (0-65536) size 64k starting 2020/03/09 05:24:56 DEBUG : file1: multi-thread copy: stream 2/2 (65536-131072) size 64k finished 2020/03/09 05:24:56 DEBUG : file1: multi-thread copy: stream 1/2 (0-65536) size 64k finished 2020/03/09 05:24:56 DEBUG : file1: Finished multi-thread copy with 2 parts of size 64k === RUN TestMultithreadCopy/{size:131073_streams:2} 2020/03/09 05:24:57 DEBUG : file1: Starting multi-thread copy with 2 parts of size 128k 2020/03/09 05:24:57 DEBUG : file1: multi-thread copy: stream 2/2 (131072-131073) size 1 starting 2020/03/09 05:24:57 DEBUG : file1: multi-thread copy: stream 1/2 (0-131072) size 128k starting 2020/03/09 05:24:57 DEBUG : file1: multi-thread copy: stream 2/2 (131072-131073) size 1 finished 2020/03/09 05:24:57 DEBUG : file1: multi-thread copy: stream 1/2 (0-131072) size 128k finished 2020/03/09 05:24:57 DEBUG : file1: Finished multi-thread copy with 2 parts of size 128k --- PASS: TestMultithreadCopy (3.46s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" --- PASS: TestMultithreadCopy/{size:131071_streams:2} (1.53s) --- PASS: TestMultithreadCopy/{size:131072_streams:2} (0.71s) --- PASS: TestMultithreadCopy/{size:131073_streams:2} (0.99s) === RUN TestSizeDiffers --- PASS: TestSizeDiffers (0.00s) === RUN TestReOpen === RUN TestReOpen/Seek === RUN TestReOpen/Seek/Basics === RUN TestReOpen/Seek/ErrorAtStart === RUN TestReOpen/Seek/WithErrors 2020/03/09 05:24:58 DEBUG : potato: Reopening on read failure after 2 bytes: retry 1/10: test error 2020/03/09 05:24:58 DEBUG : potato: Reopening on read failure after 3 bytes: retry 2/10: test error 2020/03/09 05:24:58 DEBUG : potato: Reopening on read failure after 6 bytes: retry 3/10: test error === RUN TestReOpen/Seek/TooManyErrors 2020/03/09 05:24:58 DEBUG : potato: Reopening on read failure after 2 bytes: retry 1/3: test error 2020/03/09 05:24:58 DEBUG : potato: Reopening on read failure after 3 bytes: retry 2/3: test error 2020/03/09 05:24:58 DEBUG : potato: Reopening on read failure after 6 bytes: retry 3/3: test error 2020/03/09 05:24:58 DEBUG : potato: Reopen failed after 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/Range === RUN TestReOpen/Range/Basics === RUN TestReOpen/Range/ErrorAtStart === RUN TestReOpen/Range/WithErrors 2020/03/09 05:24:58 DEBUG : potato: Reopening on read failure after 2 bytes: retry 1/10: test error 2020/03/09 05:24:58 DEBUG : potato: Reopening on read failure after 3 bytes: retry 2/10: test error 2020/03/09 05:24:58 DEBUG : potato: Reopening on read failure after 6 bytes: retry 3/10: test error === RUN TestReOpen/Range/TooManyErrors 2020/03/09 05:24:58 DEBUG : potato: Reopening on read failure after 2 bytes: retry 1/3: test error 2020/03/09 05:24:58 DEBUG : potato: Reopening on read failure after 3 bytes: retry 2/3: test error 2020/03/09 05:24:58 DEBUG : potato: Reopening on read failure after 6 bytes: retry 3/3: test error 2020/03/09 05:24:58 DEBUG : potato: Reopen failed after 6 bytes read: failed to reopen: too many retries --- PASS: TestReOpen (0.00s) --- PASS: TestReOpen/Seek (0.00s) --- PASS: TestReOpen/Seek/Basics (0.00s) --- PASS: TestReOpen/Seek/ErrorAtStart (0.00s) --- PASS: TestReOpen/Seek/WithErrors (0.00s) --- PASS: TestReOpen/Seek/TooManyErrors (0.00s) --- PASS: TestReOpen/Range (0.00s) --- PASS: TestReOpen/Range/Basics (0.00s) --- PASS: TestReOpen/Range/ErrorAtStart (0.00s) --- PASS: TestReOpen/Range/WithErrors (0.00s) --- PASS: TestReOpen/Range/TooManyErrors (0.00s) === RUN TestDeduplicateInteractive --- SKIP: TestDeduplicateInteractive (0.17s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" dedupe_test.go:23: Can't test deduplicate - no duplicate files possible === RUN TestDeduplicateSkip --- SKIP: TestDeduplicateSkip (0.16s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" dedupe_test.go:23: Can't test deduplicate - no duplicate files possible === RUN TestDeduplicateFirst --- SKIP: TestDeduplicateFirst (0.18s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" dedupe_test.go:23: Can't test deduplicate - no duplicate files possible === RUN TestDeduplicateNewest --- SKIP: TestDeduplicateNewest (0.16s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" dedupe_test.go:23: Can't test deduplicate - no duplicate files possible === RUN TestDeduplicateOldest --- SKIP: TestDeduplicateOldest (0.16s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" dedupe_test.go:23: Can't test deduplicate - no duplicate files possible === RUN TestDeduplicateLargest --- SKIP: TestDeduplicateLargest (0.16s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" dedupe_test.go:23: Can't test deduplicate - no duplicate files possible === RUN TestDeduplicateSmallest --- SKIP: TestDeduplicateSmallest (0.16s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" dedupe_test.go:23: Can't test deduplicate - no duplicate files possible === RUN TestDeduplicateRename --- SKIP: TestDeduplicateRename (0.16s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" dedupe_test.go:23: Can't test deduplicate - no duplicate files possible === RUN TestMergeDirs --- SKIP: TestMergeDirs (0.16s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" dedupe_test.go:217: Can't merge directories === RUN TestListDirSorted 2020/03/09 05:25:01 DEBUG : a.txt: Excluded 2020/03/09 05:25:01 DEBUG : sub dir/hello world: Excluded 2020/03/09 05:25:01 DEBUG : sub dir/hello world2: Excluded 2020/03/09 05:25:03 DEBUG : sub dir/ignore dir: Excluded 2020/03/09 05:25:03 DEBUG : sub dir/hello world: Excluded 2020/03/09 05:25:03 DEBUG : sub dir/hello world2: Excluded 2020/03/09 05:25:03 DEBUG : sub dir/ignore dir: Excluded --- PASS: TestListDirSorted (4.51s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestMkdir 2020/03/09 05:25:04 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: Making directory 2020/03/09 05:25:04 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: Making directory --- PASS: TestMkdir (0.23s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestLsd --- PASS: TestLsd (0.64s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestLs --- PASS: TestLs (0.96s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestLsWithFilesFrom 2020/03/09 05:25:06 DEBUG : empty space: Excluded from sync (and deletion) --- PASS: TestLsWithFilesFrom (1.04s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestLsLong --- PASS: TestLsLong (1.12s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestHashSums --- PASS: TestHashSums (1.15s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestSuffixName --- PASS: TestSuffixName (0.00s) === RUN TestCount --- PASS: TestCount (1.23s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestDelete 2020/03/09 05:25:11 DEBUG : Waiting for deletions to finish 2020/03/09 05:25:11 DEBUG : large: Excluded from sync (and deletion) 2020/03/09 05:25:11 INFO : medium: Deleted 2020/03/09 05:25:11 INFO : small: Deleted --- PASS: TestDelete (1.32s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestCheck 2020/03/09 05:25:12 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 1: Starting check test 2020/03/09 05:25:12 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 2: Starting check test 2020/03/09 05:25:12 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 3: Starting check test 2020/03/09 05:25:13 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 4: Starting check test 2020/03/09 05:25:13 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 5: Starting check test 2020/03/09 05:25:13 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 6: Starting check test 2020/03/09 05:25:13 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 7: Starting check test --- PASS: TestCheck (2.71s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestCheckFsError 2020/03/09 05:25:14 DEBUG : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/non-existent: Waiting for checks to finish 2020/03/09 05:25:14 ERROR : : error reading source directory: directory not found 2020/03/09 05:25:14 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/non-existent: 1 differences found --- PASS: TestCheckFsError (0.00s) === RUN TestCheckDownload 2020/03/09 05:25:14 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 1: Starting check test 2020/03/09 05:25:14 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 2: Starting check test 2020/03/09 05:25:15 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 3: Starting check test 2020/03/09 05:25:16 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 4: Starting check test 2020/03/09 05:25:16 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 5: Starting check test 2020/03/09 05:25:17 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 6: Starting check test 2020/03/09 05:25:17 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 7: Starting check test --- PASS: TestCheckDownload (3.82s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestCheckSizeOnly 2020/03/09 05:25:18 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 1: Starting check test 2020/03/09 05:25:18 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 2: Starting check test 2020/03/09 05:25:19 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 3: Starting check test 2020/03/09 05:25:19 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 4: Starting check test 2020/03/09 05:25:19 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 5: Starting check test 2020/03/09 05:25:20 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 6: Starting check test 2020/03/09 05:25:20 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: 7: Starting check test --- PASS: TestCheckSizeOnly (2.71s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestCat --- PASS: TestCat (1.79s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestPurge 2020/03/09 05:25:22 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2020/03/09 05:25:22 INFO : S3 bucket rclone-test-fulosux6xepexiy6detepoz2: Bucket "rclone-test-fulosux6xepexiy6detepoz2" created with ACL "private" 2020/03/09 05:25:23 DEBUG : A2: Making directory 2020/03/09 05:25:23 DEBUG : A1/B2: Making directory 2020/03/09 05:25:23 DEBUG : A1/B2/C2: Making directory 2020/03/09 05:25:23 DEBUG : A1/B1/C3: Making directory 2020/03/09 05:25:23 DEBUG : A3: Making directory 2020/03/09 05:25:23 DEBUG : A3/B3: Making directory 2020/03/09 05:25:23 DEBUG : A3/B3/C4: Making directory 2020/03/09 05:25:23 DEBUG : Waiting for deletions to finish 2020/03/09 05:25:23 INFO : A1/B1/C1/one: Deleted 2020/03/09 05:25:23 DEBUG : A1/B1: Removing directory 2020/03/09 05:25:23 DEBUG : Waiting for deletions to finish 2020/03/09 05:25:24 INFO : A1/two: Deleted 2020/03/09 05:25:24 DEBUG : S3 bucket rclone-test-fulosux6xepexiy6detepoz2: Removing directory 2020/03/09 05:25:24 INFO : S3 bucket rclone-test-fulosux6xepexiy6detepoz2: Bucket "rclone-test-fulosux6xepexiy6detepoz2" deleted 2020/03/09 05:25:24 DEBUG : S3 bucket rclone-test-fulosux6xepexiy6detepoz2: Purge dir "" 2020/03/09 05:25:24 purge failed to rmdir "": bucket already deleted 2020/03/09 05:25:24 purge failed: directory not found --- PASS: TestPurge (1.62s) run.go:176: Remote "S3 bucket rclone-test-fulosux6xepexiy6detepoz2", Local "Local file system at /tmp/rclone539126960", Modify Window "1ns" fstest.go:241: Filtering empty directory "A2" fstest.go:241: Filtering empty directory "A1/B2" fstest.go:241: Filtering empty directory "A1/B2/C2" fstest.go:241: Filtering empty directory "A1/B1/C3" fstest.go:241: Filtering empty directory "A3" fstest.go:241: Filtering empty directory "A3/B3" fstest.go:241: Filtering empty directory "A3/B3/C4" fstest.go:241: Filtering empty directory "A2" fstest.go:241: Filtering empty directory "A1/B2" fstest.go:241: Filtering empty directory "A1/B2/C2" fstest.go:241: Filtering empty directory "A3" fstest.go:241: Filtering empty directory "A3/B3" fstest.go:241: Filtering empty directory "A3/B3/C4" === RUN TestRmdirsNoLeaveRoot 2020/03/09 05:25:24 DEBUG : A2: Making directory 2020/03/09 05:25:24 DEBUG : A1/B2: Making directory 2020/03/09 05:25:24 DEBUG : A1/B2/C2: Making directory 2020/03/09 05:25:24 DEBUG : A1/B1/C3: Making directory 2020/03/09 05:25:24 DEBUG : A3: Making directory 2020/03/09 05:25:24 DEBUG : A3/B3: Making directory 2020/03/09 05:25:24 DEBUG : A3/B3/C4: Making directory 2020/03/09 05:25:25 DEBUG : A3/B3/C4: Removing directory --- PASS: TestRmdirsNoLeaveRoot (1.47s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" fstest.go:241: Filtering empty directory "A2" fstest.go:241: Filtering empty directory "A1/B2" fstest.go:241: Filtering empty directory "A1/B2/C2" fstest.go:241: Filtering empty directory "A1/B1/C3" fstest.go:241: Filtering empty directory "A3" fstest.go:241: Filtering empty directory "A3/B3" fstest.go:241: Filtering empty directory "A3/B3/C4" fstest.go:241: Filtering empty directory "A2" fstest.go:241: Filtering empty directory "A1/B2" fstest.go:241: Filtering empty directory "A1/B2/C2" fstest.go:241: Filtering empty directory "A1/B1/C3" fstest.go:241: Filtering empty directory "A3" fstest.go:241: Filtering empty directory "A3/B3" === RUN TestRmdirsLeaveRoot 2020/03/09 05:25:25 DEBUG : A1: Making directory 2020/03/09 05:25:25 DEBUG : A1/B1: Making directory 2020/03/09 05:25:25 DEBUG : A1/B1/C1: Making directory --- PASS: TestRmdirsLeaveRoot (0.38s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" fstest.go:241: Filtering empty directory "A1" fstest.go:241: Filtering empty directory "A1/B1" fstest.go:241: Filtering empty directory "A1/B1/C1" fstest.go:241: Filtering empty directory "A1" === RUN TestCopyURL --- PASS: TestCopyURL (1.45s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestCopyURLToWriter --- PASS: TestCopyURLToWriter (0.00s) === RUN TestMoveFile 2020/03/09 05:25:27 DEBUG : file1: Need to transfer - File not found at Destination 2020/03/09 05:25:27 DEBUG : file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/03/09 05:25:27 INFO : file1: Copied (new) 2020/03/09 05:25:27 INFO : file1: Deleted 2020/03/09 05:25:28 DEBUG : file1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2020/03/09 05:25:28 DEBUG : file1: Unchanged skipping 2020/03/09 05:25:28 INFO : file1: Deleted 2020/03/09 05:25:28 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: don't need to copy/move sub/file2, it is already at target location --- PASS: TestMoveFile (1.04s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestCaseInsensitiveMoveFile --- PASS: TestCaseInsensitiveMoveFile (0.16s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestMoveFileBackupDir 2020/03/09 05:25:29 DEBUG : dst/file1: Sizes differ (src 14 vs dst 18) 2020/03/09 05:25:29 INFO : S3 bucket rclone-test-simizoc1xexayaw8periviy9 path backup: Bucket "rclone-test-simizoc1xexayaw8periviy9" created with ACL "private" 2020/03/09 05:25:29 DEBUG : dst/file1: MD5 = 05164b153084ba910184c26e561a7c18 OK 2020/03/09 05:25:29 INFO : dst/file1: Copied (server side copy) 2020/03/09 05:25:30 INFO : dst/file1: Deleted 2020/03/09 05:25:30 DEBUG : dst/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/03/09 05:25:30 INFO : dst/file1: Copied (new) 2020/03/09 05:25:30 INFO : dst/file1: Deleted --- PASS: TestMoveFileBackupDir (1.87s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestCopyFile 2020/03/09 05:25:30 DEBUG : file1: Need to transfer - File not found at Destination 2020/03/09 05:25:31 DEBUG : file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/03/09 05:25:31 INFO : file1: Copied (new) 2020/03/09 05:25:31 DEBUG : file1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2020/03/09 05:25:31 DEBUG : file1: Unchanged skipping 2020/03/09 05:25:31 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: don't need to copy/move sub/file2, it is already at target location --- PASS: TestCopyFile (1.06s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestCopyFileBackupDir 2020/03/09 05:25:32 DEBUG : dst/file1: Sizes differ (src 14 vs dst 18) 2020/03/09 05:25:32 INFO : S3 bucket rclone-test-simizoc1xexayaw8periviy9 path backup: Bucket "rclone-test-simizoc1xexayaw8periviy9" created with ACL "private" 2020/03/09 05:25:32 DEBUG : dst/file1: MD5 = 05164b153084ba910184c26e561a7c18 OK 2020/03/09 05:25:32 INFO : dst/file1: Copied (server side copy) 2020/03/09 05:25:32 INFO : dst/file1: Deleted 2020/03/09 05:25:32 DEBUG : dst/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/03/09 05:25:32 INFO : dst/file1: Copied (new) --- PASS: TestCopyFileBackupDir (1.62s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestCopyFileCompareDest 2020/03/09 05:25:33 DEBUG : one: Need to transfer - File not found at Destination 2020/03/09 05:25:33 INFO : S3 bucket rclone-test-simizoc1xexayaw8periviy9 path dst: Bucket "rclone-test-simizoc1xexayaw8periviy9" created with ACL "private" 2020/03/09 05:25:34 DEBUG : one: MD5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2020/03/09 05:25:34 INFO : one: Copied (new) 2020/03/09 05:25:34 DEBUG : one: Sizes differ (src 5 vs dst 3) 2020/03/09 05:25:34 DEBUG : one: MD5 = 07912d142f5d63ee918b34796b5a2432 OK 2020/03/09 05:25:34 INFO : one: Copied (replaced existing) 2020/03/09 05:25:35 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2020/03/09 05:25:35 DEBUG : one: Destination found in --compare-dest, skipping 2020/03/09 05:25:36 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2020/03/09 05:25:36 DEBUG : two: Destination found in --compare-dest, skipping 2020/03/09 05:25:36 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2020/03/09 05:25:36 DEBUG : two: Destination found in --compare-dest, skipping 2020/03/09 05:25:37 DEBUG : two: Sizes differ (src 5 vs dst 3) 2020/03/09 05:25:37 DEBUG : two: Need to transfer - File not found at Destination 2020/03/09 05:25:37 DEBUG : two: MD5 = 2379e4ce8c3380e996ab0509f17069ad OK 2020/03/09 05:25:37 INFO : two: Copied (new) --- PASS: TestCopyFileCompareDest (5.31s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestCopyFileCopyDest 2020/03/09 05:25:39 DEBUG : one: Need to transfer - File not found at Destination 2020/03/09 05:25:39 INFO : S3 bucket rclone-test-simizoc1xexayaw8periviy9 path dst: Bucket "rclone-test-simizoc1xexayaw8periviy9" created with ACL "private" 2020/03/09 05:25:39 DEBUG : one: MD5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2020/03/09 05:25:39 INFO : one: Copied (new) 2020/03/09 05:25:39 DEBUG : one: Sizes differ (src 5 vs dst 3) 2020/03/09 05:25:40 DEBUG : one: MD5 = 07912d142f5d63ee918b34796b5a2432 OK 2020/03/09 05:25:40 INFO : one: Copied (replaced existing) 2020/03/09 05:25:40 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2020/03/09 05:25:40 DEBUG : one: Sizes differ (src 5 vs dst 3) 2020/03/09 05:25:41 INFO : S3 bucket rclone-test-simizoc1xexayaw8periviy9 path BackupDir: Bucket "rclone-test-simizoc1xexayaw8periviy9" created with ACL "private" 2020/03/09 05:25:41 DEBUG : one: MD5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2020/03/09 05:25:41 INFO : one: Copied (server side copy) 2020/03/09 05:25:41 INFO : one: Deleted 2020/03/09 05:25:41 DEBUG : one: MD5 = 07912d142f5d63ee918b34796b5a2432 OK 2020/03/09 05:25:41 INFO : one: Copied (server side copy) 2020/03/09 05:25:41 DEBUG : one: Destination found in --copy-dest, using server side copy 2020/03/09 05:25:42 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2020/03/09 05:25:42 DEBUG : two: MD5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2020/03/09 05:25:42 INFO : two: Copied (server side copy) 2020/03/09 05:25:42 DEBUG : two: Destination found in --copy-dest, using server side copy 2020/03/09 05:25:43 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2020/03/09 05:25:43 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2020/03/09 05:25:43 DEBUG : two: Unchanged skipping 2020/03/09 05:25:44 DEBUG : three: Sizes differ (src 7 vs dst 5) 2020/03/09 05:25:44 DEBUG : three: Destination not found in --copy-dest 2020/03/09 05:25:44 DEBUG : three: Need to transfer - File not found at Destination 2020/03/09 05:25:44 DEBUG : three: MD5 = 1bccb9dccb3e9f6a3f9d2a8bdb54b7f5 OK 2020/03/09 05:25:44 INFO : three: Copied (new) --- PASS: TestCopyFileCopyDest (7.45s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestSameConfig --- PASS: TestSameConfig (0.00s) === RUN TestSame --- PASS: TestSame (0.00s) === RUN TestOverlapping --- PASS: TestOverlapping (0.00s) === RUN TestCheckEqualReaders --- PASS: TestCheckEqualReaders (0.00s) === RUN TestListFormat --- PASS: TestListFormat (0.00s) === RUN TestDirMove 2020/03/09 05:25:47 DEBUG : A1/B2: Making directory 2020/03/09 05:25:47 DEBUG : A1/B1/C3: Making directory 2020/03/09 05:25:47 DEBUG : A1/B1/C2/five: MD5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2020/03/09 05:25:47 INFO : A1/B1/C2/five: Copied (server side copy) 2020/03/09 05:25:47 DEBUG : A1/B1/C1/four: MD5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2020/03/09 05:25:47 INFO : A1/B1/C1/four: Copied (server side copy) 2020/03/09 05:25:48 DEBUG : A1/B1/three: MD5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2020/03/09 05:25:48 INFO : A1/B1/three: Copied (server side copy) 2020/03/09 05:25:48 DEBUG : A1/one: MD5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2020/03/09 05:25:48 INFO : A1/one: Copied (server side copy) 2020/03/09 05:25:48 INFO : A1/B1/C2/five: Deleted 2020/03/09 05:25:48 INFO : A1/B1/C1/four: Deleted 2020/03/09 05:25:48 INFO : A1/one: Deleted 2020/03/09 05:25:48 INFO : A1/B1/three: Deleted 2020/03/09 05:25:48 DEBUG : A1/two: MD5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2020/03/09 05:25:48 INFO : A1/two: Copied (server side copy) 2020/03/09 05:25:48 INFO : A1/two: Deleted 2020/03/09 05:25:49 DEBUG : A2/B1/C2/five: MD5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2020/03/09 05:25:49 INFO : A2/B1/C2/five: Copied (server side copy) 2020/03/09 05:25:49 DEBUG : A2/B1/three: MD5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2020/03/09 05:25:49 INFO : A2/B1/three: Copied (server side copy) 2020/03/09 05:25:49 DEBUG : A2/B1/C1/four: MD5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2020/03/09 05:25:49 INFO : A2/B1/C1/four: Copied (server side copy) 2020/03/09 05:25:49 DEBUG : A2/one: MD5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2020/03/09 05:25:49 INFO : A2/one: Copied (server side copy) 2020/03/09 05:25:49 INFO : A2/B1/C2/five: Deleted 2020/03/09 05:25:49 INFO : A2/B1/C1/four: Deleted 2020/03/09 05:25:49 INFO : A2/B1/three: Deleted 2020/03/09 05:25:49 INFO : A2/one: Deleted 2020/03/09 05:25:49 DEBUG : A2/two: MD5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2020/03/09 05:25:49 INFO : A2/two: Copied (server side copy) 2020/03/09 05:25:49 INFO : A2/two: Deleted --- PASS: TestDirMove (4.35s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" fstest.go:241: Filtering empty directory "A1/B2" fstest.go:241: Filtering empty directory "A1/B1/C3" fstest.go:241: Filtering empty directory "A2/B2" fstest.go:241: Filtering empty directory "A2/B1/C3" fstest.go:241: Filtering empty directory "A3/B2" fstest.go:241: Filtering empty directory "A3/B1/C3" === RUN TestGetFsInfo --- PASS: TestGetFsInfo (0.15s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestRcat === RUN TestRcat/withChecksum=false,ignoreChecksum=false 2020/03/09 05:25:50 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: File to upload is small (34 bytes), uploading instead of streaming 2020/03/09 05:25:50 DEBUG : no_checksum_small_file_from_pipe: MD5 = 4c762bc6ec18f21b23fcae426c7863b5 OK 2020/03/09 05:25:50 INFO : no_checksum_small_file_from_pipe: Copied (new) 2020/03/09 05:25:50 NOTICE: S3 bucket rclone-test-simizoc1xexayaw8periviy9: Streaming uploads using chunk size 5M will have maximum file size of 48.828G 2020/03/09 05:25:51 DEBUG : no_checksum_big_file_from_pipe: multipart upload starting chunk 1 size 100.001k offset 0/off 2020/03/09 05:25:51 DEBUG : no_checksum_big_file_from_pipe: Size and modification time the same (differ by 0s, within tolerance 1ns) === RUN TestRcat/withChecksum=true,ignoreChecksum=false 2020/03/09 05:25:52 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: File to upload is small (34 bytes), uploading instead of streaming 2020/03/09 05:25:52 DEBUG : with_checksum_small_file_from_pipe: MD5 = 4c762bc6ec18f21b23fcae426c7863b5 OK 2020/03/09 05:25:52 INFO : with_checksum_small_file_from_pipe: Copied (new) 2020/03/09 05:25:52 DEBUG : with_checksum_big_file_from_pipe: multipart upload starting chunk 1 size 100.001k offset 0/off 2020/03/09 05:25:52 NOTICE: S3 bucket rclone-test-simizoc1xexayaw8periviy9: --checksum is in use but the source and destination have no hashes in common; falling back to --size-only 2020/03/09 05:25:52 DEBUG : with_checksum_big_file_from_pipe: Size of src and dst objects identical === RUN TestRcat/withChecksum=false,ignoreChecksum=true 2020/03/09 05:25:53 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: File to upload is small (34 bytes), uploading instead of streaming 2020/03/09 05:25:53 INFO : ignore_checksum_small_file_from_pipe: Copied (new) 2020/03/09 05:25:53 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload starting chunk 1 size 100.001k offset 0/off 2020/03/09 05:25:53 DEBUG : ignore_checksum_big_file_from_pipe: Size and modification time the same (differ by 0s, within tolerance 1ns) === RUN TestRcat/withChecksum=true,ignoreChecksum=true 2020/03/09 05:25:54 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: File to upload is small (34 bytes), uploading instead of streaming 2020/03/09 05:25:54 INFO : ignore_checksum_small_file_from_pipe: Copied (new) 2020/03/09 05:25:54 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload starting chunk 1 size 100.001k offset 0/off 2020/03/09 05:25:54 DEBUG : ignore_checksum_big_file_from_pipe: Size of src and dst objects identical --- PASS: TestRcat (4.74s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" --- PASS: TestRcat/withChecksum=false,ignoreChecksum=false (1.37s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" --- PASS: TestRcat/withChecksum=true,ignoreChecksum=false (1.15s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" --- PASS: TestRcat/withChecksum=false,ignoreChecksum=true (1.14s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" --- PASS: TestRcat/withChecksum=true,ignoreChecksum=true (1.08s) === RUN TestRcatSize 2020/03/09 05:25:55 DEBUG : S3 bucket rclone-test-simizoc1xexayaw8periviy9: File to upload is small (60 bytes), uploading instead of streaming 2020/03/09 05:25:55 DEBUG : potato2: MD5 = d6548b156ea68a4e003e786df99eee76 OK 2020/03/09 05:25:55 INFO : potato2: Copied (new) --- PASS: TestRcatSize (0.83s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" === RUN TestCopyFileMaxTransfer 2020/03/09 05:25:56 DEBUG : file1: Need to transfer - File not found at Destination 2020/03/09 05:25:56 DEBUG : file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/03/09 05:25:56 INFO : file1: Copied (new) 2020/03/09 05:25:56 DEBUG : file2: Need to transfer - File not found at Destination 2020/03/09 05:25:56 ERROR : file2: Failed to copy: Put https://s3.wasabisys.com/rclone-test-simizoc1xexayaw8periviy9/sub/file2?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=W4KG518AP72N7NQEE3BY%2F20200309%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200309T052556Z&X-Amz-Expires=900&X-Amz-SignedHeaders=content-md5%3Bcontent-type%3Bhost%3Bx-amz-acl%3Bx-amz-meta-mtime&X-Amz-Signature=f84721ff691412c84cc5050d864965c3c44c16decb7da7b82653a0e208e86456: Max transfer limit reached as set by --max-transfer 2020/03/09 05:27:00 DEBUG : file2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2020/03/09 05:27:00 DEBUG : file2: Unchanged skipping --- FAIL: TestCopyFileMaxTransfer (128.09s) run.go:176: Remote "S3 bucket rclone-test-simizoc1xexayaw8periviy9", Local "Local file system at /tmp/rclone804400206", Modify Window "1ns" fstest.go:289: Sleeping for 1s for list eventual consistency: 1/6 fstest.go:289: Sleeping for 2s for list eventual consistency: 2/6 fstest.go:289: Sleeping for 4s for list eventual consistency: 3/6 fstest.go:289: Sleeping for 8s for list eventual consistency: 4/6 fstest.go:289: Sleeping for 16s for list eventual consistency: 5/6 fstest.go:289: Sleeping for 32s for list eventual consistency: 6/6 fstest.go:296: Error Trace: fstest.go:296 fstest.go:329 fstest.go:341 operations_test.go:1565 Error: Should be true Test: TestCopyFileMaxTransfer Messages: listing wrong, want sub/file1 (14) got sub/file1 (14), sub/file2 (25) fstest.go:182: Error Trace: fstest.go:182 fstest.go:299 fstest.go:329 fstest.go:341 operations_test.go:1565 Error: Should be true Test: TestCopyFileMaxTransfer Messages: Unexpected file "sub/file2" fstest.go:289: Sleeping for 1s for list eventual consistency: 1/6 fstest.go:289: Sleeping for 2s for list eventual consistency: 2/6 fstest.go:289: Sleeping for 4s for list eventual consistency: 3/6 fstest.go:289: Sleeping for 8s for list eventual consistency: 4/6 fstest.go:289: Sleeping for 16s for list eventual consistency: 5/6 fstest.go:289: Sleeping for 32s for list eventual consistency: 6/6 fstest.go:296: Error Trace: fstest.go:296 fstest.go:329 fstest.go:341 operations_test.go:1574 Error: Should be true Test: TestCopyFileMaxTransfer Messages: listing wrong, want sub/file1 (14) got sub/file1 (14), sub/file2 (25) fstest.go:182: Error Trace: fstest.go:182 fstest.go:299 fstest.go:329 fstest.go:341 operations_test.go:1574 Error: Should be true Test: TestCopyFileMaxTransfer Messages: Unexpected file "sub/file2" panic: runtime error: invalid memory address or nil pointer dereference [recovered] panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x11c0b38] goroutine 2144 [running]: testing.tRunner.func1(0xc00083a000) /usr/local/go/src/testing/testing.go:874 +0x3a3 panic(0x1377560, 0x22dab60) /usr/local/go/src/runtime/panic.go:679 +0x1b2 github.com/rclone/rclone/fs/operations_test.TestCopyFileMaxTransfer(0xc00083a000) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1575 +0xa88 testing.tRunner(0xc00083a000, 0x15fe100) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 "./operations.test -test.v -test.timeout 30m0s -remote TestS3Wasabi: -verbose -fast-list" - Finished ERROR in 3m9.771003355s (try 1/5): exit status 2: Failed [TestCopyFileMaxTransfer]