"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bSHA1QuickS3: -verbose -size-limit 1024 -test.run '^TestServerSideMoveDeleteEmptySourceDirs$'" - Starting (try 4/5) 2020/12/27 05:08:58 DEBUG : Creating backend with remote "TestChunkerChunk50bSHA1QuickS3:rclone-test-ruvasux6jivarab9peheday2" 2020/12/27 05:08:58 DEBUG : Creating backend with remote "TestS3:rclone-test-ruvasux6jivarab9peheday2" 2020/12/27 05:08:58 DEBUG : Reset feature "ListR" 2020/12/27 05:08:58 DEBUG : Creating backend with remote "/tmp/rclone482948048" === RUN TestServerSideMoveDeleteEmptySourceDirs run.go:176: Remote "Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-ruvasux6jivarab9peheday2'", Local "Local file system at /tmp/rclone482948048", Modify Window "1ns" 2020/12/27 05:08:58 DEBUG : Creating backend with remote "TestChunkerChunk50bSHA1QuickS3:rclone-test-huwovit7dejoxoq7hesapan3" 2020/12/27 05:08:58 DEBUG : Creating backend with remote "TestS3:rclone-test-huwovit7dejoxoq7hesapan3" 2020/12/27 05:08:58 DEBUG : Reset feature "ListR" 2020/12/27 05:08:59 INFO : S3 bucket rclone-test-ruvasux6jivarab9peheday2: Bucket "rclone-test-ruvasux6jivarab9peheday2" created with ACL "private" 2020/12/27 05:08:59 DEBUG : potato2.rclone_chunk.001_zkt27l: MD5 = dbbc040ac83a6f6c6816767a36d34c7b OK 2020/12/27 05:08:59 INFO : potato2.rclone_chunk.001_zkt27l: Copied (server-side copy) to: potato2.rclone_chunk.001 2020/12/27 05:08:59 INFO : potato2.rclone_chunk.001_zkt27l: Deleted 2020/12/27 05:08:59 DEBUG : potato2.rclone_chunk.002_zkt27l: MD5 = 01a6651a94ab602dbfc47587d234b52c OK 2020/12/27 05:08:59 INFO : potato2.rclone_chunk.002_zkt27l: Copied (server-side copy) to: potato2.rclone_chunk.002 2020/12/27 05:08:59 INFO : potato2.rclone_chunk.002_zkt27l: Deleted 2020/12/27 05:08:59 DEBUG : empty space.rclone_chunk.001_zkt222: MD5 = 336d5ebc5436534e61d16e63ddfca327 OK 2020/12/27 05:08:59 INFO : empty space.rclone_chunk.001_zkt222: Copied (server-side copy) to: empty space 2020/12/27 05:08:59 INFO : empty space.rclone_chunk.001_zkt222: Deleted 2020/12/27 05:09:00 DEBUG : potato3.rclone_chunk.001_zkt27s: MD5 = dbbc040ac83a6f6c6816767a36d34c7b OK 2020/12/27 05:09:00 INFO : potato3.rclone_chunk.001_zkt27s: Copied (server-side copy) to: potato3.rclone_chunk.001 2020/12/27 05:09:00 INFO : potato3.rclone_chunk.001_zkt27s: Deleted 2020/12/27 05:09:00 DEBUG : potato3.rclone_chunk.002_zkt27s: MD5 = 111c387f2584838efb7e0ec6f2fa2e10 OK 2020/12/27 05:09:00 INFO : potato3.rclone_chunk.002_zkt27s: Copied (server-side copy) to: potato3.rclone_chunk.002 2020/12/27 05:09:00 INFO : potato3.rclone_chunk.002_zkt27s: Deleted 2020/12/27 05:09:00 DEBUG : tomatoDir: Making directory sync_test.go:1294: Server side move (if possible) Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-ruvasux6jivarab9peheday2' -> Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-huwovit7dejoxoq7hesapan3' 2020/12/27 05:09:00 INFO : S3 bucket rclone-test-huwovit7dejoxoq7hesapan3: Bucket "rclone-test-huwovit7dejoxoq7hesapan3" created with ACL "private" 2020/12/27 05:09:01 DEBUG : empty space.rclone_chunk.001_zkt3oz: MD5 = 336d5ebc5436534e61d16e63ddfca327 OK 2020/12/27 05:09:01 INFO : empty space.rclone_chunk.001_zkt3oz: Copied (server-side copy) to: empty space 2020/12/27 05:09:01 INFO : empty space.rclone_chunk.001_zkt3oz: Deleted 2020/12/27 05:09:01 DEBUG : potato3.rclone_chunk.001_zkt43l: MD5 = dbbc040ac83a6f6c6816767a36d34c7b OK 2020/12/27 05:09:01 INFO : potato3.rclone_chunk.001_zkt43l: Copied (server-side copy) to: potato3.rclone_chunk.001 2020/12/27 05:09:01 INFO : potato3.rclone_chunk.001_zkt43l: Deleted 2020/12/27 05:09:01 DEBUG : potato3.rclone_chunk.002_zkt43l: MD5 = 01a6651a94ab602dbfc47587d234b52c OK 2020/12/27 05:09:01 INFO : potato3.rclone_chunk.002_zkt43l: Copied (server-side copy) to: potato3.rclone_chunk.002 2020/12/27 05:09:01 INFO : potato3.rclone_chunk.002_zkt43l: Deleted 2020/12/27 05:09:01 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2020/12/27 05:09:01 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-huwovit7dejoxoq7hesapan3': Waiting for checks to finish 2020/12/27 05:09:01 DEBUG : potato2: Can't copy - required hash not found 2020/12/27 05:09:01 DEBUG : empty space: Size and modification time the same (differ by 0s, within tolerance 1ns) 2020/12/27 05:09:01 DEBUG : empty space: Unchanged skipping 2020/12/27 05:09:01 DEBUG : potato3: Can't copy - required hash not found 2020/12/27 05:09:01 INFO : empty space: Deleted 2020/12/27 05:09:01 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-huwovit7dejoxoq7hesapan3': Waiting for transfers to finish 2020/12/27 05:09:01 DEBUG : potato2.rclone_chunk.001_zkt4ss: MD5 = dbbc040ac83a6f6c6816767a36d34c7b OK 2020/12/27 05:09:01 INFO : potato2.rclone_chunk.001_zkt4ss: Copied (server-side copy) to: potato2.rclone_chunk.001 2020/12/27 05:09:01 INFO : potato2.rclone_chunk.001_zkt4ss: Deleted 2020/12/27 05:09:01 DEBUG : potato3.rclone_chunk.001_zkt41o: MD5 = dbbc040ac83a6f6c6816767a36d34c7b OK 2020/12/27 05:09:01 INFO : potato3.rclone_chunk.001_zkt41o: Copied (server-side copy) to: potato3.rclone_chunk.001 2020/12/27 05:09:01 DEBUG : potato2.rclone_chunk.002_zkt4ss: MD5 = 01a6651a94ab602dbfc47587d234b52c OK 2020/12/27 05:09:01 INFO : potato2.rclone_chunk.002_zkt4ss: Copied (server-side copy) to: potato2.rclone_chunk.002 2020/12/27 05:09:01 INFO : potato3.rclone_chunk.001_zkt41o: Deleted 2020/12/27 05:09:01 INFO : potato2.rclone_chunk.002_zkt4ss: Deleted 2020/12/27 05:09:01 DEBUG : potato3.rclone_chunk.002_zkt41o: MD5 = 111c387f2584838efb7e0ec6f2fa2e10 OK 2020/12/27 05:09:01 INFO : potato3.rclone_chunk.002_zkt41o: Copied (server-side copy) to: potato3.rclone_chunk.002 2020/12/27 05:09:01 INFO : potato2: Copied (new) 2020/12/27 05:09:01 INFO : potato3.rclone_chunk.002_zkt41o: Deleted 2020/12/27 05:09:02 INFO : potato3: Copied (replaced existing) 2020/12/27 05:09:02 INFO : potato2: Deleted 2020/12/27 05:09:02 INFO : potato3: Deleted 2020/12/27 05:09:02 DEBUG : Creating backend with remote "TestChunkerChunk50bSHA1QuickS3:rclone-test-wazutof1sojibuy0terejan6" 2020/12/27 05:09:02 DEBUG : Creating backend with remote "TestS3:rclone-test-wazutof1sojibuy0terejan6" 2020/12/27 05:09:02 DEBUG : Reset feature "ListR" 2020/12/27 05:09:02 DEBUG : tomatoDir: Making directory 2020/12/27 05:09:02 DEBUG : empty space: copy non-chunked object... 2020/12/27 05:09:02 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-wazutof1sojibuy0terejan6': Waiting for checks to finish 2020/12/27 05:09:02 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-wazutof1sojibuy0terejan6': Waiting for transfers to finish 2020/12/27 05:09:02 DEBUG : potato3: Can't copy - required hash not found 2020/12/27 05:09:02 DEBUG : potato2: Can't copy - required hash not found 2020/12/27 05:09:02 INFO : S3 bucket rclone-test-wazutof1sojibuy0terejan6: Bucket "rclone-test-wazutof1sojibuy0terejan6" created with ACL "private" 2020/12/27 05:09:03 INFO : empty space: Copied (server-side copy) 2020/12/27 05:09:03 INFO : empty space: Deleted 2020/12/27 05:09:03 ERROR : potato2: Failed to copy: object not found 2020/12/27 05:09:03 ERROR : potato2: Not deleting source as copy failed: object not found 2020/12/27 05:09:03 DEBUG : potato3.rclone_chunk.001_zkt58i: MD5 = dbbc040ac83a6f6c6816767a36d34c7b OK 2020/12/27 05:09:03 INFO : potato3.rclone_chunk.001_zkt58i: Copied (server-side copy) to: potato3.rclone_chunk.001 2020/12/27 05:09:03 INFO : potato3.rclone_chunk.001_zkt58i: Deleted 2020/12/27 05:09:03 DEBUG : potato3.rclone_chunk.002_zkt58i: MD5 = 111c387f2584838efb7e0ec6f2fa2e10 OK 2020/12/27 05:09:03 INFO : potato3.rclone_chunk.002_zkt58i: Copied (server-side copy) to: potato3.rclone_chunk.002 2020/12/27 05:09:03 INFO : potato3.rclone_chunk.002_zkt58i: Deleted 2020/12/27 05:09:03 INFO : potato3: Copied (new) 2020/12/27 05:09:03 INFO : potato3: Deleted sync_test.go:1331: Error Trace: sync_test.go:1331 sync_test.go:1420 Error: Received unexpected error: object not found Test: TestServerSideMoveDeleteEmptySourceDirs 2020/12/27 05:09:03 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-wazutof1sojibuy0terejan6': Purge object "empty space" 2020/12/27 05:09:03 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-wazutof1sojibuy0terejan6': Purge object "potato3" 2020/12/27 05:09:03 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-wazutof1sojibuy0terejan6': Purge dir "" 2020/12/27 05:09:03 purge failed to rmdir "": BucketNotEmpty: The bucket you tried to delete is not empty status code: 409, request id: E7AEDF246741CE69, host id: apLwokSOhgx7SZtyYZsaB3vUUUmeLysQaN9HXYHvnx+HNNh8+yyX/D+8R2xG9q8JZGCXGiqmDVU= 2020/12/27 05:09:03 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-huwovit7dejoxoq7hesapan3': Purge object "potato2" 2020/12/27 05:09:03 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-huwovit7dejoxoq7hesapan3': Purge dir "" 2020/12/27 05:09:03 INFO : S3 bucket rclone-test-huwovit7dejoxoq7hesapan3: Bucket "rclone-test-huwovit7dejoxoq7hesapan3" deleted --- FAIL: TestServerSideMoveDeleteEmptySourceDirs (5.33s) FAIL 2020/12/27 05:09:04 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-ruvasux6jivarab9peheday2': Purge dir "" 2020/12/27 05:09:04 INFO : S3 bucket rclone-test-ruvasux6jivarab9peheday2: Bucket "rclone-test-ruvasux6jivarab9peheday2" deleted "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bSHA1QuickS3: -verbose -size-limit 1024 -test.run '^TestServerSideMoveDeleteEmptySourceDirs$'" - Finished ERROR in 5.616129833s (try 4/5): exit status 1: Failed [TestServerSideMoveDeleteEmptySourceDirs]