"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bSHA1QuickS3: -verbose -size-limit 1024 -test.run '^TestServerSideMoveDeleteEmptySourceDirs$'" - Starting (try 3/5) 2021/03/04 05:38:53 DEBUG : Creating backend with remote "TestChunkerChunk50bSHA1QuickS3:rclone-test-lozejav6tabecat0mosagig0" 2021/03/04 05:38:53 DEBUG : Creating backend with remote "TestS3:rclone-test-lozejav6tabecat0mosagig0" 2021/03/04 05:38:53 DEBUG : Reset feature "ListR" 2021/03/04 05:38:53 DEBUG : Creating backend with remote "/tmp/rclone315297580" === RUN TestServerSideMoveDeleteEmptySourceDirs run.go:176: Remote "Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-lozejav6tabecat0mosagig0'", Local "Local file system at /tmp/rclone315297580", Modify Window "1ns" 2021/03/04 05:38:53 DEBUG : Creating backend with remote "TestChunkerChunk50bSHA1QuickS3:rclone-test-nuyimos6rolobup4hujowuz3" 2021/03/04 05:38:53 DEBUG : Creating backend with remote "TestS3:rclone-test-nuyimos6rolobup4hujowuz3" 2021/03/04 05:38:53 DEBUG : Reset feature "ListR" 2021/03/04 05:38:53 INFO : S3 bucket rclone-test-lozejav6tabecat0mosagig0: Bucket "rclone-test-lozejav6tabecat0mosagig0" created with ACL "private" 2021/03/04 05:38:54 DEBUG : potato2.rclone_chunk.001_fovote: MD5 = dbbc040ac83a6f6c6816767a36d34c7b OK 2021/03/04 05:38:54 INFO : potato2.rclone_chunk.001_fovote: Copied (server-side copy) to: potato2.rclone_chunk.001 2021/03/04 05:38:54 INFO : potato2.rclone_chunk.001_fovote: Deleted 2021/03/04 05:38:54 DEBUG : potato2.rclone_chunk.002_fovote: MD5 = 01a6651a94ab602dbfc47587d234b52c OK 2021/03/04 05:38:54 INFO : potato2.rclone_chunk.002_fovote: Copied (server-side copy) to: potato2.rclone_chunk.002 2021/03/04 05:38:54 INFO : potato2.rclone_chunk.002_fovote: Deleted 2021/03/04 05:38:54 DEBUG : empty space.rclone_chunk.001_fovpnd: MD5 = 336d5ebc5436534e61d16e63ddfca327 OK 2021/03/04 05:38:54 INFO : empty space.rclone_chunk.001_fovpnd: Copied (server-side copy) to: empty space 2021/03/04 05:38:54 INFO : empty space.rclone_chunk.001_fovpnd: Deleted 2021/03/04 05:38:54 DEBUG : potato3.rclone_chunk.001_fovpvh: MD5 = dbbc040ac83a6f6c6816767a36d34c7b OK 2021/03/04 05:38:54 INFO : potato3.rclone_chunk.001_fovpvh: Copied (server-side copy) to: potato3.rclone_chunk.001 2021/03/04 05:38:54 INFO : potato3.rclone_chunk.001_fovpvh: Deleted 2021/03/04 05:38:54 DEBUG : potato3.rclone_chunk.002_fovpvh: MD5 = 111c387f2584838efb7e0ec6f2fa2e10 OK 2021/03/04 05:38:54 INFO : potato3.rclone_chunk.002_fovpvh: Copied (server-side copy) to: potato3.rclone_chunk.002 2021/03/04 05:38:54 INFO : potato3.rclone_chunk.002_fovpvh: Deleted 2021/03/04 05:38:54 DEBUG : tomatoDir: Making directory sync_test.go:1294: Server side move (if possible) Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-lozejav6tabecat0mosagig0' -> Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-nuyimos6rolobup4hujowuz3' 2021/03/04 05:38:55 INFO : S3 bucket rclone-test-nuyimos6rolobup4hujowuz3: Bucket "rclone-test-nuyimos6rolobup4hujowuz3" created with ACL "private" 2021/03/04 05:38:55 DEBUG : empty space.rclone_chunk.001_fovq2w: MD5 = 336d5ebc5436534e61d16e63ddfca327 OK 2021/03/04 05:38:55 INFO : empty space.rclone_chunk.001_fovq2w: Copied (server-side copy) to: empty space 2021/03/04 05:38:55 INFO : empty space.rclone_chunk.001_fovq2w: Deleted 2021/03/04 05:38:56 DEBUG : potato3.rclone_chunk.001_fovqsi: MD5 = dbbc040ac83a6f6c6816767a36d34c7b OK 2021/03/04 05:38:56 INFO : potato3.rclone_chunk.001_fovqsi: Copied (server-side copy) to: potato3.rclone_chunk.001 2021/03/04 05:38:56 INFO : potato3.rclone_chunk.001_fovqsi: Deleted 2021/03/04 05:38:56 DEBUG : potato3.rclone_chunk.002_fovqsi: MD5 = 01a6651a94ab602dbfc47587d234b52c OK 2021/03/04 05:38:56 INFO : potato3.rclone_chunk.002_fovqsi: Copied (server-side copy) to: potato3.rclone_chunk.002 2021/03/04 05:38:56 INFO : potato3.rclone_chunk.002_fovqsi: Deleted 2021/03/04 05:38:56 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2021/03/04 05:38:56 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-nuyimos6rolobup4hujowuz3': Waiting for checks to finish 2021/03/04 05:38:56 DEBUG : potato2: Can't copy - required hash not found 2021/03/04 05:38:56 DEBUG : potato3: Can't copy - required hash not found 2021/03/04 05:38:56 DEBUG : empty space: Size and modification time the same (differ by 0s, within tolerance 1ns) 2021/03/04 05:38:56 DEBUG : empty space: Unchanged skipping 2021/03/04 05:38:56 INFO : empty space: Deleted 2021/03/04 05:38:56 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-nuyimos6rolobup4hujowuz3': Waiting for transfers to finish 2021/03/04 05:38:56 DEBUG : potato2.rclone_chunk.001_fovr2r: MD5 = dbbc040ac83a6f6c6816767a36d34c7b OK 2021/03/04 05:38:56 INFO : potato2.rclone_chunk.001_fovr2r: Copied (server-side copy) to: potato2.rclone_chunk.001 2021/03/04 05:38:56 INFO : potato2.rclone_chunk.001_fovr2r: Deleted 2021/03/04 05:38:56 DEBUG : potato2.rclone_chunk.002_fovr2r: MD5 = 01a6651a94ab602dbfc47587d234b52c OK 2021/03/04 05:38:56 INFO : potato2.rclone_chunk.002_fovr2r: Copied (server-side copy) to: potato2.rclone_chunk.002 2021/03/04 05:38:56 DEBUG : potato3.rclone_chunk.001_fovr6x: MD5 = dbbc040ac83a6f6c6816767a36d34c7b OK 2021/03/04 05:38:56 INFO : potato3.rclone_chunk.001_fovr6x: Copied (server-side copy) to: potato3.rclone_chunk.001 2021/03/04 05:38:56 INFO : potato2.rclone_chunk.002_fovr2r: Deleted 2021/03/04 05:38:56 INFO : potato3.rclone_chunk.001_fovr6x: Deleted 2021/03/04 05:38:56 INFO : potato2: Copied (new) 2021/03/04 05:38:56 DEBUG : potato3.rclone_chunk.002_fovr6x: MD5 = 111c387f2584838efb7e0ec6f2fa2e10 OK 2021/03/04 05:38:56 INFO : potato3.rclone_chunk.002_fovr6x: Copied (server-side copy) to: potato3.rclone_chunk.002 2021/03/04 05:38:56 INFO : potato3.rclone_chunk.002_fovr6x: Deleted 2021/03/04 05:38:56 INFO : potato2: Deleted 2021/03/04 05:38:57 INFO : potato3: Copied (replaced existing) 2021/03/04 05:38:57 INFO : potato3: Deleted 2021/03/04 05:38:57 DEBUG : Creating backend with remote "TestChunkerChunk50bSHA1QuickS3:rclone-test-xufivod3fofexob8tucaxiz8" 2021/03/04 05:38:57 DEBUG : Creating backend with remote "TestS3:rclone-test-xufivod3fofexob8tucaxiz8" 2021/03/04 05:38:57 DEBUG : Reset feature "ListR" 2021/03/04 05:38:57 DEBUG : tomatoDir: Making directory 2021/03/04 05:38:57 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-xufivod3fofexob8tucaxiz8': Waiting for checks to finish 2021/03/04 05:38:57 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-xufivod3fofexob8tucaxiz8': Waiting for transfers to finish 2021/03/04 05:38:57 DEBUG : empty space: copy non-chunked object... 2021/03/04 05:38:57 DEBUG : potato2: Can't copy - required hash not found 2021/03/04 05:38:57 DEBUG : potato3: Can't copy - required hash not found 2021/03/04 05:38:58 INFO : S3 bucket rclone-test-xufivod3fofexob8tucaxiz8: Bucket "rclone-test-xufivod3fofexob8tucaxiz8" created with ACL "private" 2021/03/04 05:38:58 INFO : empty space: Copied (server-side copy) 2021/03/04 05:38:58 ERROR : potato3: Failed to copy: object not found 2021/03/04 05:38:58 ERROR : potato3: Not deleting source as copy failed: object not found 2021/03/04 05:38:58 INFO : empty space: Deleted 2021/03/04 05:38:58 DEBUG : potato2.rclone_chunk.001_fovsck: MD5 = dbbc040ac83a6f6c6816767a36d34c7b OK 2021/03/04 05:38:58 INFO : potato2.rclone_chunk.001_fovsck: Copied (server-side copy) to: potato2.rclone_chunk.001 2021/03/04 05:38:58 INFO : potato2.rclone_chunk.001_fovsck: Deleted 2021/03/04 05:38:58 DEBUG : potato2.rclone_chunk.002_fovsck: MD5 = 01a6651a94ab602dbfc47587d234b52c OK 2021/03/04 05:38:58 INFO : potato2.rclone_chunk.002_fovsck: Copied (server-side copy) to: potato2.rclone_chunk.002 2021/03/04 05:38:58 INFO : potato2.rclone_chunk.002_fovsck: Deleted 2021/03/04 05:38:58 INFO : potato2: Copied (new) 2021/03/04 05:38:58 INFO : potato2: Deleted sync_test.go:1331: Error Trace: sync_test.go:1331 sync_test.go:1420 Error: Received unexpected error: object not found Test: TestServerSideMoveDeleteEmptySourceDirs 2021/03/04 05:38:58 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-xufivod3fofexob8tucaxiz8': Purge object "empty space" 2021/03/04 05:38:58 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-xufivod3fofexob8tucaxiz8': Purge object "potato2" 2021/03/04 05:38:58 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-xufivod3fofexob8tucaxiz8': Purge dir "" 2021/03/04 05:38:58 purge failed to rmdir "": BucketNotEmpty: The bucket you tried to delete is not empty status code: 409, request id: BB9B4A1821809CA1, host id: 6XSJSX07ySNlRFvS9cCAqcwIgUKJBB6eQycogVFTyiLVN2zu/SsW/TTgU6n/8OEGWgQT7uhA1n8= 2021/03/04 05:38:58 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-nuyimos6rolobup4hujowuz3': Purge object "potato3" 2021/03/04 05:38:58 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-nuyimos6rolobup4hujowuz3': Purge dir "" 2021/03/04 05:38:59 INFO : S3 bucket rclone-test-nuyimos6rolobup4hujowuz3: Bucket "rclone-test-nuyimos6rolobup4hujowuz3" deleted --- FAIL: TestServerSideMoveDeleteEmptySourceDirs (6.14s) FAIL 2021/03/04 05:38:59 DEBUG : Chunked 'TestChunkerChunk50bSHA1QuickS3:rclone-test-lozejav6tabecat0mosagig0': Purge dir "" 2021/03/04 05:38:59 INFO : S3 bucket rclone-test-lozejav6tabecat0mosagig0: Bucket "rclone-test-lozejav6tabecat0mosagig0" deleted "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bSHA1QuickS3: -verbose -size-limit 1024 -test.run '^TestServerSideMoveDeleteEmptySourceDirs$'" - Finished ERROR in 6.505485064s (try 3/5): exit status 1: Failed [TestServerSideMoveDeleteEmptySourceDirs]