"./operations.test -test.v -test.timeout 1h0m0s -remote TestFilesCom: -verbose -test.run '^(TestCheckSum|TestDeduplicateNewestByHash|TestDirMove|TestRmdirsWithFilter)$|^TestHashSums$/^Md5$'" - Starting (try 3/5) 2025/06/18 02:04:24 DEBUG : Creating backend with remote "TestFilesCom:rclone-test-pirosit9quli" 2025/06/18 02:04:24 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/06/18 02:04:25 DEBUG : Creating backend with remote "/tmp/rclone3599646816" === RUN TestCheckSum run.go:180: Remote "files root 'rclone-test-pirosit9quli'", Local "Local file system at /tmp/rclone3599646816", Modify Window "1s" 2025/06/18 02:04:25 DEBUG : Creating backend with remote "TestFilesCom:rclone-test-pirosit9quli/data" === RUN TestCheckSum/subtest1 === RUN TestCheckSum/subtest2 === RUN TestCheckSum/subtest3 === RUN TestCheckSum/subtest4 === NAME TestCheckSum check_test.go:407: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:407 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: An error is expected but got nil. Test: TestCheckSum Messages: no expected error in run 4 check_test.go:409: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:409 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: 1 actual : 0 Test: TestCheckSum Messages: wrong error count in run 4 check_test.go:384: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:384 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:417 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: []string{"", "* banana", "= potato"} actual : []string{"", "= banana", "= potato"} Diff: --- Expected +++ Actual @@ -2,3 +2,3 @@ (string) "", - (string) (len=8) "* banana", + (string) (len=8) "= banana", (string) (len=8) "= potato" Test: TestCheckSum Messages: wrong combined result in run 4 check_test.go:384: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:384 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:420 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: []string{"", "potato"} actual : []string{"", "banana", "potato"} Diff: --- Expected +++ Actual @@ -1,3 +1,4 @@ -([]string) (len=2) { +([]string) (len=3) { (string) "", + (string) (len=6) "banana", (string) (len=6) "potato" Test: TestCheckSum Messages: wrong match result in run 4 check_test.go:384: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:384 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:421 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: []string{"", "banana"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=2) { - (string) "", - (string) (len=6) "banana" +([]string) { } Test: TestCheckSum Messages: wrong differ result in run 4 === RUN TestCheckSum/subtest5 === RUN TestCheckSum/subtest6 === NAME TestCheckSum check_test.go:409: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:409 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: 2 actual : 1 Test: TestCheckSum Messages: wrong error count in run 6 check_test.go:384: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:384 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:417 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: []string{"", "* potato", "+ orange", "= banana"} actual : []string{"", "+ orange", "= banana", "= potato"} Diff: --- Expected +++ Actual @@ -2,5 +2,5 @@ (string) "", - (string) (len=8) "* potato", (string) (len=8) "+ orange", - (string) (len=8) "= banana" + (string) (len=8) "= banana", + (string) (len=8) "= potato" } Test: TestCheckSum Messages: wrong combined result in run 6 check_test.go:384: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:384 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:420 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: []string{"", "banana"} actual : []string{"", "banana", "potato"} Diff: --- Expected +++ Actual @@ -1,4 +1,5 @@ -([]string) (len=2) { +([]string) (len=3) { (string) "", - (string) (len=6) "banana" + (string) (len=6) "banana", + (string) (len=6) "potato" } Test: TestCheckSum Messages: wrong match result in run 6 check_test.go:384: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:384 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:421 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: []string{"", "potato"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=2) { - (string) "", - (string) (len=6) "potato" +([]string) { } Test: TestCheckSum Messages: wrong differ result in run 6 === RUN TestCheckSum/subtest7 --- FAIL: TestCheckSum (19.27s) --- PASS: TestCheckSum/subtest1 (0.76s) --- PASS: TestCheckSum/subtest2 (0.75s) --- PASS: TestCheckSum/subtest3 (0.69s) --- PASS: TestCheckSum/subtest4 (0.74s) --- PASS: TestCheckSum/subtest5 (0.68s) --- PASS: TestCheckSum/subtest6 (0.69s) --- PASS: TestCheckSum/subtest7 (0.70s) === RUN TestDeduplicateNewestByHash run.go:180: Remote "files root 'rclone-test-pirosit9quli'", Local "Local file system at /tmp/rclone3599646816", Modify Window "1s" 2025/06/18 02:04:48 INFO : files root 'rclone-test-pirosit9quli': Looking for duplicate md5 hashes using newest mode. fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:302: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:335 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:347 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/dedupe_test.go:164 Error: Should be true Test: TestDeduplicateNewestByHash Messages: listing wrong, want another (100), not-one (5) got also/one (100), another (100), not-one (5), one (100) fstest.go:188: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:188 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:335 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:347 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/dedupe_test.go:164 Error: Should be true Test: TestDeduplicateNewestByHash Messages: Unexpected file "one" fstest.go:188: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:188 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:335 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:347 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/dedupe_test.go:164 Error: Should be true Test: TestDeduplicateNewestByHash Messages: Unexpected file "also/one" --- FAIL: TestDeduplicateNewestByHash (13.36s) === RUN TestHashSums run.go:180: Remote "files root 'rclone-test-pirosit9quli'", Local "Local file system at /tmp/rclone3599646816", Modify Window "1s" === RUN TestHashSums/Md5 operations_test.go:280: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:280 Error: " empty space\n potato2\n" does not contain "336d5ebc5436534e61d16e63ddfca327 empty space\n" Test: TestHashSums/Md5 operations_test.go:280: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:280 Error: " empty space\n potato2\n" does not contain "d6548b156ea68a4e003e786df99eee76 potato2\n" Test: TestHashSums/Md5 --- FAIL: TestHashSums (2.80s) --- FAIL: TestHashSums/Md5 (0.14s) === RUN TestRmdirsWithFilter run.go:180: Remote "files root 'rclone-test-pirosit9quli'", Local "Local file system at /tmp/rclone3599646816", Modify Window "1s" 2025/06/18 02:05:01 INFO : A1: Making directory 2025/06/18 02:05:01 INFO : A1/B1: Making directory 2025/06/18 02:05:01 INFO : A1/B1/C1: Making directory 2025/06/18 02:05:02 DEBUG : removing 1 level 3 directories 2025/06/18 02:05:02 INFO : A1/B1/C1: Removing directory 2025/06/18 02:05:03 DEBUG : removing 1 level 2 directories 2025/06/18 02:05:03 INFO : A1/B1: Removing directory 2025/06/18 02:05:03 DEBUG : pacer: low level retry 1/10 (error Folder Not Empty - `Folder rclone-test-pirosit9quli/A1/B1 not empty`) 2025/06/18 02:05:03 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/18 02:05:03 DEBUG : pacer: Reducing sleep to 15ms 2025/06/18 02:05:03 DEBUG : pacer: Reducing sleep to 11.25ms 2025/06/18 02:05:03 DEBUG : pacer: Reducing sleep to 10ms --- PASS: TestRmdirsWithFilter (3.35s) === RUN TestDirMove run.go:180: Remote "files root 'rclone-test-pirosit9quli'", Local "Local file system at /tmp/rclone3599646816", Modify Window "1s" 2025/06/18 02:05:08 INFO : A1/B2: Making directory 2025/06/18 02:05:08 INFO : A1/B1/C3: Making directory 2025/06/18 02:05:10 ERROR : A2/B1: error listing: directory not found 2025/06/18 02:05:10 ERROR : A2/B2: error listing: directory not found fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:289: Sleeping for 6s just to make sure 2025/06/18 02:05:21 INFO : A2/one: Moved (server-side) to: A3/one 2025/06/18 02:05:21 INFO : A2/two: Moved (server-side) to: A3/two 2025/06/18 02:05:21 INFO : A2/B1/C1/four: Moved (server-side) to: A3/B1/C1/four 2025/06/18 02:05:21 INFO : A2/B1/three: Moved (server-side) to: A3/B1/three 2025/06/18 02:05:21 INFO : A2/B1/C2/five: Moved (server-side) to: A3/B1/C2/five 2025/06/18 02:05:22 DEBUG : pacer: low level retry 1/10 (error Folder Not Empty - `Folder rclone-test-pirosit9quli/A2 not empty`) 2025/06/18 02:05:22 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/18 02:05:22 DEBUG : pacer: low level retry 2/10 (error Folder Not Empty - `Folder rclone-test-pirosit9quli/A2 not empty`) 2025/06/18 02:05:22 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/06/18 02:05:22 DEBUG : pacer: Reducing sleep to 30ms 2025/06/18 02:05:22 DEBUG : pacer: Reducing sleep to 22.5ms 2025/06/18 02:05:22 DEBUG : pacer: Reducing sleep to 16.875ms 2025/06/18 02:05:22 DEBUG : pacer: Reducing sleep to 12.65625ms 2025/06/18 02:05:22 DEBUG : pacer: Reducing sleep to 10ms 2025/06/18 02:05:23 INFO : files root 'rclone-test-pirosit9quli': Can't DirMove - falling back to file moves: can't move directory - incompatible remotes 2025/06/18 02:05:25 INFO : A3/B1/C2/five: Moved (server-side) to: A4/B1/C2/five 2025/06/18 02:05:25 INFO : A3/B1/C1/four: Moved (server-side) to: A4/B1/C1/four 2025/06/18 02:05:25 INFO : A3/one: Moved (server-side) to: A4/one 2025/06/18 02:05:25 INFO : A3/two: Moved (server-side) to: A4/two 2025/06/18 02:05:25 INFO : A3/B1/three: Moved (server-side) to: A4/B1/three 2025/06/18 02:05:26 DEBUG : pacer: low level retry 1/10 (error Folder Not Empty - `Folder rclone-test-pirosit9quli/A3/B1 not empty`) 2025/06/18 02:05:26 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/18 02:05:26 DEBUG : pacer: low level retry 2/10 (error Folder Not Empty - `Folder rclone-test-pirosit9quli/A3/B1 not empty`) 2025/06/18 02:05:26 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/06/18 02:05:26 DEBUG : pacer: Reducing sleep to 30ms 2025/06/18 02:05:26 DEBUG : pacer: low level retry 1/10 (error Folder Not Empty - `Folder rclone-test-pirosit9quli/A3 not empty`) 2025/06/18 02:05:26 DEBUG : pacer: Rate limited, increasing sleep to 60ms 2025/06/18 02:05:26 DEBUG : pacer: low level retry 2/10 (error Folder Not Empty - `Folder rclone-test-pirosit9quli/A3 not empty`) 2025/06/18 02:05:26 DEBUG : pacer: Rate limited, increasing sleep to 120ms 2025/06/18 02:05:26 DEBUG : pacer: low level retry 3/10 (error Folder Not Empty - `Folder rclone-test-pirosit9quli/A3 not empty`) 2025/06/18 02:05:26 DEBUG : pacer: Rate limited, increasing sleep to 240ms 2025/06/18 02:05:27 DEBUG : pacer: low level retry 4/10 (error Folder Not Empty - `Folder rclone-test-pirosit9quli/A3 not empty`) 2025/06/18 02:05:27 DEBUG : pacer: Rate limited, increasing sleep to 480ms 2025/06/18 02:05:27 DEBUG : pacer: Reducing sleep to 360ms 2025/06/18 02:05:27 DEBUG : pacer: Reducing sleep to 270ms 2025/06/18 02:05:28 DEBUG : pacer: Reducing sleep to 202.5ms 2025/06/18 02:05:28 DEBUG : pacer: Reducing sleep to 151.875ms 2025/06/18 02:05:28 DEBUG : pacer: Reducing sleep to 113.90625ms 2025/06/18 02:05:28 DEBUG : pacer: Reducing sleep to 85.429687ms 2025/06/18 02:05:28 DEBUG : pacer: Reducing sleep to 64.072265ms 2025/06/18 02:05:28 DEBUG : pacer: Reducing sleep to 48.054198ms 2025/06/18 02:05:29 DEBUG : pacer: Reducing sleep to 36.040648ms 2025/06/18 02:05:29 DEBUG : pacer: Reducing sleep to 27.030486ms 2025/06/18 02:05:29 DEBUG : pacer: Reducing sleep to 20.272864ms 2025/06/18 02:05:29 DEBUG : pacer: Reducing sleep to 15.204648ms 2025/06/18 02:05:29 DEBUG : pacer: Reducing sleep to 11.403486ms 2025/06/18 02:05:29 DEBUG : pacer: Reducing sleep to 10ms 2025/06/18 02:05:31 DEBUG : pacer: low level retry 1/10 (error Folder Not Empty - `Folder rclone-test-pirosit9quli/A4/B1 not empty`) 2025/06/18 02:05:31 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/18 02:05:31 DEBUG : pacer: low level retry 2/10 (error Folder Not Empty - `Folder rclone-test-pirosit9quli/A4/B1 not empty`) 2025/06/18 02:05:31 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/06/18 02:05:31 DEBUG : pacer: low level retry 3/10 (error Folder Not Empty - `Folder rclone-test-pirosit9quli/A4/B1 not empty`) 2025/06/18 02:05:31 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2025/06/18 02:05:31 DEBUG : pacer: Reducing sleep to 60ms 2025/06/18 02:05:31 DEBUG : pacer: Reducing sleep to 45ms 2025/06/18 02:05:31 DEBUG : pacer: Reducing sleep to 33.75ms --- PASS: TestDirMove (27.61s) FAIL 2025/06/18 02:05:31 DEBUG : files root 'rclone-test-pirosit9quli': Purge remote 2025/06/18 02:05:32 DEBUG : pacer: Reducing sleep to 25.3125ms "./operations.test -test.v -test.timeout 1h0m0s -remote TestFilesCom: -verbose -test.run '^(TestCheckSum|TestDeduplicateNewestByHash|TestDirMove|TestRmdirsWithFilter)$|^TestHashSums$/^Md5$'" - Finished ERROR in 1m7.437759721s (try 3/5): exit status 1: Failed [TestCheckSum TestDeduplicateNewestByHash TestHashSums/Md5]