"./sync.test -test.v -test.timeout 1h0m0s -remote TestHubic: -verbose -test.run '^TestSyncConcurrentDelete$'" - Starting (try 3/5) 2022/01/08 06:02:01 DEBUG : Creating backend with remote "TestHubic:rclone-test-baxivuc8senolim9beqeqox0" 2022/01/08 06:02:01 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2022/01/08 06:02:02 DEBUG : Hubic: Got swift credentials (expiry 2022-01-09 06:46:03 +0100 +0100 in 23h44m0.769812303s) 2022/01/08 06:02:02 DEBUG : Creating backend with remote "/tmp/rclone4240052557" === RUN TestSyncConcurrentDelete run.go:181: Remote "Hubic Swift container rclone-test-baxivuc8senolim9beqeqox0", Local "Local file system at /tmp/rclone4240052557", Modify Window "1ns" 2022/01/08 06:02:02 INFO : Swift container rclone-test-baxivuc8senolim9beqeqox0: Container "rclone-test-baxivuc8senolim9beqeqox0" created fstest.go:299: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:299: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:299: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:306: Error Trace: fstest.go:306 fstest.go:339 fstest.go:351 run.go:342 sync_test.go:2050 sync_test.go:2062 Error: Should be true Test: TestSyncConcurrentDelete Messages: listing wrong, want both0 (6), both1 (6), both10 (6), both11 (6), both12 (6), both13 (6), both14 (6), both15 (6), both16 (6), both17 (6), both18 (6), both19 (6), both2 (6), both3 (6), both4 (6), both5 (6), both6 (6), both7 (6), both8 (6), both9 (6), only0 (6), only1 (6), only10 (6), only11 (6), only12 (6), only13 (6), only14 (6), only15 (6), only16 (6), only17 (6), only18 (6), only19 (6), only2 (6), only3 (6), only4 (6), only5 (6), only6 (6), only7 (6), only8 (6), only9 (6) got both0 (6), both1 (6), both10 (6), both11 (6), both12 (6), both13 (6), both14 (6), both15 (6), both16 (6), both17 (6), both18 (6), both19 (6), both2 (6), both3 (6), both4 (6), both5 (6), both6 (6), both7 (6), both8 (6), both9 (6), only0 (6), only1 (6), only10 (6), only11 (6), only12 (6), only13 (6), only14 (6), only15 (6), only16 (6), only19 (6), only2 (6), only3 (6), only4 (6), only5 (6), only6 (6), only7 (6), only8 (6), only9 (6) fstest.go:204: Not found "only17" fstest.go:204: Not found "only18" fstest.go:207: Error Trace: fstest.go:207 fstest.go:311 fstest.go:339 fstest.go:351 run.go:342 sync_test.go:2050 sync_test.go:2062 Error: Not equal: expected: 0 actual : 2 Test: TestSyncConcurrentDelete Messages: 2 objects not found 2022/01/08 06:03:43 DEBUG : Hubic Swift container rclone-test-baxivuc8senolim9beqeqox0: Waiting for checks to finish 2022/01/08 06:03:43 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:43 DEBUG : both0: Unchanged skipping 2022/01/08 06:03:43 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:43 DEBUG : both1: Unchanged skipping 2022/01/08 06:03:43 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:43 DEBUG : both10: Unchanged skipping 2022/01/08 06:03:43 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:43 DEBUG : both12: Unchanged skipping 2022/01/08 06:03:43 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:43 DEBUG : both13: Unchanged skipping 2022/01/08 06:03:43 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:43 DEBUG : both11: Unchanged skipping 2022/01/08 06:03:43 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:43 DEBUG : both17: Unchanged skipping 2022/01/08 06:03:43 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:43 DEBUG : both15: Unchanged skipping 2022/01/08 06:03:43 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:43 DEBUG : both14: Unchanged skipping 2022/01/08 06:03:43 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:43 DEBUG : both16: Unchanged skipping 2022/01/08 06:03:44 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:44 DEBUG : both18: Unchanged skipping 2022/01/08 06:03:44 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:44 DEBUG : both3: Unchanged skipping 2022/01/08 06:03:44 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:44 DEBUG : both2: Unchanged skipping 2022/01/08 06:03:44 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:44 DEBUG : both19: Unchanged skipping 2022/01/08 06:03:44 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:44 DEBUG : both4: Unchanged skipping 2022/01/08 06:03:44 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:44 DEBUG : both7: Unchanged skipping 2022/01/08 06:03:44 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:44 DEBUG : both6: Unchanged skipping 2022/01/08 06:03:44 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:44 DEBUG : both5: Unchanged skipping 2022/01/08 06:03:44 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:44 DEBUG : both8: Unchanged skipping 2022/01/08 06:03:44 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/01/08 06:03:44 DEBUG : both9: Unchanged skipping 2022/01/08 06:03:44 DEBUG : Hubic Swift container rclone-test-baxivuc8senolim9beqeqox0: Waiting for transfers to finish 2022/01/08 06:03:44 DEBUG : Waiting for deletions to finish 2022/01/08 06:03:44 INFO : only19: Deleted 2022/01/08 06:03:45 INFO : only12: Deleted 2022/01/08 06:03:45 INFO : only3: Deleted 2022/01/08 06:03:45 INFO : only16: Deleted 2022/01/08 06:03:45 INFO : only2: Deleted 2022/01/08 06:03:45 INFO : only10: Deleted 2022/01/08 06:03:46 INFO : only13: Deleted 2022/01/08 06:03:46 INFO : only14: Deleted 2022/01/08 06:03:46 INFO : only6: Deleted 2022/01/08 06:03:46 INFO : only11: Deleted 2022/01/08 06:03:46 INFO : only5: Deleted 2022/01/08 06:03:46 INFO : only0: Deleted 2022/01/08 06:03:47 INFO : only1: Deleted 2022/01/08 06:03:47 INFO : only4: Deleted 2022/01/08 06:03:47 INFO : only7: Deleted 2022/01/08 06:03:47 INFO : only8: Deleted 2022/01/08 06:03:48 INFO : only9: Deleted 2022/01/08 06:03:48 INFO : only17: Deleted 2022/01/08 06:03:48 INFO : only15: Deleted 2022/01/08 06:03:48 INFO : There was nothing to transfer fstest.go:299: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:299: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:299: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:306: Error Trace: fstest.go:306 fstest.go:339 fstest.go:351 run.go:342 sync_test.go:2058 sync_test.go:2062 Error: Should be true Test: TestSyncConcurrentDelete Messages: listing wrong, want both0 (6), both1 (6), both10 (6), both11 (6), both12 (6), both13 (6), both14 (6), both15 (6), both16 (6), both17 (6), both18 (6), both19 (6), both2 (6), both3 (6), both4 (6), both5 (6), both6 (6), both7 (6), both8 (6), both9 (6) got both0 (6), both1 (6), both10 (6), both11 (6), both12 (6), both13 (6), both14 (6), both15 (6), both16 (6), both17 (6), both18 (6), both19 (6), both2 (6), both3 (6), both4 (6), both5 (6), both6 (6), both7 (6), both8 (6), both9 (6), only18 (6), only9 (6) fstest.go:192: Error Trace: fstest.go:192 fstest.go:309 fstest.go:339 fstest.go:351 run.go:342 sync_test.go:2058 sync_test.go:2062 Error: Should be true Test: TestSyncConcurrentDelete Messages: Unexpected file "only18" fstest.go:192: Error Trace: fstest.go:192 fstest.go:309 fstest.go:339 fstest.go:351 run.go:342 sync_test.go:2058 sync_test.go:2062 Error: Should be true Test: TestSyncConcurrentDelete Messages: Unexpected file "only9" run.go:126: removing file "only9" failed - try 1/3: Object Not Found run.go:126: removing file "only9" failed - try 2/3: Object Not Found run.go:126: removing file "only9" failed - try 3/3: Object Not Found run.go:129: removing file "only9" failed: Object Not Found --- FAIL: TestSyncConcurrentDelete (144.66s) FAIL 2022/01/08 06:04:26 DEBUG : Hubic Swift container rclone-test-baxivuc8senolim9beqeqox0: Purge remote 2022/01/08 06:04:26 DEBUG : Waiting for deletions to finish 2022/01/08 06:04:27 INFO : Swift container rclone-test-baxivuc8senolim9beqeqox0: Container "rclone-test-baxivuc8senolim9beqeqox0" removed "./sync.test -test.v -test.timeout 1h0m0s -remote TestHubic: -verbose -test.run '^TestSyncConcurrentDelete$'" - Finished ERROR in 2m25.641708466s (try 3/5): exit status 1: Failed [TestSyncConcurrentDelete]