"./operations.test -test.v -test.timeout 1h0m0s -remote TestHubic: -verbose -test.run '^(TestDirMove|TestRcat)$'" - Starting (try 2/5) 2022/02/10 05:41:52 DEBUG : Creating backend with remote "TestHubic:rclone-test-qequkuy5yuhuhes7zoqazey5" 2022/02/10 05:41:52 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2022/02/10 05:41:53 DEBUG : Hubic: Got swift credentials (expiry 2022-02-11 06:23:39 +0100 +0100 in 23h41m45.762141937s) 2022/02/10 05:41:53 DEBUG : Creating backend with remote "/tmp/rclone3057862040" === RUN TestDirMove run.go:181: Remote "Hubic Swift container rclone-test-qequkuy5yuhuhes7zoqazey5", Local "Local file system at /tmp/rclone3057862040", Modify Window "1ns" 2022/02/10 05:41:53 INFO : Swift container rclone-test-qequkuy5yuhuhes7zoqazey5: Container "rclone-test-qequkuy5yuhuhes7zoqazey5" created 2022/02/10 05:42:05 DEBUG : A1/B2: Making directory 2022/02/10 05:42:05 DEBUG : A1/B1/C3: Making directory fstest.go:251: Filtering empty directory "A1/B2" fstest.go:251: Filtering empty directory "A1/B1/C3" 2022/02/10 05:42:07 DEBUG : A1/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2022/02/10 05:42:07 INFO : A1/B1/three: Copied (server-side copy) to: A2/B1/three 2022/02/10 05:42:08 DEBUG : A1/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2022/02/10 05:42:08 INFO : A1/one: Copied (server-side copy) to: A2/one 2022/02/10 05:42:08 DEBUG : A1/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2022/02/10 05:42:08 INFO : A1/B1/C2/five: Copied (server-side copy) to: A2/B1/C2/five 2022/02/10 05:42:08 DEBUG : A1/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2022/02/10 05:42:08 INFO : A1/B1/C1/four: Copied (server-side copy) to: A2/B1/C1/four 2022/02/10 05:42:08 INFO : A1/B1/three: Deleted 2022/02/10 05:42:09 INFO : A1/one: Deleted 2022/02/10 05:42:09 INFO : A1/B1/C2/five: Deleted 2022/02/10 05:42:09 INFO : A1/B1/C1/four: Deleted 2022/02/10 05:42:10 DEBUG : A1/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2022/02/10 05:42:10 INFO : A1/two: Copied (server-side copy) to: A2/two 2022/02/10 05:42:11 INFO : A1/two: Deleted fstest.go:251: Filtering empty directory "A2/B2" fstest.go:251: Filtering empty directory "A2/B1/C3" fstest.go:299: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:299: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:299: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:306: Error Trace: fstest.go:306 fstest.go:339 operations_test.go:1412 Error: Should be true Test: TestDirMove Messages: listing wrong, want A2/B1/C1/four (4), A2/B1/C2/five (4), A2/B1/three (5), A2/one (3), A2/two (3) got A1/B1/C2/five (4), A2/B1/C1/four (4), A2/B1/C2/five (4), A2/B1/three (5), A2/one (3), A2/two (3) fstest.go:192: Error Trace: fstest.go:192 fstest.go:309 fstest.go:339 operations_test.go:1412 Error: Should be true Test: TestDirMove Messages: Unexpected file "A1/B1/C2/five" fstest.go:328: Error Trace: fstest.go:328 fstest.go:339 operations_test.go:1412 Error: Not equal: expected: []string{"A2", "A2/B1", "A2/B1/C1", "A2/B1/C2"} actual : []string{"A1", "A1/B1", "A1/B1/C2", "A2", "A2/B1", "A2/B1/C1", "A2/B1/C2"} Diff: --- Expected +++ Actual @@ -1,2 +1,5 @@ -([]string) (len=4) { +([]string) (len=7) { + (string) (len=2) "A1", + (string) (len=5) "A1/B1", + (string) (len=8) "A1/B1/C2", (string) (len=2) "A2", Test: TestDirMove Messages: directories 2022/02/10 05:42:23 DEBUG : A2/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2022/02/10 05:42:23 INFO : A2/B1/C2/five: Copied (server-side copy) to: A3/B1/C2/five 2022/02/10 05:42:23 DEBUG : A2/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2022/02/10 05:42:23 INFO : A2/B1/three: Copied (server-side copy) to: A3/B1/three 2022/02/10 05:42:23 DEBUG : A2/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2022/02/10 05:42:23 INFO : A2/B1/C1/four: Copied (server-side copy) to: A3/B1/C1/four 2022/02/10 05:42:23 DEBUG : A2/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2022/02/10 05:42:23 INFO : A2/one: Copied (server-side copy) to: A3/one 2022/02/10 05:42:24 INFO : A2/B1/C2/five: Deleted 2022/02/10 05:42:24 INFO : A2/B1/three: Deleted 2022/02/10 05:42:24 INFO : A2/B1/C1/four: Deleted 2022/02/10 05:42:24 INFO : A2/one: Deleted 2022/02/10 05:42:26 DEBUG : A2/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2022/02/10 05:42:26 INFO : A2/two: Copied (server-side copy) to: A3/two 2022/02/10 05:42:27 INFO : A2/two: Deleted fstest.go:251: Filtering empty directory "A3/B2" fstest.go:251: Filtering empty directory "A3/B1/C3" fstest.go:299: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:299: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:299: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:306: Error Trace: fstest.go:306 fstest.go:339 operations_test.go:1437 Error: Should be true Test: TestDirMove Messages: listing wrong, want A3/B1/C1/four (4), A3/B1/C2/five (4), A3/B1/three (5), A3/one (3), A3/two (3) got A1/B1/C2/five (4), A2/one (3), A3/B1/C1/four (4), A3/B1/C2/five (4), A3/B1/three (5), A3/one (3) fstest.go:192: Error Trace: fstest.go:192 fstest.go:309 fstest.go:339 operations_test.go:1437 Error: Should be true Test: TestDirMove Messages: Unexpected file "A1/B1/C2/five" fstest.go:192: Error Trace: fstest.go:192 fstest.go:309 fstest.go:339 operations_test.go:1437 Error: Should be true Test: TestDirMove Messages: Unexpected file "A2/one" fstest.go:204: Not found "A3/two" fstest.go:207: Error Trace: fstest.go:207 fstest.go:311 fstest.go:339 operations_test.go:1437 Error: Not equal: expected: 0 actual : 1 Test: TestDirMove Messages: 1 objects not found fstest.go:328: Error Trace: fstest.go:328 fstest.go:339 operations_test.go:1437 Error: Not equal: expected: []string{"A3", "A3/B1", "A3/B1/C1", "A3/B1/C2"} actual : []string{"A1", "A1/B1", "A1/B1/C2", "A2", "A3", "A3/B1", "A3/B1/C1", "A3/B1/C2"} Diff: --- Expected +++ Actual @@ -1,2 +1,6 @@ -([]string) (len=4) { +([]string) (len=8) { + (string) (len=2) "A1", + (string) (len=5) "A1/B1", + (string) (len=8) "A1/B1/C2", + (string) (len=2) "A2", (string) (len=2) "A3", Test: TestDirMove Messages: directories fstest.go:299: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:293: Sleeping for 6s just to make sure --- FAIL: TestDirMove (56.64s) === RUN TestRcat === RUN TestRcat/withChecksum=false,ignoreChecksum=false === CONT TestRcat run.go:181: Remote "Hubic Swift container rclone-test-qequkuy5yuhuhes7zoqazey5", Local "Local file system at /tmp/rclone3057862040", Modify Window "1ns" fstest.go:299: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:299: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:299: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:306: Error Trace: fstest.go:306 fstest.go:339 fstest.go:345 operations_test.go:1499 operations_test.go:1524 Error: Should be true Test: TestRcat Messages: listing wrong, want got A3/one (3) fstest.go:192: Error Trace: fstest.go:192 fstest.go:309 fstest.go:339 fstest.go:345 operations_test.go:1499 operations_test.go:1524 Error: Should be true Test: TestRcat Messages: Unexpected file "A3/one" 2022/02/10 05:42:57 DEBUG : Hubic Swift container rclone-test-qequkuy5yuhuhes7zoqazey5: File to upload is small (34 bytes), uploading instead of streaming 2022/02/10 05:43:00 DEBUG : no_checksum_small_file_from_pipe: md5 = 4c762bc6ec18f21b23fcae426c7863b5 OK 2022/02/10 05:43:00 INFO : no_checksum_small_file_from_pipe: Copied (new) 2022/02/10 05:43:00 DEBUG : no_checksum_big_file_from_pipe: Uploading segment file "no_checksum_big_file_from_pipe/1644471780.759191937/-1/00000000" into "rclone-test-qequkuy5yuhuhes7zoqazey5_segments" 2022/02/10 05:43:02 DEBUG : no_checksum_big_file_from_pipe: Uploading segments into "rclone-test-qequkuy5yuhuhes7zoqazey5_segments" seems done (EOF) 2022/02/10 05:43:04 DEBUG : no_checksum_big_file_from_pipe: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/02/10 05:43:04 DEBUG : no_checksum_big_file_from_pipe: Returning empty Md5sum for swift large object === RUN TestRcat/withChecksum=true,ignoreChecksum=false === CONT TestRcat run.go:181: Remote "Hubic Swift container rclone-test-qequkuy5yuhuhes7zoqazey5", Local "Local file system at /tmp/rclone3057862040", Modify Window "1ns" 2022/02/10 05:43:09 DEBUG : Hubic Swift container rclone-test-qequkuy5yuhuhes7zoqazey5: File to upload is small (34 bytes), uploading instead of streaming 2022/02/10 05:43:12 DEBUG : with_checksum_small_file_from_pipe: md5 = 4c762bc6ec18f21b23fcae426c7863b5 OK 2022/02/10 05:43:12 INFO : with_checksum_small_file_from_pipe: Copied (new) 2022/02/10 05:43:12 DEBUG : with_checksum_big_file_from_pipe: Uploading segment file "with_checksum_big_file_from_pipe/1644471792.074513501/-1/00000000" into "rclone-test-qequkuy5yuhuhes7zoqazey5_segments" 2022/02/10 05:43:14 DEBUG : with_checksum_big_file_from_pipe: Uploading segments into "rclone-test-qequkuy5yuhuhes7zoqazey5_segments" seems done (EOF) 2022/02/10 05:43:15 DEBUG : with_checksum_big_file_from_pipe: Returning empty Md5sum for swift large object 2022/02/10 05:43:15 DEBUG : with_checksum_big_file_from_pipe: Size of src and dst objects identical 2022/02/10 05:43:16 DEBUG : with_checksum_big_file_from_pipe: Returning empty Md5sum for swift large object === RUN TestRcat/withChecksum=false,ignoreChecksum=true === CONT TestRcat run.go:181: Remote "Hubic Swift container rclone-test-qequkuy5yuhuhes7zoqazey5", Local "Local file system at /tmp/rclone3057862040", Modify Window "1ns" 2022/02/10 05:43:20 DEBUG : Hubic Swift container rclone-test-qequkuy5yuhuhes7zoqazey5: File to upload is small (34 bytes), uploading instead of streaming 2022/02/10 05:43:22 INFO : ignore_checksum_small_file_from_pipe: Copied (new) 2022/02/10 05:43:22 DEBUG : ignore_checksum_big_file_from_pipe: Uploading segment file "ignore_checksum_big_file_from_pipe/1644471802.843086944/-1/00000000" into "rclone-test-qequkuy5yuhuhes7zoqazey5_segments" 2022/02/10 05:43:24 DEBUG : ignore_checksum_big_file_from_pipe: Uploading segments into "rclone-test-qequkuy5yuhuhes7zoqazey5_segments" seems done (EOF) 2022/02/10 05:43:26 DEBUG : ignore_checksum_big_file_from_pipe: Size and modification time the same (differ by 0s, within tolerance 1ns) 2022/02/10 05:43:26 DEBUG : ignore_checksum_big_file_from_pipe: Returning empty Md5sum for swift large object === RUN TestRcat/withChecksum=true,ignoreChecksum=true === CONT TestRcat run.go:181: Remote "Hubic Swift container rclone-test-qequkuy5yuhuhes7zoqazey5", Local "Local file system at /tmp/rclone3057862040", Modify Window "1ns" 2022/02/10 05:43:30 DEBUG : Hubic Swift container rclone-test-qequkuy5yuhuhes7zoqazey5: File to upload is small (34 bytes), uploading instead of streaming 2022/02/10 05:43:32 INFO : ignore_checksum_small_file_from_pipe: Copied (new) 2022/02/10 05:43:32 DEBUG : ignore_checksum_big_file_from_pipe: Uploading segment file "ignore_checksum_big_file_from_pipe/1644471812.374720251/-1/00000000" into "rclone-test-qequkuy5yuhuhes7zoqazey5_segments" 2022/02/10 05:43:34 DEBUG : ignore_checksum_big_file_from_pipe: Uploading segments into "rclone-test-qequkuy5yuhuhes7zoqazey5_segments" seems done (EOF) 2022/02/10 05:43:37 DEBUG : ignore_checksum_big_file_from_pipe: Returning empty Md5sum for swift large object 2022/02/10 05:43:37 DEBUG : ignore_checksum_big_file_from_pipe: Size of src and dst objects identical 2022/02/10 05:43:37 DEBUG : ignore_checksum_big_file_from_pipe: Returning empty Md5sum for swift large object 2022/02/10 05:43:41 ERROR : ignore_checksum_big_file_from_pipe: dangling large object with no contents fstest.go:299: Sleeping for 1s for list eventual consistency: 1/3 2022/02/10 05:43:42 ERROR : ignore_checksum_big_file_from_pipe: dangling large object with no contents fstest.go:299: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:293: Sleeping for 7s just to make sure --- FAIL: TestRcat (62.72s) --- PASS: TestRcat/withChecksum=false,ignoreChecksum=false (19.49s) --- PASS: TestRcat/withChecksum=true,ignoreChecksum=false (11.52s) --- PASS: TestRcat/withChecksum=false,ignoreChecksum=true (9.76s) --- PASS: TestRcat/withChecksum=true,ignoreChecksum=true (21.94s) FAIL 2022/02/10 05:43:52 DEBUG : Hubic Swift container rclone-test-qequkuy5yuhuhes7zoqazey5: Purge remote 2022/02/10 05:43:52 DEBUG : Waiting for deletions to finish 2022/02/10 05:43:53 INFO : Swift container rclone-test-qequkuy5yuhuhes7zoqazey5: Container "rclone-test-qequkuy5yuhuhes7zoqazey5" removed "./operations.test -test.v -test.timeout 1h0m0s -remote TestHubic: -verbose -test.run '^(TestDirMove|TestRcat)$'" - Finished ERROR in 2m0.376183548s (try 2/5): exit status 1: Failed [TestDirMove TestRcat]