"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^(TestCheckSumDownload|TestCopyFileCompareDest|TestCopyFileCopyDest|TestDirMove|TestMaxDelete|TestMaxDeleteSize|TestParseSumFile|TestRemoveExisting|TestRmdirsNoLeaveRoot)$'" - Starting (try 3/5) 2026/04/27 01:43:44 DEBUG : Creating backend with remote "TestDrime:rclone-test-suvadum2nefe" 2026/04/27 01:43:44 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/27 01:43:44 DEBUG : Creating backend with remote "/tmp/rclone2889378844" === RUN TestParseSumFile run.go:185: Remote "drime root 'rclone-test-suvadum2nefe'", Local "Local file system at /tmp/rclone2889378844", Modify Window "876000h0m0s" fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/3 (object not found) 2026/04/27 01:43:48 NOTICE: test.sum: improperly formatted checksum line 4 2026/04/27 01:43:48 NOTICE: test.sum: improperly formatted checksum line 5 2026/04/27 01:43:48 NOTICE: test.sum: improperly formatted checksum line 6 2026/04/27 01:43:48 NOTICE: test.sum: 2 warning(s) suppressed... 2026/04/27 01:43:48 DEBUG : test.sum: Removing old object on successful upload run.go:290: Failed to put "test.sum" to "drime root 'rclone-test-suvadum2nefe'": failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- FAIL: TestParseSumFile (12.35s) === RUN TestCheckSumDownload run.go:185: Remote "drime root 'rclone-test-suvadum2nefe'", Local "Local file system at /tmp/rclone2889378844", Modify Window "876000h0m0s" 2026/04/27 01:43:57 DEBUG : Creating backend with remote "TestDrime:rclone-test-suvadum2nefe/data" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckSumDownload/subtest1 2026/04/27 01:44:11 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload run.go:290: Failed to put "test.sum" to "drime root 'rclone-test-suvadum2nefe'": failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "test.sum" failed - try 1/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "test.sum" failed - try 2/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "test.sum" failed - try 3/3: failed to delete item: Error "The selected entry ids is invalid." run.go:133: removing file "test.sum" failed: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing dir "data" failed - try 1/3: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1317 /usr/local/go/src/testing/testing.go:1667 /usr/local/go/src/testing/testing.go:2030 /usr/local/go/src/runtime/panic.go:694 /usr/local/go/src/testing/testing.go:1022 /usr/local/go/src/testing/testing.go:1228 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:290 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:297 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:368 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:447 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want got test.sum (41) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1317 /usr/local/go/src/testing/testing.go:1667 /usr/local/go/src/testing/testing.go:2030 /usr/local/go/src/runtime/panic.go:694 /usr/local/go/src/testing/testing.go:1022 /usr/local/go/src/testing/testing.go:1228 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:290 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:297 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:368 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:447 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1771 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" --- FAIL: TestCheckSumDownload (28.61s) --- PASS: TestCheckSumDownload/subtest1 (1.52s) === RUN TestCopyFileCompareDest run.go:185: Remote "drime root 'rclone-test-suvadum2nefe'", Local "Local file system at /tmp/rclone2889378844", Modify Window "876000h0m0s" 2026/04/27 01:44:25 DEBUG : Creating backend with remote "TestDrime:rclone-test-suvadum2nefe/dst" 2026/04/27 01:44:27 DEBUG : Creating backend with remote "TestDrime:rclone-test-suvadum2nefe/CompareDest" 2026/04/27 01:44:27 DEBUG : one: Need to transfer - File not found at Destination 2026/04/27 01:44:29 DEBUG : one: size = 3 OK 2026/04/27 01:44:29 INFO : one: Copied (new) fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:212 Error: Should be true Test: TestCopyFileCompareDest Messages: listing wrong, want dst/one (3) got dst/one (3), test.sum (41) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:212 /usr/local/go/src/runtime/asm_amd64.s:1771 Error: Should be true Test: TestCopyFileCompareDest Messages: Unexpected file "test.sum" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:216 Error: Should be true Test: TestCopyFileCompareDest Messages: listing wrong, want dst/one (3) got dst/one (3), test.sum (41) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:216 /usr/local/go/src/runtime/asm_amd64.s:1771 Error: Should be true Test: TestCopyFileCompareDest Messages: Unexpected file "test.sum" 2026/04/27 01:44:48 DEBUG : one: size = 5 (Local file system at /tmp/rclone2889378844) 2026/04/27 01:44:48 DEBUG : one: size = 3 (drime root 'rclone-test-suvadum2nefe/dst') 2026/04/27 01:44:48 DEBUG : one: Sizes differ 2026/04/27 01:44:48 DEBUG : one: Removing old object on successful upload 2026/04/27 01:44:49 ERROR : one: Failed to copy: failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." copy_test.go:220: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:220 Error: Received unexpected error: failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." Test: TestCopyFileCompareDest run.go:130: removing dir "dst" failed - try 1/3: directory not empty --- FAIL: TestCopyFileCompareDest (26.41s) === RUN TestCopyFileCopyDest run.go:185: Remote "drime root 'rclone-test-suvadum2nefe'", Local "Local file system at /tmp/rclone2889378844", Modify Window "876000h0m0s" 2026/04/27 01:44:52 DEBUG : Creating backend with remote "TestDrime:rclone-test-suvadum2nefe/dst" 2026/04/27 01:44:53 DEBUG : Creating backend with remote "TestDrime:rclone-test-suvadum2nefe/CopyDest" 2026/04/27 01:44:54 DEBUG : one: Need to transfer - File not found at Destination 2026/04/27 01:44:55 DEBUG : one: size = 3 OK 2026/04/27 01:44:55 INFO : one: Copied (new) 2026/04/27 01:44:56 DEBUG : one: size = 5 (Local file system at /tmp/rclone2889378844) 2026/04/27 01:44:56 DEBUG : one: size = 3 (drime root 'rclone-test-suvadum2nefe/dst') 2026/04/27 01:44:56 DEBUG : one: Sizes differ 2026/04/27 01:44:57 DEBUG : one: Removing old object on successful upload 2026/04/27 01:44:58 ERROR : one: Failed to copy: failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." copy_test.go:303: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:303 Error: Received unexpected error: failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." Test: TestCopyFileCopyDest run.go:130: removing dir "dst" failed - try 1/3: directory not empty --- FAIL: TestCopyFileCopyDest (8.41s) === RUN TestMaxDelete run.go:185: Remote "drime root 'rclone-test-suvadum2nefe'", Local "Local file system at /tmp/rclone2889378844", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/04/27 01:45:10 DEBUG : Waiting for deletions to finish 2026/04/27 01:45:11 ERROR : large: Got fatal error on delete: --max-delete threshold reached 2026/04/27 01:45:11 INFO : medium: Deleted 2026/04/27 01:45:11 INFO : small: Deleted operations_test.go:453: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:453 Error: Not equal: expected: 1 actual : 3 Test: TestMaxDelete run.go:130: removing file "medium" failed - try 1/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "medium" failed - try 2/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "medium" failed - try 3/3: failed to delete item: Error "The selected entry ids is invalid." run.go:133: removing file "medium" failed: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "small" failed - try 1/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "small" failed - try 2/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "small" failed - try 3/3: failed to delete item: Error "The selected entry ids is invalid." run.go:133: removing file "small" failed: failed to delete item: Error "The selected entry ids is invalid." --- FAIL: TestMaxDelete (19.26s) === RUN TestMaxDeleteSize run.go:185: Remote "drime root 'rclone-test-suvadum2nefe'", Local "Local file system at /tmp/rclone2889378844", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/04/27 01:45:29 DEBUG : Waiting for deletions to finish 2026/04/27 01:45:30 ERROR : small: Got fatal error on delete: --max-delete-size threshold reached 2026/04/27 01:45:30 INFO : medium: Deleted 2026/04/27 01:45:30 INFO : large: Deleted operations_test.go:492: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:492 Error: Not equal: expected: 1 actual : 3 Test: TestMaxDeleteSize run.go:130: removing file "large" failed - try 1/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "large" failed - try 2/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "large" failed - try 3/3: failed to delete item: Error "The selected entry ids is invalid." run.go:133: removing file "large" failed: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "medium" failed - try 1/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "medium" failed - try 2/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "medium" failed - try 3/3: failed to delete item: Error "The selected entry ids is invalid." run.go:133: removing file "medium" failed: failed to delete item: Error "The selected entry ids is invalid." --- FAIL: TestMaxDeleteSize (18.94s) === RUN TestRmdirsNoLeaveRoot run.go:185: Remote "drime root 'rclone-test-suvadum2nefe'", Local "Local file system at /tmp/rclone2889378844", Modify Window "876000h0m0s" 2026/04/27 01:45:41 INFO : A2: Making directory 2026/04/27 01:45:41 INFO : A1/B2: Making directory 2026/04/27 01:45:42 INFO : A1/B2/C2: Making directory 2026/04/27 01:45:42 INFO : A1/B1/C3: Making directory 2026/04/27 01:45:43 INFO : A3: Making directory 2026/04/27 01:45:43 INFO : A3/B3: Making directory 2026/04/27 01:45:44 INFO : A3/B3/C4: Making directory 2026/04/27 01:45:46 DEBUG : removing 1 level 3 directories 2026/04/27 01:45:46 INFO : A3/B3/C4: Removing directory 2026/04/27 01:45:49 DEBUG : removing 2 level 3 directories 2026/04/27 01:45:49 INFO : A1/B2/C2: Removing directory 2026/04/27 01:45:49 INFO : A1/B1/C3: Removing directory 2026/04/27 01:45:49 DEBUG : removing 2 level 2 directories 2026/04/27 01:45:49 INFO : A3/B3: Removing directory 2026/04/27 01:45:49 INFO : A1/B2: Removing directory 2026/04/27 01:45:50 DEBUG : removing 2 level 1 directories 2026/04/27 01:45:50 INFO : A3: Removing directory 2026/04/27 01:45:50 INFO : A2: Removing directory 2026/04/27 01:45:53 DEBUG : removing 1 level 3 directories 2026/04/27 01:45:53 INFO : A1/B1/C1: Removing directory 2026/04/27 01:45:54 DEBUG : removing 1 level 2 directories 2026/04/27 01:45:54 INFO : A1/B1: Removing directory 2026/04/27 01:45:54 ERROR : A1/B1: Failed to rmdir: directory not empty operations_test.go:728: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:728 Error: Received unexpected error: failed to remove directories: directory not empty Test: TestRmdirsNoLeaveRoot run.go:130: removing dir "A1" failed - try 1/3: directory not empty --- FAIL: TestRmdirsNoLeaveRoot (18.35s) === RUN TestDirMove run.go:185: Remote "drime root 'rclone-test-suvadum2nefe'", Local "Local file system at /tmp/rclone2889378844", Modify Window "876000h0m0s" 2026/04/27 01:46:03 INFO : A1/B2: Making directory 2026/04/27 01:46:03 INFO : A1/B1/C3: Making directory operations_test.go:1411: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1411 Error: Received unexpected error: Move rename leaf: failed to patch item "name" to A2: Error "520 (520): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-520/\",\"title\":\"Error 520: Web server is returning an unknown error\",\"status\":520,\"detail\":\"The origin web server sent a response that Cloudflare could not parse. This may indicate the origin returned an empty response, malformed HTTP headers, or an otherwise invalid response.\",\"instance\":\"9f2a26c80d6c9024\",\"error_code\":520,\"error_name\":\"unknown_origin_error\",\"error_category\":\"origin_error\",\"ray_id\":\"9f2a26c80d6c9024\",\"timestamp\":\"2026-04-27T01:46:05Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check the origin server error logs and submit them to Cloudflare support.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}" Test: TestDirMove --- FAIL: TestDirMove (13.15s) === RUN TestRemoveExisting run.go:185: Remote "drime root 'rclone-test-suvadum2nefe'", Local "Local file system at /tmp/rclone2889378844", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/04/27 01:46:21 DEBUG : sub dir/test remove existing: TEST: renaming existing object to "sub dir/test remove existing.hitipic1" before starting operations_test.go:1981: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1981 Error: Not equal: expected: *fmt.wrapError(&fmt.wrapError{msg:"TEST: failed to rename existing file: Move rename leaf: failed to patch item \"name\" to test remove existing.hitipic1: Error \"520 (520): {\\\"type\\\":\\\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-520/\\\",\\\"title\\\":\\\"Error 520: Web server is returning an unknown error\\\",\\\"status\\\":520,\\\"detail\\\":\\\"The origin web server sent a response that Cloudflare could not parse. This may indicate the origin returned an empty response, malformed HTTP headers, or an otherwise invalid response.\\\",\\\"instance\\\":\\\"9f2a272e1a5d9024\\\",\\\"error_code\\\":520,\\\"error_name\\\":\\\"unknown_origin_error\\\",\\\"error_category\\\":\\\"origin_error\\\",\\\"ray_id\\\":\\\"9f2a272e1a5d9024\\\",\\\"timestamp\\\":\\\"2026-04-27T01:46:21Z\\\",\\\"zone\\\":\\\"app.drime.cloud\\\",\\\"cloudflare_error\\\":true,\\\"retryable\\\":true,\\\"retry_after\\\":60,\\\"owner_action_required\\\":true,\\\"what_you_should_do\\\":\\\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check the origin server error logs and submit them to Cloudflare support.\\\",\\\"footer\\\":\\\"This error was generated by Cloudflare on behalf of the website owner.\\\"}\"", err:(*fmt.wrapError)(0x394c42c09020)}) actual : () Test: TestRemoveExisting operations_test.go:1989: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1989 Error: " 11 sub dir/test remove existing\n 21 sub dir/test remove existing with long name 123456789012345678901234567890123456789012345678901234567890123456789\n" should not contain " 11 sub dir/test remove existing\n" Test: TestRemoveExisting operations_test.go:1990: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1990 Error: " 11 sub dir/test remove existing\n 21 sub dir/test remove existing with long name 123456789012345678901234567890123456789012345678901234567890123456789\n" does not contain " 11 sub dir/test remove existing." Test: TestRemoveExisting --- FAIL: TestRemoveExisting (13.63s) panic: runtime error: invalid memory address or nil pointer dereference [recovered, repanicked] [signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x2175f64] goroutine 1351 [running]: testing.tRunner.func1.2({0x2509ac0, 0x45b8a70}) /usr/local/go/src/testing/testing.go:1974 +0x232 testing.tRunner.func1() /usr/local/go/src/testing/testing.go:1977 +0x349 panic({0x2509ac0?, 0x45b8a70?}) /usr/local/go/src/runtime/panic.go:860 +0x13a github.com/rclone/rclone/fs/operations_test.TestRemoveExisting(0x394c42b96488) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1993 +0x8c4 testing.tRunner(0x394c42b96488, 0x2b8cb90) /usr/local/go/src/testing/testing.go:2036 +0xea created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:2101 +0x4c5 "./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^(TestCheckSumDownload|TestCopyFileCompareDest|TestCopyFileCopyDest|TestDirMove|TestMaxDelete|TestMaxDeleteSize|TestParseSumFile|TestRemoveExisting|TestRmdirsNoLeaveRoot)$'" - Finished ERROR in 2m39.684229088s (try 3/5): exit status 2: Failed [TestParseSumFile TestCheckSumDownload TestCopyFileCompareDest TestCopyFileCopyDest TestMaxDelete TestMaxDeleteSize TestRmdirsNoLeaveRoot TestDirMove TestRemoveExisting]