"./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose -test.run '^(TestCopyRedownload|TestNothingToTransferWithoutEmptyDirs|TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveOverSelf|TestServerSideMoveWithFilter|TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors|TestSyncCompareDest)$'" - Starting (try 3/5) 2025/04/29 07:19:42 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-hesicaj2jaye" 2025/04/29 07:19:42 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/04/29 07:19:42 DEBUG : Creating backend with remote "/tmp/rclone2778512096" === RUN TestServerSideCopy run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" 2025/04/29 07:19:48 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-puloxuk7cisa" sync_test.go:590: Server side copy (if possible) Linkbox root 'rclone-test-hesicaj2jaye' -> Linkbox root 'rclone-test-puloxuk7cisa' 2025/04/29 07:19:49 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/29 07:19:49 DEBUG : Linkbox root 'rclone-test-puloxuk7cisa': Waiting for checks to finish 2025/04/29 07:19:49 DEBUG : Linkbox root 'rclone-test-puloxuk7cisa': Waiting for transfers to finish 2025/04/29 07:19:49 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:594: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:594 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideCopy 2025/04/29 07:19:49 DEBUG : Linkbox root 'rclone-test-puloxuk7cisa': Purge remote 2025/04/29 07:19:50 NOTICE: purge failed: directory not found --- FAIL: TestServerSideCopy (11.20s) === RUN TestServerSideCopyOverSelf run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" 2025/04/29 07:19:58 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-pihewot3siho" sync_test.go:626: Server side copy (if possible) Linkbox root 'rclone-test-hesicaj2jaye' -> Linkbox root 'rclone-test-pihewot3siho' 2025/04/29 07:19:59 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/29 07:19:59 DEBUG : Linkbox root 'rclone-test-pihewot3siho': Waiting for checks to finish 2025/04/29 07:19:59 DEBUG : Linkbox root 'rclone-test-pihewot3siho': Waiting for transfers to finish 2025/04/29 07:19:59 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:630: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:630 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideCopyOverSelf 2025/04/29 07:19:59 DEBUG : Linkbox root 'rclone-test-pihewot3siho': Purge remote 2025/04/29 07:19:59 NOTICE: purge failed: directory not found run.go:125: removing dir "sub dir" failed - try 1/3: directory not empty run.go:125: removing dir "sub dir" failed - try 2/3: directory not empty run.go:125: removing dir "sub dir" failed - try 3/3: directory not empty run.go:128: removing dir "sub dir" failed: directory not empty fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Flushing the directory cache fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Flushing the directory cache fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:295: Flushing the directory cache fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:173 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1176 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1354 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1684 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/runtime/panic.go:629 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1006 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:630 Error: Should be true Test: TestServerSideCopyOverSelf Messages: listing wrong, want got sub dir/hello world (11) fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:173 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1176 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1354 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1684 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/runtime/panic.go:629 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1006 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:630 Error: Should be true Test: TestServerSideCopyOverSelf Messages: Unexpected file "sub dir/hello world" fstest.go:321: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:321 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:173 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1176 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1354 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1684 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/runtime/panic.go:629 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1006 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:630 Error: Not equal: expected: []string{} actual : []string{"sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=7) "sub dir" } Test: TestServerSideCopyOverSelf Messages: directories --- FAIL: TestServerSideCopyOverSelf (28.91s) === RUN TestServerSideMoveOverSelf run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" 2025/04/29 07:20:23 DEBUG : sub dir/hello world: Update: removing old file 2025/04/29 07:20:27 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-zegufor0kepo" sync_test.go:671: Server side copy (if possible) Linkbox root 'rclone-test-hesicaj2jaye' -> Linkbox root 'rclone-test-zegufor0kepo' 2025/04/29 07:20:28 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/29 07:20:28 DEBUG : Linkbox root 'rclone-test-zegufor0kepo': Waiting for checks to finish 2025/04/29 07:20:28 DEBUG : Linkbox root 'rclone-test-zegufor0kepo': Waiting for transfers to finish 2025/04/29 07:20:28 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:675: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:675 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideMoveOverSelf 2025/04/29 07:20:28 DEBUG : Linkbox root 'rclone-test-zegufor0kepo': Purge remote 2025/04/29 07:20:28 NOTICE: purge failed: directory not found fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Flushing the directory cache fstest.go:286: Sleeping for 6s just to make sure --- FAIL: TestServerSideMoveOverSelf (34.08s) === RUN TestCopyRedownload run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" 2025/04/29 07:20:57 DEBUG : sub dir/hello world: Update: removing old file fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Flushing the directory cache fstest.go:286: Sleeping for 6s just to make sure 2025/04/29 07:21:19 DEBUG : Added delayed dir = "sub dir", newDst= 2025/04/29 07:21:20 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/29 07:21:20 DEBUG : Local file system at /tmp/rclone2778512096: Waiting for checks to finish 2025/04/29 07:21:20 DEBUG : Local file system at /tmp/rclone2778512096: Waiting for transfers to finish 2025/04/29 07:21:20 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/04/29 07:21:20 ERROR : sub dir: Failed to update directory timestamp or metadata: chtimes /tmp/rclone2778512096/sub dir: no such file or directory sync_test.go:732: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:732 Error: Received unexpected error: failed to set directory modtime: chtimes /tmp/rclone2778512096/sub dir: no such file or directory Test: TestCopyRedownload --- FAIL: TestCopyRedownload (28.04s) === RUN TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" 2025/04/29 07:21:34 INFO : d: Making directory 2025/04/29 07:21:38 DEBUG : a/potato2: Need to transfer - File not found at Destination 2025/04/29 07:21:38 DEBUG : c/non empty space: Sizes identical 2025/04/29 07:21:38 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye': Waiting for checks to finish 2025/04/29 07:21:38 DEBUG : c/non empty space: Unchanged skipping 2025/04/29 07:21:38 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye': Waiting for transfers to finish 2025/04/29 07:21:43 INFO : a/potato2: Copied (new) 2025/04/29 07:21:43 ERROR : Linkbox root 'rclone-test-hesicaj2jaye': not deleting files as there were IO errors 2025/04/29 07:21:43 ERROR : Linkbox root 'rclone-test-hesicaj2jaye': not deleting directories as there were IO errors run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" --- PASS: TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors (34.56s) === RUN TestServerSideMove run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" 2025/04/29 07:21:59 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-samehan0hage" 2025/04/29 07:22:12 DEBUG : potato2: Trying to read object after upload: try again in 100ms (1/10) sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-hesicaj2jaye' -> Linkbox root 'rclone-test-samehan0hage' 2025/04/29 07:22:29 DEBUG : potato2: Need to transfer - File not found at Destination 2025/04/29 07:22:29 DEBUG : empty space: Sizes identical 2025/04/29 07:22:29 DEBUG : empty space: Unchanged skipping 2025/04/29 07:22:29 DEBUG : Linkbox root 'rclone-test-samehan0hage': Waiting for checks to finish 2025/04/29 07:22:29 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/04/29 07:22:29 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/04/29 07:22:29 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/04/29 07:22:29 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/04/29 07:22:29 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/04/29 07:22:30 INFO : empty space: Deleted 2025/04/29 07:22:30 DEBUG : Linkbox root 'rclone-test-samehan0hage': Waiting for transfers to finish sync_test.go:1716: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1881 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideMove 2025/04/29 07:22:30 DEBUG : Linkbox root 'rclone-test-samehan0hage': Purge remote --- FAIL: TestServerSideMove (36.62s) === RUN TestServerSideMoveWithFilter run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" 2025/04/29 07:22:36 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-tezidin2fece" 2025/04/29 07:23:05 DEBUG : potato3: Trying to read object after upload: try again in 100ms (1/10) 2025/04/29 07:23:15 DEBUG : potato3: Trying to read object after upload: try again in 200ms (2/10) sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-hesicaj2jaye' -> Linkbox root 'rclone-test-tezidin2fece' 2025/04/29 07:23:25 DEBUG : empty space: Excluded (Size Filter) 2025/04/29 07:23:25 DEBUG : empty space: Excluded 2025/04/29 07:23:25 DEBUG : empty space: Excluded (Size Filter) 2025/04/29 07:23:25 DEBUG : empty space: Excluded 2025/04/29 07:23:25 DEBUG : potato2: Need to transfer - File not found at Destination 2025/04/29 07:23:25 DEBUG : Linkbox root 'rclone-test-tezidin2fece': Waiting for checks to finish 2025/04/29 07:23:25 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/04/29 07:23:25 DEBUG : Linkbox root 'rclone-test-tezidin2fece': Waiting for transfers to finish 2025/04/29 07:23:25 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/04/29 07:23:25 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/04/29 07:23:25 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/04/29 07:23:25 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:1716: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1894 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideMoveWithFilter 2025/04/29 07:23:25 DEBUG : Linkbox root 'rclone-test-tezidin2fece': Purge remote --- FAIL: TestServerSideMoveWithFilter (56.19s) === RUN TestServerSideMoveDeleteEmptySourceDirs run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" 2025/04/29 07:23:32 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-hecopiz7cale" run.go:285: Failed to put "potato3" to "Linkbox root 'rclone-test-hesicaj2jaye'": Update second step failed: HTTP error 524 (524 ) returned body: "" 2025/04/29 07:24:24 DEBUG : Linkbox root 'rclone-test-hecopiz7cale': Purge remote 2025/04/29 07:24:24 NOTICE: purge failed: directory not found --- FAIL: TestServerSideMoveDeleteEmptySourceDirs (56.06s) === RUN TestSyncCompareDest run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" 2025/04/29 07:24:28 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-hesicaj2jaye/dst" 2025/04/29 07:24:29 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-hesicaj2jaye/CompareDest" 2025/04/29 07:24:32 DEBUG : one: Need to transfer - File not found at Destination 2025/04/29 07:24:32 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye/dst': Waiting for checks to finish 2025/04/29 07:24:32 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye/dst': Waiting for transfers to finish 2025/04/29 07:24:36 INFO : one: Copied (new) 2025/04/29 07:24:36 DEBUG : Waiting for deletions to finish 2025/04/29 07:24:38 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/04/29 07:24:38 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye/dst': Waiting for checks to finish 2025/04/29 07:24:38 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye/dst': Waiting for transfers to finish 2025/04/29 07:24:38 DEBUG : one: Update: removing old file 2025/04/29 07:24:42 INFO : one: Copied (replaced existing) 2025/04/29 07:24:42 DEBUG : Waiting for deletions to finish 2025/04/29 07:24:43 DEBUG : dst/one: Update: removing old file 2025/04/29 07:25:02 DEBUG : CompareDest/one: Trying to read object after upload: try again in 100ms (1/10) 2025/04/29 07:25:12 DEBUG : CompareDest/one: Trying to read object after upload: try again in 200ms (2/10) 2025/04/29 07:25:23 DEBUG : CompareDest/one: Trying to read object after upload: try again in 400ms (3/10) 2025/04/29 07:25:33 DEBUG : CompareDest/one: Trying to read object after upload: try again in 800ms (4/10) 2025/04/29 07:25:36 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/04/29 07:25:36 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye/dst': Waiting for checks to finish 2025/04/29 07:25:36 DEBUG : one: Sizes identical 2025/04/29 07:25:36 DEBUG : one: Destination found in --compare-dest, skipping 2025/04/29 07:25:36 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye/dst': Waiting for transfers to finish 2025/04/29 07:25:36 DEBUG : Waiting for deletions to finish 2025/04/29 07:25:36 INFO : There was nothing to transfer fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Flushing the directory cache fstest.go:286: Sleeping for 6s just to make sure 2025/04/29 07:26:00 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/04/29 07:26:00 DEBUG : two: Sizes identical 2025/04/29 07:26:00 DEBUG : two: Destination found in --compare-dest, skipping 2025/04/29 07:26:00 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye/dst': Waiting for checks to finish 2025/04/29 07:26:00 DEBUG : one: Sizes identical 2025/04/29 07:26:00 DEBUG : one: Destination found in --compare-dest, skipping 2025/04/29 07:26:00 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye/dst': Waiting for transfers to finish 2025/04/29 07:26:00 DEBUG : Waiting for deletions to finish 2025/04/29 07:26:00 INFO : There was nothing to transfer 2025/04/29 07:26:01 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/04/29 07:26:02 DEBUG : two: Sizes identical 2025/04/29 07:26:02 DEBUG : two: Destination found in --compare-dest, skipping 2025/04/29 07:26:02 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye/dst': Waiting for checks to finish 2025/04/29 07:26:02 DEBUG : one: Sizes identical 2025/04/29 07:26:02 DEBUG : one: Destination found in --compare-dest, skipping 2025/04/29 07:26:02 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye/dst': Waiting for transfers to finish 2025/04/29 07:26:02 DEBUG : Waiting for deletions to finish 2025/04/29 07:26:02 INFO : There was nothing to transfer sync_test.go:2175: No hash on uploaded file so skipping compare timestamp test 2025/04/29 07:26:05 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/04/29 07:26:05 DEBUG : two: Sizes differ (src 5 vs dst 3) 2025/04/29 07:26:05 DEBUG : two: Need to transfer - File not found at Destination 2025/04/29 07:26:05 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye/dst': Waiting for checks to finish 2025/04/29 07:26:05 DEBUG : one: Sizes identical 2025/04/29 07:26:05 DEBUG : one: Destination found in --compare-dest, skipping 2025/04/29 07:26:05 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye/dst': Waiting for transfers to finish 2025/04/29 07:26:08 INFO : two: Copied (new) 2025/04/29 07:26:08 DEBUG : Waiting for deletions to finish run.go:125: removing file "dst/two" failed - try 1/3: could not Remove: Linkbox error 500: Post "http://192.168.0.133:9200/zdisk_item/_search": context deadline exceeded run.go:125: removing dir "CompareDest" failed - try 1/3: directory not empty run.go:125: removing dir "CompareDest" failed - try 2/3: directory not empty run.go:125: removing dir "CompareDest" failed - try 3/3: directory not empty run.go:128: removing dir "CompareDest" failed: directory not empty fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Flushing the directory cache fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Flushing the directory cache fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:295: Flushing the directory cache fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:173 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1176 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1354 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1684 Error: Should be true Test: TestSyncCompareDest Messages: listing wrong, want got CompareDest/one (5), CompareDest/two (3) fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:173 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1176 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1354 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1684 Error: Should be true Test: TestSyncCompareDest Messages: Unexpected file "CompareDest/one" fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:173 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1176 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1354 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1684 Error: Should be true Test: TestSyncCompareDest Messages: Unexpected file "CompareDest/two" fstest.go:321: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:321 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:173 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1176 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1354 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1684 Error: Not equal: expected: []string{} actual : []string{"CompareDest"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=11) "CompareDest" } Test: TestSyncCompareDest Messages: directories --- FAIL: TestSyncCompareDest (128.80s) === RUN TestNothingToTransferWithoutEmptyDirs run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" 2025/04/29 07:26:37 INFO : sub dir: Set directory modification time (using DirSetModTime) 2025/04/29 07:26:37 INFO : sub dir: Making directory 2025/04/29 07:26:49 INFO : sub dir: Made directory with modification time 2011-12-30 12:59:59 +0000 UTC run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Flushing the directory cache fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Flushing the directory cache fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:295: Flushing the directory cache fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2873 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2950 Error: Should be true Test: TestNothingToTransferWithoutEmptyDirs Messages: listing wrong, want sub dir/hello world (11), sub dir2/very/very/very/very/very/nested/subdir/hello world (11) got CompareDest/one (5), CompareDest/two (3), sub dir/hello world (11) fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2873 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2950 Error: Should be true Test: TestNothingToTransferWithoutEmptyDirs Messages: Unexpected file "CompareDest/one" fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2873 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2950 Error: Should be true Test: TestNothingToTransferWithoutEmptyDirs Messages: Unexpected file "CompareDest/two" fstest.go:197: Not found "sub dir2/very/very/very/very/very/nested/subdir/hello world" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2873 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2950 Error: Not equal: expected: 0 actual : 1 Test: TestNothingToTransferWithoutEmptyDirs Messages: 1 objects not found run.go:180: Remote "Linkbox root 'rclone-test-hesicaj2jaye'", Local "Local file system at /tmp/rclone2778512096", Modify Window "876000h0m0s" fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Flushing the directory cache fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Flushing the directory cache fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:295: Flushing the directory cache fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2895 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2950 Error: Should be true Test: TestNothingToTransferWithoutEmptyDirs Messages: listing wrong, want sub dir/hello world (11), sub dir2/very/very/very/very/very/nested/subdir/hello world (11) got CompareDest/one (5), CompareDest/two (3), sub dir/hello world (11), sub dir2/very/very/very/very/very/nested/subdir/hello world (11) fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2895 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2950 Error: Should be true Test: TestNothingToTransferWithoutEmptyDirs Messages: Unexpected file "CompareDest/one" fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2895 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2950 Error: Should be true Test: TestNothingToTransferWithoutEmptyDirs Messages: Unexpected file "CompareDest/two" --- FAIL: TestNothingToTransferWithoutEmptyDirs (148.63s) FAIL 2025/04/29 07:29:05 DEBUG : Linkbox root 'rclone-test-hesicaj2jaye': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose -test.run '^(TestCopyRedownload|TestNothingToTransferWithoutEmptyDirs|TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveOverSelf|TestServerSideMoveWithFilter|TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors|TestSyncCompareDest)$'" - Finished ERROR in 9m25.235867093s (try 3/5): exit status 1: Failed [TestServerSideCopy TestServerSideCopyOverSelf TestServerSideMoveOverSelf TestCopyRedownload TestServerSideMove TestServerSideMoveWithFilter TestServerSideMoveDeleteEmptySourceDirs TestSyncCompareDest TestNothingToTransferWithoutEmptyDirs]