"./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose -test.run '^(TestCopyRedownload|TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveOverSelf|TestServerSideMoveWithFilter)$'" - Starting (try 3/5) 2025/02/05 01:49:41 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-wafukuv2bace" 2025/02/05 01:49:41 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/05 01:49:41 DEBUG : Creating backend with remote "/tmp/rclone2074121508" === RUN TestServerSideCopy run.go:180: Remote "Linkbox root 'rclone-test-wafukuv2bace'", Local "Local file system at /tmp/rclone2074121508", Modify Window "876000h0m0s" 2025/02/05 01:49:49 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-xapayes6tide" sync_test.go:590: Server side copy (if possible) Linkbox root 'rclone-test-wafukuv2bace' -> Linkbox root 'rclone-test-xapayes6tide' 2025/02/05 01:49:49 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/02/05 01:49:49 DEBUG : Linkbox root 'rclone-test-xapayes6tide': Waiting for checks to finish 2025/02/05 01:49:49 DEBUG : Linkbox root 'rclone-test-xapayes6tide': Waiting for transfers to finish 2025/02/05 01:49:50 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:594: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:594 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideCopy 2025/02/05 01:49:50 DEBUG : Linkbox root 'rclone-test-xapayes6tide': Purge remote 2025/02/05 01:49:50 NOTICE: purge failed: directory not found --- FAIL: TestServerSideCopy (13.54s) === RUN TestServerSideCopyOverSelf run.go:180: Remote "Linkbox root 'rclone-test-wafukuv2bace'", Local "Local file system at /tmp/rclone2074121508", Modify Window "876000h0m0s" 2025/02/05 01:50:00 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-judemiy8samo" 2025/02/05 01:50:00 DEBUG : Config file has changed externally - reloading sync_test.go:626: Server side copy (if possible) Linkbox root 'rclone-test-wafukuv2bace' -> Linkbox root 'rclone-test-judemiy8samo' 2025/02/05 01:50:02 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/02/05 01:50:02 DEBUG : Linkbox root 'rclone-test-judemiy8samo': Waiting for checks to finish 2025/02/05 01:50:02 DEBUG : Linkbox root 'rclone-test-judemiy8samo': Waiting for transfers to finish 2025/02/05 01:50:02 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:630: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:630 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideCopyOverSelf 2025/02/05 01:50:02 DEBUG : Linkbox root 'rclone-test-judemiy8samo': Purge remote 2025/02/05 01:50:02 NOTICE: purge failed: directory not found --- FAIL: TestServerSideCopyOverSelf (11.65s) === RUN TestServerSideMoveOverSelf run.go:180: Remote "Linkbox root 'rclone-test-wafukuv2bace'", Local "Local file system at /tmp/rclone2074121508", Modify Window "876000h0m0s" 2025/02/05 01:50:12 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-qarisug8lesi" sync_test.go:671: Server side copy (if possible) Linkbox root 'rclone-test-wafukuv2bace' -> Linkbox root 'rclone-test-qarisug8lesi' 2025/02/05 01:50:12 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/02/05 01:50:12 DEBUG : Linkbox root 'rclone-test-qarisug8lesi': Waiting for checks to finish 2025/02/05 01:50:12 DEBUG : Linkbox root 'rclone-test-qarisug8lesi': Waiting for transfers to finish 2025/02/05 01:50:13 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:675: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:675 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideMoveOverSelf 2025/02/05 01:50:13 DEBUG : Linkbox root 'rclone-test-qarisug8lesi': Purge remote 2025/02/05 01:50:13 NOTICE: purge failed: directory not found run.go:125: removing dir "sub dir" failed - try 1/3: directory not empty fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Flushing the directory cache fstest.go:286: Sleeping for 6s just to make sure --- FAIL: TestServerSideMoveOverSelf (19.88s) === RUN TestCopyRedownload run.go:180: Remote "Linkbox root 'rclone-test-wafukuv2bace'", Local "Local file system at /tmp/rclone2074121508", Modify Window "876000h0m0s" 2025/02/05 01:50:31 DEBUG : Added delayed dir = "sub dir", newDst= 2025/02/05 01:50:32 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/02/05 01:50:32 DEBUG : Local file system at /tmp/rclone2074121508: Waiting for checks to finish 2025/02/05 01:50:32 DEBUG : Local file system at /tmp/rclone2074121508: Waiting for transfers to finish 2025/02/05 01:50:32 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/02/05 01:50:32 ERROR : sub dir: Failed to update directory timestamp or metadata: chtimes /tmp/rclone2074121508/sub dir: no such file or directory sync_test.go:732: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:732 Error: Received unexpected error: failed to set directory modtime: chtimes /tmp/rclone2074121508/sub dir: no such file or directory Test: TestCopyRedownload --- FAIL: TestCopyRedownload (10.00s) === RUN TestServerSideMove run.go:180: Remote "Linkbox root 'rclone-test-wafukuv2bace'", Local "Local file system at /tmp/rclone2074121508", Modify Window "876000h0m0s" 2025/02/05 01:50:36 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-dowinab6bepi" sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-wafukuv2bace' -> Linkbox root 'rclone-test-dowinab6bepi' 2025/02/05 01:50:53 DEBUG : potato2: Need to transfer - File not found at Destination 2025/02/05 01:50:53 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/02/05 01:50:53 DEBUG : Linkbox root 'rclone-test-dowinab6bepi': Waiting for checks to finish 2025/02/05 01:50:53 DEBUG : empty space: Sizes identical 2025/02/05 01:50:53 DEBUG : empty space: Unchanged skipping 2025/02/05 01:50:53 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/02/05 01:50:53 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/02/05 01:50:53 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/02/05 01:50:53 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/02/05 01:50:55 INFO : empty space: Deleted 2025/02/05 01:50:55 DEBUG : Linkbox root 'rclone-test-dowinab6bepi': Waiting for transfers to finish sync_test.go:1716: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1881 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideMove 2025/02/05 01:50:55 DEBUG : Linkbox root 'rclone-test-dowinab6bepi': Purge remote --- FAIL: TestServerSideMove (24.05s) === RUN TestServerSideMoveWithFilter run.go:180: Remote "Linkbox root 'rclone-test-wafukuv2bace'", Local "Local file system at /tmp/rclone2074121508", Modify Window "876000h0m0s" 2025/02/05 01:51:00 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-kibidob7yuze" sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-wafukuv2bace' -> Linkbox root 'rclone-test-kibidob7yuze' 2025/02/05 01:51:16 DEBUG : empty space: Excluded (Size Filter) 2025/02/05 01:51:16 DEBUG : empty space: Excluded 2025/02/05 01:51:17 DEBUG : empty space: Excluded (Size Filter) 2025/02/05 01:51:17 DEBUG : empty space: Excluded 2025/02/05 01:51:17 DEBUG : potato2: Need to transfer - File not found at Destination 2025/02/05 01:51:17 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/02/05 01:51:17 DEBUG : Linkbox root 'rclone-test-kibidob7yuze': Waiting for checks to finish 2025/02/05 01:51:17 DEBUG : Linkbox root 'rclone-test-kibidob7yuze': Waiting for transfers to finish 2025/02/05 01:51:17 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/02/05 01:51:17 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/02/05 01:51:17 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/02/05 01:51:17 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:1716: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1894 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideMoveWithFilter 2025/02/05 01:51:17 DEBUG : Linkbox root 'rclone-test-kibidob7yuze': Purge remote --- FAIL: TestServerSideMoveWithFilter (23.03s) === RUN TestServerSideMoveDeleteEmptySourceDirs run.go:180: Remote "Linkbox root 'rclone-test-wafukuv2bace'", Local "Local file system at /tmp/rclone2074121508", Modify Window "876000h0m0s" 2025/02/05 01:51:23 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-hujacuf0ceca" 2025/02/05 01:51:32 INFO : tomatoDir: Making directory sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-wafukuv2bace' -> Linkbox root 'rclone-test-hujacuf0ceca' 2025/02/05 01:51:42 DEBUG : potato2: Need to transfer - File not found at Destination 2025/02/05 01:51:42 DEBUG : empty space: Sizes identical 2025/02/05 01:51:42 DEBUG : empty space: Unchanged skipping 2025/02/05 01:51:42 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/02/05 01:51:42 DEBUG : Linkbox root 'rclone-test-hujacuf0ceca': Waiting for checks to finish 2025/02/05 01:51:42 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/02/05 01:51:42 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/02/05 01:51:43 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/02/05 01:51:43 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/02/05 01:51:44 INFO : empty space: Deleted 2025/02/05 01:51:44 DEBUG : Linkbox root 'rclone-test-hujacuf0ceca': Waiting for transfers to finish 2025/02/05 01:51:44 ERROR : Linkbox root 'rclone-test-wafukuv2bace': not deleting directories as there were IO errors sync_test.go:1716: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1901 Error: Received unexpected error: not deleting directories as there were IO errors Test: TestServerSideMoveDeleteEmptySourceDirs 2025/02/05 01:51:44 DEBUG : Linkbox root 'rclone-test-hujacuf0ceca': Purge remote --- FAIL: TestServerSideMoveDeleteEmptySourceDirs (27.67s) FAIL 2025/02/05 01:51:51 DEBUG : Linkbox root 'rclone-test-wafukuv2bace': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose -test.run '^(TestCopyRedownload|TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveOverSelf|TestServerSideMoveWithFilter)$'" - Finished ERROR in 2m11.781147416s (try 3/5): exit status 1: Failed [TestServerSideCopy TestServerSideCopyOverSelf TestServerSideMoveOverSelf TestCopyRedownload TestServerSideMove TestServerSideMoveWithFilter TestServerSideMoveDeleteEmptySourceDirs]