"./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose -test.run '^(TestCopyRedownload|TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveOverSelf|TestServerSideMoveWithFilter)$'" - Starting (try 3/5) 2025/05/16 02:05:22 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-miqucaz4cote" 2025/05/16 02:05:22 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/05/16 02:05:22 DEBUG : Creating backend with remote "/tmp/rclone3459648362" === RUN TestServerSideCopy run.go:180: Remote "Linkbox root 'rclone-test-miqucaz4cote'", Local "Local file system at /tmp/rclone3459648362", Modify Window "876000h0m0s" 2025/05/16 02:05:28 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-mubuyem2ledi" 2025/05/16 02:05:28 DEBUG : Config file has changed externally - reloading sync_test.go:590: Server side copy (if possible) Linkbox root 'rclone-test-miqucaz4cote' -> Linkbox root 'rclone-test-mubuyem2ledi' 2025/05/16 02:05:29 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/05/16 02:05:29 DEBUG : Linkbox root 'rclone-test-mubuyem2ledi': Waiting for checks to finish 2025/05/16 02:05:29 DEBUG : Linkbox root 'rclone-test-mubuyem2ledi': Waiting for transfers to finish 2025/05/16 02:05:29 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:594: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:594 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideCopy 2025/05/16 02:05:29 DEBUG : Linkbox root 'rclone-test-mubuyem2ledi': Purge remote 2025/05/16 02:05:29 NOTICE: purge failed: directory not found --- FAIL: TestServerSideCopy (9.79s) === RUN TestServerSideCopyOverSelf run.go:180: Remote "Linkbox root 'rclone-test-miqucaz4cote'", Local "Local file system at /tmp/rclone3459648362", Modify Window "876000h0m0s" 2025/05/16 02:05:36 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-basulen1xume" sync_test.go:626: Server side copy (if possible) Linkbox root 'rclone-test-miqucaz4cote' -> Linkbox root 'rclone-test-basulen1xume' 2025/05/16 02:05:37 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/05/16 02:05:37 DEBUG : Linkbox root 'rclone-test-basulen1xume': Waiting for checks to finish 2025/05/16 02:05:37 DEBUG : Linkbox root 'rclone-test-basulen1xume': Waiting for transfers to finish 2025/05/16 02:05:37 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:630: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:630 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideCopyOverSelf 2025/05/16 02:05:37 DEBUG : Linkbox root 'rclone-test-basulen1xume': Purge remote 2025/05/16 02:05:37 NOTICE: purge failed: directory not found --- FAIL: TestServerSideCopyOverSelf (8.26s) === RUN TestServerSideMoveOverSelf run.go:180: Remote "Linkbox root 'rclone-test-miqucaz4cote'", Local "Local file system at /tmp/rclone3459648362", Modify Window "876000h0m0s" 2025/05/16 02:05:44 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-carinif7jizo" sync_test.go:671: Server side copy (if possible) Linkbox root 'rclone-test-miqucaz4cote' -> Linkbox root 'rclone-test-carinif7jizo' 2025/05/16 02:05:45 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/05/16 02:05:45 DEBUG : Linkbox root 'rclone-test-carinif7jizo': Waiting for checks to finish 2025/05/16 02:05:45 DEBUG : Linkbox root 'rclone-test-carinif7jizo': Waiting for transfers to finish 2025/05/16 02:05:45 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:675: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:675 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideMoveOverSelf 2025/05/16 02:05:45 DEBUG : Linkbox root 'rclone-test-carinif7jizo': Purge remote 2025/05/16 02:05:45 NOTICE: purge failed: directory not found --- FAIL: TestServerSideMoveOverSelf (8.30s) === RUN TestCopyRedownload run.go:180: Remote "Linkbox root 'rclone-test-miqucaz4cote'", Local "Local file system at /tmp/rclone3459648362", Modify Window "876000h0m0s" 2025/05/16 02:05:53 DEBUG : Added delayed dir = "sub dir", newDst= 2025/05/16 02:05:53 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/05/16 02:05:53 DEBUG : Local file system at /tmp/rclone3459648362: Waiting for checks to finish 2025/05/16 02:05:53 DEBUG : Local file system at /tmp/rclone3459648362: Waiting for transfers to finish 2025/05/16 02:05:53 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/05/16 02:05:53 ERROR : sub dir: Failed to update directory timestamp or metadata: chtimes /tmp/rclone3459648362/sub dir: no such file or directory sync_test.go:732: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:732 Error: Received unexpected error: failed to set directory modtime: chtimes /tmp/rclone3459648362/sub dir: no such file or directory Test: TestCopyRedownload --- FAIL: TestCopyRedownload (7.99s) === RUN TestServerSideMove run.go:180: Remote "Linkbox root 'rclone-test-miqucaz4cote'", Local "Local file system at /tmp/rclone3459648362", Modify Window "876000h0m0s" 2025/05/16 02:05:57 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-xakanad7hofi" sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-miqucaz4cote' -> Linkbox root 'rclone-test-xakanad7hofi' 2025/05/16 02:06:09 DEBUG : potato3: Trying to read object after upload: try again in 100ms (1/10) 2025/05/16 02:06:09 DEBUG : potato3: Trying to read object after upload: try again in 200ms (2/10) 2025/05/16 02:06:10 DEBUG : potato3: Trying to read object after upload: try again in 400ms (3/10) 2025/05/16 02:06:10 DEBUG : potato3: Trying to read object after upload: try again in 800ms (4/10) 2025/05/16 02:06:11 DEBUG : potato3: Trying to read object after upload: try again in 1.6s (5/10) 2025/05/16 02:06:13 DEBUG : potato3: Trying to read object after upload: try again in 3.2s (6/10) 2025/05/16 02:06:16 DEBUG : potato3: Trying to read object after upload: try again in 6.4s (7/10) 2025/05/16 02:06:23 DEBUG : potato3: Trying to read object after upload: try again in 12.8s (8/10) 2025/05/16 02:06:36 DEBUG : potato2: Need to transfer - File not found at Destination 2025/05/16 02:06:36 DEBUG : empty space: Sizes identical 2025/05/16 02:06:36 DEBUG : empty space: Unchanged skipping 2025/05/16 02:06:36 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/05/16 02:06:36 DEBUG : Linkbox root 'rclone-test-xakanad7hofi': Waiting for checks to finish 2025/05/16 02:06:37 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/05/16 02:06:37 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/05/16 02:06:37 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/05/16 02:06:37 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/05/16 02:06:38 INFO : empty space: Deleted 2025/05/16 02:06:38 DEBUG : Linkbox root 'rclone-test-xakanad7hofi': Waiting for transfers to finish sync_test.go:1716: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1881 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideMove 2025/05/16 02:06:38 DEBUG : Linkbox root 'rclone-test-xakanad7hofi': Purge remote --- FAIL: TestServerSideMove (45.31s) === RUN TestServerSideMoveWithFilter run.go:180: Remote "Linkbox root 'rclone-test-miqucaz4cote'", Local "Local file system at /tmp/rclone3459648362", Modify Window "876000h0m0s" 2025/05/16 02:06:42 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-xajaval5yita" 2025/05/16 02:06:42 DEBUG : Config file has changed externally - reloading sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-miqucaz4cote' -> Linkbox root 'rclone-test-xajaval5yita' 2025/05/16 02:06:54 DEBUG : empty space: Excluded (Size Filter) 2025/05/16 02:06:54 DEBUG : empty space: Excluded 2025/05/16 02:06:54 DEBUG : empty space: Excluded (Size Filter) 2025/05/16 02:06:54 DEBUG : empty space: Excluded 2025/05/16 02:06:54 DEBUG : potato2: Need to transfer - File not found at Destination 2025/05/16 02:06:54 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/05/16 02:06:54 DEBUG : Linkbox root 'rclone-test-xajaval5yita': Waiting for checks to finish 2025/05/16 02:06:54 DEBUG : Linkbox root 'rclone-test-xajaval5yita': Waiting for transfers to finish 2025/05/16 02:06:54 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/05/16 02:06:54 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/05/16 02:06:55 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/05/16 02:06:55 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:1716: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1894 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideMoveWithFilter 2025/05/16 02:06:55 DEBUG : Linkbox root 'rclone-test-xajaval5yita': Purge remote --- FAIL: TestServerSideMoveWithFilter (18.27s) === RUN TestServerSideMoveDeleteEmptySourceDirs run.go:180: Remote "Linkbox root 'rclone-test-miqucaz4cote'", Local "Local file system at /tmp/rclone3459648362", Modify Window "876000h0m0s" 2025/05/16 02:07:00 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-degahoy1suvi" 2025/05/16 02:07:00 DEBUG : Config file has changed externally - reloading 2025/05/16 02:07:07 INFO : tomatoDir: Making directory sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-miqucaz4cote' -> Linkbox root 'rclone-test-degahoy1suvi' 2025/05/16 02:07:15 DEBUG : potato2: Need to transfer - File not found at Destination 2025/05/16 02:07:15 DEBUG : empty space: Sizes identical 2025/05/16 02:07:15 DEBUG : empty space: Unchanged skipping 2025/05/16 02:07:15 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/05/16 02:07:15 DEBUG : Linkbox root 'rclone-test-degahoy1suvi': Waiting for checks to finish 2025/05/16 02:07:15 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/05/16 02:07:15 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/05/16 02:07:15 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/05/16 02:07:15 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/05/16 02:07:16 INFO : empty space: Deleted 2025/05/16 02:07:16 DEBUG : Linkbox root 'rclone-test-degahoy1suvi': Waiting for transfers to finish 2025/05/16 02:07:16 ERROR : Linkbox root 'rclone-test-miqucaz4cote': not deleting directories as there were IO errors sync_test.go:1716: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1901 Error: Received unexpected error: not deleting directories as there were IO errors Test: TestServerSideMoveDeleteEmptySourceDirs 2025/05/16 02:07:16 DEBUG : Linkbox root 'rclone-test-degahoy1suvi': Purge remote --- FAIL: TestServerSideMoveDeleteEmptySourceDirs (21.97s) FAIL 2025/05/16 02:07:22 DEBUG : Linkbox root 'rclone-test-miqucaz4cote': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose -test.run '^(TestCopyRedownload|TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveOverSelf|TestServerSideMoveWithFilter)$'" - Finished ERROR in 2m1.771657117s (try 3/5): exit status 1: Failed [TestServerSideCopy TestServerSideCopyOverSelf TestServerSideMoveOverSelf TestCopyRedownload TestServerSideMove TestServerSideMoveWithFilter TestServerSideMoveDeleteEmptySourceDirs]