"./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose -test.run '^(TestCopyNoEmptyDirectories|TestCopyRedownload|TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveOverSelf|TestServerSideMoveWithFilter)$'" - Starting (try 2/5) 2025/03/06 02:03:52 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-gamomiw0yeto" 2025/03/06 02:03:52 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/03/06 02:03:53 DEBUG : Creating backend with remote "/tmp/rclone3136490447" === RUN TestCopyNoEmptyDirectories run.go:180: Remote "Linkbox root 'rclone-test-gamomiw0yeto'", Local "Local file system at /tmp/rclone3136490447", Modify Window "876000h0m0s" 2025/03/06 02:03:53 INFO : sub dir2: Making directory 2025/03/06 02:03:53 DEBUG : sub dir2/sub sub dir2: Making directory with metadata 2025/03/06 02:03:53 INFO : sub dir2/sub sub dir2: Made directory with metadata (mtime=2011-12-25T12:59:59.123456789Z) 2025/03/06 02:03:55 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/03/06 02:03:55 DEBUG : Linkbox root 'rclone-test-gamomiw0yeto': Waiting for checks to finish 2025/03/06 02:03:55 DEBUG : Linkbox root 'rclone-test-gamomiw0yeto': Waiting for transfers to finish 2025/03/06 02:03:59 INFO : sub dir/hello world: Copied (new) --- PASS: TestCopyNoEmptyDirectories (11.33s) === RUN TestServerSideCopy run.go:180: Remote "Linkbox root 'rclone-test-gamomiw0yeto'", Local "Local file system at /tmp/rclone3136490447", Modify Window "876000h0m0s" 2025/03/06 02:04:09 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-xahakoj2xeko" sync_test.go:590: Server side copy (if possible) Linkbox root 'rclone-test-gamomiw0yeto' -> Linkbox root 'rclone-test-xahakoj2xeko' 2025/03/06 02:04:10 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/03/06 02:04:10 DEBUG : Linkbox root 'rclone-test-xahakoj2xeko': Waiting for checks to finish 2025/03/06 02:04:10 DEBUG : Linkbox root 'rclone-test-xahakoj2xeko': Waiting for transfers to finish 2025/03/06 02:04:10 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:594: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:594 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideCopy 2025/03/06 02:04:10 DEBUG : Linkbox root 'rclone-test-xahakoj2xeko': Purge remote 2025/03/06 02:04:11 NOTICE: purge failed: directory not found --- FAIL: TestServerSideCopy (10.32s) === RUN TestServerSideCopyOverSelf run.go:180: Remote "Linkbox root 'rclone-test-gamomiw0yeto'", Local "Local file system at /tmp/rclone3136490447", Modify Window "876000h0m0s" 2025/03/06 02:04:19 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-biboheb5domo" sync_test.go:626: Server side copy (if possible) Linkbox root 'rclone-test-gamomiw0yeto' -> Linkbox root 'rclone-test-biboheb5domo' 2025/03/06 02:04:20 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/03/06 02:04:20 DEBUG : Linkbox root 'rclone-test-biboheb5domo': Waiting for checks to finish 2025/03/06 02:04:20 DEBUG : Linkbox root 'rclone-test-biboheb5domo': Waiting for transfers to finish 2025/03/06 02:04:20 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:630: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:630 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideCopyOverSelf 2025/03/06 02:04:20 DEBUG : Linkbox root 'rclone-test-biboheb5domo': Purge remote 2025/03/06 02:04:21 NOTICE: purge failed: directory not found --- FAIL: TestServerSideCopyOverSelf (10.06s) === RUN TestServerSideMoveOverSelf run.go:180: Remote "Linkbox root 'rclone-test-gamomiw0yeto'", Local "Local file system at /tmp/rclone3136490447", Modify Window "876000h0m0s" 2025/03/06 02:04:29 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-yugakok1caqe" sync_test.go:671: Server side copy (if possible) Linkbox root 'rclone-test-gamomiw0yeto' -> Linkbox root 'rclone-test-yugakok1caqe' 2025/03/06 02:04:30 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/03/06 02:04:30 DEBUG : Linkbox root 'rclone-test-yugakok1caqe': Waiting for checks to finish 2025/03/06 02:04:30 DEBUG : Linkbox root 'rclone-test-yugakok1caqe': Waiting for transfers to finish 2025/03/06 02:04:30 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:675: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:675 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideMoveOverSelf 2025/03/06 02:04:30 DEBUG : Linkbox root 'rclone-test-yugakok1caqe': Purge remote 2025/03/06 02:04:31 NOTICE: purge failed: directory not found --- FAIL: TestServerSideMoveOverSelf (10.06s) === RUN TestCopyRedownload run.go:180: Remote "Linkbox root 'rclone-test-gamomiw0yeto'", Local "Local file system at /tmp/rclone3136490447", Modify Window "876000h0m0s" 2025/03/06 02:04:39 DEBUG : Added delayed dir = "sub dir", newDst= 2025/03/06 02:04:40 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/03/06 02:04:40 DEBUG : Local file system at /tmp/rclone3136490447: Waiting for checks to finish 2025/03/06 02:04:40 DEBUG : Local file system at /tmp/rclone3136490447: Waiting for transfers to finish 2025/03/06 02:04:40 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/03/06 02:04:40 ERROR : sub dir: Failed to update directory timestamp or metadata: chtimes /tmp/rclone3136490447/sub dir: no such file or directory sync_test.go:732: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:732 Error: Received unexpected error: failed to set directory modtime: chtimes /tmp/rclone3136490447/sub dir: no such file or directory Test: TestCopyRedownload --- FAIL: TestCopyRedownload (9.20s) === RUN TestServerSideMove run.go:180: Remote "Linkbox root 'rclone-test-gamomiw0yeto'", Local "Local file system at /tmp/rclone3136490447", Modify Window "876000h0m0s" 2025/03/06 02:04:44 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-golubix4kiha" sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-gamomiw0yeto' -> Linkbox root 'rclone-test-golubix4kiha' 2025/03/06 02:05:00 DEBUG : potato2: Need to transfer - File not found at Destination 2025/03/06 02:05:00 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/03/06 02:05:00 DEBUG : empty space: Sizes identical 2025/03/06 02:05:00 DEBUG : empty space: Unchanged skipping 2025/03/06 02:05:00 DEBUG : Linkbox root 'rclone-test-golubix4kiha': Waiting for checks to finish 2025/03/06 02:05:00 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/03/06 02:05:00 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/03/06 02:05:00 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/03/06 02:05:00 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/03/06 02:05:01 INFO : empty space: Deleted 2025/03/06 02:05:01 DEBUG : Linkbox root 'rclone-test-golubix4kiha': Waiting for transfers to finish sync_test.go:1716: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1881 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideMove 2025/03/06 02:05:01 DEBUG : Linkbox root 'rclone-test-golubix4kiha': Purge remote --- FAIL: TestServerSideMove (22.51s) === RUN TestServerSideMoveWithFilter run.go:180: Remote "Linkbox root 'rclone-test-gamomiw0yeto'", Local "Local file system at /tmp/rclone3136490447", Modify Window "876000h0m0s" 2025/03/06 02:05:06 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-hinalal5miju" sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-gamomiw0yeto' -> Linkbox root 'rclone-test-hinalal5miju' 2025/03/06 02:05:22 DEBUG : empty space: Excluded (Size Filter) 2025/03/06 02:05:22 DEBUG : empty space: Excluded 2025/03/06 02:05:22 DEBUG : empty space: Excluded (Size Filter) 2025/03/06 02:05:22 DEBUG : empty space: Excluded 2025/03/06 02:05:22 DEBUG : potato2: Need to transfer - File not found at Destination 2025/03/06 02:05:22 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/03/06 02:05:22 DEBUG : Linkbox root 'rclone-test-hinalal5miju': Waiting for checks to finish 2025/03/06 02:05:22 DEBUG : Linkbox root 'rclone-test-hinalal5miju': Waiting for transfers to finish 2025/03/06 02:05:22 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/03/06 02:05:22 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/03/06 02:05:22 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/03/06 02:05:22 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" sync_test.go:1716: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1894 Error: Received unexpected error: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" Test: TestServerSideMoveWithFilter 2025/03/06 02:05:22 DEBUG : Linkbox root 'rclone-test-hinalal5miju': Purge remote --- FAIL: TestServerSideMoveWithFilter (22.33s) === RUN TestServerSideMoveDeleteEmptySourceDirs run.go:180: Remote "Linkbox root 'rclone-test-gamomiw0yeto'", Local "Local file system at /tmp/rclone3136490447", Modify Window "876000h0m0s" 2025/03/06 02:05:29 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-qusarov5piqu" 2025/03/06 02:05:37 INFO : tomatoDir: Making directory sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-gamomiw0yeto' -> Linkbox root 'rclone-test-qusarov5piqu' 2025/03/06 02:05:46 DEBUG : potato2: Need to transfer - File not found at Destination 2025/03/06 02:05:46 DEBUG : empty space: Sizes identical 2025/03/06 02:05:46 DEBUG : empty space: Unchanged skipping 2025/03/06 02:05:46 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/03/06 02:05:46 DEBUG : Linkbox root 'rclone-test-qusarov5piqu': Waiting for checks to finish 2025/03/06 02:05:46 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/03/06 02:05:46 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/03/06 02:05:47 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/03/06 02:05:47 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect" 2025/03/06 02:05:48 INFO : empty space: Deleted 2025/03/06 02:05:48 DEBUG : Linkbox root 'rclone-test-qusarov5piqu': Waiting for transfers to finish 2025/03/06 02:05:48 ERROR : Linkbox root 'rclone-test-gamomiw0yeto': not deleting directories as there were IO errors sync_test.go:1716: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1901 Error: Received unexpected error: not deleting directories as there were IO errors Test: TestServerSideMoveDeleteEmptySourceDirs 2025/03/06 02:05:48 DEBUG : Linkbox root 'rclone-test-qusarov5piqu': Purge remote --- FAIL: TestServerSideMoveDeleteEmptySourceDirs (25.72s) FAIL 2025/03/06 02:05:54 DEBUG : Linkbox root 'rclone-test-gamomiw0yeto': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose -test.run '^(TestCopyNoEmptyDirectories|TestCopyRedownload|TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveOverSelf|TestServerSideMoveWithFilter)$'" - Finished ERROR in 2m3.653011967s (try 2/5): exit status 1: Failed [TestServerSideCopy TestServerSideCopyOverSelf TestServerSideMoveOverSelf TestCopyRedownload TestServerSideMove TestServerSideMoveWithFilter TestServerSideMoveDeleteEmptySourceDirs]