"./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose -test.run '^(TestCopyRedownload|TestMoveWithIgnoreExisting|TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveOverSelf|TestServerSideMoveWithFilter|TestSyncWithTrackRenamesStrategyModtime)$'" - Starting (try 2/5)
2025/04/24 03:01:05 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-jiwadod5yani"
2025/04/24 03:01:05 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2025/04/24 03:01:06 DEBUG : Creating backend with remote "/tmp/rclone2306231212"
=== RUN   TestServerSideCopy
    run.go:180: Remote "Linkbox root 'rclone-test-jiwadod5yani'", Local "Local file system at /tmp/rclone2306231212", Modify Window "876000h0m0s"
2025/04/24 03:01:13 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-puyurep7veye"
    sync_test.go:590: Server side copy (if possible) Linkbox root 'rclone-test-jiwadod5yani' -> Linkbox root 'rclone-test-puyurep7veye'
2025/04/24 03:01:14 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination
2025/04/24 03:01:14 DEBUG : Linkbox root 'rclone-test-puyurep7veye': Waiting for checks to finish
2025/04/24 03:01:14 DEBUG : Linkbox root 'rclone-test-puyurep7veye': Waiting for transfers to finish
2025/04/24 03:01:14 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
    sync_test.go:594: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:594
        	Error:      	Received unexpected error:
        	            	failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
        	Test:       	TestServerSideCopy
2025/04/24 03:01:14 DEBUG : Linkbox root 'rclone-test-puyurep7veye': Purge remote
2025/04/24 03:01:15 NOTICE: purge failed: directory not found
--- FAIL: TestServerSideCopy (12.97s)
=== RUN   TestServerSideCopyOverSelf
    run.go:180: Remote "Linkbox root 'rclone-test-jiwadod5yani'", Local "Local file system at /tmp/rclone2306231212", Modify Window "876000h0m0s"
2025/04/24 03:01:24 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-hiqoquw8coxo"
    sync_test.go:626: Server side copy (if possible) Linkbox root 'rclone-test-jiwadod5yani' -> Linkbox root 'rclone-test-hiqoquw8coxo'
2025/04/24 03:01:26 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination
2025/04/24 03:01:26 DEBUG : Linkbox root 'rclone-test-hiqoquw8coxo': Waiting for checks to finish
2025/04/24 03:01:26 DEBUG : Linkbox root 'rclone-test-hiqoquw8coxo': Waiting for transfers to finish
2025/04/24 03:01:26 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
    sync_test.go:630: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:630
        	Error:      	Received unexpected error:
        	            	failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
        	Test:       	TestServerSideCopyOverSelf
2025/04/24 03:01:26 DEBUG : Linkbox root 'rclone-test-hiqoquw8coxo': Purge remote
2025/04/24 03:01:27 NOTICE: purge failed: directory not found
--- FAIL: TestServerSideCopyOverSelf (12.61s)
=== RUN   TestServerSideMoveOverSelf
    run.go:180: Remote "Linkbox root 'rclone-test-jiwadod5yani'", Local "Local file system at /tmp/rclone2306231212", Modify Window "876000h0m0s"
2025/04/24 03:01:36 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-nanekuh2zipa"
    sync_test.go:671: Server side copy (if possible) Linkbox root 'rclone-test-jiwadod5yani' -> Linkbox root 'rclone-test-nanekuh2zipa'
2025/04/24 03:01:38 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination
2025/04/24 03:01:38 DEBUG : Linkbox root 'rclone-test-nanekuh2zipa': Waiting for checks to finish
2025/04/24 03:01:38 DEBUG : Linkbox root 'rclone-test-nanekuh2zipa': Waiting for transfers to finish
2025/04/24 03:01:38 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
    sync_test.go:675: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:675
        	Error:      	Received unexpected error:
        	            	failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
        	Test:       	TestServerSideMoveOverSelf
2025/04/24 03:01:38 DEBUG : Linkbox root 'rclone-test-nanekuh2zipa': Purge remote
2025/04/24 03:01:38 NOTICE: purge failed: directory not found
--- FAIL: TestServerSideMoveOverSelf (11.35s)
=== RUN   TestCopyRedownload
    run.go:180: Remote "Linkbox root 'rclone-test-jiwadod5yani'", Local "Local file system at /tmp/rclone2306231212", Modify Window "876000h0m0s"
2025/04/24 03:01:48 DEBUG : Added delayed dir = "sub dir", newDst=<nil>
2025/04/24 03:01:48 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination
2025/04/24 03:01:48 DEBUG : Local file system at /tmp/rclone2306231212: Waiting for checks to finish
2025/04/24 03:01:48 DEBUG : Local file system at /tmp/rclone2306231212: Waiting for transfers to finish
2025/04/24 03:01:48 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/04/24 03:01:48 ERROR : sub dir: Failed to update directory timestamp or metadata: chtimes /tmp/rclone2306231212/sub dir: no such file or directory
    sync_test.go:732: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:732
        	Error:      	Received unexpected error:
        	            	failed to set directory modtime: chtimes /tmp/rclone2306231212/sub dir: no such file or directory
        	Test:       	TestCopyRedownload
--- FAIL: TestCopyRedownload (10.02s)
=== RUN   TestSyncWithTrackRenamesStrategyModtime
    run.go:180: Remote "Linkbox root 'rclone-test-jiwadod5yani'", Local "Local file system at /tmp/rclone2306231212", Modify Window "876000h0m0s"
    sync_test.go:1610: Can track renames: false
2025/04/24 03:01:53 ERROR : Linkbox root 'rclone-test-jiwadod5yani': Ignoring --track-renames as the destination does not support server-side move or copy
2025/04/24 03:01:53 ERROR : Linkbox root 'rclone-test-jiwadod5yani': Ignoring --track-renames as either the source or destination do not support modtime
2025/04/24 03:01:53 DEBUG : potato: Need to transfer - File not found at Destination
2025/04/24 03:01:53 DEBUG : yam: Need to transfer - File not found at Destination
2025/04/24 03:01:53 DEBUG : Linkbox root 'rclone-test-jiwadod5yani': Waiting for checks to finish
2025/04/24 03:01:53 DEBUG : Linkbox root 'rclone-test-jiwadod5yani': Waiting for transfers to finish
2025/04/24 03:01:56 INFO  : potato: Copied (new)
2025/04/24 03:01:56 INFO  : yam: Copied (new)
2025/04/24 03:01:56 DEBUG : Waiting for deletions to finish
    run.go:180: Remote "Linkbox root 'rclone-test-jiwadod5yani'", Local "Local file system at /tmp/rclone2306231212", Modify Window "876000h0m0s"
2025/04/24 03:01:56 ERROR : Linkbox root 'rclone-test-jiwadod5yani': Ignoring --track-renames as the destination does not support server-side move or copy
2025/04/24 03:01:56 ERROR : Linkbox root 'rclone-test-jiwadod5yani': Ignoring --track-renames as either the source or destination do not support modtime
2025/04/24 03:01:57 DEBUG : potato: Sizes identical
2025/04/24 03:01:57 DEBUG : yaml: Need to transfer - File not found at Destination
2025/04/24 03:01:57 DEBUG : potato: Unchanged skipping
2025/04/24 03:01:57 DEBUG : Linkbox root 'rclone-test-jiwadod5yani': Waiting for checks to finish
2025/04/24 03:01:57 DEBUG : Linkbox root 'rclone-test-jiwadod5yani': Waiting for transfers to finish
2025/04/24 03:01:59 INFO  : yaml: Copied (new)
2025/04/24 03:01:59 DEBUG : Waiting for deletions to finish
2025/04/24 03:02:01 INFO  : yam: Deleted
    run.go:180: Remote "Linkbox root 'rclone-test-jiwadod5yani'", Local "Local file system at /tmp/rclone2306231212", Modify Window "876000h0m0s"
--- PASS: TestSyncWithTrackRenamesStrategyModtime (13.93s)
=== RUN   TestMoveWithIgnoreExisting
    run.go:180: Remote "Linkbox root 'rclone-test-jiwadod5yani'", Local "Local file system at /tmp/rclone2306231212", Modify Window "876000h0m0s"
2025/04/24 03:02:07 DEBUG : existing: Need to transfer - File not found at Destination
2025/04/24 03:02:07 DEBUG : existing-b: Need to transfer - File not found at Destination
2025/04/24 03:02:07 DEBUG : Linkbox root 'rclone-test-jiwadod5yani': Waiting for checks to finish
2025/04/24 03:02:07 DEBUG : Linkbox root 'rclone-test-jiwadod5yani': Waiting for transfers to finish
2025/04/24 03:02:10 INFO  : existing: Copied (new)
2025/04/24 03:02:10 INFO  : existing: Deleted
2025/04/24 03:02:10 INFO  : existing-b: Copied (new)
2025/04/24 03:02:10 INFO  : existing-b: Deleted
2025/04/24 03:02:10 DEBUG : Linkbox root 'rclone-test-jiwadod5yani': Waiting for checks to finish
2025/04/24 03:02:10 DEBUG : existing: Destination exists, skipping
2025/04/24 03:02:10 DEBUG : existing: Not removing source file as destination file exists and --ignore-existing is set
2025/04/24 03:02:10 DEBUG : Linkbox root 'rclone-test-jiwadod5yani': Waiting for transfers to finish
2025/04/24 03:02:10 INFO  : There was nothing to transfer
    run.go:180: Remote "Linkbox root 'rclone-test-jiwadod5yani'", Local "Local file system at /tmp/rclone2306231212", Modify Window "876000h0m0s"
--- PASS: TestMoveWithIgnoreExisting (8.83s)
=== RUN   TestServerSideMove
    run.go:180: Remote "Linkbox root 'rclone-test-jiwadod5yani'", Local "Local file system at /tmp/rclone2306231212", Modify Window "876000h0m0s"
2025/04/24 03:02:15 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-yoxegeh6luqo"
2025/04/24 03:02:15 DEBUG : Config file has changed externally - reloading
    sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-jiwadod5yani' -> Linkbox root 'rclone-test-yoxegeh6luqo'
2025/04/24 03:02:33 DEBUG : potato2: Need to transfer - File not found at Destination
2025/04/24 03:02:33 DEBUG : potato3: Sizes differ (src 68 vs dst 60)
2025/04/24 03:02:33 DEBUG : empty space: Sizes identical
2025/04/24 03:02:33 DEBUG : Linkbox root 'rclone-test-yoxegeh6luqo': Waiting for checks to finish
2025/04/24 03:02:33 DEBUG : empty space: Unchanged skipping
2025/04/24 03:02:33 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/04/24 03:02:33 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/04/24 03:02:33 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/04/24 03:02:33 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/04/24 03:02:35 INFO  : empty space: Deleted
2025/04/24 03:02:35 DEBUG : Linkbox root 'rclone-test-yoxegeh6luqo': Waiting for transfers to finish
    sync_test.go:1716: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716
        	            				/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1881
        	Error:      	Received unexpected error:
        	            	failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
        	Test:       	TestServerSideMove
2025/04/24 03:02:35 DEBUG : Linkbox root 'rclone-test-yoxegeh6luqo': Purge remote
--- FAIL: TestServerSideMove (24.60s)
=== RUN   TestServerSideMoveWithFilter
    run.go:180: Remote "Linkbox root 'rclone-test-jiwadod5yani'", Local "Local file system at /tmp/rclone2306231212", Modify Window "876000h0m0s"
2025/04/24 03:02:40 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-mukirok4lofo"
    sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-jiwadod5yani' -> Linkbox root 'rclone-test-mukirok4lofo'
2025/04/24 03:02:56 DEBUG : empty space: Excluded (Size Filter)
2025/04/24 03:02:56 DEBUG : empty space: Excluded
2025/04/24 03:02:56 DEBUG : empty space: Excluded (Size Filter)
2025/04/24 03:02:56 DEBUG : empty space: Excluded
2025/04/24 03:02:56 DEBUG : potato2: Need to transfer - File not found at Destination
2025/04/24 03:02:56 DEBUG : potato3: Sizes differ (src 68 vs dst 60)
2025/04/24 03:02:56 DEBUG : Linkbox root 'rclone-test-mukirok4lofo': Waiting for checks to finish
2025/04/24 03:02:56 DEBUG : Linkbox root 'rclone-test-mukirok4lofo': Waiting for transfers to finish
2025/04/24 03:02:56 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/04/24 03:02:56 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/04/24 03:02:57 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/04/24 03:02:57 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
    sync_test.go:1716: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716
        	            				/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1894
        	Error:      	Received unexpected error:
        	            	failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
        	Test:       	TestServerSideMoveWithFilter
2025/04/24 03:02:57 DEBUG : Linkbox root 'rclone-test-mukirok4lofo': Purge remote
--- FAIL: TestServerSideMoveWithFilter (23.72s)
=== RUN   TestServerSideMoveDeleteEmptySourceDirs
    run.go:180: Remote "Linkbox root 'rclone-test-jiwadod5yani'", Local "Local file system at /tmp/rclone2306231212", Modify Window "876000h0m0s"
2025/04/24 03:03:04 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-tiyopid2xebo"
2025/04/24 03:03:04 DEBUG : Config file has changed externally - reloading
2025/04/24 03:03:12 INFO  : tomatoDir: Making directory
    sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-jiwadod5yani' -> Linkbox root 'rclone-test-tiyopid2xebo'
2025/04/24 03:03:22 DEBUG : potato2: Need to transfer - File not found at Destination
2025/04/24 03:03:22 DEBUG : empty space: Sizes identical
2025/04/24 03:03:22 DEBUG : empty space: Unchanged skipping
2025/04/24 03:03:22 DEBUG : potato3: Sizes differ (src 68 vs dst 60)
2025/04/24 03:03:22 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/04/24 03:03:22 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/04/24 03:03:23 DEBUG : Linkbox root 'rclone-test-tiyopid2xebo': Waiting for checks to finish
2025/04/24 03:03:23 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/04/24 03:03:23 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/04/24 03:03:24 INFO  : empty space: Deleted
2025/04/24 03:03:24 DEBUG : Linkbox root 'rclone-test-tiyopid2xebo': Waiting for transfers to finish
2025/04/24 03:03:24 ERROR : Linkbox root 'rclone-test-jiwadod5yani': not deleting directories as there were IO errors
    sync_test.go:1716: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716
        	            				/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1901
        	Error:      	Received unexpected error:
        	            	not deleting directories as there were IO errors
        	Test:       	TestServerSideMoveDeleteEmptySourceDirs
2025/04/24 03:03:24 DEBUG : Linkbox root 'rclone-test-tiyopid2xebo': Purge remote
--- FAIL: TestServerSideMoveDeleteEmptySourceDirs (27.95s)
FAIL
2025/04/24 03:03:32 DEBUG : Linkbox root 'rclone-test-jiwadod5yani': Purge remote
"./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose -test.run '^(TestCopyRedownload|TestMoveWithIgnoreExisting|TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveOverSelf|TestServerSideMoveWithFilter|TestSyncWithTrackRenamesStrategyModtime)$'" - Finished ERROR in 2m28.37244765s (try 2/5): exit status 1: Failed [TestServerSideCopy TestServerSideCopyOverSelf TestServerSideMoveOverSelf TestCopyRedownload TestServerSideMove TestServerSideMoveWithFilter TestServerSideMoveDeleteEmptySourceDirs]