"./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose -test.run '^(TestCopyRedownload|TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveOverSelf|TestServerSideMoveWithFilter|TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors)$'" - Starting (try 2/5)
2025/05/08 01:26:27 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-bawiwit8bewa"
2025/05/08 01:26:27 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2025/05/08 01:26:28 DEBUG : Creating backend with remote "/tmp/rclone4068662626"
=== RUN   TestServerSideCopy
    run.go:180: Remote "Linkbox root 'rclone-test-bawiwit8bewa'", Local "Local file system at /tmp/rclone4068662626", Modify Window "876000h0m0s"
2025/05/08 01:26:35 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-benafon3wixu"
    sync_test.go:590: Server side copy (if possible) Linkbox root 'rclone-test-bawiwit8bewa' -> Linkbox root 'rclone-test-benafon3wixu'
2025/05/08 01:26:37 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination
2025/05/08 01:26:37 DEBUG : Linkbox root 'rclone-test-benafon3wixu': Waiting for checks to finish
2025/05/08 01:26:37 DEBUG : Linkbox root 'rclone-test-benafon3wixu': Waiting for transfers to finish
2025/05/08 01:26:37 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
    sync_test.go:594: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:594
        	Error:      	Received unexpected error:
        	            	failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
        	Test:       	TestServerSideCopy
2025/05/08 01:26:37 DEBUG : Linkbox root 'rclone-test-benafon3wixu': Purge remote
2025/05/08 01:26:37 NOTICE: purge failed: directory not found
--- FAIL: TestServerSideCopy (13.57s)
=== RUN   TestServerSideCopyOverSelf
    run.go:180: Remote "Linkbox root 'rclone-test-bawiwit8bewa'", Local "Local file system at /tmp/rclone4068662626", Modify Window "876000h0m0s"
2025/05/08 01:26:47 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-koxoyah9guho"
    sync_test.go:626: Server side copy (if possible) Linkbox root 'rclone-test-bawiwit8bewa' -> Linkbox root 'rclone-test-koxoyah9guho'
2025/05/08 01:26:48 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination
2025/05/08 01:26:48 DEBUG : Linkbox root 'rclone-test-koxoyah9guho': Waiting for checks to finish
2025/05/08 01:26:48 DEBUG : Linkbox root 'rclone-test-koxoyah9guho': Waiting for transfers to finish
2025/05/08 01:26:48 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
    sync_test.go:630: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:630
        	Error:      	Received unexpected error:
        	            	failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
        	Test:       	TestServerSideCopyOverSelf
2025/05/08 01:26:48 DEBUG : Linkbox root 'rclone-test-koxoyah9guho': Purge remote
2025/05/08 01:26:49 NOTICE: purge failed: directory not found
--- FAIL: TestServerSideCopyOverSelf (11.63s)
=== RUN   TestServerSideMoveOverSelf
    run.go:180: Remote "Linkbox root 'rclone-test-bawiwit8bewa'", Local "Local file system at /tmp/rclone4068662626", Modify Window "876000h0m0s"
2025/05/08 01:26:59 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-vunalej7hoge"
    sync_test.go:671: Server side copy (if possible) Linkbox root 'rclone-test-bawiwit8bewa' -> Linkbox root 'rclone-test-vunalej7hoge'
2025/05/08 01:27:00 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination
2025/05/08 01:27:00 DEBUG : Linkbox root 'rclone-test-vunalej7hoge': Waiting for checks to finish
2025/05/08 01:27:00 DEBUG : Linkbox root 'rclone-test-vunalej7hoge': Waiting for transfers to finish
2025/05/08 01:27:00 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
    sync_test.go:675: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:675
        	Error:      	Received unexpected error:
        	            	failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
        	Test:       	TestServerSideMoveOverSelf
2025/05/08 01:27:00 DEBUG : Linkbox root 'rclone-test-vunalej7hoge': Purge remote
2025/05/08 01:27:01 NOTICE: purge failed: directory not found
--- FAIL: TestServerSideMoveOverSelf (11.66s)
=== RUN   TestCopyRedownload
    run.go:180: Remote "Linkbox root 'rclone-test-bawiwit8bewa'", Local "Local file system at /tmp/rclone4068662626", Modify Window "876000h0m0s"
2025/05/08 01:27:10 DEBUG : Added delayed dir = "sub dir", newDst=<nil>
2025/05/08 01:27:11 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination
2025/05/08 01:27:11 DEBUG : Local file system at /tmp/rclone4068662626: Waiting for checks to finish
2025/05/08 01:27:11 DEBUG : Local file system at /tmp/rclone4068662626: Waiting for transfers to finish
2025/05/08 01:27:11 ERROR : sub dir/hello world: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/05/08 01:27:11 ERROR : sub dir: Failed to update directory timestamp or metadata: chtimes /tmp/rclone4068662626/sub dir: no such file or directory
    sync_test.go:732: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:732
        	Error:      	Received unexpected error:
        	            	failed to set directory modtime: chtimes /tmp/rclone4068662626/sub dir: no such file or directory
        	Test:       	TestCopyRedownload
--- FAIL: TestCopyRedownload (10.59s)
=== RUN   TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors
    run.go:180: Remote "Linkbox root 'rclone-test-bawiwit8bewa'", Local "Local file system at /tmp/rclone4068662626", Modify Window "876000h0m0s"
2025/05/08 01:27:25 INFO  : d: Making directory
2025/05/08 01:27:28 DEBUG : a/potato2: Need to transfer - File not found at Destination
2025/05/08 01:27:29 DEBUG : c/non empty space: Sizes identical
2025/05/08 01:27:29 DEBUG : c/non empty space: Unchanged skipping
2025/05/08 01:27:29 DEBUG : Linkbox root 'rclone-test-bawiwit8bewa': Waiting for checks to finish
2025/05/08 01:27:29 DEBUG : Linkbox root 'rclone-test-bawiwit8bewa': Waiting for transfers to finish
2025/05/08 01:27:33 INFO  : a/potato2: Copied (new)
2025/05/08 01:27:33 ERROR : Linkbox root 'rclone-test-bawiwit8bewa': not deleting files as there were IO errors
2025/05/08 01:27:33 ERROR : Linkbox root 'rclone-test-bawiwit8bewa': not deleting directories as there were IO errors
    run.go:180: Remote "Linkbox root 'rclone-test-bawiwit8bewa'", Local "Local file system at /tmp/rclone4068662626", Modify Window "876000h0m0s"
--- PASS: TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors (33.04s)
=== RUN   TestServerSideMove
    run.go:180: Remote "Linkbox root 'rclone-test-bawiwit8bewa'", Local "Local file system at /tmp/rclone4068662626", Modify Window "876000h0m0s"
2025/05/08 01:27:49 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-viloziv3fawe"
    sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-bawiwit8bewa' -> Linkbox root 'rclone-test-viloziv3fawe'
2025/05/08 01:28:06 DEBUG : potato2: Need to transfer - File not found at Destination
2025/05/08 01:28:06 DEBUG : empty space: Sizes identical
2025/05/08 01:28:06 DEBUG : empty space: Unchanged skipping
2025/05/08 01:28:06 DEBUG : potato3: Sizes differ (src 68 vs dst 60)
2025/05/08 01:28:06 DEBUG : Linkbox root 'rclone-test-viloziv3fawe': Waiting for checks to finish
2025/05/08 01:28:06 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/05/08 01:28:06 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/05/08 01:28:06 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/05/08 01:28:06 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/05/08 01:28:07 INFO  : empty space: Deleted
2025/05/08 01:28:07 DEBUG : Linkbox root 'rclone-test-viloziv3fawe': Waiting for transfers to finish
    sync_test.go:1716: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716
        	            				/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1881
        	Error:      	Received unexpected error:
        	            	failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
        	Test:       	TestServerSideMove
2025/05/08 01:28:07 DEBUG : Linkbox root 'rclone-test-viloziv3fawe': Purge remote
--- FAIL: TestServerSideMove (23.90s)
=== RUN   TestServerSideMoveWithFilter
    run.go:180: Remote "Linkbox root 'rclone-test-bawiwit8bewa'", Local "Local file system at /tmp/rclone4068662626", Modify Window "876000h0m0s"
2025/05/08 01:28:12 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-fobisuk2yomi"
    sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-bawiwit8bewa' -> Linkbox root 'rclone-test-fobisuk2yomi'
2025/05/08 01:28:30 DEBUG : empty space: Excluded (Size Filter)
2025/05/08 01:28:30 DEBUG : empty space: Excluded
2025/05/08 01:28:30 DEBUG : empty space: Excluded (Size Filter)
2025/05/08 01:28:30 DEBUG : empty space: Excluded
2025/05/08 01:28:30 DEBUG : potato2: Need to transfer - File not found at Destination
2025/05/08 01:28:30 DEBUG : potato3: Sizes differ (src 68 vs dst 60)
2025/05/08 01:28:30 DEBUG : Linkbox root 'rclone-test-fobisuk2yomi': Waiting for checks to finish
2025/05/08 01:28:30 DEBUG : Linkbox root 'rclone-test-fobisuk2yomi': Waiting for transfers to finish
2025/05/08 01:28:30 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/05/08 01:28:30 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/05/08 01:28:30 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/05/08 01:28:30 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
    sync_test.go:1716: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716
        	            				/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1894
        	Error:      	Received unexpected error:
        	            	failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
        	Test:       	TestServerSideMoveWithFilter
2025/05/08 01:28:30 DEBUG : Linkbox root 'rclone-test-fobisuk2yomi': Purge remote
--- FAIL: TestServerSideMoveWithFilter (24.31s)
=== RUN   TestServerSideMoveDeleteEmptySourceDirs
    run.go:180: Remote "Linkbox root 'rclone-test-bawiwit8bewa'", Local "Local file system at /tmp/rclone4068662626", Modify Window "876000h0m0s"
2025/05/08 01:28:37 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-xiqevek3hano"
2025/05/08 01:28:46 INFO  : tomatoDir: Making directory
    sync_test.go:1705: Server side move (if possible) Linkbox root 'rclone-test-bawiwit8bewa' -> Linkbox root 'rclone-test-xiqevek3hano'
2025/05/08 01:28:56 DEBUG : potato2: Need to transfer - File not found at Destination
2025/05/08 01:28:56 DEBUG : potato3: Sizes differ (src 68 vs dst 60)
2025/05/08 01:28:56 DEBUG : empty space: Sizes identical
2025/05/08 01:28:56 DEBUG : empty space: Unchanged skipping
2025/05/08 01:28:56 ERROR : potato2: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/05/08 01:28:56 ERROR : potato2: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/05/08 01:28:56 DEBUG : Linkbox root 'rclone-test-xiqevek3hano': Waiting for checks to finish
2025/05/08 01:28:57 ERROR : potato3: Failed to copy: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/05/08 01:28:57 ERROR : potato3: Not deleting source as copy failed: failed to open source object: Open failed: HTTP error 403 (403 Forbidden) returned body: "ip incorrect"
2025/05/08 01:28:58 INFO  : empty space: Deleted
2025/05/08 01:28:58 DEBUG : Linkbox root 'rclone-test-xiqevek3hano': Waiting for transfers to finish
2025/05/08 01:28:58 ERROR : Linkbox root 'rclone-test-bawiwit8bewa': not deleting directories as there were IO errors
    sync_test.go:1716: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1716
        	            				/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1901
        	Error:      	Received unexpected error:
        	            	not deleting directories as there were IO errors
        	Test:       	TestServerSideMoveDeleteEmptySourceDirs
2025/05/08 01:28:58 DEBUG : Linkbox root 'rclone-test-xiqevek3hano': Purge remote
--- FAIL: TestServerSideMoveDeleteEmptySourceDirs (28.63s)
FAIL
2025/05/08 01:29:05 DEBUG : Linkbox root 'rclone-test-bawiwit8bewa': Purge remote
"./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose -test.run '^(TestCopyRedownload|TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveOverSelf|TestServerSideMoveWithFilter|TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors)$'" - Finished ERROR in 2m39.742209598s (try 2/5): exit status 1: Failed [TestServerSideCopy TestServerSideCopyOverSelf TestServerSideMoveOverSelf TestCopyRedownload TestServerSideMove TestServerSideMoveWithFilter TestServerSideMoveDeleteEmptySourceDirs]