"./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose" - Starting (try 1/5) 2025/04/28 02:24:58 DEBUG : Creating backend with remote "TestLinkbox:rclone-test-qoxasud7funi" 2025/04/28 02:24:58 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/04/28 02:24:58 DEBUG : Creating backend with remote "/tmp/rclone2585669698" === RUN TestPipe --- PASS: TestPipe (0.00s) === RUN TestPipeConcurrent --- PASS: TestPipeConcurrent (0.05s) === RUN TestPipeOrderBy === RUN TestPipeOrderBy/#00 === RUN TestPipeOrderBy/size === RUN TestPipeOrderBy/name === RUN TestPipeOrderBy/modtime === RUN TestPipeOrderBy/size,ascending === RUN TestPipeOrderBy/name,asc === RUN TestPipeOrderBy/modtime,ascending === RUN TestPipeOrderBy/size,descending === RUN TestPipeOrderBy/name,desc === RUN TestPipeOrderBy/modtime,descending === RUN TestPipeOrderBy/size,mixed,50 === RUN TestPipeOrderBy/size,mixed,51 --- PASS: TestPipeOrderBy (0.00s) --- PASS: TestPipeOrderBy/#00 (0.00s) --- PASS: TestPipeOrderBy/size (0.00s) --- PASS: TestPipeOrderBy/name (0.00s) --- PASS: TestPipeOrderBy/modtime (0.00s) --- PASS: TestPipeOrderBy/size,ascending (0.00s) --- PASS: TestPipeOrderBy/name,asc (0.00s) --- PASS: TestPipeOrderBy/modtime,ascending (0.00s) --- PASS: TestPipeOrderBy/size,descending (0.00s) --- PASS: TestPipeOrderBy/name,desc (0.00s) --- PASS: TestPipeOrderBy/modtime,descending (0.00s) --- PASS: TestPipeOrderBy/size,mixed,50 (0.00s) --- PASS: TestPipeOrderBy/size,mixed,51 (0.00s) === RUN TestNewLess === RUN TestNewLess/blankOK === RUN TestNewLess/tooManyParts === RUN TestNewLess/tooManyParts2 === RUN TestNewLess/badMixed === RUN TestNewLess/unknownComparison === RUN TestNewLess/unknownSortDirection === RUN TestNewLess/size === RUN TestNewLess/name === RUN TestNewLess/modtime === RUN TestNewLess/size,ascending === RUN TestNewLess/name,asc === RUN TestNewLess/modtime,ascending === RUN TestNewLess/size,descending === RUN TestNewLess/name,desc === RUN TestNewLess/modtime,descending === RUN TestNewLess/modtime,mixed === RUN TestNewLess/modtime,mixed,30 --- PASS: TestNewLess (0.00s) --- PASS: TestNewLess/blankOK (0.00s) --- PASS: TestNewLess/tooManyParts (0.00s) --- PASS: TestNewLess/tooManyParts2 (0.00s) --- PASS: TestNewLess/badMixed (0.00s) --- PASS: TestNewLess/unknownComparison (0.00s) --- PASS: TestNewLess/unknownSortDirection (0.00s) --- PASS: TestNewLess/size (0.00s) --- PASS: TestNewLess/name (0.00s) --- PASS: TestNewLess/modtime (0.00s) --- PASS: TestNewLess/size,ascending (0.00s) --- PASS: TestNewLess/name,asc (0.00s) --- PASS: TestNewLess/modtime,ascending (0.00s) --- PASS: TestNewLess/size,descending (0.00s) --- PASS: TestNewLess/name,desc (0.00s) --- PASS: TestNewLess/modtime,descending (0.00s) --- PASS: TestNewLess/modtime,mixed (0.00s) --- PASS: TestNewLess/modtime,mixed,30 (0.00s) === RUN TestRcCopy rc_test.go:16: Skipping test on non local remote --- SKIP: TestRcCopy (0.00s) === RUN TestRcMove rc_test.go:16: Skipping test on non local remote --- SKIP: TestRcMove (0.00s) === RUN TestRcSync rc_test.go:16: Skipping test on non local remote --- SKIP: TestRcSync (0.00s) === RUN TestCopyWithDryRun run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:25:00 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/28 02:25:00 NOTICE: sub dir/hello world: Skipped copy as --dry-run is set (size 11) 2025/04/28 02:25:00 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:25:00 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" --- PASS: TestCopyWithDryRun (2.98s) === RUN TestCopy run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:25:01 INFO : sub dir: Set directory modification time (using DirSetModTime) 2025/04/28 02:25:01 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/28 02:25:01 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:25:01 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:25:06 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:25:06 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:25:06 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:25:07 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:25:08 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:25:09 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:25:12 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:25:19 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:25:32 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:25:57 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:26:48 ERROR : sub dir/hello world: Failed to copy: object not found sync_test.go:78: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:78 Error: Received unexpected error: object not found Test: TestCopy --- FAIL: TestCopy (107.51s) === RUN TestCopyMetadata run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" sync_test.go:97: Skipping as metadata not supported --- SKIP: TestCopyMetadata (0.40s) === RUN TestCopyMetadataNoEmptyDirs run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" sync_test.go:97: Skipping as metadata not supported --- SKIP: TestCopyMetadataNoEmptyDirs (0.40s) === RUN TestCopyMissingDirectory run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:26:50 DEBUG : Creating backend with remote "/non-existing" 2025/04/28 02:26:50 ERROR : Local file system at /non-existing: error reading source root directory: directory not found 2025/04/28 02:26:50 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:26:50 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" --- PASS: TestCopyMissingDirectory (1.00s) === RUN TestCopyNoTraverse run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:26:51 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/28 02:26:51 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:26:51 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:26:52 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:26:52 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:26:52 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:26:52 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:26:53 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:26:55 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:26:58 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:27:04 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:27:17 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:27:43 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:28:34 ERROR : sub dir/hello world: Failed to copy: object not found sync_test.go:211: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:211 Error: Received unexpected error: object not found Test: TestCopyNoTraverse --- FAIL: TestCopyNoTraverse (103.83s) === RUN TestCopyCheckFirst run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:28:34 INFO : Linkbox root 'rclone-test-qoxasud7funi': Running all checks before starting transfers 2025/04/28 02:28:35 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/28 02:28:35 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:28:35 INFO : Linkbox root 'rclone-test-qoxasud7funi': Checks finished, now starting transfers 2025/04/28 02:28:35 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:28:35 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:28:36 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:28:36 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:28:36 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:28:37 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:28:39 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:28:42 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:28:48 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:29:01 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:29:27 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:30:18 ERROR : sub dir/hello world: Failed to copy: object not found sync_test.go:230: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:230 Error: Received unexpected error: object not found Test: TestCopyCheckFirst --- FAIL: TestCopyCheckFirst (103.82s) === RUN TestSyncNoTraverse run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:30:18 ERROR : Ignoring --no-traverse with sync 2025/04/28 02:30:18 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/28 02:30:18 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:30:18 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:30:19 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:30:19 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:30:20 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:30:20 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:30:21 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:30:22 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:30:26 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:30:32 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:30:45 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:31:11 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:32:02 ERROR : sub dir/hello world: Failed to copy: object not found 2025/04/28 02:32:02 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting files as there were IO errors 2025/04/28 02:32:02 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting directories as there were IO errors sync_test.go:250: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:250 Error: Received unexpected error: object not found Test: TestSyncNoTraverse --- FAIL: TestSyncNoTraverse (103.82s) === RUN TestCopyWithDepth run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:32:02 DEBUG : hello world2: Need to transfer - File not found at Destination 2025/04/28 02:32:02 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:32:02 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:32:05 DEBUG : hello world2: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:32:05 DEBUG : hello world2: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:32:05 DEBUG : hello world2: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:32:06 DEBUG : hello world2: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:32:06 DEBUG : hello world2: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:32:08 DEBUG : hello world2: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:32:11 DEBUG : hello world2: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:32:18 DEBUG : hello world2: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:32:30 DEBUG : hello world2: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:32:56 DEBUG : hello world2: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:33:47 ERROR : hello world2: Failed to copy: object not found sync_test.go:270: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:270 Error: Received unexpected error: object not found Test: TestCopyWithDepth --- FAIL: TestCopyWithDepth (105.53s) === RUN TestCopyWithFilesFrom run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:33:48 DEBUG : potato2: Need to transfer - File not found at Destination 2025/04/28 02:33:48 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:33:48 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:33:50 DEBUG : potato2: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:33:50 DEBUG : potato2: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:33:51 DEBUG : potato2: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:33:51 DEBUG : potato2: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:33:52 DEBUG : potato2: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:33:53 DEBUG : potato2: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:33:57 DEBUG : potato2: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:34:03 DEBUG : potato2: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:34:16 DEBUG : potato2: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:34:42 DEBUG : potato2: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:35:33 ERROR : potato2: Failed to copy: object not found sync_test.go:298: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:298 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:304 Error: Received unexpected error: object not found Test: TestCopyWithFilesFrom --- FAIL: TestCopyWithFilesFrom (105.45s) === RUN TestCopyWithFilesFromAndNoTraverse run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:35:33 DEBUG : potato2: Need to transfer - File not found at Destination 2025/04/28 02:35:33 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:35:33 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:35:34 DEBUG : potato2: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:35:34 DEBUG : potato2: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:35:34 DEBUG : potato2: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:35:35 DEBUG : potato2: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:35:36 DEBUG : potato2: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:35:37 DEBUG : potato2: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:35:40 DEBUG : potato2: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:35:47 DEBUG : potato2: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:36:00 DEBUG : potato2: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:36:25 DEBUG : potato2: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:37:17 ERROR : potato2: Failed to copy: object not found sync_test.go:298: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:298 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:305 Error: Received unexpected error: object not found Test: TestCopyWithFilesFromAndNoTraverse --- FAIL: TestCopyWithFilesFromAndNoTraverse (103.82s) === RUN TestCopyEmptyDirectories run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:37:17 DEBUG : sub dir2/sub sub dir2: Making directory with metadata 2025/04/28 02:37:17 INFO : sub dir2/sub sub dir2: Made directory with metadata (mtime=2011-12-25T12:59:59.123456789Z) 2025/04/28 02:37:17 INFO : sub dir2: Set directory modification time (using DirSetModTime) 2025/04/28 02:37:17 INFO : sub dir: Set directory modification time (using DirSetModTime) 2025/04/28 02:37:17 INFO : sub dir: Making directory 2025/04/28 02:37:17 INFO : sub dir2: Making directory 2025/04/28 02:37:19 INFO : sub dir2/sub sub dir2: Making directory 2025/04/28 02:37:19 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/28 02:37:21 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:37:21 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:37:21 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:37:22 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:37:22 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:37:22 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:37:23 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:37:25 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:37:28 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:37:34 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:37:47 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:38:13 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:39:04 ERROR : sub dir/hello world: Failed to copy: object not found sync_test.go:325: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:325 Error: Received unexpected error: object not found Test: TestCopyEmptyDirectories --- FAIL: TestCopyEmptyDirectories (107.53s) === RUN TestCopyNoEmptyDirectories run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:39:04 INFO : sub dir2: Making directory 2025/04/28 02:39:04 DEBUG : sub dir2/sub sub dir2: Making directory with metadata 2025/04/28 02:39:04 INFO : sub dir2/sub sub dir2: Made directory with metadata (mtime=2011-12-25T12:59:59.123456789Z) 2025/04/28 02:39:05 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/28 02:39:05 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:39:05 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:39:05 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:39:06 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:39:06 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:39:06 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:39:07 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:39:09 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:39:12 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:39:18 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:39:31 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:39:57 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:40:48 ERROR : sub dir/hello world: Failed to copy: object not found sync_test.go:356: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:356 Error: Received unexpected error: object not found Test: TestCopyNoEmptyDirectories --- FAIL: TestCopyNoEmptyDirectories (103.83s) === RUN TestMoveEmptyDirectories run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:40:48 DEBUG : sub dir2: Making directory with metadata 2025/04/28 02:40:48 INFO : sub dir2: Made directory with metadata (mtime=2011-12-25T12:59:59.123456789Z) 2025/04/28 02:40:48 INFO : sub dir: Making directory 2025/04/28 02:40:48 INFO : sub dir2: Making directory 2025/04/28 02:40:48 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/28 02:40:48 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:40:48 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:40:49 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:40:49 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:40:50 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:40:50 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:40:51 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:40:52 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:40:56 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:41:02 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:41:15 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:41:41 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:42:32 ERROR : sub dir/hello world: Failed to copy: object not found 2025/04/28 02:42:32 ERROR : sub dir/hello world: Not deleting source as copy failed: object not found sync_test.go:382: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:382 Error: Received unexpected error: object not found Test: TestMoveEmptyDirectories --- FAIL: TestMoveEmptyDirectories (103.82s) === RUN TestSyncNoUpdateDirModtime run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" sync_test.go:408: Skipping test as backend does not support DirSetModTime --- SKIP: TestSyncNoUpdateDirModtime (0.40s) === RUN TestMoveNoEmptyDirectories run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:42:32 INFO : sub dir2: Making directory 2025/04/28 02:42:33 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/28 02:42:33 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:42:33 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:42:33 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:42:34 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:42:34 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:42:34 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:42:35 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:42:37 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:42:40 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:42:46 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:42:59 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:43:25 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:44:16 ERROR : sub dir/hello world: Failed to copy: object not found 2025/04/28 02:44:16 ERROR : sub dir/hello world: Not deleting source as copy failed: object not found sync_test.go:453: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:453 Error: Received unexpected error: object not found Test: TestMoveNoEmptyDirectories --- FAIL: TestMoveNoEmptyDirectories (103.82s) === RUN TestSyncEmptyDirectories run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:44:16 DEBUG : sub dir2: Making directory with metadata 2025/04/28 02:44:16 INFO : sub dir2: Made directory with metadata (mtime=2011-12-25T12:59:59.123456789Z) 2025/04/28 02:44:16 INFO : sub dir: Set directory modification time (using DirSetModTime) 2025/04/28 02:44:16 INFO : sub dir: Making directory 2025/04/28 02:44:16 INFO : sub dir2: Making directory 2025/04/28 02:44:16 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/28 02:44:16 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:44:16 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:44:17 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:44:17 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:44:18 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:44:18 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:44:19 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:44:20 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:44:24 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:44:30 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:44:43 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:45:09 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:46:00 ERROR : sub dir/hello world: Failed to copy: object not found 2025/04/28 02:46:00 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting files as there were IO errors 2025/04/28 02:46:00 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting directories as there were IO errors sync_test.go:483: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:483 Error: Received unexpected error: object not found Test: TestSyncEmptyDirectories --- FAIL: TestSyncEmptyDirectories (103.82s) === RUN TestSyncSetDelayedModTimes run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" sync_test.go:507: Backend doesn't have DirModTimeUpdatesOnWrite set --- SKIP: TestSyncSetDelayedModTimes (0.40s) === RUN TestSyncNoEmptyDirectories run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:46:00 INFO : sub dir2: Making directory 2025/04/28 02:46:01 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/04/28 02:46:01 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:46:01 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:46:01 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:46:02 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:46:02 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:46:02 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:46:03 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:46:05 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:46:08 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:46:14 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:46:27 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:46:53 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 02:47:44 ERROR : sub dir/hello world: Failed to copy: object not found 2025/04/28 02:47:44 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting files as there were IO errors 2025/04/28 02:47:44 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting directories as there were IO errors sync_test.go:567: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:567 Error: Received unexpected error: object not found Test: TestSyncNoEmptyDirectories --- FAIL: TestSyncNoEmptyDirectories (103.81s) === RUN TestServerSideCopy run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:47:45 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:47:45 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:47:45 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:47:46 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:47:47 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:47:48 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:47:52 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:47:58 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:48:11 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:48:36 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "sub dir/hello world" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestServerSideCopy (103.63s) === RUN TestCopyOverSelf run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:49:29 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:49:29 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:49:29 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:49:29 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:49:30 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:49:32 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:49:35 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:49:42 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:49:54 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:50:20 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "sub dir/hello world" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestCopyOverSelf (103.62s) === RUN TestServerSideCopyOverSelf run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:51:12 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:51:12 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:51:13 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:51:13 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:51:14 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:51:16 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:51:19 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:51:25 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:51:38 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:52:04 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "sub dir/hello world" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestServerSideCopyOverSelf (103.62s) === RUN TestMoveOverSelf run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:52:56 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:52:56 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:52:56 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:52:57 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:52:58 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:52:59 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:53:02 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:53:09 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:53:22 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:53:47 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "sub dir/hello world" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestMoveOverSelf (103.63s) === RUN TestServerSideMoveOverSelf run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:54:40 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:54:40 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:54:40 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:54:40 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:54:41 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:54:43 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:54:46 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:54:52 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:55:05 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:55:31 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "sub dir/hello world" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestServerSideMoveOverSelf (103.62s) === RUN TestCopyAfterDelete run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:56:23 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:56:23 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:56:24 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:56:24 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:56:25 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:56:26 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:56:30 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:56:36 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:56:49 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:57:15 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "sub dir/hello world" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestCopyAfterDelete (103.63s) === RUN TestCopyRedownload run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:58:07 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:58:07 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:58:07 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:58:08 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:58:08 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:58:10 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:58:13 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 02:58:20 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 02:58:33 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 02:58:58 DEBUG : sub dir/hello world: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "sub dir/hello world" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestCopyRedownload (103.62s) === RUN TestSyncBasedOnCheckSum run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 02:59:50 DEBUG : check sum: Need to transfer - File not found at Destination 2025/04/28 02:59:50 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 02:59:50 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 02:59:52 DEBUG : check sum: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 02:59:53 DEBUG : check sum: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 02:59:53 DEBUG : check sum: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 02:59:53 DEBUG : check sum: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 02:59:54 DEBUG : check sum: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 02:59:56 DEBUG : check sum: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 02:59:59 DEBUG : check sum: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:00:05 DEBUG : check sum: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:00:18 DEBUG : check sum: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:00:44 DEBUG : check sum: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 03:01:35 ERROR : check sum: Failed to copy: object not found 2025/04/28 03:01:35 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting files as there were IO errors 2025/04/28 03:01:35 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting directories as there were IO errors sync_test.go:754: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:754 Error: Received unexpected error: object not found Test: TestSyncBasedOnCheckSum --- FAIL: TestSyncBasedOnCheckSum (105.74s) === RUN TestSyncSizeOnly run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:01:36 DEBUG : sizeonly: Need to transfer - File not found at Destination 2025/04/28 03:01:36 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 03:01:36 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 03:01:38 DEBUG : sizeonly: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:01:38 DEBUG : sizeonly: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:01:38 DEBUG : sizeonly: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:01:39 DEBUG : sizeonly: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:01:39 DEBUG : sizeonly: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:01:41 DEBUG : sizeonly: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:01:44 DEBUG : sizeonly: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:01:51 DEBUG : sizeonly: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:02:03 DEBUG : sizeonly: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:02:29 DEBUG : sizeonly: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 03:03:20 ERROR : sizeonly: Failed to copy: object not found 2025/04/28 03:03:20 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting files as there were IO errors 2025/04/28 03:03:20 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting directories as there were IO errors sync_test.go:792: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:792 Error: Received unexpected error: object not found Test: TestSyncSizeOnly --- FAIL: TestSyncSizeOnly (105.21s) === RUN TestSyncIgnoreSize run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:03:21 DEBUG : ignore-size: Need to transfer - File not found at Destination 2025/04/28 03:03:21 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 03:03:21 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 03:03:24 DEBUG : ignore-size: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:03:24 DEBUG : ignore-size: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:03:24 DEBUG : ignore-size: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:03:25 DEBUG : ignore-size: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:03:25 DEBUG : ignore-size: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:03:27 DEBUG : ignore-size: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:03:30 DEBUG : ignore-size: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:03:37 DEBUG : ignore-size: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:03:49 DEBUG : ignore-size: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:04:15 DEBUG : ignore-size: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 03:05:06 ERROR : ignore-size: Failed to copy: object not found 2025/04/28 03:05:06 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting files as there were IO errors 2025/04/28 03:05:06 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting directories as there were IO errors sync_test.go:830: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:830 Error: Received unexpected error: object not found Test: TestSyncIgnoreSize --- FAIL: TestSyncIgnoreSize (105.97s) === RUN TestSyncIgnoreTimes run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:05:09 DEBUG : existing: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:05:10 DEBUG : existing: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:05:10 DEBUG : existing: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:05:10 DEBUG : existing: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:05:11 DEBUG : existing: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:05:13 DEBUG : existing: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:05:16 DEBUG : existing: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:05:22 DEBUG : existing: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:05:35 DEBUG : existing: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:06:01 DEBUG : existing: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "existing" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestSyncIgnoreTimes (105.83s) === RUN TestSyncIgnoreExisting run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:06:53 DEBUG : existing: Need to transfer - File not found at Destination 2025/04/28 03:06:53 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for checks to finish 2025/04/28 03:06:53 DEBUG : Linkbox root 'rclone-test-qoxasud7funi': Waiting for transfers to finish 2025/04/28 03:06:53 DEBUG : existing: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:06:54 DEBUG : existing: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:06:54 DEBUG : existing: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:06:54 DEBUG : existing: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:06:55 DEBUG : existing: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:06:57 DEBUG : existing: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:07:00 DEBUG : existing: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:07:06 DEBUG : existing: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:07:19 DEBUG : existing: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:07:45 DEBUG : existing: Trying to read object after upload: try again in 51.2s (10/10) 2025/04/28 03:08:36 ERROR : existing: Failed to copy: object not found 2025/04/28 03:08:36 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting files as there were IO errors 2025/04/28 03:08:36 ERROR : Linkbox root 'rclone-test-qoxasud7funi': not deleting directories as there were IO errors sync_test.go:897: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:897 Error: Received unexpected error: object not found Test: TestSyncIgnoreExisting --- FAIL: TestSyncIgnoreExisting (103.82s) === RUN TestSyncIgnoreErrors run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:08:41 DEBUG : b/potato: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:08:41 DEBUG : b/potato: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:08:41 DEBUG : b/potato: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:08:41 DEBUG : b/potato: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:08:42 DEBUG : b/potato: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:08:44 DEBUG : b/potato: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:08:47 DEBUG : b/potato: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:08:53 DEBUG : b/potato: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:09:06 DEBUG : b/potato: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:09:32 DEBUG : b/potato: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "b/potato" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestSyncIgnoreErrors (107.34s) === RUN TestSyncAfterChangingModtimeOnly run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:10:26 DEBUG : empty space: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:10:26 DEBUG : empty space: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:10:26 DEBUG : empty space: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:10:27 DEBUG : empty space: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:10:27 DEBUG : empty space: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:10:29 DEBUG : empty space: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:10:32 DEBUG : empty space: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:10:39 DEBUG : empty space: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:10:52 DEBUG : empty space: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:11:17 DEBUG : empty space: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "empty space" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestSyncAfterChangingModtimeOnly (105.15s) === RUN TestSyncAfterChangingModtimeOnlyWithNoUpdateModTime run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" sync_test.go:1016: Can't check this if no hashes supported --- PASS: TestSyncAfterChangingModtimeOnlyWithNoUpdateModTime (0.40s) === RUN TestSyncDoesntUpdateModtime run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" sync_test.go:1042: Can't run this test on fs which doesn't support mod time --- SKIP: TestSyncDoesntUpdateModtime (0.40s) === RUN TestSyncAfterAddingAFile run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:12:10 DEBUG : empty space: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:12:10 DEBUG : empty space: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:12:11 DEBUG : empty space: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:12:11 DEBUG : empty space: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:12:12 DEBUG : empty space: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:12:14 DEBUG : empty space: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:12:17 DEBUG : empty space: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:12:23 DEBUG : empty space: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:12:36 DEBUG : empty space: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:13:02 DEBUG : empty space: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "empty space" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestSyncAfterAddingAFile (103.62s) === RUN TestSyncAfterChangingFilesSizeOnly run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:13:55 DEBUG : potato: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:13:56 DEBUG : potato: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:13:56 DEBUG : potato: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:13:56 DEBUG : potato: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:13:57 DEBUG : potato: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:13:59 DEBUG : potato: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:14:02 DEBUG : potato: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:14:08 DEBUG : potato: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:14:21 DEBUG : potato: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:14:47 DEBUG : potato: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "potato" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestSyncAfterChangingFilesSizeOnly (105.19s) === RUN TestSyncAfterChangingContentsOnly run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" sync_test.go:1106: ModTimeNotSupported so forcing file to be a different size 2025/04/28 03:15:41 DEBUG : potato: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:15:41 DEBUG : potato: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:15:41 DEBUG : potato: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:15:42 DEBUG : potato: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:15:43 DEBUG : potato: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:15:44 DEBUG : potato: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:15:47 DEBUG : potato: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:15:54 DEBUG : potato: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:16:07 DEBUG : potato: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:16:32 DEBUG : potato: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "potato" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestSyncAfterChangingContentsOnly (105.53s) === RUN TestSyncAfterRemovingAFileAndAddingAFileDryRun run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:17:26 DEBUG : potato: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:17:26 DEBUG : potato: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:17:26 DEBUG : potato: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:17:27 DEBUG : potato: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:17:28 DEBUG : potato: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:17:29 DEBUG : potato: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:17:33 DEBUG : potato: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:17:39 DEBUG : potato: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:17:52 DEBUG : potato: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:18:17 DEBUG : potato: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "potato" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestSyncAfterRemovingAFileAndAddingAFileDryRun (105.06s) === RUN TestSyncAfterRemovingAFileAndAddingAFile run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:19:10 DEBUG : potato: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:19:10 DEBUG : potato: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:19:10 DEBUG : potato: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:19:10 DEBUG : potato: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:19:11 DEBUG : potato: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:19:13 DEBUG : potato: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:19:16 DEBUG : potato: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:19:23 DEBUG : potato: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:19:35 DEBUG : potato: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:20:01 DEBUG : potato: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "potato" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestSyncAfterRemovingAFileAndAddingAFile (103.63s) === RUN TestSyncAfterRemovingAFileAndAddingAFileSubDir run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:20:53 DEBUG : b/potato: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:20:53 DEBUG : b/potato: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:20:54 DEBUG : b/potato: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:20:54 DEBUG : b/potato: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:20:55 DEBUG : b/potato: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:20:57 DEBUG : b/potato: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:21:00 DEBUG : b/potato: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:21:06 DEBUG : b/potato: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:21:19 DEBUG : b/potato: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:21:45 DEBUG : b/potato: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "b/potato" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestSyncAfterRemovingAFileAndAddingAFileSubDir (103.63s) === RUN TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:22:37 DEBUG : b/potato: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:22:37 DEBUG : b/potato: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:22:37 DEBUG : b/potato: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:22:38 DEBUG : b/potato: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:22:39 DEBUG : b/potato: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:22:40 DEBUG : b/potato: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:22:43 DEBUG : b/potato: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:22:50 DEBUG : b/potato: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:23:03 DEBUG : b/potato: Trying to read object after upload: try again in 25.6s (9/10) 2025/04/28 03:23:28 DEBUG : b/potato: Trying to read object after upload: try again in 51.2s (10/10) run.go:285: Failed to put "b/potato" to "Linkbox root 'rclone-test-qoxasud7funi'": object not found --- FAIL: TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors (103.63s) === RUN TestSyncDeleteAfter --- PASS: TestSyncDeleteAfter (0.00s) === RUN TestSyncDeleteDuring run.go:180: Remote "Linkbox root 'rclone-test-qoxasud7funi'", Local "Local file system at /tmp/rclone2585669698", Modify Window "876000h0m0s" 2025/04/28 03:24:20 DEBUG : potato: Trying to read object after upload: try again in 100ms (1/10) 2025/04/28 03:24:21 DEBUG : potato: Trying to read object after upload: try again in 200ms (2/10) 2025/04/28 03:24:21 DEBUG : potato: Trying to read object after upload: try again in 400ms (3/10) 2025/04/28 03:24:21 DEBUG : potato: Trying to read object after upload: try again in 800ms (4/10) 2025/04/28 03:24:22 DEBUG : potato: Trying to read object after upload: try again in 1.6s (5/10) 2025/04/28 03:24:24 DEBUG : potato: Trying to read object after upload: try again in 3.2s (6/10) 2025/04/28 03:24:27 DEBUG : potato: Trying to read object after upload: try again in 6.4s (7/10) 2025/04/28 03:24:33 DEBUG : potato: Trying to read object after upload: try again in 12.8s (8/10) 2025/04/28 03:24:46 DEBUG : potato: Trying to read object after upload: try again in 25.6s (9/10) panic: test timed out after 1h0m0s running tests: TestSyncDeleteDuring (38s) goroutine 2614 [running]: testing.(*M).startAlarm.func1() /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:2373 +0x385 created by time.goFunc /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/time/sleep.go:215 +0x2d goroutine 1 [chan receive]: testing.(*T).Run(0xc000168000, {0x25f74f2?, 0x0?}, 0x271eb58) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1751 +0x3ab testing.runTests.func1(0xc000168000) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:2168 +0x37 testing.tRunner(0xc000168000, 0xc000987c18) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1690 +0xf4 testing.runTests(0xc000a36af8, {0x3cfbaa0, 0x5c, 0x5c}, {0x858300?, 0x3d36278?, 0x3d12880?}) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:2166 +0x43d testing.(*M).Run(0xc00052dea0) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:2034 +0x64a github.com/rclone/rclone/fstest.TestMain(0xc00052dea0) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:69 +0xa5 github.com/rclone/rclone/fs/sync.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:44 main.main() _testmain.go:229 +0xa9 goroutine 52 [syscall, 60 minutes]: os/signal.signal_recv() /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/os/signal/signal.go:151 +0x1f goroutine 53 [chan receive, 60 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 26 [IO wait]: internal/poll.runtime_pollWait(0x7f32dba81678, 0x72) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/runtime/netpoll.go:351 +0x85 internal/poll.(*pollDesc).wait(0xc0001d1f00?, 0xc00075a000?, 0x0) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:84 +0x27 internal/poll.(*pollDesc).waitRead(...) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc0001d1f00, {0xc00075a000, 0x1300, 0x1300}) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/internal/poll/fd_unix.go:165 +0x27a net.(*netFD).Read(0xc0001d1f00, {0xc00075a000?, 0xc00075a089?, 0x2?}) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/fd_posix.go:55 +0x25 net.(*conn).Read(0xc00061c008, {0xc00075a000?, 0x10000007bc272?, 0xc0006bb9a0?}) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/net.go:189 +0x45 github.com/rclone/rclone/fs/fshttp.(*timeoutConn).Read(0xc000012048, {0xc00075a000?, 0x18?, 0x23f47e0?}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:111 +0x2c crypto/tls.(*atLeastReader).Read(0xc000a369d8, {0xc00075a000?, 0x0?, 0xc000a369d8?}) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/crypto/tls/conn.go:809 +0x3b bytes.(*Buffer).ReadFrom(0xc00016beb8, {0x29d60a0, 0xc000a369d8}) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/bytes/buffer.go:211 +0x98 crypto/tls.(*Conn).readFromUntil(0xc00016bc08, {0x7f32da0fdeb8, 0xc000012048}, 0xc0006bba10?) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/crypto/tls/conn.go:831 +0xde crypto/tls.(*Conn).readRecordOrCCS(0xc00016bc08, 0x0) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/crypto/tls/conn.go:629 +0x3cf crypto/tls.(*Conn).readRecord(...) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/crypto/tls/conn.go:591 crypto/tls.(*Conn).Read(0xc00016bc08, {0xc000a5d000, 0x1000, 0xc0006bbca0?}) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/crypto/tls/conn.go:1385 +0x150 bufio.(*Reader).Read(0xc000a58ba0, {0xc0009cbb60, 0x9, 0x3c8c040?}) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/bufio/bufio.go:241 +0x197 io.ReadAtLeast({0x29d3780, 0xc000a58ba0}, {0xc0009cbb60, 0x9, 0x9}, 0x9) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/io/io.go:335 +0x90 io.ReadFull(...) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/io/io.go:354 net/http.http2readFrameHeader({0xc0009cbb60, 0x9, 0x33d0e0?}, {0x29d3780?, 0xc000a58ba0?}) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/http/h2_bundle.go:1642 +0x65 net/http.(*http2Framer).ReadFrame(0xc0009cbb20) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/http/h2_bundle.go:1909 +0x85 net/http.(*http2clientConnReadLoop).run(0xc0006bbfa8) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/http/h2_bundle.go:9496 +0xda net/http.(*http2ClientConn).readLoop(0xc0000e4600) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/http/h2_bundle.go:9392 +0x7c created by net/http.(*http2Transport).newClientConn in goroutine 25 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/http/h2_bundle.go:8006 +0xd1b goroutine 2051 [select]: github.com/rclone/rclone/fs/accounting.(*StatsInfo).averageLoop(0xc000b11500) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:343 +0x13d created by github.com/rclone/rclone/fs/accounting.(*StatsInfo)._startAverageLoop in goroutine 2050 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:408 +0xb6 goroutine 2586 [sleep]: time.Sleep(0x5f5e10000) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/runtime/time.go:285 +0xf2 github.com/rclone/rclone/backend/linkbox.(*Object).Update(0xc000af2580, {0x29fac68, 0xc0006562a0}, {0x29d3360, 0xc000656600}, {0x2a05340, 0xc000606230}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/linkbox/linkbox.go:691 +0x14d7 github.com/rclone/rclone/backend/linkbox.(*Fs).Put(0xc0002e52c0, {0x29fac68, 0xc0006562a0}, {0x29d3360, 0xc000656600}, {0x2a05340, 0xc000606230}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/linkbox/linkbox.go:854 +0x194 github.com/rclone/rclone/fstest.(*Run).WriteObjectTo(0xc0006061c0, {0x29fac68, 0xc0006562a0}, {0x2a10000, 0xc0002e52c0}, {0x25ce806, 0x6}, {0x25faa32, 0x15}, {0x75bcd15, ...}, ...) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:275 +0x3f8 github.com/rclone/rclone/fstest.(*Run).WriteObject(...) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:292 github.com/rclone/rclone/fs/sync.testSyncAfterRemovingAFileAndAddingAFile({0x29fac68, 0xc0006562a0}, 0xc000168680) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1149 +0x167 github.com/rclone/rclone/fs/sync.TestSyncDeleteDuring(0xc000168680) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1317 +0x34 testing.tRunner(0xc000168680, 0x271eb58) /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1690 +0xf4 created by testing.(*T).Run in goroutine 1 /home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1743 +0x390 "./sync.test -test.v -test.timeout 1h0m0s -remote TestLinkbox: -verbose" - Finished ERROR in 1h0m0.656379406s (try 1/5): exit status 2: Failed [TestCopy TestCopyNoTraverse TestCopyCheckFirst TestSyncNoTraverse TestCopyWithDepth TestCopyWithFilesFrom TestCopyWithFilesFromAndNoTraverse TestCopyEmptyDirectories TestCopyNoEmptyDirectories TestMoveEmptyDirectories TestMoveNoEmptyDirectories TestSyncEmptyDirectories TestSyncNoEmptyDirectories TestServerSideCopy TestCopyOverSelf TestServerSideCopyOverSelf TestMoveOverSelf TestServerSideMoveOverSelf TestCopyAfterDelete TestCopyRedownload TestSyncBasedOnCheckSum TestSyncSizeOnly TestSyncIgnoreSize TestSyncIgnoreTimes TestSyncIgnoreExisting TestSyncIgnoreErrors TestSyncAfterChangingModtimeOnly TestSyncAfterAddingAFile TestSyncAfterChangingFilesSizeOnly TestSyncAfterChangingContentsOnly TestSyncAfterRemovingAFileAndAddingAFileDryRun TestSyncAfterRemovingAFileAndAddingAFile TestSyncAfterRemovingAFileAndAddingAFileSubDir TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors]