"./sync.test -test.v -test.timeout 1h0m0s -remote TestPcloud: -verbose -fast-list" - Starting (try 2/5) 2025/06/28 02:00:54 DEBUG : Creating backend with remote "TestPcloud:rclone-test-niziter1bive" 2025/06/28 02:00:54 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/06/28 02:00:55 DEBUG : Creating backend with remote "/tmp/rclone76978408" === RUN TestPipe --- PASS: TestPipe (0.00s) === RUN TestPipeConcurrent --- PASS: TestPipeConcurrent (0.04s) === RUN TestPipeOrderBy === RUN TestPipeOrderBy/#00 === RUN TestPipeOrderBy/size === RUN TestPipeOrderBy/name === RUN TestPipeOrderBy/modtime === RUN TestPipeOrderBy/size,ascending === RUN TestPipeOrderBy/name,asc === RUN TestPipeOrderBy/modtime,ascending === RUN TestPipeOrderBy/size,descending === RUN TestPipeOrderBy/name,desc === RUN TestPipeOrderBy/modtime,descending === RUN TestPipeOrderBy/size,mixed,50 === RUN TestPipeOrderBy/size,mixed,51 --- PASS: TestPipeOrderBy (0.00s) --- PASS: TestPipeOrderBy/#00 (0.00s) --- PASS: TestPipeOrderBy/size (0.00s) --- PASS: TestPipeOrderBy/name (0.00s) --- PASS: TestPipeOrderBy/modtime (0.00s) --- PASS: TestPipeOrderBy/size,ascending (0.00s) --- PASS: TestPipeOrderBy/name,asc (0.00s) --- PASS: TestPipeOrderBy/modtime,ascending (0.00s) --- PASS: TestPipeOrderBy/size,descending (0.00s) --- PASS: TestPipeOrderBy/name,desc (0.00s) --- PASS: TestPipeOrderBy/modtime,descending (0.00s) --- PASS: TestPipeOrderBy/size,mixed,50 (0.00s) --- PASS: TestPipeOrderBy/size,mixed,51 (0.00s) === RUN TestNewLess === RUN TestNewLess/blankOK === RUN TestNewLess/tooManyParts === RUN TestNewLess/tooManyParts2 === RUN TestNewLess/badMixed === RUN TestNewLess/unknownComparison === RUN TestNewLess/unknownSortDirection === RUN TestNewLess/size === RUN TestNewLess/name === RUN TestNewLess/modtime === RUN TestNewLess/size,ascending === RUN TestNewLess/name,asc === RUN TestNewLess/modtime,ascending === RUN TestNewLess/size,descending === RUN TestNewLess/name,desc === RUN TestNewLess/modtime,descending === RUN TestNewLess/modtime,mixed === RUN TestNewLess/modtime,mixed,30 --- PASS: TestNewLess (0.00s) --- PASS: TestNewLess/blankOK (0.00s) --- PASS: TestNewLess/tooManyParts (0.00s) --- PASS: TestNewLess/tooManyParts2 (0.00s) --- PASS: TestNewLess/badMixed (0.00s) --- PASS: TestNewLess/unknownComparison (0.00s) --- PASS: TestNewLess/unknownSortDirection (0.00s) --- PASS: TestNewLess/size (0.00s) --- PASS: TestNewLess/name (0.00s) --- PASS: TestNewLess/modtime (0.00s) --- PASS: TestNewLess/size,ascending (0.00s) --- PASS: TestNewLess/name,asc (0.00s) --- PASS: TestNewLess/modtime,ascending (0.00s) --- PASS: TestNewLess/size,descending (0.00s) --- PASS: TestNewLess/name,desc (0.00s) --- PASS: TestNewLess/modtime,descending (0.00s) --- PASS: TestNewLess/modtime,mixed (0.00s) --- PASS: TestNewLess/modtime,mixed,30 (0.00s) === RUN TestRcCopy rc_test.go:16: Skipping test on non local remote --- SKIP: TestRcCopy (0.00s) === RUN TestRcMove rc_test.go:16: Skipping test on non local remote --- SKIP: TestRcMove (0.00s) === RUN TestRcSync rc_test.go:16: Skipping test on non local remote --- SKIP: TestRcSync (0.00s) === RUN TestCopyWithDryRun run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:00:56 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/06/28 02:00:56 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:00:56 NOTICE: sub dir/hello world: Skipped copy as --dry-run is set (size 11) 2025/06/28 02:00:56 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish --- PASS: TestCopyWithDryRun (0.91s) === RUN TestCopy run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:00:56 INFO : sub dir: Set directory modification time (using DirSetModTime) 2025/06/28 02:00:56 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/06/28 02:00:56 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:00:56 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish 2025/06/28 02:00:56 DEBUG : sub dir/hello world: sha1 = 2aae6c35c94fcfb415dbe95f408b9ce91ee846ed OK 2025/06/28 02:00:57 DEBUG : sub dir/hello world.adfb51a5.partial: renamed to: sub dir/hello world 2025/06/28 02:00:57 INFO : sub dir/hello world: Copied (new) 2025/06/28 02:00:57 DEBUG : pcloud root 'rclone-test-niziter1bive': Skipping modtime test as remote does not support DirSetModTime or MkdirMetadata --- PASS: TestCopy (0.96s) === RUN TestCopyMetadata run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" sync_test.go:98: Skipping as metadata not supported --- SKIP: TestCopyMetadata (0.17s) === RUN TestCopyMetadataNoEmptyDirs run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" sync_test.go:98: Skipping as metadata not supported fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:298: Flushing the directory cache fstest.go:289: Sleeping for 6s just to make sure --- SKIP: TestCopyMetadataNoEmptyDirs (7.69s) === RUN TestCopyMissingDirectory run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:01:05 DEBUG : Creating backend with remote "/non-existing" 2025/06/28 02:01:05 ERROR : Local file system at /non-existing: error reading source root directory: directory not found 2025/06/28 02:01:05 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:01:05 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish --- PASS: TestCopyMissingDirectory (0.27s) === RUN TestCopyNoTraverse run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:01:05 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/06/28 02:01:05 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:01:05 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish 2025/06/28 02:01:06 DEBUG : sub dir/hello world: sha1 = 2aae6c35c94fcfb415dbe95f408b9ce91ee846ed OK 2025/06/28 02:01:06 DEBUG : sub dir/hello world.adfb51a5.partial: renamed to: sub dir/hello world 2025/06/28 02:01:06 INFO : sub dir/hello world: Copied (new) --- PASS: TestCopyNoTraverse (0.94s) === RUN TestCopyCheckFirst run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:01:06 INFO : pcloud root 'rclone-test-niziter1bive': Running all checks before starting transfers 2025/06/28 02:01:06 DEBUG : sub dir/hello world: Size and modification time the same (differ by -499.999999ms, within tolerance 1s) 2025/06/28 02:01:06 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:01:06 DEBUG : sub dir/hello world: Unchanged skipping 2025/06/28 02:01:06 INFO : pcloud root 'rclone-test-niziter1bive': Checks finished, now starting transfers 2025/06/28 02:01:06 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:298: Flushing the directory cache fstest.go:295: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:298: Flushing the directory cache fstest.go:295: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:298: Flushing the directory cache fstest.go:302: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:335 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:347 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:235 Error: Should be true Test: TestCopyCheckFirst Messages: listing wrong, want sub dir/hello world (11) got fstest.go:200: Not found "sub dir/hello world" fstest.go:203: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:203 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:307 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:335 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:347 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:235 Error: Not equal: expected: 0 actual : 1 Test: TestCopyCheckFirst Messages: 1 objects not found --- FAIL: TestCopyCheckFirst (9.01s) === RUN TestSyncNoTraverse run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:01:15 ERROR : Ignoring --no-traverse with sync 2025/06/28 02:01:15 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/06/28 02:01:15 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:01:15 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish 2025/06/28 02:01:15 DEBUG : sub dir/hello world: sha1 = 2aae6c35c94fcfb415dbe95f408b9ce91ee846ed OK 2025/06/28 02:01:16 DEBUG : sub dir/hello world.adfb51a5.partial: renamed to: sub dir/hello world 2025/06/28 02:01:16 INFO : sub dir/hello world: Copied (new) 2025/06/28 02:01:16 DEBUG : Waiting for deletions to finish --- PASS: TestSyncNoTraverse (0.95s) === RUN TestCopyWithDepth run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:01:16 DEBUG : hello world2: Need to transfer - File not found at Destination 2025/06/28 02:01:16 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:01:16 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish 2025/06/28 02:01:16 DEBUG : hello world2: sha1 = c0bf117f9c93d02c894fe8ffd6e5cecf3545c209 OK 2025/06/28 02:01:16 DEBUG : hello world2.ab19a585.partial: renamed to: hello world2 2025/06/28 02:01:16 INFO : hello world2: Copied (new) fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:298: Flushing the directory cache fstest.go:289: Sleeping for 6s just to make sure --- PASS: TestCopyWithDepth (8.16s) === RUN TestCopyWithFilesFrom run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:01:24 DEBUG : potato2: Need to transfer - File not found at Destination 2025/06/28 02:01:24 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:01:24 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish 2025/06/28 02:01:24 DEBUG : potato2: sha1 = 2aae6c35c94fcfb415dbe95f408b9ce91ee846ed OK 2025/06/28 02:01:25 DEBUG : potato2.adfb51a5.partial: renamed to: potato2 2025/06/28 02:01:25 INFO : potato2: Copied (new) --- PASS: TestCopyWithFilesFrom (0.70s) === RUN TestCopyWithFilesFromAndNoTraverse run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:01:25 DEBUG : potato2: Need to transfer - File not found at Destination 2025/06/28 02:01:25 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:01:25 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish 2025/06/28 02:01:25 DEBUG : potato2: sha1 = 2aae6c35c94fcfb415dbe95f408b9ce91ee846ed OK 2025/06/28 02:01:25 DEBUG : potato2.adfb51a5.partial: renamed to: potato2 2025/06/28 02:01:25 INFO : potato2: Copied (new) --- PASS: TestCopyWithFilesFromAndNoTraverse (0.70s) === RUN TestCopyEmptyDirectories run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:01:26 DEBUG : sub dir2/sub sub dir2: Making directory with metadata 2025/06/28 02:01:26 INFO : sub dir2/sub sub dir2: Made directory with metadata (mtime=2011-12-25T12:59:59.123456789Z) 2025/06/28 02:01:26 INFO : sub dir2: Set directory modification time (using DirSetModTime) 2025/06/28 02:01:26 INFO : sub dir: Set directory modification time (using DirSetModTime) 2025/06/28 02:01:26 INFO : sub dir2: Making directory 2025/06/28 02:01:26 INFO : sub dir: Making directory 2025/06/28 02:01:26 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/06/28 02:01:26 INFO : sub dir2/sub sub dir2: Making directory 2025/06/28 02:01:26 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:01:26 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish 2025/06/28 02:01:26 DEBUG : sub dir/hello world: sha1 = 2aae6c35c94fcfb415dbe95f408b9ce91ee846ed OK 2025/06/28 02:01:26 DEBUG : sub dir/hello world.adfb51a5.partial: renamed to: sub dir/hello world 2025/06/28 02:01:26 INFO : sub dir/hello world: Copied (new) 2025/06/28 02:01:27 DEBUG : pcloud root 'rclone-test-niziter1bive': Skipping modtime test as remote does not support DirSetModTime or MkdirMetadata --- PASS: TestCopyEmptyDirectories (1.47s) === RUN TestCopyNoEmptyDirectories run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:01:27 INFO : sub dir2: Making directory 2025/06/28 02:01:27 DEBUG : sub dir2/sub sub dir2: Making directory with metadata 2025/06/28 02:01:27 INFO : sub dir2/sub sub dir2: Made directory with metadata (mtime=2011-12-25T12:59:59.123456789Z) 2025/06/28 02:01:27 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/06/28 02:01:27 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:01:27 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish 2025/06/28 02:01:27 DEBUG : sub dir/hello world: sha1 = 2aae6c35c94fcfb415dbe95f408b9ce91ee846ed OK 2025/06/28 02:01:28 DEBUG : sub dir/hello world.adfb51a5.partial: renamed to: sub dir/hello world 2025/06/28 02:01:28 INFO : sub dir/hello world: Copied (new) fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:298: Flushing the directory cache fstest.go:289: Sleeping for 6s just to make sure --- PASS: TestCopyNoEmptyDirectories (8.45s) === RUN TestMoveEmptyDirectories run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:01:36 DEBUG : sub dir2: Making directory with metadata 2025/06/28 02:01:36 INFO : sub dir2: Made directory with metadata (mtime=2011-12-25T12:59:59.123456789Z) 2025/06/28 02:01:36 INFO : sub dir2: Making directory 2025/06/28 02:01:36 INFO : sub dir: Making directory 2025/06/28 02:01:36 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/06/28 02:01:36 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:01:36 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish 2025/06/28 02:01:36 DEBUG : sub dir/hello world: sha1 = 2aae6c35c94fcfb415dbe95f408b9ce91ee846ed OK 2025/06/28 02:01:36 DEBUG : sub dir/hello world.adfb51a5.partial: renamed to: sub dir/hello world 2025/06/28 02:01:36 INFO : sub dir/hello world: Copied (new) 2025/06/28 02:01:36 INFO : sub dir/hello world: Deleted 2025/06/28 02:01:36 DEBUG : pcloud root 'rclone-test-niziter1bive': Skipping modtime test as remote does not support DirSetModTime or MkdirMetadata 2025/06/28 02:01:36 DEBUG : pcloud root 'rclone-test-niziter1bive': Skipping modtime test as remote does not support DirSetModTime or MkdirMetadata --- PASS: TestMoveEmptyDirectories (1.28s) === RUN TestSyncNoUpdateDirModtime run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" sync_test.go:409: Skipping test as backend does not support DirSetModTime --- SKIP: TestSyncNoUpdateDirModtime (0.17s) === RUN TestMoveNoEmptyDirectories run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:01:37 INFO : sub dir2: Making directory 2025/06/28 02:01:37 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/06/28 02:01:37 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:01:37 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish 2025/06/28 02:01:37 DEBUG : sub dir/hello world: sha1 = 2aae6c35c94fcfb415dbe95f408b9ce91ee846ed OK 2025/06/28 02:01:37 DEBUG : sub dir/hello world.adfb51a5.partial: renamed to: sub dir/hello world 2025/06/28 02:01:38 INFO : sub dir/hello world: Copied (new) 2025/06/28 02:01:38 INFO : sub dir/hello world: Deleted --- PASS: TestMoveNoEmptyDirectories (0.97s) === RUN TestSyncEmptyDirectories run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:01:38 DEBUG : sub dir2: Making directory with metadata 2025/06/28 02:01:38 INFO : sub dir2: Made directory with metadata (mtime=2011-12-25T12:59:59.123456789Z) 2025/06/28 02:01:38 INFO : sub dir: Set directory modification time (using DirSetModTime) 2025/06/28 02:01:38 INFO : sub dir2: Making directory 2025/06/28 02:01:38 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/06/28 02:01:38 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:01:38 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish 2025/06/28 02:06:38 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=hello+world.adfb51a5.partial&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:06:38 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/28 02:06:38 DEBUG : pacer: Reducing sleep to 15ms 2025/06/28 02:06:39 DEBUG : pacer: Reducing sleep to 11.25ms 2025/06/28 02:06:41 DEBUG : pacer: Reducing sleep to 10ms 2025/06/28 02:06:44 DEBUG : sub dir/hello world: Received error: Put "https://eapi.pcloud.com/uploadfile?filename=hello+world.adfb51a5.partial&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers - low level retry 0/10 2025/06/28 02:06:49 ERROR : sub dir/hello world: Failed to copy: pcloud error: Directory does not exist. (2005) 2025/06/28 02:06:49 INFO : sub dir/hello world.adfb51a5.partial: Failed to remove failed partial copy: couldn't list files: pcloud error: Directory does not exist. (2005) 2025/06/28 02:06:49 ERROR : pcloud root 'rclone-test-niziter1bive': not deleting files as there were IO errors 2025/06/28 02:06:49 ERROR : pcloud root 'rclone-test-niziter1bive': not deleting directories as there were IO errors sync_test.go:484: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:484 Error: Received unexpected error: pcloud error: Directory does not exist. (2005) Test: TestSyncEmptyDirectories --- FAIL: TestSyncEmptyDirectories (311.57s) === RUN TestSyncSetDelayedModTimes run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" sync_test.go:508: Backend doesn't have DirModTimeUpdatesOnWrite set --- SKIP: TestSyncSetDelayedModTimes (0.16s) === RUN TestSyncNoEmptyDirectories run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:06:50 INFO : sub dir2: Making directory 2025/06/28 02:06:50 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/06/28 02:06:50 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for checks to finish 2025/06/28 02:06:50 DEBUG : pcloud root 'rclone-test-niziter1bive': Waiting for transfers to finish 2025/06/28 02:11:50 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=hello+world.adfb51a5.partial&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:11:50 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/28 02:11:50 DEBUG : pacer: Reducing sleep to 15ms 2025/06/28 02:11:51 DEBUG : pacer: Reducing sleep to 11.25ms 2025/06/28 02:11:52 DEBUG : pacer: Reducing sleep to 10ms 2025/06/28 02:11:55 DEBUG : sub dir/hello world: Received error: Put "https://eapi.pcloud.com/uploadfile?filename=hello+world.adfb51a5.partial&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers - low level retry 0/10 2025/06/28 02:12:01 ERROR : sub dir/hello world: Failed to copy: pcloud error: Directory does not exist. (2005) 2025/06/28 02:12:01 INFO : sub dir/hello world.adfb51a5.partial: Failed to remove failed partial copy: couldn't list files: pcloud error: Directory does not exist. (2005) 2025/06/28 02:12:01 ERROR : pcloud root 'rclone-test-niziter1bive': not deleting files as there were IO errors 2025/06/28 02:12:01 ERROR : pcloud root 'rclone-test-niziter1bive': not deleting directories as there were IO errors sync_test.go:568: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:568 Error: Received unexpected error: pcloud error: Directory does not exist. (2005) Test: TestSyncNoEmptyDirectories --- FAIL: TestSyncNoEmptyDirectories (311.32s) === RUN TestServerSideCopy run.go:180: Remote "pcloud root 'rclone-test-niziter1bive'", Local "Local file system at /tmp/rclone76978408", Modify Window "1s" 2025/06/28 02:17:01 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:17:01 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/28 02:17:01 DEBUG : pacer: Reducing sleep to 15ms 2025/06/28 02:17:02 DEBUG : pacer: Reducing sleep to 11.25ms 2025/06/28 02:17:03 DEBUG : pacer: Reducing sleep to 10ms run.go:281: Retry Put of "sub dir/hello world" to pcloud root 'rclone-test-niziter1bive': 1/10 (Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:22:09 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:22:09 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/28 02:22:09 DEBUG : pacer: Reducing sleep to 15ms 2025/06/28 02:22:10 DEBUG : pacer: Reducing sleep to 11.25ms 2025/06/28 02:22:11 DEBUG : pacer: Reducing sleep to 10ms run.go:281: Retry Put of "sub dir/hello world" to pcloud root 'rclone-test-niziter1bive': 2/10 (Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:27:16 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:27:16 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/28 02:27:16 DEBUG : pacer: Reducing sleep to 15ms 2025/06/28 02:27:17 DEBUG : pacer: Reducing sleep to 11.25ms 2025/06/28 02:27:18 DEBUG : pacer: Reducing sleep to 10ms run.go:281: Retry Put of "sub dir/hello world" to pcloud root 'rclone-test-niziter1bive': 3/10 (Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:32:24 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:32:24 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/28 02:32:24 DEBUG : pacer: Reducing sleep to 15ms 2025/06/28 02:32:25 DEBUG : pacer: Reducing sleep to 11.25ms 2025/06/28 02:32:26 DEBUG : pacer: Reducing sleep to 10ms run.go:281: Retry Put of "sub dir/hello world" to pcloud root 'rclone-test-niziter1bive': 4/10 (Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:37:31 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:37:31 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/28 02:37:31 DEBUG : pacer: Reducing sleep to 15ms 2025/06/28 02:37:32 DEBUG : pacer: Reducing sleep to 11.25ms 2025/06/28 02:37:33 DEBUG : pacer: Reducing sleep to 10ms run.go:281: Retry Put of "sub dir/hello world" to pcloud root 'rclone-test-niziter1bive': 5/10 (Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:42:39 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:42:39 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/28 02:42:39 DEBUG : pacer: Reducing sleep to 15ms 2025/06/28 02:42:40 DEBUG : pacer: Reducing sleep to 11.25ms 2025/06/28 02:42:41 DEBUG : pacer: Reducing sleep to 10ms run.go:281: Retry Put of "sub dir/hello world" to pcloud root 'rclone-test-niziter1bive': 6/10 (Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:47:46 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:47:46 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/28 02:47:46 DEBUG : pacer: Reducing sleep to 15ms 2025/06/28 02:47:47 DEBUG : pacer: Reducing sleep to 11.25ms 2025/06/28 02:47:48 DEBUG : pacer: Reducing sleep to 10ms run.go:281: Retry Put of "sub dir/hello world" to pcloud root 'rclone-test-niziter1bive': 7/10 (Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:52:54 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:52:54 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/28 02:52:54 DEBUG : pacer: Reducing sleep to 15ms 2025/06/28 02:52:55 DEBUG : pacer: Reducing sleep to 11.25ms 2025/06/28 02:52:56 DEBUG : pacer: Reducing sleep to 10ms run.go:281: Retry Put of "sub dir/hello world" to pcloud root 'rclone-test-niziter1bive': 8/10 (Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:58:01 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/06/28 02:58:01 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/06/28 02:58:01 DEBUG : pacer: Reducing sleep to 15ms 2025/06/28 02:58:02 DEBUG : pacer: Reducing sleep to 11.25ms 2025/06/28 02:58:03 DEBUG : pacer: Reducing sleep to 10ms run.go:281: Retry Put of "sub dir/hello world" to pcloud root 'rclone-test-niziter1bive': 9/10 (Put "https://eapi.pcloud.com/uploadfile?filename=hello+world&folderid=17636773778&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) panic: test timed out after 1h0m0s running tests: TestServerSideCopy (48m54s) goroutine 3118 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2484 +0x394 created by time.goFunc /usr/local/go/src/time/sleep.go:215 +0x2d goroutine 1 [chan receive, 48 minutes]: testing.(*T).Run(0xc000391500, {0x26a5361?, 0xc00006bad8?}, 0x27c29c8) /usr/local/go/src/testing/testing.go:1859 +0x431 testing.runTests.func1(0xc000391500) /usr/local/go/src/testing/testing.go:2279 +0x37 testing.tRunner(0xc000391500, 0xc00006bc18) /usr/local/go/src/testing/testing.go:1792 +0xf4 testing.runTests(0xc000a20108, {0x3e80600, 0x6b, 0x6b}, {0xedff143d7?, 0x3e965c0?, 0x3e965c0?}) /usr/local/go/src/testing/testing.go:2277 +0x4b4 testing.(*M).Run(0xc0004b99a0) /usr/local/go/src/testing/testing.go:2142 +0x64a github.com/rclone/rclone/fstest.TestMain(0xc0004b99a0) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:69 +0xa5 github.com/rclone/rclone/fs/sync.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:45 main.main() _testmain.go:259 +0xa9 goroutine 7 [syscall, 60 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:152 +0x1f goroutine 8 [chan receive, 60 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 9 [select, 60 minutes]: github.com/rclone/rclone/lib/oauthutil.(*Renew).renewOnExpiry(0xc00011ce00) /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:43 +0x86 created by github.com/rclone/rclone/lib/oauthutil.NewRenew in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:32 +0xe5 goroutine 2566 [select, 3 minutes]: net/http.(*persistConn).roundTrip(0xc0006c8c60, 0xc00068cb90) /usr/local/go/src/net/http/transport.go:2826 +0x785 net/http.(*Transport).roundTrip(0xc0003d0ea0, 0xc00078ef00) /usr/local/go/src/net/http/transport.go:696 +0xb9a net/http.(*Transport).RoundTrip(...) /usr/local/go/src/net/http/roundtrip.go:30 github.com/rclone/rclone/fs/fshttp.(*Transport).RoundTrip(0xc0004be230, 0xc00078ef00) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/http.go:349 +0x345 golang.org/x/oauth2.(*Transport).RoundTrip(0xc00058fc20, 0xc00078edc0) /home/rclone/go/pkg/mod/golang.org/x/oauth2@v0.30.0/transport.go:55 +0x15e net/http.send(0xc00078edc0, {0x2ad13a0, 0xc00058fc20}, {0x6e3b01?, 0xc000a6ec48?, 0x0?}) /usr/local/go/src/net/http/client.go:259 +0x5e2 net/http.(*Client).send(0xc00054f9e0, 0xc00078edc0, {0xb?, 0x1?, 0x0?}) /usr/local/go/src/net/http/client.go:180 +0x91 net/http.(*Client).do(0xc00054f9e0, 0xc00078edc0) /usr/local/go/src/net/http/client.go:728 +0x989 net/http.(*Client).Do(...) /usr/local/go/src/net/http/client.go:587 github.com/rclone/rclone/lib/rest.(*Client).Call(0xc00079a0a0, {0x2af5d08, 0x3eb9b80}, 0xc00078ec80) /home/rclone/go/src/github.com/rclone/rclone/lib/rest/rest.go:353 +0xd67 github.com/rclone/rclone/lib/rest.(*Client).callCodec(0xc00079a0a0, {0x2af5d08, 0x3eb9b80}, 0xc0005a35a8?, {0x0?, 0x0?}, {0x21a83e0, 0xc0008d66c0}, 0xc0005a3620?, 0x27c40a0, ...) /home/rclone/go/src/github.com/rclone/rclone/lib/rest/rest.go:550 +0x3f2 github.com/rclone/rclone/lib/rest.(*Client).CallJSON(...) /home/rclone/go/src/github.com/rclone/rclone/lib/rest/rest.go:493 github.com/rclone/rclone/backend/pcloud.(*Object).Update.func1() /home/rclone/go/src/github.com/rclone/rclone/backend/pcloud/pcloud.go:1325 +0x93 github.com/rclone/rclone/fs.pacerInvoker(0x1, 0x1, 0xc0005a3948?) /home/rclone/go/src/github.com/rclone/rclone/fs/pacer.go:86 +0x32 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc00038af00, 0xc0005e3400, 0x1) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:199 +0x7c github.com/rclone/rclone/lib/pacer.(*Pacer).CallNoRetry(...) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:227 github.com/rclone/rclone/backend/pcloud.(*Object).Update(0xc0005a4fc0, {0x2af5d08, 0x3eb9b80}, {0x2acd740, 0xc0007d9bf0}, {0x2b00df0, 0xc000159340}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/pcloud/pcloud.go:1324 +0xb1e github.com/rclone/rclone/backend/pcloud.(*Fs).Put(0xc0006d0140, {0x2af5d08, 0x3eb9b80}, {0x2acd740, 0xc0007d9bf0}, {0x2b00df0, 0xc000159340}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/pcloud/pcloud.go:686 +0x14c github.com/rclone/rclone/fstest.(*Run).WriteObjectTo(0xc0005021c0, {0x2af5d08, 0x3eb9b80}, {0x2b0c860, 0xc0006d0140}, {0x26a8724, 0x13}, {0x2690df6, 0xb}, {0x1dcd64ff, ...}, ...) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:275 +0x3f2 github.com/rclone/rclone/fstest.(*Run).WriteObject(...) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:292 github.com/rclone/rclone/fs/sync.TestServerSideCopy(0xc0006d8fc0) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:585 +0xaf testing.tRunner(0xc0006d8fc0, 0x27c29c8) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 3096 [select, 3 minutes]: net/http.(*persistConn).writeLoop(0xc0006c8c60) /usr/local/go/src/net/http/transport.go:2590 +0xe7 created by net/http.(*Transport).dialConn in goroutine 3114 /usr/local/go/src/net/http/transport.go:1945 +0x17a5 goroutine 3095 [IO wait, 3 minutes]: internal/poll.runtime_pollWait(0x746a1f6c86f0, 0x72) /usr/local/go/src/runtime/netpoll.go:351 +0x85 internal/poll.(*pollDesc).wait(0xc000454800?, 0xc00081a600?, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc000454800, {0xc00081a600, 0x1980, 0x1980}) /usr/local/go/src/internal/poll/fd_unix.go:165 +0x27a net.(*netFD).Read(0xc000454800, {0xc00081a600?, 0x192c?, 0xc0002e1d00?}) /usr/local/go/src/net/fd_posix.go:55 +0x25 net.(*conn).Read(0xc000114358, {0xc00081a600?, 0xc00081a64f?, 0x5?}) /usr/local/go/src/net/net.go:194 +0x45 github.com/rclone/rclone/fs/fshttp.(*timeoutConn).Read(0xc0007eade0, {0xc00081a600?, 0x746a1cb1ab18?, 0x746a66b67a78?}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:111 +0x29 crypto/tls.(*atLeastReader).Read(0xc000a20a08, {0xc00081a600?, 0x192c?, 0x47c27f?}) /usr/local/go/src/crypto/tls/conn.go:809 +0x3b bytes.(*Buffer).ReadFrom(0xc000649438, {0x2ad0720, 0xc000a20a08}) /usr/local/go/src/bytes/buffer.go:211 +0x98 crypto/tls.(*Conn).readFromUntil(0xc000649188, {0x746a1cacb7d8, 0xc0007eade0}, 0x1931?) /usr/local/go/src/crypto/tls/conn.go:831 +0xde crypto/tls.(*Conn).readRecordOrCCS(0xc000649188, 0x0) /usr/local/go/src/crypto/tls/conn.go:629 +0x3cf crypto/tls.(*Conn).readRecord(...) /usr/local/go/src/crypto/tls/conn.go:591 crypto/tls.(*Conn).Read(0xc000649188, {0xc000826000, 0x1000, 0x746a66b67108?}) /usr/local/go/src/crypto/tls/conn.go:1385 +0x145 net/http.(*persistConn).Read(0xc0006c8c60, {0xc000826000?, 0x412565?, 0x68?}) /usr/local/go/src/net/http/transport.go:2122 +0x47 bufio.(*Reader).fill(0xc000a6ba40) /usr/local/go/src/bufio/bufio.go:113 +0x103 bufio.(*Reader).Peek(0xc000a6ba40, 0x1) /usr/local/go/src/bufio/bufio.go:152 +0x53 net/http.(*persistConn).readLoop(0xc0006c8c60) /usr/local/go/src/net/http/transport.go:2275 +0x172 created by net/http.(*Transport).dialConn in goroutine 3114 /usr/local/go/src/net/http/transport.go:1944 +0x174f goroutine 204 [chan receive, 59 minutes]: github.com/rclone/rclone/lib/atexit.Register.func1.1() /home/rclone/go/src/github.com/rclone/rclone/lib/atexit/atexit.go:45 +0x29 created by github.com/rclone/rclone/lib/atexit.Register.func1 in goroutine 239 /home/rclone/go/src/github.com/rclone/rclone/lib/atexit/atexit.go:44 +0x68 "./sync.test -test.v -test.timeout 1h0m0s -remote TestPcloud: -verbose -fast-list" - Finished ERROR in 1h0m1.09170056s (try 2/5): exit status 2: Failed [TestCopyCheckFirst TestSyncEmptyDirectories TestSyncNoEmptyDirectories]