"./operations.test -test.v -test.timeout 1h0m0s -remote TestPcloud: -verbose -test.run '^TestMultithreadCopy$/^(upload=true,size=134217727,streams=2|upload=true,size=134217728,streams=2|upload=true,size=134217729,streams=2)$|^TestMultithreadCopyAbort$'" - Starting (try 3/5) 2025/05/07 06:36:13 DEBUG : Creating backend with remote "TestPcloud:rclone-test-rudeyil3dotu" 2025/05/07 06:36:13 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/05/07 06:36:14 DEBUG : Creating backend with remote "/tmp/rclone1542105560" === RUN TestMultithreadCopy run.go:180: Remote "pcloud root 'rclone-test-rudeyil3dotu'", Local "Local file system at /tmp/rclone1542105560", Modify Window "1s" === RUN TestMultithreadCopy/upload=true,size=134217727,streams=2 2025/05/07 06:36:26 DEBUG : test-multithread-copy-true-134217727-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt multithread_test.go:220: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:220 Error: Received unexpected error: multi-thread copy: failed to open chunk writer: open file: open new file descriptor: pcloud error: Access denied. You do not have permissions to perform this operation. (2003) Test: TestMultithreadCopy/upload=true,size=134217727,streams=2 === RUN TestMultithreadCopy/upload=true,size=134217728,streams=2 fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:189 Error: Should be true Test: TestMultithreadCopy/upload=true,size=134217728,streams=2 Messages: listing wrong, want test-multithread-copy-true-134217728-2 (134217728) got test-multithread-copy-true-134217727-2 (134217727), test-multithread-copy-true-134217728-2 (134217728) fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:189 Error: Should be true Test: TestMultithreadCopy/upload=true,size=134217728,streams=2 Messages: Unexpected file "test-multithread-copy-true-134217727-2" 2025/05/07 06:36:46 DEBUG : test-multithread-copy-true-134217728-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt multithread_test.go:220: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:220 Error: Received unexpected error: multi-thread copy: failed to open chunk writer: open file: open new file descriptor: pcloud error: Access denied. You do not have permissions to perform this operation. (2003) Test: TestMultithreadCopy/upload=true,size=134217728,streams=2 === RUN TestMultithreadCopy/upload=true,size=134217729,streams=2 fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:189 Error: Should be true Test: TestMultithreadCopy/upload=true,size=134217729,streams=2 Messages: listing wrong, want test-multithread-copy-true-134217729-2 (134217729) got test-multithread-copy-true-134217727-2 (134217727), test-multithread-copy-true-134217728-2 (134217728), test-multithread-copy-true-134217729-2 (134217729) fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:189 Error: Should be true Test: TestMultithreadCopy/upload=true,size=134217729,streams=2 Messages: Unexpected file "test-multithread-copy-true-134217727-2" fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:189 Error: Should be true Test: TestMultithreadCopy/upload=true,size=134217729,streams=2 Messages: Unexpected file "test-multithread-copy-true-134217728-2" 2025/05/07 06:37:05 DEBUG : test-multithread-copy-true-134217729-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt multithread_test.go:220: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:220 Error: Received unexpected error: multi-thread copy: failed to open chunk writer: open file: open new file descriptor: pcloud error: Access denied. You do not have permissions to perform this operation. (2003) Test: TestMultithreadCopy/upload=true,size=134217729,streams=2 --- FAIL: TestMultithreadCopy (50.94s) --- FAIL: TestMultithreadCopy/upload=true,size=134217727,streams=2 (12.51s) --- FAIL: TestMultithreadCopy/upload=true,size=134217728,streams=2 (19.04s) --- FAIL: TestMultithreadCopy/upload=true,size=134217729,streams=2 (19.22s) === RUN TestMultithreadCopyAbort run.go:180: Remote "pcloud root 'rclone-test-rudeyil3dotu'", Local "Local file system at /tmp/rclone1542105560", Modify Window "1s" 2025/05/07 06:42:05 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=test-multithread-abort&folderid=16757909716&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/05/07 06:42:05 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/05/07 06:42:05 DEBUG : pacer: Reducing sleep to 15ms 2025/05/07 06:42:06 DEBUG : pacer: Reducing sleep to 11.25ms 2025/05/07 06:42:08 DEBUG : pacer: Reducing sleep to 10ms run.go:281: Retry Put of "test-multithread-abort" to pcloud root 'rclone-test-rudeyil3dotu': 1/10 (Put "https://eapi.pcloud.com/uploadfile?filename=test-multithread-abort&folderid=16757909716&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/05/07 06:47:13 DEBUG : pacer: low level retry 1/1 (error Put "https://eapi.pcloud.com/uploadfile?filename=test-multithread-abort&folderid=16757909716&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) 2025/05/07 06:47:13 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/05/07 06:47:13 DEBUG : pacer: Reducing sleep to 15ms 2025/05/07 06:47:14 DEBUG : pacer: Reducing sleep to 11.25ms 2025/05/07 06:47:15 DEBUG : pacer: Reducing sleep to 10ms run.go:281: Retry Put of "test-multithread-abort" to pcloud root 'rclone-test-rudeyil3dotu': 2/10 (Put "https://eapi.pcloud.com/uploadfile?filename=test-multithread-abort&folderid=16757909716&mtime=981173106&nopartial=1": net/http: timeout awaiting response headers) fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Flushing the directory cache fstest.go:286: Sleeping for 6s just to make sure 2025/05/07 06:49:18 DEBUG : test-multithread-abort: multi-thread copy: disabling buffering because destination uses OpenWriterAt fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Flushing the directory cache fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Flushing the directory cache fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:295: Flushing the directory cache fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:327 Error: Should be true Test: TestMultithreadCopyAbort Messages: listing wrong, want got test-multithread-abort (100) fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:327 Error: Should be true Test: TestMultithreadCopyAbort Messages: Unexpected file "test-multithread-abort" --- FAIL: TestMultithreadCopyAbort (742.11s) FAIL 2025/05/07 06:49:27 DEBUG : pcloud root 'rclone-test-rudeyil3dotu': Purge remote "./operations.test -test.v -test.timeout 1h0m0s -remote TestPcloud: -verbose -test.run '^TestMultithreadCopy$/^(upload=true,size=134217727,streams=2|upload=true,size=134217728,streams=2|upload=true,size=134217729,streams=2)$|^TestMultithreadCopyAbort$'" - Finished ERROR in 13m13.773049992s (try 3/5): exit status 1: Failed [TestMultithreadCopy/upload=true,size=134217727,streams=2 TestMultithreadCopy/upload=true,size=134217728,streams=2 TestMultithreadCopy/upload=true,size=134217729,streams=2 TestMultithreadCopyAbort]