"./operations.test -test.v -test.timeout 1h0m0s -remote TestPikPak: -verbose" - Starting (try 3/5) 2024/12/15 05:11:55 DEBUG : Creating backend with remote "TestPikPak:rclone-test-timihoq6cezo" 2024/12/15 05:11:55 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/12/15 05:11:56 DEBUG : Saving config "captcha_token" in section "TestPikPak" of the config file 2024/12/15 05:11:57 DEBUG : Creating backend with remote "/tmp/rclone3669930317" === RUN TestDoMultiThreadCopy --- PASS: TestDoMultiThreadCopy (0.00s) === RUN TestMultithreadCalculateNumChunks === RUN TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} === RUN TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} === RUN TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} --- PASS: TestMultithreadCalculateNumChunks (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} (0.00s) === RUN TestMultithreadCopy run.go:180: Remote "PikPak root 'rclone-test-timihoq6cezo'", Local "Local file system at /tmp/rclone3669930317", Modify Window "876000h0m0s" multithread_test.go:121: multithread writing not supported 2024/12/15 05:11:58 ERROR : : error listing: directory not found --- SKIP: TestMultithreadCopy (0.30s) === RUN TestMultithreadCopyAbort run.go:180: Remote "PikPak root 'rclone-test-timihoq6cezo'", Local "Local file system at /tmp/rclone3669930317", Modify Window "876000h0m0s" multithread_test.go:121: multithread writing not supported 2024/12/15 05:11:58 ERROR : : error listing: directory not found --- SKIP: TestMultithreadCopyAbort (0.31s) === RUN TestSizeDiffers --- PASS: TestSizeDiffers (0.00s) === RUN TestReOpen === RUN TestReOpen/Normal === RUN TestReOpen/Normal/Basics 2024/12/15 05:11:58 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/ErrorAtStart === RUN TestReOpen/Normal/WithErrors 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/Normal/TooManyErrors 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2024/12/15 05:11:58 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/Normal/Seek 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2024/12/15 05:11:58 DEBUG : potato: Seek from 5 to 2 === RUN TestReOpen/Normal/AccountRead === RUN TestReOpen/Normal/AccountReadDelay 2024/12/15 05:11:58 DEBUG : potato: Seek from 10 to 0 2024/12/15 05:11:58 DEBUG : potato: Seek from 10 to 0 2024/12/15 05:11:58 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/AccountReadError === RUN TestReOpen/WithRangeOption === RUN TestReOpen/WithRangeOption/Basics 2024/12/15 05:11:58 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/ErrorAtStart === RUN TestReOpen/WithRangeOption/WithErrors 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithRangeOption/TooManyErrors 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2024/12/15 05:11:58 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithRangeOption/Seek 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2024/12/15 05:11:58 DEBUG : potato: Seek from 5 to 2 2024/12/15 05:11:58 DEBUG : potato: Seek from 7 to 4 === RUN TestReOpen/WithRangeOption/AccountRead === RUN TestReOpen/WithRangeOption/AccountReadDelay 2024/12/15 05:11:58 DEBUG : potato: Seek from 7 to 0 2024/12/15 05:11:58 DEBUG : potato: Seek from 7 to 0 2024/12/15 05:11:58 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/AccountReadError === RUN TestReOpen/WithSeekOption === RUN TestReOpen/WithSeekOption/Basics 2024/12/15 05:11:58 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/ErrorAtStart === RUN TestReOpen/WithSeekOption/WithErrors 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithSeekOption/TooManyErrors 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2024/12/15 05:11:58 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithSeekOption/Seek 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2024/12/15 05:11:58 DEBUG : potato: Seek from 5 to 2 2024/12/15 05:11:58 DEBUG : potato: Seek from 7 to 5 === RUN TestReOpen/WithSeekOption/AccountRead === RUN TestReOpen/WithSeekOption/AccountReadDelay 2024/12/15 05:11:58 DEBUG : potato: Seek from 8 to 0 2024/12/15 05:11:58 DEBUG : potato: Seek from 8 to 0 2024/12/15 05:11:58 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/AccountReadError === RUN TestReOpen/UnknownSize === RUN TestReOpen/UnknownSize/Basics 2024/12/15 05:11:58 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/ErrorAtStart === RUN TestReOpen/UnknownSize/WithErrors 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/UnknownSize/TooManyErrors 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2024/12/15 05:11:58 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/UnknownSize/Seek 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2024/12/15 05:11:58 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2024/12/15 05:11:58 DEBUG : potato: Seek from 5 to 2 2024/12/15 05:11:58 DEBUG : potato: Seek from 7 to 6 === RUN TestReOpen/UnknownSize/AccountRead === RUN TestReOpen/UnknownSize/AccountReadDelay 2024/12/15 05:11:58 DEBUG : potato: Seek from 9 to 0 2024/12/15 05:11:58 DEBUG : potato: Seek from 9 to 0 2024/12/15 05:11:58 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/AccountReadError --- PASS: TestReOpen (0.00s) --- PASS: TestReOpen/Normal (0.00s) --- PASS: TestReOpen/Normal/Basics (0.00s) --- PASS: TestReOpen/Normal/ErrorAtStart (0.00s) --- PASS: TestReOpen/Normal/WithErrors (0.00s) --- PASS: TestReOpen/Normal/TooManyErrors (0.00s) --- PASS: TestReOpen/Normal/Seek (0.00s) --- PASS: TestReOpen/Normal/AccountRead (0.00s) --- PASS: TestReOpen/Normal/AccountReadDelay (0.00s) --- PASS: TestReOpen/Normal/AccountReadError (0.00s) --- PASS: TestReOpen/WithRangeOption (0.00s) --- PASS: TestReOpen/WithRangeOption/Basics (0.00s) --- PASS: TestReOpen/WithRangeOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithRangeOption/WithErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/Seek (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountRead (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadError (0.00s) --- PASS: TestReOpen/WithSeekOption (0.00s) --- PASS: TestReOpen/WithSeekOption/Basics (0.00s) --- PASS: TestReOpen/WithSeekOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithSeekOption/WithErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/Seek (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountRead (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadError (0.00s) --- PASS: TestReOpen/UnknownSize (0.00s) --- PASS: TestReOpen/UnknownSize/Basics (0.00s) --- PASS: TestReOpen/UnknownSize/ErrorAtStart (0.00s) --- PASS: TestReOpen/UnknownSize/WithErrors (0.00s) --- PASS: TestReOpen/UnknownSize/TooManyErrors (0.00s) --- PASS: TestReOpen/UnknownSize/Seek (0.00s) --- PASS: TestReOpen/UnknownSize/AccountRead (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadDelay (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadError (0.00s) === RUN TestCheck run.go:180: Remote "PikPak root 'rclone-test-timihoq6cezo'", Local "Local file system at /tmp/rclone3669930317", Modify Window "876000h0m0s" 2024/12/15 05:11:59 DEBUG : rutabaga: calculating gcid: failed to unwrap object from src: rutabaga 2024/12/15 05:11:59 DEBUG : rutabaga: gcid = 8277717b2668765d3c4e3449b6be32223a7e3d33 === RUN TestCheck/1 === RUN TestCheck/2 2024/12/15 05:12:01 DEBUG : empty space: calculating gcid: failed to unwrap object from src: empty space 2024/12/15 05:12:01 DEBUG : empty space: gcid = 09f49478af9c899f0e74bf1a8e2ec667345a178b === RUN TestCheck/3 2024/12/15 05:12:02 DEBUG : potato2: calculating gcid: failed to unwrap object from src: potato2 2024/12/15 05:12:02 DEBUG : potato2: gcid = f284ca644cf64403b777451495ca659cc12415af === RUN TestCheck/4 === RUN TestCheck/5 2024/12/15 05:12:03 DEBUG : remotepotato: calculating gcid: failed to unwrap object from src: remotepotato 2024/12/15 05:12:03 DEBUG : remotepotato: gcid = f284ca644cf64403b777451495ca659cc12415af === RUN TestCheck/6 === RUN TestCheck/7 --- PASS: TestCheck (11.19s) --- PASS: TestCheck/1 (0.28s) --- PASS: TestCheck/2 (0.43s) --- PASS: TestCheck/3 (0.30s) --- PASS: TestCheck/4 (0.28s) --- PASS: TestCheck/5 (0.34s) --- PASS: TestCheck/6 (0.43s) --- PASS: TestCheck/7 (0.27s) === RUN TestCheckFsError 2024/12/15 05:12:09 DEBUG : Creating backend with remote "nonexistent" 2024/12/15 05:12:09 DEBUG : Creating backend with remote "nonexistent" 2024/12/15 05:12:09 DEBUG : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: Waiting for checks to finish 2024/12/15 05:12:09 ERROR : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: error reading source root directory: directory not found 2024/12/15 05:12:09 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 2 differences found 2024/12/15 05:12:09 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 2 errors while checking --- PASS: TestCheckFsError (0.00s) === RUN TestCheckDownload run.go:180: Remote "PikPak root 'rclone-test-timihoq6cezo'", Local "Local file system at /tmp/rclone3669930317", Modify Window "876000h0m0s" 2024/12/15 05:12:09 DEBUG : rutabaga: calculating gcid: failed to unwrap object from src: rutabaga 2024/12/15 05:12:09 DEBUG : rutabaga: gcid = 8277717b2668765d3c4e3449b6be32223a7e3d33 === RUN TestCheckDownload/1 === RUN TestCheckDownload/2 2024/12/15 05:12:15 DEBUG : empty space: calculating gcid: failed to unwrap object from src: empty space 2024/12/15 05:12:15 DEBUG : empty space: gcid = 09f49478af9c899f0e74bf1a8e2ec667345a178b === RUN TestCheckDownload/3 2024/12/15 05:12:17 DEBUG : potato2: calculating gcid: failed to unwrap object from src: potato2 2024/12/15 05:12:17 DEBUG : potato2: gcid = f284ca644cf64403b777451495ca659cc12415af === RUN TestCheckDownload/4 === RUN TestCheckDownload/5 panic: test timed out after 1h0m0s running tests: TestCheckDownload (59m48s) TestCheckDownload/5 (59m38s) goroutine 1356 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2366 +0x385 created by time.goFunc /usr/local/go/src/time/sleep.go:177 +0x2d goroutine 1 [chan receive, 59 minutes]: testing.(*T).Run(0xc000162ea0, {0x23f4981?, 0x0?}, 0x2516840) /usr/local/go/src/testing/testing.go:1750 +0x3ab testing.runTests.func1(0xc000162ea0) /usr/local/go/src/testing/testing.go:2161 +0x37 testing.tRunner(0xc000162ea0, 0xc000707c00) /usr/local/go/src/testing/testing.go:1689 +0xfb testing.runTests(0xc0007ee648, {0x39a6a60, 0x6c, 0x6c}, {0x3a1dd08?, 0xc000707c48?, 0x39ba660?}) /usr/local/go/src/testing/testing.go:2159 +0x445 testing.(*M).Run(0xc000316460) /usr/local/go/src/testing/testing.go:2027 +0x68b github.com/rclone/rclone/fstest.TestMain(0xc000316460) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:69 +0xa5 github.com/rclone/rclone/fs/operations_test.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:61 main.main() _testmain.go:265 +0x196 goroutine 9 [syscall, 60 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:151 +0x1f goroutine 10 [chan receive, 60 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xab goroutine 329 [chan receive (nil chan), 59 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 320 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 607 [chan receive (nil chan), 59 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 598 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 460 [chan receive, 59 minutes]: testing.(*T).Run(0xc000966340, {0x384eda8?, 0xc00006bb10?}, 0xc00031f7a0) /usr/local/go/src/testing/testing.go:1750 +0x3ab github.com/rclone/rclone/fs/operations_test.testCheck.func5(0x5, 0x1, 0x3, 0x0, 0xc0000cbe30) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:66 +0x1ba github.com/rclone/rclone/fs/operations_test.testCheck(0xc000966340, 0x2516d98) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:154 +0x158c github.com/rclone/rclone/fs/operations_test.TestCheckDownload(0xc000966340?) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:207 +0x1a testing.tRunner(0xc000966340, 0x2516840) /usr/local/go/src/testing/testing.go:1689 +0xfb created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:1742 +0x390 goroutine 377 [chan receive (nil chan), 59 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 272 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 219 [chan receive (nil chan), 60 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 210 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 498 [chan receive (nil chan), 59 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 489 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 175 [chan receive (nil chan), 60 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 166 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 562 [chan receive (nil chan), 59 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 553 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 592 [chan receive (nil chan), 59 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 583 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 278 [chan receive (nil chan), 60 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 237 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 365 [chan receive (nil chan), 59 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 356 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 253 [chan receive (nil chan), 60 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 244 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 457 [chan receive (nil chan), 59 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 384 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 712 [select]: github.com/rclone/rclone/fs/accounting.(*StatsInfo).averageLoop(0xc0002fa780) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:335 +0x156 created by github.com/rclone/rclone/fs/accounting.(*StatsInfo).startAverageLoop.func1 in goroutine 691 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:367 +0x69 goroutine 673 [semacquire, 59 minutes]: sync.runtime_Semacquire(0xc0008c6db0?) /usr/local/go/src/runtime/sema.go:62 +0x25 sync.(*WaitGroup).Wait(0xc0003b2900?) /usr/local/go/src/sync/waitgroup.go:116 +0x48 github.com/rclone/rclone/fs/operations.CheckFn({0x27d63c0, 0x3a1d7e0}, 0xc000553cf8) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:235 +0x249 github.com/rclone/rclone/fs/operations.CheckDownload({0x27d63c0?, 0x3a1d7e0?}, 0xc0000cbe90?) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:378 +0x69 github.com/rclone/rclone/fs/operations_test.testCheck.func5.1(0xc000966d00) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:79 +0x382 testing.tRunner(0xc000966d00, 0xc00031f7a0) /usr/local/go/src/testing/testing.go:1689 +0xfb created by testing.(*T).Run in goroutine 460 /usr/local/go/src/testing/testing.go:1742 +0x390 goroutine 682 [chan receive (nil chan), 59 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 673 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 690 [select]: net/http.(*Transport).getConn(0xc000426f00, 0xc00051e040, {{}, 0x0, {0xc00089d880, 0x5}, {0xc0005144a0, 0x1d}, 0x0}) /usr/local/go/src/net/http/transport.go:1406 +0x5a5 net/http.(*Transport).roundTrip(0xc000426f00, 0xc000622120) /usr/local/go/src/net/http/transport.go:595 +0x73a net/http.(*Transport).RoundTrip(...) /usr/local/go/src/net/http/roundtrip.go:17 github.com/rclone/rclone/fs/fshttp.(*Transport).RoundTrip(0xc000345c70, 0xc000622120) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/http.go:352 +0x345 golang.org/x/oauth2.(*Transport).RoundTrip(0xc000070d00, 0xc000622000) /home/rclone/go/pkg/mod/golang.org/x/oauth2@v0.24.0/transport.go:55 +0x3de net/http.send(0xc000622000, {0x27b4380, 0xc000070d00}, {0x1?, 0x3a1d7e0?, 0x0?}) /usr/local/go/src/net/http/client.go:259 +0x5e4 net/http.(*Client).send(0xc000609350, 0xc000622000, {0x0?, 0x0?, 0x0?}) /usr/local/go/src/net/http/client.go:180 +0x98 net/http.(*Client).do(0xc000609350, 0xc000622000) /usr/local/go/src/net/http/client.go:724 +0x8dc net/http.(*Client).Do(...) /usr/local/go/src/net/http/client.go:590 github.com/rclone/rclone/backend/pikpak.(*Object).httpResponse.func1() /home/rclone/go/src/github.com/rclone/rclone/backend/pikpak/pikpak.go:1718 +0x52 github.com/rclone/rclone/fs.pacerInvoker(0xa, 0xa, 0x27b14c0?) /home/rclone/go/src/github.com/rclone/rclone/fs/pacer.go:88 +0x32 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc00031e5a0, 0xc00051e000, 0xa) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:197 +0x7c github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc00031e5a0, 0xc00051e000) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:216 +0x92 github.com/rclone/rclone/backend/pikpak.(*Object).httpResponse(0xc0007d21e0, {0x27d63c0, 0x3a1d7e0}, {0xc00089d880, 0x339}, {0x23d5c23, 0x3}, {0x3a1d7e0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/pikpak/pikpak.go:1717 +0x2af github.com/rclone/rclone/backend/pikpak.(*Object).open(0xc0007d21e0?, {0x27d63c0?, 0x3a1d7e0?}, {0xc00089d880?, 0xc000530240?}, {0x3a1d7e0?, 0x4137de?, 0x7f2074e2ad38?}) /home/rclone/go/src/github.com/rclone/rclone/backend/pikpak/pikpak.go:1729 +0x4f github.com/rclone/rclone/backend/pikpak.(*Object).Open(0xc0007d21e0, {0x27d63c0, 0x3a1d7e0}, {0x3a1d7e0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/pikpak/pikpak.go:1748 +0x131 github.com/rclone/rclone/fs/operations.(*ReOpen).open(0xc0001f69a0) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/reopen.go:147 +0x109 github.com/rclone/rclone/fs/operations.NewReOpen({0x27d63c0, 0x3a1d7e0}, {0x27eadc8, 0xc0007d21e0}, 0xa, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/reopen.go:102 +0x50b github.com/rclone/rclone/fs/operations.Open({0x27d63c0, 0x3a1d7e0}, {0x27eadc8, 0xc0007d21e0}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/reopen.go:124 +0x6b github.com/rclone/rclone/fs/operations.checkIdenticalDownload({0x27d63c0, 0x3a1d7e0}, {0x27eadc8, 0xc0007d21e0}, {0x27ea5e8, 0xc0008ce6c0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:342 +0x70 github.com/rclone/rclone/fs/operations.CheckIdenticalDownload.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:333 +0x3d github.com/rclone/rclone/fs/operations.Retry({0x27d63c0, 0x3a1d7e0}, {0x235b780, 0xc0008ce6c0}, 0xa, 0xc0004a1db0) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations.go:738 +0xa5 github.com/rclone/rclone/fs/operations.CheckIdenticalDownload({0x27d63c0, 0x3a1d7e0}, {0x27eadc8, 0xc0007d21e0}, {0x27ea5e8, 0xc0008ce6c0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:332 +0x117 github.com/rclone/rclone/fs/operations.CheckDownload.func1({0x27d63c0?, 0x3a1d7e0?}, {0x27eadc8?, 0xc0007d21e0?}, {0x27ea5e8?, 0xc0008ce6c0?}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:372 +0x35 github.com/rclone/rclone/fs/operations.(*checkMarch).checkIdentical(0xc0006b4540, {0x27d63c0, 0x3a1d7e0}, {0x27eadc8, 0xc0007d21e0}, {0x27ea5e8, 0xc0008ce6c0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:137 +0x24c github.com/rclone/rclone/fs/operations.(*checkMarch).Match.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:156 +0xb0 created by github.com/rclone/rclone/fs/operations.(*checkMarch).Match in goroutine 674 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:151 +0x6e5 goroutine 1364 [IO wait]: internal/poll.runtime_pollWait(0x7f2074e232b0, 0x77) /usr/local/go/src/runtime/netpoll.go:345 +0x85 internal/poll.(*pollDesc).wait(0xc0001cc380?, 0x0?, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 internal/poll.(*pollDesc).waitWrite(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:93 internal/poll.(*FD).WaitWrite(...) /usr/local/go/src/internal/poll/fd_unix.go:683 net.(*netFD).connect(0xc0001cc380, {0x27d6548, 0xc0002de230}, {0xc00052b198?, 0x413fdb?}, {0x27b1100?, 0xc0008161e0?}) /usr/local/go/src/net/fd_unix.go:141 +0x70b net.(*netFD).dial(0xc0001cc380, {0x27d6548, 0xc0002de230}, {0x27dc3d8?, 0x0?}, {0x27dc3d8, 0xc00091a4b0}, 0x90?) /usr/local/go/src/net/sock_posix.go:124 +0x3bc net.socket({0x27d6548, 0xc0002de230}, {0x23d5c35, 0x3}, 0x2, 0x1, 0x41cefe?, 0x0, {0x27dc3d8, 0x0}, ...) /usr/local/go/src/net/sock_posix.go:70 +0x29b net.internetSocket({0x27d6548, 0xc0002de230}, {0x23d5c35, 0x3}, {0x27dc3d8, 0x0}, {0x27dc3d8, 0xc00091a4b0}, 0x1, 0x0, ...) /usr/local/go/src/net/ipsock_posix.go:154 +0xf8 net.(*sysDialer).doDialTCPProto(0xc0005486e0, {0x27d6548, 0xc0002de230}, 0x0, 0xc00091a4b0, 0x0) /usr/local/go/src/net/tcpsock_posix.go:85 +0xec net.(*sysDialer).doDialTCP(...) /usr/local/go/src/net/tcpsock_posix.go:75 net.(*sysDialer).dialTCP(0x10?, {0x27d6548?, 0xc0002de230?}, 0xc00052b4a0?, 0x5392bb?) /usr/local/go/src/net/tcpsock_posix.go:71 +0x65 net.(*sysDialer).dialSingle(0xc0005486e0, {0x27d6548, 0xc0002de230}, {0x27c3d50, 0xc00091a4b0}) /usr/local/go/src/net/dial.go:651 +0x27d net.(*sysDialer).dialSerial(0xc0005486e0, {0x27d6548, 0xc0001500e0}, {0xc0000ac700?, 0x3, 0xc0000ac700?}) /usr/local/go/src/net/dial.go:616 +0x24e net.(*sysDialer).dialParallel(0xc0000ac5c0?, {0x27d6548?, 0xc0001500e0?}, {0xc0000ac700?, 0xc0001500e0?, 0x23d6740?}, {0x0?, 0x23d5c35?, 0xc00081a030?}) /usr/local/go/src/net/dial.go:517 +0x3b4 net.(*Dialer).DialContext(0xc000342100, {0x27d63c0, 0x3a1d7e0}, {0x23d5c35, 0x3}, {0xc0005144a0, 0x1d}) /usr/local/go/src/net/dial.go:508 +0x69a github.com/rclone/rclone/fs/fshttp.(*Dialer).DialContext(0xc000342100, {0x27d63c0, 0x3a1d7e0}, {0x23d5c35?, 0x60?}, {0xc0005144a0, 0x1d}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:62 +0x125 github.com/rclone/rclone/fs/fshttp.NewTransportCustom.func1({0x27d63c0, 0x3a1d7e0}, {0x23d5c35, 0x3}, {0xc0005144a0, 0x1d}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/http.go:109 +0x65 net/http.(*Transport).dial(0x0?, {0x27d63c0?, 0x3a1d7e0?}, {0x23d5c35?, 0x0?}, {0xc0005144a0?, 0x0?}) /usr/local/go/src/net/http/transport.go:1187 +0xd2 net/http.(*Transport).dialConn(0xc000426f00, {0x27d63c0, 0x3a1d7e0}, {{}, 0x0, {0xc00089d880, 0x5}, {0xc0005144a0, 0x1d}, 0x0}) /usr/local/go/src/net/http/transport.go:1647 +0x7e8 net/http.(*Transport).dialConnFor(0xc000426f00, 0xc00042e630) /usr/local/go/src/net/http/transport.go:1484 +0xca created by net/http.(*Transport).queueForDial in goroutine 690 /usr/local/go/src/net/http/transport.go:1449 +0x3c9 goroutine 1378 [select]: net.(*netFD).connect.func2() /usr/local/go/src/net/fd_unix.go:118 +0x7a created by net.(*netFD).connect in goroutine 1364 /usr/local/go/src/net/fd_unix.go:117 +0x37c "./operations.test -test.v -test.timeout 1h0m0s -remote TestPikPak: -verbose" - Finished ERROR in 1h0m2.856599099s (try 3/5): exit status 2: Failed []