"./operations.test -test.v -test.timeout 1h0m0s -remote TestWebdavInfiniteScale: -verbose -test.run '^(TestCat|TestCheckSumDownload|TestCopyFile|TestCopyFileBackupDir|TestCopyFileCompareDest|TestCopyFileCopyDest|TestCopyFileMaxTransfer|TestCopyURL|TestMoveFile|TestMoveFileBackupDir|TestMoveFileWithIgnoreExisting|TestParseSumFile|TestRcatSize|TestReadFile|TestTouchDir)$|^TestCheckDownload$/^(1|2|3|4|5|6|7)$|^TestHashSums$/^Sha1Download$'" - Starting (try 4/5) 2026/01/23 03:44:00 DEBUG : Creating backend with remote "TestWebdavInfiniteScale:rclone-test-nuvesat2seju" 2026/01/23 03:44:00 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/01/23 03:44:00 DEBUG : Setting type="webdav" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_TYPE 2026/01/23 03:44:00 DEBUG : Setting url="https://127.0.0.1:28639/dav/spaces/some-admin-user-id-0000-100000000000" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_URL 2026/01/23 03:44:00 DEBUG : Setting vendor="infinitescale" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_VENDOR 2026/01/23 03:44:00 DEBUG : Setting user="admin" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_USER 2026/01/23 03:44:00 DEBUG : Setting pass="QddOjA6onfTIkLx42MTy88U9zvm6" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_PASS 2026/01/23 03:44:00 DEBUG : TestWebdavInfiniteScale: detected overridden config - adding "{-8o__}" suffix to name 2026/01/23 03:44:00 DEBUG : Setting url="https://127.0.0.1:28639/dav/spaces/some-admin-user-id-0000-100000000000" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_URL 2026/01/23 03:44:00 DEBUG : Setting vendor="infinitescale" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_VENDOR 2026/01/23 03:44:00 DEBUG : Setting user="admin" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_USER 2026/01/23 03:44:00 DEBUG : Setting pass="QddOjA6onfTIkLx42MTy88U9zvm6" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_PASS 2026/01/23 03:44:00 DEBUG : found headers: 2026/01/23 03:44:00 DEBUG : Creating backend with remote "/tmp/rclone1556175958" === RUN TestCheckDownload run.go:185: Remote "webdav root 'rclone-test-nuvesat2seju'", Local "Local file system at /tmp/rclone1556175958", Modify Window "1s" 2026/01/23 03:44:01 DEBUG : rutabaga: Update will use the tus protocol to upload 2026/01/23 03:44:01 INFO : rutabaga: Failed to read metadata: object not found 2026/01/23 03:44:01 DEBUG : webdav root 'rclone-test-nuvesat2seju': Uploaded starts 2026/01/23 03:44:01 DEBUG : webdav root 'rclone-test-nuvesat2seju': Uploaded chunk no 1 ok, range 0 -> 8 2026/01/23 03:44:01 DEBUG : webdav root 'rclone-test-nuvesat2seju': -- Uploaded finished === RUN TestCheckDownload/1 check_test.go:86: 1: Expecting 0 errors but got 2 check_test.go:89: 1: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "= rutabaga"} actual : []string{"", "! rutabaga"} Diff: --- Expected +++ Actual @@ -2,3 +2,3 @@ (string) "", - (string) (len=10) "= rutabaga" + (string) (len=10) "! rutabaga" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=2) { - (string) "", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) "", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error === RUN TestCheckDownload/2 check_test.go:86: 2: Expecting 1 errors but got 3 check_test.go:89: 2: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "+ potato2", "= rutabaga"} actual : []string{"", "! rutabaga", "+ potato2"} Diff: --- Expected +++ Actual @@ -2,4 +2,4 @@ (string) "", - (string) (len=9) "+ potato2", - (string) (len=10) "= rutabaga" + (string) (len=10) "! rutabaga", + (string) (len=9) "+ potato2" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=2) { - (string) "", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) "", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error 2026/01/23 03:50:29 DEBUG : pacer: Reducing sleep to 1.5s 2026/01/23 03:50:29 DEBUG : empty space: Update will use the tus protocol to upload 2026/01/23 03:50:31 DEBUG : pacer: Reducing sleep to 1.125s 2026/01/23 03:50:31 INFO : empty space: Failed to read metadata: object not found 2026/01/23 03:50:33 DEBUG : pacer: Reducing sleep to 843.75ms 2026/01/23 03:50:33 DEBUG : webdav root 'rclone-test-nuvesat2seju': Uploaded starts 2026/01/23 03:50:34 DEBUG : pacer: Reducing sleep to 632.8125ms 2026/01/23 03:50:34 DEBUG : webdav root 'rclone-test-nuvesat2seju': Uploaded chunk no 1 ok, range 0 -> 1 2026/01/23 03:50:34 DEBUG : webdav root 'rclone-test-nuvesat2seju': -- Uploaded finished 2026/01/23 03:50:35 DEBUG : pacer: Reducing sleep to 474.609375ms 2026/01/23 03:50:35 DEBUG : pacer: Reducing sleep to 355.957031ms === RUN TestCheckDownload/3 check_test.go:86: 3: Expecting 2 errors but got 4 check_test.go:89: 3: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "+ potato2", "- empty space", "= rutabaga"} actual : []string{"", "! rutabaga", "+ potato2", "- empty space"} Diff: --- Expected +++ Actual @@ -2,5 +2,5 @@ (string) "", + (string) (len=10) "! rutabaga", (string) (len=9) "+ potato2", - (string) (len=13) "- empty space", - (string) (len=10) "= rutabaga" + (string) (len=13) "- empty space" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=2) { - (string) "", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) "", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error 2026/01/23 03:53:52 DEBUG : pacer: Reducing sleep to 1.5s 2026/01/23 03:53:52 DEBUG : potato2: Update will use the tus protocol to upload 2026/01/23 03:53:54 DEBUG : pacer: Reducing sleep to 1.125s 2026/01/23 03:53:54 INFO : potato2: Failed to read metadata: object not found 2026/01/23 03:53:56 DEBUG : pacer: Reducing sleep to 843.75ms 2026/01/23 03:53:56 DEBUG : webdav root 'rclone-test-nuvesat2seju': Uploaded starts 2026/01/23 03:53:57 DEBUG : pacer: Reducing sleep to 632.8125ms 2026/01/23 03:53:57 DEBUG : webdav root 'rclone-test-nuvesat2seju': Uploaded chunk no 1 ok, range 0 -> 60 2026/01/23 03:53:57 DEBUG : webdav root 'rclone-test-nuvesat2seju': -- Uploaded finished 2026/01/23 03:53:58 DEBUG : pacer: Reducing sleep to 474.609375ms 2026/01/23 03:53:58 DEBUG : pacer: Reducing sleep to 355.957031ms === RUN TestCheckDownload/4 check_test.go:86: 4: Expecting 1 errors but got 5 check_test.go:89: 4: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "- empty space", "= potato2", "= rutabaga"} actual : []string{"", "! potato2", "! rutabaga", "- empty space"} Diff: --- Expected +++ Actual @@ -2,5 +2,5 @@ (string) "", - (string) (len=13) "- empty space", - (string) (len=9) "= potato2", - (string) (len=10) "= rutabaga" + (string) (len=9) "! potato2", + (string) (len=10) "! rutabaga", + (string) (len=13) "- empty space" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "potato2", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,5 +1,2 @@ -([]string) (len=3) { - (string) "", - (string) (len=7) "potato2", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "potato2", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,5 @@ -([]string) { +([]string) (len=3) { + (string) "", + (string) (len=7) "potato2", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error === RUN TestCheckDownload/5 check_test.go:86: 5: Expecting 1 errors but got 5 check_test.go:89: 5: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "* empty space", "= potato2", "= rutabaga"} actual : []string{"", "! potato2", "! rutabaga", "* empty space"} Diff: --- Expected +++ Actual @@ -2,5 +2,5 @@ (string) "", - (string) (len=13) "* empty space", - (string) (len=9) "= potato2", - (string) (len=10) "= rutabaga" + (string) (len=9) "! potato2", + (string) (len=10) "! rutabaga", + (string) (len=13) "* empty space" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "potato2", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,5 +1,2 @@ -([]string) (len=3) { - (string) "", - (string) (len=7) "potato2", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "potato2", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,5 @@ -([]string) { +([]string) (len=3) { + (string) "", + (string) (len=7) "potato2", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error 2026/01/23 04:07:17 DEBUG : pacer: Reducing sleep to 1.5s 2026/01/23 04:07:17 DEBUG : remotepotato: Update will use the tus protocol to upload 2026/01/23 04:07:19 DEBUG : pacer: Reducing sleep to 1.125s 2026/01/23 04:07:19 INFO : remotepotato: Failed to read metadata: object not found 2026/01/23 04:07:20 DEBUG : pacer: Reducing sleep to 843.75ms 2026/01/23 04:07:20 DEBUG : webdav root 'rclone-test-nuvesat2seju': Uploaded starts 2026/01/23 04:07:22 DEBUG : pacer: Reducing sleep to 632.8125ms 2026/01/23 04:07:22 DEBUG : webdav root 'rclone-test-nuvesat2seju': Uploaded chunk no 1 ok, range 0 -> 60 2026/01/23 04:07:22 DEBUG : webdav root 'rclone-test-nuvesat2seju': -- Uploaded finished 2026/01/23 04:08:10 DEBUG : pacer: Reducing sleep to 474.609375ms 2026/01/23 04:20:35 DEBUG : pacer: low level retry 1/10 (error Propfind "https://127.0.0.1:28639/dav/spaces/some-admin-user-id-0000-100000000000/rclone-test-nuvesat2seju/": net/http: timeout awaiting response headers) 2026/01/23 04:20:35 DEBUG : pacer: Rate limited, increasing sleep to 949.21875ms 2026/01/23 04:20:36 DEBUG : pacer: Reducing sleep to 711.914062ms === RUN TestCheckDownload/6 check_test.go:86: 6: Expecting 2 errors but got 6 check_test.go:89: 6: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "* empty space", "- remotepotato", "= potato2", "= rutabaga"} actual : []string{"", "! potato2", "! rutabaga", "* empty space", "- remotepotato"} Diff: --- Expected +++ Actual @@ -2,6 +2,6 @@ (string) "", + (string) (len=9) "! potato2", + (string) (len=10) "! rutabaga", (string) (len=13) "* empty space", - (string) (len=14) "- remotepotato", - (string) (len=9) "= potato2", - (string) (len=10) "= rutabaga" + (string) (len=14) "- remotepotato" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "potato2", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,5 +1,2 @@ -([]string) (len=3) { - (string) "", - (string) (len=7) "potato2", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "potato2", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,5 @@ -([]string) { +([]string) (len=3) { + (string) "", + (string) (len=7) "potato2", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error === RUN TestCheckDownload/7 panic: test timed out after 1h0m0s running tests: TestCheckDownload (1h0m39s) TestCheckDownload/7 (17m27s) goroutine 1415 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2484 +0x394 created by time.goFunc /usr/local/go/src/time/sleep.go:215 +0x2d goroutine 1 [chan receive, 60 minutes]: testing.(*T).Run(0xc000487180, {0x28f4f6a?, 0xc000361ad8?}, 0x2a2b2f0) /usr/local/go/src/testing/testing.go:1859 +0x431 testing.runTests.func1(0xc000487180) /usr/local/go/src/testing/testing.go:2279 +0x37 testing.tRunner(0xc000487180, 0xc000361c18) /usr/local/go/src/testing/testing.go:1792 +0xf4 testing.runTests(0xc000363d88, {0x43b8b20, 0x6f, 0x6f}, {0xee104e580?, 0x43cf460?, 0x43cf460?}) /usr/local/go/src/testing/testing.go:2277 +0x4b4 testing.(*M).Run(0xc0006f3720) /usr/local/go/src/testing/testing.go:2142 +0x64a github.com/rclone/rclone/fstest.TestMain(0xc0006f3720) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:74 +0xa6 github.com/rclone/rclone/fs/operations_test.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:61 main.main() _testmain.go:269 +0xa9 goroutine 482 [chan receive, 50 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 15 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 8 [syscall, 60 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:152 +0x1f goroutine 9 [chan receive, 60 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 15 [chan receive, 18 minutes]: testing.(*T).Run(0xc000487340, {0x2e20118?, 0xc000687f30?}, 0xc00058a360) /usr/local/go/src/testing/testing.go:1859 +0x431 github.com/rclone/rclone/fs/operations_test.testCheck.func5(...) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:65 github.com/rclone/rclone/fs/operations_test.testCheck(0xc000487340, 0x2a2b900) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:170 +0x22a5 github.com/rclone/rclone/fs/operations_test.TestCheckDownload(0xc000487340?) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:204 +0x1a testing.tRunner(0xc000487340, 0x2a2b2f0) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 1399 [chan receive]: net/http.(*persistConn).addTLS(0xc000544d80, {0x2dc4fa0, 0xc00039b040}, {0xc000784400, 0x9}, 0x0) /usr/local/go/src/net/http/transport.go:1714 +0x3ab net/http.(*Transport).dialConn(0xc000759040, {0x2dc4fa0, 0xc00039b040}, {{}, 0x0, {0xc000595260, 0x5}, {0xc000784400, 0xf}, 0x0}) /usr/local/go/src/net/http/transport.go:1790 +0x99c net/http.(*Transport).dialConnFor(0xc000759040, 0xc00019de40) /usr/local/go/src/net/http/transport.go:1615 +0xb8 net/http.(*Transport).startDialConnForLocked.func1() /usr/local/go/src/net/http/transport.go:1597 +0x35 created by net/http.(*Transport).startDialConnForLocked in goroutine 1208 /usr/local/go/src/net/http/transport.go:1596 +0x112 goroutine 1245 [runnable]: crypto/internal/sysrand.Read({0xc0007182e0?, 0x20?, 0x20?}) /usr/local/go/src/crypto/internal/sysrand/rand.go:34 +0x14d crypto/rand.(*reader).Read(0x0?, {0xc0007182e0, 0x20, 0x20}) /usr/local/go/src/crypto/rand/rand.go:50 +0x65 io.ReadAtLeast({0x2d9c620, 0xc00011cdd0}, {0xc0007182e0, 0x20, 0x20}, 0x20) /usr/local/go/src/io/io.go:335 +0x91 io.ReadFull(...) /usr/local/go/src/io/io.go:354 crypto/tls.(*Conn).makeClientHello(0xc000586008) /usr/local/go/src/crypto/tls/handshake_client.go:117 +0x6b6 crypto/tls.(*Conn).clientHandshake(0xc000586008, {0x2dc4fa0, 0xc0000f73b0}) /usr/local/go/src/crypto/tls/handshake_client.go:275 +0x7d crypto/tls.(*Conn).handshakeContext(0xc000586008, {0x2dc4fa0, 0xc00039b040}) /usr/local/go/src/crypto/tls/conn.go:1568 +0x39a crypto/tls.(*Conn).HandshakeContext(...) /usr/local/go/src/crypto/tls/conn.go:1508 net/http.(*persistConn).addTLS.func2() /usr/local/go/src/net/http/transport.go:1703 +0x6e created by net/http.(*persistConn).addTLS in goroutine 1399 /usr/local/go/src/net/http/transport.go:1699 +0x309 goroutine 69 [chan receive, 60 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 15 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 100 [chan receive (nil chan), 60 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 90 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1221 [select, 12 minutes]: github.com/rclone/rclone/fs/accounting.(*StatsInfo).averageLoop(0xc0005841e0, {0x2dc4fa0, 0xc00037e780}) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:352 +0x145 created by github.com/rclone/rclone/fs/accounting.(*StatsInfo)._startAverageLoop in goroutine 1220 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:389 +0x11a goroutine 1208 [select, 12 minutes]: net/http.(*Transport).getConn(0xc000759040, 0xc00039aff0, {{}, 0x0, {0xc000595260, 0x5}, {0xc000784400, 0xf}, 0x0}) /usr/local/go/src/net/http/transport.go:1520 +0x4ae net/http.(*Transport).roundTrip(0xc000759040, 0xc0004fc8c0) /usr/local/go/src/net/http/transport.go:685 +0xb57 net/http.(*Transport).RoundTrip(...) /usr/local/go/src/net/http/roundtrip.go:30 github.com/rclone/rclone/fs/fshttp.(*Transport).RoundTrip(0xc0004814a0, 0xc0004fc8c0) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/http.go:496 +0x345 net/http.send(0xc0004fc8c0, {0x2d9c4c0, 0xc0004814a0}, {0x6fe201?, 0xc000595268?, 0x0?}) /usr/local/go/src/net/http/client.go:259 +0x5e2 net/http.(*Client).send(0xc0004d3c20, 0xc0004fc8c0, {0x52?, 0x18006a7100?, 0x0?}) /usr/local/go/src/net/http/client.go:180 +0x91 net/http.(*Client).do(0xc0004d3c20, 0xc0004fc8c0) /usr/local/go/src/net/http/client.go:728 +0x989 net/http.(*Client).Do(...) /usr/local/go/src/net/http/client.go:587 github.com/rclone/rclone/lib/rest.(*Client).Call(0xc0000f62d0, {0x2dc4e88, 0x43f2c80}, 0xc0006678c0) /home/rclone/go/src/github.com/rclone/rclone/lib/rest/rest.go:356 +0xd67 github.com/rclone/rclone/backend/webdav.(*Object).Open.func1() /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/webdav.go:1527 +0x52 github.com/rclone/rclone/fs.pacerInvoker(0x4, 0xa, 0x2d9b800?) /home/rclone/go/src/github.com/rclone/rclone/fs/pacer.go:86 +0x32 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc000481440, 0xc0007a64c0, 0xa) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:216 +0xd2 github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc000481440, 0xc0007a64c0) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:235 +0x93 github.com/rclone/rclone/backend/webdav.(*Object).Open(0xc0012a8e40, {0x2dc4e88, 0x43f2c80}, {0x43f2c80, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/webdav.go:1526 +0x2b8 github.com/rclone/rclone/fs/operations.(*ReOpen).open(0xc000658000) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/reopen.go:148 +0x109 github.com/rclone/rclone/fs/operations.NewReOpen({0x2dc4e88, 0x43f2c80}, {0x2ddecc0, 0xc0012a8e40}, 0xa, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/reopen.go:103 +0x4fb github.com/rclone/rclone/fs/operations.Open({0x2dc4e88, 0x43f2c80}, {0x2ddecc0, 0xc0012a8e40}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/reopen.go:125 +0x6b github.com/rclone/rclone/fs/operations.checkIdenticalDownload({0x2dc4e88, 0x43f2c80}, {0x2ddd280, 0xc0012a8ba0}, {0x2ddecc0, 0xc0012a8e40}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:342 +0x76 github.com/rclone/rclone/fs/operations.CheckIdenticalDownload.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:333 +0x3d github.com/rclone/rclone/fs/operations.Retry({0x2dc4e88, 0x43f2c80}, {0x284bde0, 0xc0012a8ba0}, 0xa, 0xc0006a7d90) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations.go:742 +0xa5 github.com/rclone/rclone/fs/operations.CheckIdenticalDownload({0x2dc4e88, 0x43f2c80}, {0x2ddd280, 0xc0012a8ba0}, {0x2ddecc0, 0xc0012a8e40}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:332 +0xf3 github.com/rclone/rclone/fs/operations.CheckDownload.func1({0x2dc4e88?, 0x43f2c80?}, {0x2ddecc0?, 0xc0012a8e40?}, {0x2ddd280, 0xc0012a8ba0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:372 +0x53 github.com/rclone/rclone/fs/operations.(*checkMarch).checkIdentical(0xc000796000, {0x2dc4e88, 0x43f2c80}, {0x2ddecc0, 0xc0012a8e40}, {0x2ddd280, 0xc0012a8ba0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:137 +0x22c github.com/rclone/rclone/fs/operations.(*checkMarch).Match.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:156 +0xa7 created by github.com/rclone/rclone/fs/operations.(*checkMarch).Match in goroutine 1222 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:151 +0x5df goroutine 1230 [chan receive (nil chan), 18 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1220 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1207 [runnable]: crypto/tls.init.func1() /usr/local/go/src/crypto/tls/conn.go:967 sync.(*Pool).Get(0x4387260) /usr/local/go/src/sync/pool.go:155 +0xb1 crypto/tls.(*Conn).writeRecordLocked(0xc000586388, 0x15, {0xc0005866ec, 0x2, 0x10}) /usr/local/go/src/crypto/tls/conn.go:988 +0x3b3 crypto/tls.(*Conn).sendAlertLocked(0xc000586388, 0x0) /usr/local/go/src/crypto/tls/conn.go:849 +0xbf crypto/tls.(*Conn).closeNotify(0xc000586388) /usr/local/go/src/crypto/tls/conn.go:1470 +0xc7 crypto/tls.(*Conn).Close(0x4030000000000000?) /usr/local/go/src/crypto/tls/conn.go:1439 +0x66 net/http.(*persistConn).closeLocked(0xc000544000, {0x2d9c060, 0x433b3e0}) /usr/local/go/src/net/http/transport.go:2919 +0x12b net/http.(*persistConn).close(0xc000572ad8?, {0x2d9c060?, 0x433b3e0?}) /usr/local/go/src/net/http/transport.go:2904 +0xa5 net/http.(*persistConn).roundTrip(0xc000544000, 0xc0000f72c0) /usr/local/go/src/net/http/transport.go:2860 +0xb1c net/http.(*Transport).roundTrip(0xc000759040, 0xc00028ef00) /usr/local/go/src/net/http/transport.go:696 +0xb9a net/http.(*Transport).RoundTrip(...) /usr/local/go/src/net/http/roundtrip.go:30 github.com/rclone/rclone/fs/fshttp.(*Transport).RoundTrip(0xc0004814a0, 0xc00028ef00) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/http.go:496 +0x345 net/http.send(0xc00028ef00, {0x2d9c4c0, 0xc0004814a0}, {0x6fe201?, 0xc000662fc8?, 0x0?}) /usr/local/go/src/net/http/client.go:259 +0x5e2 net/http.(*Client).send(0xc0004d3c20, 0xc00028ef00, {0x51?, 0x1?, 0x0?}) /usr/local/go/src/net/http/client.go:180 +0x91 net/http.(*Client).do(0xc0004d3c20, 0xc00028ef00) /usr/local/go/src/net/http/client.go:728 +0x989 net/http.(*Client).Do(...) /usr/local/go/src/net/http/client.go:587 github.com/rclone/rclone/lib/rest.(*Client).Call(0xc0000f62d0, {0x2dc4e88, 0x43f2c80}, 0xc00017b8c0) /home/rclone/go/src/github.com/rclone/rclone/lib/rest/rest.go:356 +0xd67 github.com/rclone/rclone/backend/webdav.(*Object).Open.func1() /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/webdav.go:1527 +0x52 github.com/rclone/rclone/fs.pacerInvoker(0x3, 0xa, 0xc00057c340?) /home/rclone/go/src/github.com/rclone/rclone/fs/pacer.go:86 +0x32 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc000481440, 0xc00057c340, 0xa) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:216 +0xd2 github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc000481440, 0xc00057c340) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:235 +0x93 github.com/rclone/rclone/backend/webdav.(*Object).Open(0xc0012a8de0, {0x2dc4e88, 0x43f2c80}, {0x43f2c80, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/webdav.go:1526 +0x2b8 github.com/rclone/rclone/fs/operations.(*ReOpen).open(0xc000248d20) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/reopen.go:148 +0x109 github.com/rclone/rclone/fs/operations.NewReOpen({0x2dc4e88, 0x43f2c80}, {0x2ddecc0, 0xc0012a8de0}, 0xa, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/reopen.go:103 +0x4fb github.com/rclone/rclone/fs/operations.Open({0x2dc4e88, 0x43f2c80}, {0x2ddecc0, 0xc0012a8de0}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/reopen.go:125 +0x6b github.com/rclone/rclone/fs/operations.checkIdenticalDownload({0x2dc4e88, 0x43f2c80}, {0x2ddd280, 0xc0012a8b40}, {0x2ddecc0, 0xc0012a8de0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:342 +0x76 github.com/rclone/rclone/fs/operations.CheckIdenticalDownload.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:333 +0x3d github.com/rclone/rclone/fs/operations.Retry({0x2dc4e88, 0x43f2c80}, {0x284bde0, 0xc0012a8b40}, 0xa, 0xc00006bd90) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations.go:742 +0xa5 github.com/rclone/rclone/fs/operations.CheckIdenticalDownload({0x2dc4e88, 0x43f2c80}, {0x2ddd280, 0xc0012a8b40}, {0x2ddecc0, 0xc0012a8de0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:332 +0xf3 github.com/rclone/rclone/fs/operations.CheckDownload.func1({0x2dc4e88?, 0x43f2c80?}, {0x2ddecc0?, 0xc0012a8de0?}, {0x2ddd280, 0xc0012a8b40}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:372 +0x53 github.com/rclone/rclone/fs/operations.(*checkMarch).checkIdentical(0xc000796000, {0x2dc4e88, 0x43f2c80}, {0x2ddecc0, 0xc0012a8de0}, {0x2ddd280, 0xc0012a8b40}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:137 +0x22c github.com/rclone/rclone/fs/operations.(*checkMarch).Match.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:156 +0xa7 created by github.com/rclone/rclone/fs/operations.(*checkMarch).Match in goroutine 1222 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:151 +0x5df goroutine 320 [chan receive, 54 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 15 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 517 [chan receive (nil chan), 50 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 427 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 949 [chan receive, 37 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 15 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 238 [chan receive (nil chan), 58 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 228 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 364 [chan receive (nil chan), 54 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 354 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1400 [select]: crypto/tls.(*Conn).handshakeContext.func2() /usr/local/go/src/crypto/tls/conn.go:1544 +0x86 created by crypto/tls.(*Conn).handshakeContext in goroutine 1245 /usr/local/go/src/crypto/tls/conn.go:1543 +0x27b goroutine 771 [chan receive (nil chan), 44 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 761 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1220 [sync.WaitGroup.Wait, 18 minutes]: sync.runtime_SemacquireWaitGroup(0xc000597978?) /usr/local/go/src/runtime/sema.go:110 +0x25 sync.(*WaitGroup).Wait(0xc000050a20?) /usr/local/go/src/sync/waitgroup.go:118 +0x48 github.com/rclone/rclone/fs/operations.CheckFn({0x2dc4e88, 0x43f2c80}, 0xc000687c08) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:235 +0x249 github.com/rclone/rclone/fs/operations.CheckDownload({0x2dc4e88?, 0x43f2c80?}, 0xc00019ddc8?) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check.go:383 +0x69 github.com/rclone/rclone/fs/operations_test.testCheck.testCheck.func5.func12.1() /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:75 +0x2f github.com/rclone/rclone/cmd/bisync/bilib.CaptureOutput(0xc000687e58) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bilib/output.go:26 +0xfb github.com/rclone/rclone/fs/operations_test.testCheck.testCheck.func5.func12(0xc000360a80) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:74 +0x1f7 testing.tRunner(0xc000360a80, 0xc00058a360) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 15 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 996 [sync.Mutex.Lock]: internal/sync.runtime_SemacquireMutex(0xc000425000?, 0xa5?, 0x0?) /usr/local/go/src/runtime/sema.go:95 +0x25 internal/sync.(*Mutex).lockSlow(0xc0005440d8) /usr/local/go/src/internal/sync/mutex.go:149 +0x15d internal/sync.(*Mutex).Lock(...) /usr/local/go/src/internal/sync/mutex.go:70 sync.(*Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:46 net/http.(*persistConn).readLoop(0xc000544000) /usr/local/go/src/net/http/transport.go:2277 +0x1b2 created by net/http.(*Transport).dialConn in goroutine 960 /usr/local/go/src/net/http/transport.go:1944 +0x174f goroutine 997 [select]: net/http.(*persistConn).writeLoop(0xc000544000) /usr/local/go/src/net/http/transport.go:2590 +0xe7 created by net/http.(*Transport).dialConn in goroutine 960 /usr/local/go/src/net/http/transport.go:1945 +0x17a5 goroutine 1008 [chan receive (nil chan), 24 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 998 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 "./operations.test -test.v -test.timeout 1h0m0s -remote TestWebdavInfiniteScale: -verbose -test.run '^(TestCat|TestCheckSumDownload|TestCopyFile|TestCopyFileBackupDir|TestCopyFileCompareDest|TestCopyFileCopyDest|TestCopyFileMaxTransfer|TestCopyURL|TestMoveFile|TestMoveFileBackupDir|TestMoveFileWithIgnoreExisting|TestParseSumFile|TestRcatSize|TestReadFile|TestTouchDir)$|^TestCheckDownload$/^(1|2|3|4|5|6|7)$|^TestHashSums$/^Sha1Download$'" - Finished ERROR in 1h0m39.306721094s (try 4/5): exit status 2: Failed [TestCheckDownload/1 TestCheckDownload/2 TestCheckDownload/3 TestCheckDownload/4 TestCheckDownload/5 TestCheckDownload/6 TestCheckDownload/7 TestParseSumFile TestCheckSumDownload TestCopyFile TestCopyFileBackupDir TestCopyFileCompareDest TestCopyFileCopyDest TestCopyFileMaxTransfer TestHashSums/Sha1Download TestReadFile TestCat TestCopyURL TestMoveFile TestMoveFileWithIgnoreExisting TestMoveFileBackupDir TestRcatSize TestTouchDir]