"./operations.test -test.v -test.timeout 1h0m0s -remote TestWebdavInfiniteScale: -verbose -test.run '^(TestCat|TestCheckSumDownload|TestCopyFile|TestCopyFileBackupDir|TestCopyFileCompareDest|TestCopyFileCopyDest|TestCopyFileMaxTransfer|TestCopyURL|TestMoveFile|TestMoveFileBackupDir|TestMoveFileWithIgnoreExisting|TestParseSumFile|TestRcatSize|TestReadFile|TestTouchDir)$|^TestCheckDownload$/^(1|2|3|4|5|6|7)$|^TestHashSums$/^Sha1Download$'" - Starting (try 2/5) 2026/01/28 04:42:26 DEBUG : Creating backend with remote "TestWebdavInfiniteScale:rclone-test-rogubek8xoze" 2026/01/28 04:42:26 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/01/28 04:42:26 DEBUG : Setting type="webdav" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_TYPE 2026/01/28 04:42:26 DEBUG : Setting url="https://127.0.0.1:28639/dav/spaces/some-admin-user-id-0000-100000000000" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_URL 2026/01/28 04:42:26 DEBUG : Setting vendor="infinitescale" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_VENDOR 2026/01/28 04:42:26 DEBUG : Setting user="admin" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_USER 2026/01/28 04:42:26 DEBUG : Setting pass="6zPupCBG3B0t7IL59oMnpjPGitO5" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_PASS 2026/01/28 04:42:26 DEBUG : TestWebdavInfiniteScale: detected overridden config - adding "{Elz0p}" suffix to name 2026/01/28 04:42:26 DEBUG : Setting url="https://127.0.0.1:28639/dav/spaces/some-admin-user-id-0000-100000000000" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_URL 2026/01/28 04:42:26 DEBUG : Setting vendor="infinitescale" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_VENDOR 2026/01/28 04:42:26 DEBUG : Setting user="admin" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_USER 2026/01/28 04:42:26 DEBUG : Setting pass="6zPupCBG3B0t7IL59oMnpjPGitO5" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_PASS 2026/01/28 04:42:26 DEBUG : found headers: 2026/01/28 04:42:26 DEBUG : Creating backend with remote "/tmp/rclone796671227" === RUN TestCheckDownload run.go:185: Remote "webdav root 'rclone-test-rogubek8xoze'", Local "Local file system at /tmp/rclone796671227", Modify Window "1s" 2026/01/28 04:42:26 DEBUG : rutabaga: Update will use the tus protocol to upload 2026/01/28 04:42:26 INFO : rutabaga: Failed to read metadata: object not found 2026/01/28 04:42:26 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded starts 2026/01/28 04:42:26 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded chunk no 1 ok, range 0 -> 8 2026/01/28 04:42:26 DEBUG : webdav root 'rclone-test-rogubek8xoze': -- Uploaded finished === RUN TestCheckDownload/1 check_test.go:86: 1: Expecting 0 errors but got 2 check_test.go:89: 1: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "= rutabaga"} actual : []string{"", "! rutabaga"} Diff: --- Expected +++ Actual @@ -2,3 +2,3 @@ (string) "", - (string) (len=10) "= rutabaga" + (string) (len=10) "! rutabaga" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=2) { - (string) "", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) "", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error === RUN TestCheckDownload/2 check_test.go:86: 2: Expecting 1 errors but got 3 check_test.go:89: 2: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "+ potato2", "= rutabaga"} actual : []string{"", "! rutabaga", "+ potato2"} Diff: --- Expected +++ Actual @@ -2,4 +2,4 @@ (string) "", - (string) (len=9) "+ potato2", - (string) (len=10) "= rutabaga" + (string) (len=10) "! rutabaga", + (string) (len=9) "+ potato2" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=2) { - (string) "", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) "", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error 2026/01/28 04:48:55 DEBUG : pacer: Reducing sleep to 1.5s 2026/01/28 04:48:55 DEBUG : empty space: Update will use the tus protocol to upload 2026/01/28 04:48:57 DEBUG : pacer: Reducing sleep to 1.125s 2026/01/28 04:48:57 INFO : empty space: Failed to read metadata: object not found 2026/01/28 04:48:58 DEBUG : pacer: Reducing sleep to 843.75ms 2026/01/28 04:48:58 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded starts 2026/01/28 04:48:59 DEBUG : pacer: Reducing sleep to 632.8125ms 2026/01/28 04:48:59 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded chunk no 1 ok, range 0 -> 1 2026/01/28 04:48:59 DEBUG : webdav root 'rclone-test-rogubek8xoze': -- Uploaded finished 2026/01/28 04:49:00 DEBUG : pacer: Reducing sleep to 474.609375ms 2026/01/28 04:49:01 DEBUG : pacer: Reducing sleep to 355.957031ms === RUN TestCheckDownload/3 check_test.go:86: 3: Expecting 2 errors but got 4 check_test.go:89: 3: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "+ potato2", "- empty space", "= rutabaga"} actual : []string{"", "! rutabaga", "+ potato2", "- empty space"} Diff: --- Expected +++ Actual @@ -2,5 +2,5 @@ (string) "", + (string) (len=10) "! rutabaga", (string) (len=9) "+ potato2", - (string) (len=13) "- empty space", - (string) (len=10) "= rutabaga" + (string) (len=13) "- empty space" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=2) { - (string) "", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) "", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error 2026/01/28 04:52:18 DEBUG : pacer: Reducing sleep to 1.5s 2026/01/28 04:52:18 DEBUG : potato2: Update will use the tus protocol to upload 2026/01/28 04:52:19 DEBUG : pacer: Reducing sleep to 1.125s 2026/01/28 04:52:19 INFO : potato2: Failed to read metadata: object not found 2026/01/28 04:52:21 DEBUG : pacer: Reducing sleep to 843.75ms 2026/01/28 04:52:21 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded starts 2026/01/28 04:52:22 DEBUG : pacer: Reducing sleep to 632.8125ms 2026/01/28 04:52:22 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded chunk no 1 ok, range 0 -> 60 2026/01/28 04:52:22 DEBUG : webdav root 'rclone-test-rogubek8xoze': -- Uploaded finished 2026/01/28 04:52:23 DEBUG : pacer: Reducing sleep to 474.609375ms 2026/01/28 04:52:24 DEBUG : pacer: Reducing sleep to 355.957031ms === RUN TestCheckDownload/4 check_test.go:86: 4: Expecting 1 errors but got 5 check_test.go:89: 4: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "- empty space", "= potato2", "= rutabaga"} actual : []string{"", "! potato2", "! rutabaga", "- empty space"} Diff: --- Expected +++ Actual @@ -2,5 +2,5 @@ (string) "", - (string) (len=13) "- empty space", - (string) (len=9) "= potato2", - (string) (len=10) "= rutabaga" + (string) (len=9) "! potato2", + (string) (len=10) "! rutabaga", + (string) (len=13) "- empty space" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "potato2", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,5 +1,2 @@ -([]string) (len=3) { - (string) "", - (string) (len=7) "potato2", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "potato2", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,5 @@ -([]string) { +([]string) (len=3) { + (string) "", + (string) (len=7) "potato2", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error === RUN TestCheckDownload/5 check_test.go:86: 5: Expecting 1 errors but got 5 check_test.go:89: 5: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "* empty space", "= potato2", "= rutabaga"} actual : []string{"", "! potato2", "! rutabaga", "* empty space"} Diff: --- Expected +++ Actual @@ -2,5 +2,5 @@ (string) "", - (string) (len=13) "* empty space", - (string) (len=9) "= potato2", - (string) (len=10) "= rutabaga" + (string) (len=9) "! potato2", + (string) (len=10) "! rutabaga", + (string) (len=13) "* empty space" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "potato2", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,5 +1,2 @@ -([]string) (len=3) { - (string) "", - (string) (len=7) "potato2", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "potato2", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,5 @@ -([]string) { +([]string) (len=3) { + (string) "", + (string) (len=7) "potato2", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error 2026/01/28 05:05:42 DEBUG : pacer: Reducing sleep to 1.5s 2026/01/28 05:05:42 DEBUG : remotepotato: Update will use the tus protocol to upload 2026/01/28 05:05:44 DEBUG : pacer: Reducing sleep to 1.125s 2026/01/28 05:05:44 INFO : remotepotato: Failed to read metadata: object not found 2026/01/28 05:05:46 DEBUG : pacer: Reducing sleep to 843.75ms 2026/01/28 05:05:46 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded starts 2026/01/28 05:05:47 DEBUG : pacer: Reducing sleep to 632.8125ms 2026/01/28 05:05:47 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded chunk no 1 ok, range 0 -> 60 2026/01/28 05:05:47 DEBUG : webdav root 'rclone-test-rogubek8xoze': -- Uploaded finished 2026/01/28 05:05:48 DEBUG : pacer: Reducing sleep to 474.609375ms 2026/01/28 05:05:48 DEBUG : pacer: Reducing sleep to 355.957031ms === RUN TestCheckDownload/6 check_test.go:86: 6: Expecting 2 errors but got 6 check_test.go:89: 6: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "* empty space", "- remotepotato", "= potato2", "= rutabaga"} actual : []string{"", "! potato2", "! rutabaga", "* empty space", "- remotepotato"} Diff: --- Expected +++ Actual @@ -2,6 +2,6 @@ (string) "", + (string) (len=9) "! potato2", + (string) (len=10) "! rutabaga", (string) (len=13) "* empty space", - (string) (len=14) "- remotepotato", - (string) (len=9) "= potato2", - (string) (len=10) "= rutabaga" + (string) (len=14) "- remotepotato" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "potato2", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,5 +1,2 @@ -([]string) (len=3) { - (string) "", - (string) (len=7) "potato2", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "potato2", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,5 @@ -([]string) { +([]string) (len=3) { + (string) "", + (string) (len=7) "potato2", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error === RUN TestCheckDownload/7 check_test.go:86: 7: Expecting 1 errors but got 5 check_test.go:89: 7: Total files matching line missing === NAME TestCheckDownload check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:56 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "* empty space", "= potato2", "= rutabaga"} actual : []string{"", "! potato2", "! rutabaga", "* empty space"} Diff: --- Expected +++ Actual @@ -2,5 +2,5 @@ (string) "", - (string) (len=13) "* empty space", - (string) (len=9) "= potato2", - (string) (len=10) "= rutabaga" + (string) (len=9) "! potato2", + (string) (len=10) "! rutabaga", + (string) (len=13) "* empty space" } Test: TestCheckDownload Messages: combined check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:59 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{"", "potato2", "rutabaga"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,5 +1,2 @@ -([]string) (len=3) { - (string) "", - (string) (len=7) "potato2", - (string) (len=8) "rutabaga" +([]string) { } Test: TestCheckDownload Messages: match check_test.go:52: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:52 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:61 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:94 Error: Not equal: expected: []string{} actual : []string{"", "potato2", "rutabaga"} Diff: --- Expected +++ Actual @@ -1,2 +1,5 @@ -([]string) { +([]string) (len=3) { + (string) "", + (string) (len=7) "potato2", + (string) (len=8) "rutabaga" } Test: TestCheckDownload Messages: error 2026/01/28 05:19:08 DEBUG : pacer: Reducing sleep to 1.5s 2026/01/28 05:19:10 DEBUG : pacer: Reducing sleep to 1.125s 2026/01/28 05:19:12 DEBUG : pacer: Reducing sleep to 843.75ms 2026/01/28 05:19:13 DEBUG : pacer: Reducing sleep to 632.8125ms 2026/01/28 05:19:14 DEBUG : pacer: Reducing sleep to 474.609375ms 2026/01/28 05:19:14 DEBUG : pacer: Reducing sleep to 355.957031ms --- FAIL: TestCheckDownload (2208.50s) --- FAIL: TestCheckDownload/1 (184.93s) --- FAIL: TestCheckDownload/2 (201.54s) --- FAIL: TestCheckDownload/3 (194.75s) --- FAIL: TestCheckDownload/4 (394.86s) --- FAIL: TestCheckDownload/5 (401.57s) --- FAIL: TestCheckDownload/6 (394.82s) --- FAIL: TestCheckDownload/7 (403.11s) === RUN TestParseSumFile run.go:185: Remote "webdav root 'rclone-test-rogubek8xoze'", Local "Local file system at /tmp/rclone796671227", Modify Window "1s" 2026/01/28 05:19:15 DEBUG : pacer: Reducing sleep to 266.967773ms 2026/01/28 05:19:15 DEBUG : test.sum: Update will use the tus protocol to upload 2026/01/28 05:19:15 DEBUG : pacer: Reducing sleep to 200.225829ms 2026/01/28 05:19:15 INFO : test.sum: Failed to read metadata: object not found 2026/01/28 05:19:15 DEBUG : pacer: Reducing sleep to 150.169371ms 2026/01/28 05:19:15 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded starts 2026/01/28 05:19:16 DEBUG : pacer: Reducing sleep to 112.627028ms 2026/01/28 05:19:16 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded chunk no 1 ok, range 0 -> 81 2026/01/28 05:19:16 DEBUG : webdav root 'rclone-test-rogubek8xoze': -- Uploaded finished 2026/01/28 05:19:16 DEBUG : pacer: Reducing sleep to 84.470271ms 2026/01/28 05:19:16 DEBUG : pacer: Reducing sleep to 63.352703ms 2026/01/28 05:19:16 DEBUG : pacer: low level retry 1/10 (error 500 Internal Server Error) 2026/01/28 05:19:16 DEBUG : pacer: Rate limited, increasing sleep to 126.705406ms 2026/01/28 05:19:16 DEBUG : pacer: low level retry 2/10 (error 500 Internal Server Error) 2026/01/28 05:19:16 DEBUG : pacer: Rate limited, increasing sleep to 253.410812ms 2026/01/28 05:19:16 DEBUG : pacer: low level retry 3/10 (error 500 Internal Server Error) 2026/01/28 05:19:16 DEBUG : pacer: Rate limited, increasing sleep to 506.821624ms 2026/01/28 05:19:16 DEBUG : pacer: low level retry 4/10 (error 500 Internal Server Error) 2026/01/28 05:19:16 DEBUG : pacer: Rate limited, increasing sleep to 1.013643248s 2026/01/28 05:19:17 DEBUG : pacer: low level retry 5/10 (error 500 Internal Server Error) 2026/01/28 05:19:17 DEBUG : pacer: Rate limited, increasing sleep to 2s 2026/01/28 05:19:18 DEBUG : pacer: low level retry 6/10 (error 500 Internal Server Error) 2026/01/28 05:19:20 DEBUG : pacer: low level retry 7/10 (error 500 Internal Server Error) 2026/01/28 05:19:22 DEBUG : pacer: low level retry 8/10 (error 500 Internal Server Error) 2026/01/28 05:19:24 DEBUG : pacer: low level retry 9/10 (error 500 Internal Server Error) 2026/01/28 05:19:26 DEBUG : pacer: low level retry 10/10 (error 500 Internal Server Error) check_test.go:311: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:311 Error: Received unexpected error: 500 Internal Server Error Test: TestParseSumFile check_test.go:313: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:313 Error: Not equal: expected: 4 actual : 0 Test: TestParseSumFile check_test.go:316: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:316 Error: Not equal: expected: "1" actual : "" Diff: --- Expected +++ Actual @@ -1 +1 @@ -1 + Test: TestParseSumFile check_test.go:316: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:316 Error: Not equal: expected: "2" actual : "" Diff: --- Expected +++ Actual @@ -1 +1 @@ -2 + Test: TestParseSumFile check_test.go:316: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:316 Error: Not equal: expected: "3" actual : "" Diff: --- Expected +++ Actual @@ -1 +1 @@ -3 + Test: TestParseSumFile check_test.go:316: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:316 Error: Not equal: expected: "4" actual : "" Diff: --- Expected +++ Actual @@ -1 +1 @@ -4 + Test: TestParseSumFile 2026/01/28 05:19:28 DEBUG : pacer: Reducing sleep to 1.5s 2026/01/28 05:19:28 DEBUG : test.sum: Update will use the tus protocol to upload 2026/01/28 05:19:30 DEBUG : pacer: Reducing sleep to 1.125s 2026/01/28 05:19:31 DEBUG : pacer: Reducing sleep to 843.75ms 2026/01/28 05:19:31 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded starts 2026/01/28 05:19:33 DEBUG : pacer: Reducing sleep to 632.8125ms 2026/01/28 05:19:33 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded chunk no 1 ok, range 0 -> 90 2026/01/28 05:19:33 DEBUG : webdav root 'rclone-test-rogubek8xoze': -- Uploaded finished 2026/01/28 05:19:33 DEBUG : pacer: Reducing sleep to 474.609375ms 2026/01/28 05:19:34 DEBUG : pacer: Reducing sleep to 355.957031ms 2026/01/28 05:19:34 DEBUG : pacer: low level retry 1/10 (error 500 Internal Server Error) 2026/01/28 05:19:34 DEBUG : pacer: Rate limited, increasing sleep to 711.914062ms 2026/01/28 05:19:35 DEBUG : pacer: low level retry 2/10 (error 500 Internal Server Error) 2026/01/28 05:19:35 DEBUG : pacer: Rate limited, increasing sleep to 1.423828124s 2026/01/28 05:19:36 DEBUG : pacer: low level retry 3/10 (error 500 Internal Server Error) 2026/01/28 05:19:36 DEBUG : pacer: Rate limited, increasing sleep to 2s 2026/01/28 05:19:37 DEBUG : pacer: low level retry 4/10 (error 500 Internal Server Error) 2026/01/28 05:19:39 DEBUG : pacer: low level retry 5/10 (error 500 Internal Server Error) 2026/01/28 05:19:41 DEBUG : pacer: low level retry 6/10 (error 500 Internal Server Error) 2026/01/28 05:19:43 DEBUG : pacer: low level retry 7/10 (error 500 Internal Server Error) 2026/01/28 05:19:45 DEBUG : pacer: low level retry 8/10 (error 500 Internal Server Error) 2026/01/28 05:19:47 DEBUG : pacer: low level retry 9/10 (error 500 Internal Server Error) 2026/01/28 05:19:50 DEBUG : pacer: low level retry 10/10 (error 500 Internal Server Error) check_test.go:311: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:311 Error: Received unexpected error: 500 Internal Server Error Test: TestParseSumFile check_test.go:313: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:313 Error: Not equal: expected: 4 actual : 0 Test: TestParseSumFile check_test.go:316: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:316 Error: Not equal: expected: "1" actual : "" Diff: --- Expected +++ Actual @@ -1 +1 @@ -1 + Test: TestParseSumFile check_test.go:316: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:316 Error: Not equal: expected: "2" actual : "" Diff: --- Expected +++ Actual @@ -1 +1 @@ -2 + Test: TestParseSumFile check_test.go:316: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:316 Error: Not equal: expected: "3" actual : "" Diff: --- Expected +++ Actual @@ -1 +1 @@ -3 + Test: TestParseSumFile check_test.go:316: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:316 Error: Not equal: expected: "4" actual : "" Diff: --- Expected +++ Actual @@ -1 +1 @@ -4 + Test: TestParseSumFile 2026/01/28 05:19:53 DEBUG : pacer: Reducing sleep to 1.5s 2026/01/28 05:19:54 DEBUG : pacer: Reducing sleep to 1.125s 2026/01/28 05:20:01 DEBUG : pacer: Reducing sleep to 843.75ms --- FAIL: TestParseSumFile (46.54s) === RUN TestCheckSumDownload run.go:185: Remote "webdav root 'rclone-test-rogubek8xoze'", Local "Local file system at /tmp/rclone796671227", Modify Window "1s" 2026/01/28 05:20:01 DEBUG : Creating backend with remote "TestWebdavInfiniteScale:rclone-test-rogubek8xoze/data" 2026/01/28 05:20:01 DEBUG : Config file has changed externally - reloading 2026/01/28 05:20:01 DEBUG : Setting type="webdav" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_TYPE 2026/01/28 05:20:01 DEBUG : Setting url="https://127.0.0.1:28639/dav/spaces/some-admin-user-id-0000-100000000000" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_URL 2026/01/28 05:20:01 DEBUG : Setting vendor="infinitescale" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_VENDOR 2026/01/28 05:20:01 DEBUG : Setting user="admin" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_USER 2026/01/28 05:20:01 DEBUG : Setting pass="6zPupCBG3B0t7IL59oMnpjPGitO5" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_PASS 2026/01/28 05:20:01 DEBUG : TestWebdavInfiniteScale: detected overridden config - adding "{Elz0p}" suffix to name 2026/01/28 05:20:01 DEBUG : Setting url="https://127.0.0.1:28639/dav/spaces/some-admin-user-id-0000-100000000000" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_URL 2026/01/28 05:20:01 DEBUG : Setting vendor="infinitescale" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_VENDOR 2026/01/28 05:20:01 DEBUG : Setting user="admin" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_USER 2026/01/28 05:20:01 DEBUG : Setting pass="6zPupCBG3B0t7IL59oMnpjPGitO5" for "TestWebdavInfiniteScale" from environment variable RCLONE_CONFIG_TESTWEBDAVINFINITESCALE_PASS 2026/01/28 05:20:01 DEBUG : found headers: 2026/01/28 05:20:03 DEBUG : pacer: Reducing sleep to 632.8125ms 2026/01/28 05:20:03 DEBUG : data/banana: Update will use the tus protocol to upload 2026/01/28 05:20:07 DEBUG : pacer: Reducing sleep to 474.609375ms 2026/01/28 05:20:07 INFO : data/banana: Failed to read metadata: object not found 2026/01/28 05:20:08 DEBUG : pacer: Reducing sleep to 355.957031ms 2026/01/28 05:20:08 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded starts 2026/01/28 05:20:08 DEBUG : pacer: Reducing sleep to 266.967773ms 2026/01/28 05:20:08 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded chunk no 1 ok, range 0 -> 13 2026/01/28 05:20:08 DEBUG : webdav root 'rclone-test-rogubek8xoze': -- Uploaded finished 2026/01/28 05:20:08 DEBUG : pacer: Reducing sleep to 200.225829ms 2026/01/28 05:20:09 DEBUG : pacer: Reducing sleep to 150.169371ms 2026/01/28 05:20:09 DEBUG : test.sum: Update will use the tus protocol to upload 2026/01/28 05:20:09 DEBUG : pacer: Reducing sleep to 112.627028ms 2026/01/28 05:20:09 INFO : test.sum: Failed to read metadata: object not found 2026/01/28 05:20:09 DEBUG : pacer: Reducing sleep to 84.470271ms 2026/01/28 05:20:09 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded starts 2026/01/28 05:20:09 DEBUG : pacer: Reducing sleep to 63.352703ms 2026/01/28 05:20:09 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded chunk no 1 ok, range 0 -> 41 2026/01/28 05:20:09 DEBUG : webdav root 'rclone-test-rogubek8xoze': -- Uploaded finished 2026/01/28 05:20:09 DEBUG : pacer: Reducing sleep to 47.514527ms 2026/01/28 05:20:09 DEBUG : pacer: Reducing sleep to 35.635895ms 2026/01/28 05:20:10 DEBUG : pacer: Reducing sleep to 26.726921ms === RUN TestCheckSumDownload/subtest1 === NAME TestCheckSumDownload check_test.go:404: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:404 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Received unexpected error: failed to parse sum file: 500 Internal Server Error Test: TestCheckSumDownload Messages: unexpected error in run 1 check_test.go:413: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:413 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: "" does not contain "matching files" Test: TestCheckSumDownload Messages: missing matching files in run 1 check_test.go:415: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:415 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: 1 actual : 0 Test: TestCheckSumDownload Messages: wrong number of checks in run 1 check_test.go:384: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:384 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:417 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: []string{"", "= banana"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=2) { - (string) "", - (string) (len=8) "= banana" +([]string) { } Test: TestCheckSumDownload Messages: wrong combined result in run 1 check_test.go:384: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:384 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:420 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: []string{"", "banana"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=2) { - (string) "", - (string) (len=6) "banana" +([]string) { } Test: TestCheckSumDownload Messages: wrong match result in run 1 2026/01/28 05:20:19 DEBUG : pacer: Reducing sleep to 1.5s 2026/01/28 05:20:19 DEBUG : data/potato: Update will use the tus protocol to upload 2026/01/28 05:20:21 DEBUG : pacer: Reducing sleep to 1.125s 2026/01/28 05:20:21 INFO : data/potato: Failed to read metadata: object not found 2026/01/28 05:20:23 DEBUG : pacer: Reducing sleep to 843.75ms 2026/01/28 05:20:23 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded starts 2026/01/28 05:20:23 DEBUG : pacer: Reducing sleep to 632.8125ms 2026/01/28 05:20:23 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded chunk no 1 ok, range 0 -> 15 2026/01/28 05:20:23 DEBUG : webdav root 'rclone-test-rogubek8xoze': -- Uploaded finished 2026/01/28 05:20:25 DEBUG : pacer: Reducing sleep to 474.609375ms 2026/01/28 05:20:25 DEBUG : pacer: Reducing sleep to 355.957031ms 2026/01/28 05:20:25 DEBUG : test.sum: Update will use the tus protocol to upload 2026/01/28 05:20:26 DEBUG : pacer: Reducing sleep to 266.967773ms 2026/01/28 05:20:26 DEBUG : pacer: Reducing sleep to 200.225829ms 2026/01/28 05:20:26 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded starts 2026/01/28 05:20:26 DEBUG : pacer: Reducing sleep to 150.169371ms 2026/01/28 05:20:26 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded chunk no 1 ok, range 0 -> 41 2026/01/28 05:20:26 DEBUG : webdav root 'rclone-test-rogubek8xoze': -- Uploaded finished 2026/01/28 05:20:27 DEBUG : pacer: Reducing sleep to 112.627028ms 2026/01/28 05:20:27 DEBUG : pacer: Reducing sleep to 84.470271ms 2026/01/28 05:20:27 DEBUG : pacer: Reducing sleep to 63.352703ms === RUN TestCheckSumDownload/subtest2 === NAME TestCheckSumDownload check_test.go:409: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:409 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: 1 actual : 0 Test: TestCheckSumDownload Messages: wrong error count in run 2 check_test.go:413: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:413 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: "" does not contain "matching files" Test: TestCheckSumDownload Messages: missing matching files in run 2 check_test.go:415: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:415 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: 2 actual : 0 Test: TestCheckSumDownload Messages: wrong number of checks in run 2 check_test.go:384: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:384 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:417 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: []string{"", "- potato", "= banana"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,5 +1,2 @@ -([]string) (len=3) { - (string) "", - (string) (len=8) "- potato", - (string) (len=8) "= banana" +([]string) { } Test: TestCheckSumDownload Messages: wrong combined result in run 2 check_test.go:384: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:384 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:418 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: []string{"", "potato"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=2) { - (string) "", - (string) (len=6) "potato" +([]string) { } Test: TestCheckSumDownload Messages: wrong missingonsrc result in run 2 check_test.go:384: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:384 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:420 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:428 Error: Not equal: expected: []string{"", "banana"} actual : []string{} Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=2) { - (string) "", - (string) (len=6) "banana" +([]string) { } Test: TestCheckSumDownload Messages: wrong match result in run 2 2026/01/28 05:20:41 DEBUG : pacer: Reducing sleep to 1.5s 2026/01/28 05:20:41 DEBUG : test.sum: Update will use the tus protocol to upload 2026/01/28 05:20:45 DEBUG : pacer: Reducing sleep to 1.125s 2026/01/28 05:20:46 DEBUG : pacer: Reducing sleep to 843.75ms 2026/01/28 05:20:46 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded starts 2026/01/28 05:20:47 DEBUG : pacer: Reducing sleep to 632.8125ms 2026/01/28 05:20:47 DEBUG : webdav root 'rclone-test-rogubek8xoze': Uploaded chunk no 1 ok, range 0 -> 82 2026/01/28 05:20:47 DEBUG : webdav root 'rclone-test-rogubek8xoze': -- Uploaded finished panic: test timed out after 1h0m0s running tests: TestCheckSumDownload (23m18s) goroutine 1586 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2484 +0x394 created by time.goFunc /usr/local/go/src/time/sleep.go:215 +0x2d goroutine 1 [chan receive, 24 minutes]: testing.(*T).Run(0xc000003dc0, {0x28ff4b9?, 0xc000707ad8?}, 0x2a2b318) /usr/local/go/src/testing/testing.go:1859 +0x431 testing.runTests.func1(0xc000003dc0) /usr/local/go/src/testing/testing.go:2279 +0x37 testing.tRunner(0xc000003dc0, 0xc000707c18) /usr/local/go/src/testing/testing.go:1792 +0xf4 testing.runTests(0xc0001627f8, {0x43b8b20, 0x6f, 0x6f}, {0xee10b8ab2?, 0x43cf460?, 0x43cf460?}) /usr/local/go/src/testing/testing.go:2277 +0x4b4 testing.(*M).Run(0xc0006f4c80) /usr/local/go/src/testing/testing.go:2142 +0x64a github.com/rclone/rclone/fstest.TestMain(0xc0006f4c80) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:74 +0xa6 github.com/rclone/rclone/fs/operations_test.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:61 main.main() _testmain.go:269 +0xa9 goroutine 4 [syscall, 60 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:152 +0x1f goroutine 114 [chan receive (nil chan), 60 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 104 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 5 [chan receive, 60 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 1572 [chan receive, 22 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 1522 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 16 [chan receive, 60 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 50 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 375 [chan receive (nil chan), 54 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 333 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1536 [chan receive, 23 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 1522 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 776 [chan receive (nil chan), 45 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 766 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 956 [chan receive, 37 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 50 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 259 [chan receive (nil chan), 58 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 249 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 348 [chan receive, 54 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 50 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 1500 [chan receive, 23 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 1522 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 1552 [select]: github.com/rclone/rclone/fs/accounting.(*StatsInfo).averageLoop(0xc0002f32c0, {0x2dc4fa0, 0xc000510e10}) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:352 +0x145 created by github.com/rclone/rclone/fs/accounting.(*StatsInfo)._startAverageLoop in goroutine 1565 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:389 +0x11a goroutine 489 [chan receive, 51 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 50 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 508 [chan receive (nil chan), 51 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 498 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1223 [chan receive (nil chan), 31 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 989 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1476 [chan receive, 24 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 1365 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 1455 [chan receive, 24 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 1365 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 1369 [chan receive, 23 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 1522 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 goroutine 1003 [chan receive (nil chan), 37 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 881 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1522 [runnable]: github.com/rclone/rclone/fs/fserrors.ShouldRetry.IsNoLowLevelRetryError.func1({0x2d9c3c0?, 0xc0000f6510}) /home/rclone/go/src/github.com/rclone/rclone/fs/fserrors/error.go:231 +0x9a github.com/rclone/rclone/lib/errors.Walk({0x2d9c3c0?, 0xc0000f6510?}, 0xc00006aa78) /home/rclone/go/src/github.com/rclone/rclone/lib/errors/errors.go:27 +0x64 github.com/rclone/rclone/fs/fserrors.IsNoLowLevelRetryError(...) /home/rclone/go/src/github.com/rclone/rclone/fs/fserrors/error.go:230 github.com/rclone/rclone/fs/fserrors.ShouldRetry({0x2d9c3c0, 0xc0000f6510}) /home/rclone/go/src/github.com/rclone/rclone/fs/fserrors/error.go:410 +0x71 github.com/rclone/rclone/backend/webdav.(*Fs).shouldRetry(0xc00017b080, {0x2dc4e88?, 0x43f2c80?}, 0x0, {0x2d9c3c0, 0xc0000f6510}) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/webdav.go:296 +0x12a github.com/rclone/rclone/backend/webdav.(*Fs).readMetaDataForPath.func1() /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/webdav.go:360 +0xf9 github.com/rclone/rclone/fs.pacerInvoker(0x1, 0xa, 0x40?) /home/rclone/go/src/github.com/rclone/rclone/fs/pacer.go:86 +0x32 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc000117aa0, 0xc00072e100, 0xa) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:216 +0xd2 github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc000117aa0, 0xc00072e100) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:235 +0x93 github.com/rclone/rclone/backend/webdav.(*Fs).readMetaDataForPath(0xc00017b080, {0x2dc4e88, 0x43f2c80}, {0x28db4e6, 0x8}, {0x2d89050, 0x1}) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/webdav.go:358 +0x387 github.com/rclone/rclone/backend/webdav.(*Object).readMetaData(0xc0003e71a0, {0x2dc4e88?, 0x43f2c80?}) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/webdav.go:1407 +0x45 github.com/rclone/rclone/backend/webdav.(*Object).Update(0xc0003e71a0, {0x2dc4e88, 0x43f2c80}, {0x2d9b260, 0xc000032b70}, {0x2dd0fb0, 0xc00066f110}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/webdav.go:1578 +0x385 github.com/rclone/rclone/backend/webdav.(*Fs).Put(0xc00017b080, {0x2dc4e88, 0x43f2c80}, {0x2d9b260, 0xc000032b70}, {0x2dd0fb0, 0xc00066f110}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/webdav.go:965 +0x1ab github.com/rclone/rclone/fstest.(*Run).WriteObjectTo(0xc000415d50, {0x2dc4e88, 0x43f2c80}, {0x2ddec50, 0xc00017b080}, {0x28db4e6, 0x8}, {0xc000430120, 0x52}, {0x1dcd64ff, ...}, ...) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:280 +0x3f2 github.com/rclone/rclone/fstest.(*Run).WriteObject(...) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:297 github.com/rclone/rclone/fs/operations_test.testCheckSum.func2(0xc00006bc50) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:368 +0x3b6 github.com/rclone/rclone/fs/operations_test.testCheckSum(0xc00069a000, 0x1) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:460 +0x108c github.com/rclone/rclone/fs/operations_test.TestCheckSumDownload(0xc00069a000?) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 +0x18 testing.tRunner(0xc00069a000, 0x2a2b318) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 1554 [chan receive, 23 minutes]: github.com/rclone/rclone/backend/webdav.(*Uploader).broadcastProgress(...) /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:166 created by github.com/rclone/rclone/backend/webdav.NewUploader in goroutine 1522 /home/rclone/go/src/github.com/rclone/rclone/backend/webdav/tus-uploader.go:188 +0x118 "./operations.test -test.v -test.timeout 1h0m0s -remote TestWebdavInfiniteScale: -verbose -test.run '^(TestCat|TestCheckSumDownload|TestCopyFile|TestCopyFileBackupDir|TestCopyFileCompareDest|TestCopyFileCopyDest|TestCopyFileMaxTransfer|TestCopyURL|TestMoveFile|TestMoveFileBackupDir|TestMoveFileWithIgnoreExisting|TestParseSumFile|TestRcatSize|TestReadFile|TestTouchDir)$|^TestCheckDownload$/^(1|2|3|4|5|6|7)$|^TestHashSums$/^Sha1Download$'" - Finished ERROR in 1h0m57.207739054s (try 2/5): exit status 2: Failed [TestCheckDownload/1 TestCheckDownload/2 TestCheckDownload/3 TestCheckDownload/4 TestCheckDownload/5 TestCheckDownload/6 TestCheckDownload/7 TestParseSumFile]