"./sync.test -test.v -test.timeout 1h0m0s -remote TestIA:rclone-integration-test -verbose" - Starting (try 2/5) 2022/05/18 07:13:46 DEBUG : Creating backend with remote "TestIA:rclone-integration-test/rclone-test-nobalar4fopahag5lefivor7" 2022/05/18 07:13:46 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2022/05/18 07:13:47 DEBUG : Creating backend with remote "/tmp/rclone507855640" === RUN TestPipe --- PASS: TestPipe (0.00s) === RUN TestPipeConcurrent --- PASS: TestPipeConcurrent (0.03s) === RUN TestPipeOrderBy === RUN TestPipeOrderBy/#00 === RUN TestPipeOrderBy/size === RUN TestPipeOrderBy/name === RUN TestPipeOrderBy/modtime === RUN TestPipeOrderBy/size,ascending === RUN TestPipeOrderBy/name,asc === RUN TestPipeOrderBy/modtime,ascending === RUN TestPipeOrderBy/size,descending === RUN TestPipeOrderBy/name,desc === RUN TestPipeOrderBy/modtime,descending === RUN TestPipeOrderBy/size,mixed,50 === RUN TestPipeOrderBy/size,mixed,51 --- PASS: TestPipeOrderBy (0.00s) --- PASS: TestPipeOrderBy/#00 (0.00s) --- PASS: TestPipeOrderBy/size (0.00s) --- PASS: TestPipeOrderBy/name (0.00s) --- PASS: TestPipeOrderBy/modtime (0.00s) --- PASS: TestPipeOrderBy/size,ascending (0.00s) --- PASS: TestPipeOrderBy/name,asc (0.00s) --- PASS: TestPipeOrderBy/modtime,ascending (0.00s) --- PASS: TestPipeOrderBy/size,descending (0.00s) --- PASS: TestPipeOrderBy/name,desc (0.00s) --- PASS: TestPipeOrderBy/modtime,descending (0.00s) --- PASS: TestPipeOrderBy/size,mixed,50 (0.00s) --- PASS: TestPipeOrderBy/size,mixed,51 (0.00s) === RUN TestNewLess === RUN TestNewLess/blankOK === RUN TestNewLess/tooManyParts === RUN TestNewLess/tooManyParts2 === RUN TestNewLess/badMixed === RUN TestNewLess/unknownComparison === RUN TestNewLess/unknownSortDirection === RUN TestNewLess/size === RUN TestNewLess/name === RUN TestNewLess/modtime === RUN TestNewLess/size,ascending === RUN TestNewLess/name,asc === RUN TestNewLess/modtime,ascending === RUN TestNewLess/size,descending === RUN TestNewLess/name,desc === RUN TestNewLess/modtime,descending === RUN TestNewLess/modtime,mixed === RUN TestNewLess/modtime,mixed,30 --- PASS: TestNewLess (0.00s) --- PASS: TestNewLess/blankOK (0.00s) --- PASS: TestNewLess/tooManyParts (0.00s) --- PASS: TestNewLess/tooManyParts2 (0.00s) --- PASS: TestNewLess/badMixed (0.00s) --- PASS: TestNewLess/unknownComparison (0.00s) --- PASS: TestNewLess/unknownSortDirection (0.00s) --- PASS: TestNewLess/size (0.00s) --- PASS: TestNewLess/name (0.00s) --- PASS: TestNewLess/modtime (0.00s) --- PASS: TestNewLess/size,ascending (0.00s) --- PASS: TestNewLess/name,asc (0.00s) --- PASS: TestNewLess/modtime,ascending (0.00s) --- PASS: TestNewLess/size,descending (0.00s) --- PASS: TestNewLess/name,desc (0.00s) --- PASS: TestNewLess/modtime,descending (0.00s) --- PASS: TestNewLess/modtime,mixed (0.00s) --- PASS: TestNewLess/modtime,mixed,30 (0.00s) === RUN TestRcCopy rc_test.go:16: Skipping test on non local remote --- SKIP: TestRcCopy (0.00s) === RUN TestRcMove rc_test.go:16: Skipping test on non local remote --- SKIP: TestRcMove (0.00s) === RUN TestRcSync rc_test.go:16: Skipping test on non local remote --- SKIP: TestRcSync (0.00s) === RUN TestCopyWithDryRun run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-nobalar4fopahag5lefivor7", Local "Local file system at /tmp/rclone507855640", Modify Window "1ns" 2022/05/18 07:13:47 NOTICE: sub dir/hello world: Skipped copy as --dry-run is set (size 11) 2022/05/18 07:13:47 DEBUG : Internet Archive item rclone-integration-test path rclone-test-nobalar4fopahag5lefivor7: Waiting for checks to finish 2022/05/18 07:13:47 DEBUG : Internet Archive item rclone-integration-test path rclone-test-nobalar4fopahag5lefivor7: Waiting for transfers to finish --- PASS: TestCopyWithDryRun (0.85s) === RUN TestCopy run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-nobalar4fopahag5lefivor7", Local "Local file system at /tmp/rclone507855640", Modify Window "1ns" 2022/05/18 07:13:48 DEBUG : Internet Archive item rclone-integration-test path rclone-test-nobalar4fopahag5lefivor7: Waiting for checks to finish 2022/05/18 07:13:48 DEBUG : Internet Archive item rclone-integration-test path rclone-test-nobalar4fopahag5lefivor7: Waiting for transfers to finish panic: test timed out after 1h0m0s goroutine 848 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:1788 +0x8e created by time.goFunc /usr/local/go/src/time/sleep.go:180 +0x31 goroutine 1 [chan receive, 59 minutes]: testing.(*T).Run(0xc000348d00, {0x195bddd, 0x46f653}, 0x1a06e90) /usr/local/go/src/testing/testing.go:1307 +0x375 testing.runTests.func1(0xc0006456e0) /usr/local/go/src/testing/testing.go:1598 +0x6e testing.tRunner(0xc000348d00, 0xc000951ca0) /usr/local/go/src/testing/testing.go:1259 +0x102 testing.runTests(0xc0000f6b80, {0x2a2cd80, 0x4a, 0x4a}, {0xefab00, 0xc000227ce0, 0x2a3b720}) /usr/local/go/src/testing/testing.go:1596 +0x43f testing.(*M).Run(0xc0000f6b80) /usr/local/go/src/testing/testing.go:1504 +0x51d github.com/rclone/rclone/fstest.TestMain(0xc0000001a0) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:70 +0x9e github.com/rclone/rclone/fs/sync.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:36 main.main() _testmain.go:191 +0x166 goroutine 7 [select]: go.opencensus.io/stats/view.(*worker).start(0xc0000f7980) /home/rclone/go/pkg/mod/go.opencensus.io@v0.23.0/stats/view/worker.go:276 +0xb9 created by go.opencensus.io/stats/view.init.0 /home/rclone/go/pkg/mod/go.opencensus.io@v0.23.0/stats/view/worker.go:34 +0x92 goroutine 11 [IO wait]: internal/poll.runtime_pollWait(0x7f39bfe64f30, 0x72) /usr/local/go/src/runtime/netpoll.go:234 +0x89 internal/poll.(*pollDesc).wait(0xc000343180, 0xc0006b2000, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc000343180, {0xc0006b2000, 0x45b0, 0x45b0}) /usr/local/go/src/internal/poll/fd_unix.go:167 +0x25a net.(*netFD).Read(0xc000343180, {0xc0006b2000, 0xc00035a000, 0xc0006b4b88}) /usr/local/go/src/net/fd_posix.go:56 +0x29 net.(*conn).Read(0xc0001fb208, {0xc0006b2000, 0xc0006b4b88, 0x19}) /usr/local/go/src/net/net.go:183 +0x45 github.com/rclone/rclone/fs/fshttp.(*timeoutConn).Read(0xc000302000, {0xc0006b2000, 0x0, 0x100000100411e05}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:104 +0x32 crypto/tls.(*atLeastReader).Read(0xc000854600, {0xc0006b2000, 0x0, 0x40bb8d}) /usr/local/go/src/crypto/tls/conn.go:777 +0x3d bytes.(*Buffer).ReadFrom(0xc0000fd078, {0x1d05260, 0xc000854600}) /usr/local/go/src/bytes/buffer.go:204 +0x98 crypto/tls.(*Conn).readFromUntil(0xc0000fce00, {0x7f39bd42e298, 0xc000302000}, 0x1a35) /usr/local/go/src/crypto/tls/conn.go:799 +0xe5 crypto/tls.(*Conn).readRecordOrCCS(0xc0000fce00, 0x0) /usr/local/go/src/crypto/tls/conn.go:606 +0x112 crypto/tls.(*Conn).readRecord(...) /usr/local/go/src/crypto/tls/conn.go:574 crypto/tls.(*Conn).Read(0xc0000fce00, {0xc00053e000, 0x1000, 0x6e3c57}) /usr/local/go/src/crypto/tls/conn.go:1277 +0x16f bufio.(*Reader).Read(0xc00010eae0, {0xc00036fa78, 0x9, 0xc000894c30}) /usr/local/go/src/bufio/bufio.go:227 +0x1b4 io.ReadAtLeast({0x1d05060, 0xc00010eae0}, {0xc00036fa78, 0x9, 0x9}, 0x9) /usr/local/go/src/io/io.go:328 +0x9a io.ReadFull(...) /usr/local/go/src/io/io.go:347 net/http.http2readFrameHeader({0xc00036fa78, 0x9, 0xc00040cea0}, {0x1d05060, 0xc00010eae0}) /usr/local/go/src/net/http/h2_bundle.go:1555 +0x6e net/http.(*http2Framer).ReadFrame(0xc00036fa40) /usr/local/go/src/net/http/h2_bundle.go:1813 +0x95 net/http.(*http2clientConnReadLoop).run(0xc00050df98) /usr/local/go/src/net/http/h2_bundle.go:8583 +0x130 net/http.(*http2ClientConn).readLoop(0xc000158300) /usr/local/go/src/net/http/h2_bundle.go:8506 +0x6f created by net/http.(*http2Transport).newClientConn /usr/local/go/src/net/http/h2_bundle.go:7317 +0xb85 goroutine 149 [semacquire, 59 minutes]: sync.runtime_Semacquire(0x0) /usr/local/go/src/runtime/sema.go:56 +0x25 sync.(*WaitGroup).Wait(0x1902280) /usr/local/go/src/sync/waitgroup.go:130 +0x71 github.com/rclone/rclone/fs/sync.(*syncCopyMove).stopTransfers(0xc000244e00) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:438 +0x6a github.com/rclone/rclone/fs/sync.(*syncCopyMove).run(0xc000244e00) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:875 +0x345 github.com/rclone/rclone/fs/sync.runSyncCopyMove({0x1d3d630, 0xc000040058}, {0x1d6d428, 0xc000661970}, {0x1d6d6c8, 0xc000666e10}, 0x0, 0x0, 0x0, 0x0) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:1094 +0x21f github.com/rclone/rclone/fs/sync.CopyDir(...) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:1105 github.com/rclone/rclone/fs/sync.TestCopy(0x0) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:64 +0x19d testing.tRunner(0xc0009b9ba0, 0x1a06e90) /usr/local/go/src/testing/testing.go:1259 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1306 +0x35a goroutine 161 [select, 59 minutes]: github.com/rclone/rclone/backend/internetarchive.(*Fs).waitFileUpload(0xc000661970, {0x1d3d5f8, 0xc000756b00}, {0xc00032bd10, 0x13}, {0xc00088a020, 0x20}, 0xb) /home/rclone/go/src/github.com/rclone/rclone/backend/internetarchive/internetarchive.go:943 +0x506 github.com/rclone/rclone/backend/internetarchive.(*Object).Update(0xc0003b6000, {0x1d3d5f8, 0xc000756b00}, {0x1d0bc00, 0xc00022c800}, {0x7f39bddf5fc0, 0xc000872c60}, {0xc0000fa030, 0x1, 0x1}) /home/rclone/go/src/github.com/rclone/rclone/backend/internetarchive/internetarchive.go:721 +0x9c5 github.com/rclone/rclone/backend/internetarchive.(*Fs).Put(0xc000661970, {0x1d3d5f8, 0xc000756b00}, {0x1d0bc00, 0xc00022c800}, {0x7f39bddf5fc0, 0xc000872c60}, {0xc0000fa030, 0x1, 0x1}) /home/rclone/go/src/github.com/rclone/rclone/backend/internetarchive/internetarchive.go:444 +0x1d6 github.com/rclone/rclone/fs/operations.Copy({0x1d3d5f8, 0xc000756b00}, {0x1d6d428, 0xc000661970}, {0x0, 0x0}, {0xc00032bd10, 0x0}, {0x1d6d738, 0xc000872c60}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations.go:472 +0x1ab5 github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove(0xc000244e00, {0x1d3d5f8, 0xc000756b00}, 0xc0008ab600, {0x1d6d428, 0xc000661970}, 0x0, 0xc000536778) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:403 +0x1bb created by github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:430 +0x47 goroutine 180 [sleep]: time.Sleep(0x2540be400) /usr/local/go/src/runtime/time.go:193 +0x12e github.com/rclone/rclone/backend/internetarchive.(*Fs).waitFileUpload.func1() /home/rclone/go/src/github.com/rclone/rclone/backend/internetarchive/internetarchive.go:885 +0x153 created by github.com/rclone/rclone/backend/internetarchive.(*Fs).waitFileUpload /home/rclone/go/src/github.com/rclone/rclone/backend/internetarchive/internetarchive.go:879 +0x47b goroutine 26 [select]: github.com/rclone/rclone/fs/accounting.(*Account).averageLoop(0xc00022c800) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting.go:212 +0x10a created by github.com/rclone/rclone/fs/accounting.newAccountSizeName /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting.go:110 +0x44f goroutine 170 [chan receive, 59 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 25 [chan receive, 59 minutes]: github.com/rclone/rclone/backend/local.(*fadvise).worker(0xc000886000) /home/rclone/go/src/github.com/rclone/rclone/backend/local/fadvise_unix.go:115 +0x4b created by github.com/rclone/rclone/backend/local.newFadvise /home/rclone/go/src/github.com/rclone/rclone/backend/local/fadvise_unix.go:75 +0x12f "./sync.test -test.v -test.timeout 1h0m0s -remote TestIA:rclone-integration-test -verbose" - Finished ERROR in 1h0m0.744929323s (try 2/5): exit status 2: Failed []