"./operations.test -test.v -test.timeout 1h0m0s -remote TestIA:rclone-integration-test -verbose" - Starting (try 3/5) 2022/06/12 07:54:29 DEBUG : Creating backend with remote "TestIA:rclone-integration-test/rclone-test-wefufix0gahiwap4jusexoz3" 2022/06/12 07:54:29 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2022/06/12 07:54:30 DEBUG : Creating backend with remote "/tmp/rclone4228179240" === RUN TestDoMultiThreadCopy --- PASS: TestDoMultiThreadCopy (0.00s) === RUN TestMultithreadCalculateChunks === RUN TestMultithreadCalculateChunks/{size:1_streams:10_wantPartSize:65536_wantStreams:1} === RUN TestMultithreadCalculateChunks/{size:1048576_streams:1_wantPartSize:1048576_wantStreams:1} === RUN TestMultithreadCalculateChunks/{size:1048576_streams:2_wantPartSize:524288_wantStreams:2} === RUN TestMultithreadCalculateChunks/{size:1048577_streams:2_wantPartSize:589824_wantStreams:2} === RUN TestMultithreadCalculateChunks/{size:1048575_streams:2_wantPartSize:524288_wantStreams:2} --- PASS: TestMultithreadCalculateChunks (0.00s) --- PASS: TestMultithreadCalculateChunks/{size:1_streams:10_wantPartSize:65536_wantStreams:1} (0.00s) --- PASS: TestMultithreadCalculateChunks/{size:1048576_streams:1_wantPartSize:1048576_wantStreams:1} (0.00s) --- PASS: TestMultithreadCalculateChunks/{size:1048576_streams:2_wantPartSize:524288_wantStreams:2} (0.00s) --- PASS: TestMultithreadCalculateChunks/{size:1048577_streams:2_wantPartSize:589824_wantStreams:2} (0.00s) --- PASS: TestMultithreadCalculateChunks/{size:1048575_streams:2_wantPartSize:524288_wantStreams:2} (0.00s) === RUN TestMultithreadCopy run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" === RUN TestMultithreadCopy/{size:131071_streams:2} 2022/06/12 07:55:27 DEBUG : file1: Starting multi-thread copy with 2 parts of size 64Ki 2022/06/12 07:55:27 DEBUG : file1: multi-thread copy: stream 2/2 (65536-131071) size 63.999Ki starting 2022/06/12 07:55:27 DEBUG : file1: multi-thread copy: stream 1/2 (0-65536) size 64Ki starting 2022/06/12 07:55:28 DEBUG : file1: multi-thread copy: stream 1/2 (0-65536) size 64Ki finished 2022/06/12 07:55:29 DEBUG : file1: multi-thread copy: stream 2/2 (65536-131071) size 63.999Ki finished 2022/06/12 07:55:29 DEBUG : file1: Finished multi-thread copy with 2 parts of size 64Ki === RUN TestMultithreadCopy/{size:131072_streams:2} 2022/06/12 07:55:43 DEBUG : file1: Starting multi-thread copy with 2 parts of size 64Ki 2022/06/12 07:55:43 DEBUG : file1: multi-thread copy: stream 2/2 (65536-131072) size 64Ki starting 2022/06/12 07:55:43 DEBUG : file1: multi-thread copy: stream 1/2 (0-65536) size 64Ki starting 2022/06/12 07:55:44 DEBUG : file1: multi-thread copy: stream 2/2 (65536-131072) size 64Ki finished 2022/06/12 07:55:44 DEBUG : file1: multi-thread copy: stream 1/2 (0-65536) size 64Ki finished 2022/06/12 07:55:44 DEBUG : file1: Finished multi-thread copy with 2 parts of size 64Ki === RUN TestMultithreadCopy/{size:131073_streams:2} 2022/06/12 07:56:09 DEBUG : file1: Starting multi-thread copy with 2 parts of size 128Ki 2022/06/12 07:56:09 DEBUG : file1: multi-thread copy: stream 2/2 (131072-131073) size 1 starting 2022/06/12 07:56:09 DEBUG : file1: multi-thread copy: stream 1/2 (0-131072) size 128Ki starting 2022/06/12 07:56:09 DEBUG : file1: multi-thread copy: stream 2/2 (131072-131073) size 1 finished 2022/06/12 07:56:10 DEBUG : file1: multi-thread copy: stream 1/2 (0-131072) size 128Ki finished 2022/06/12 07:56:10 DEBUG : file1: Finished multi-thread copy with 2 parts of size 128Ki --- PASS: TestMultithreadCopy (113.81s) --- PASS: TestMultithreadCopy/{size:131071_streams:2} (58.54s) --- PASS: TestMultithreadCopy/{size:131072_streams:2} (15.46s) --- PASS: TestMultithreadCopy/{size:131073_streams:2} (25.87s) === RUN TestSizeDiffers --- PASS: TestSizeDiffers (0.00s) === RUN TestReOpen === RUN TestReOpen/Seek === RUN TestReOpen/Seek/Basics === RUN TestReOpen/Seek/ErrorAtStart === RUN TestReOpen/Seek/WithErrors 2022/06/12 07:56:24 DEBUG : potato: Reopening on read failure after 2 bytes: retry 1/10: test error 2022/06/12 07:56:24 DEBUG : potato: Reopening on read failure after 3 bytes: retry 2/10: test error 2022/06/12 07:56:24 DEBUG : potato: Reopening on read failure after 6 bytes: retry 3/10: test error === RUN TestReOpen/Seek/TooManyErrors 2022/06/12 07:56:24 DEBUG : potato: Reopening on read failure after 2 bytes: retry 1/3: test error 2022/06/12 07:56:24 DEBUG : potato: Reopening on read failure after 3 bytes: retry 2/3: test error 2022/06/12 07:56:24 DEBUG : potato: Reopening on read failure after 6 bytes: retry 3/3: test error 2022/06/12 07:56:24 DEBUG : potato: Reopen failed after 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/Range === RUN TestReOpen/Range/Basics === RUN TestReOpen/Range/ErrorAtStart === RUN TestReOpen/Range/WithErrors 2022/06/12 07:56:24 DEBUG : potato: Reopening on read failure after 2 bytes: retry 1/10: test error 2022/06/12 07:56:24 DEBUG : potato: Reopening on read failure after 3 bytes: retry 2/10: test error 2022/06/12 07:56:24 DEBUG : potato: Reopening on read failure after 6 bytes: retry 3/10: test error === RUN TestReOpen/Range/TooManyErrors 2022/06/12 07:56:24 DEBUG : potato: Reopening on read failure after 2 bytes: retry 1/3: test error 2022/06/12 07:56:24 DEBUG : potato: Reopening on read failure after 3 bytes: retry 2/3: test error 2022/06/12 07:56:24 DEBUG : potato: Reopening on read failure after 6 bytes: retry 3/3: test error 2022/06/12 07:56:24 DEBUG : potato: Reopen failed after 6 bytes read: failed to reopen: too many retries --- PASS: TestReOpen (0.00s) --- PASS: TestReOpen/Seek (0.00s) --- PASS: TestReOpen/Seek/Basics (0.00s) --- PASS: TestReOpen/Seek/ErrorAtStart (0.00s) --- PASS: TestReOpen/Seek/WithErrors (0.00s) --- PASS: TestReOpen/Seek/TooManyErrors (0.00s) --- PASS: TestReOpen/Range (0.00s) --- PASS: TestReOpen/Range/Basics (0.00s) --- PASS: TestReOpen/Range/ErrorAtStart (0.00s) --- PASS: TestReOpen/Range/WithErrors (0.00s) --- PASS: TestReOpen/Range/TooManyErrors (0.00s) === RUN TestCheck run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" === RUN TestCheck/1 === RUN TestCheck/2 === RUN TestCheck/3 === RUN TestCheck/4 === RUN TestCheck/5 === RUN TestCheck/6 === RUN TestCheck/7 --- PASS: TestCheck (222.01s) --- PASS: TestCheck/1 (0.44s) --- PASS: TestCheck/2 (0.41s) --- PASS: TestCheck/3 (0.40s) --- PASS: TestCheck/4 (0.40s) --- PASS: TestCheck/5 (0.40s) --- PASS: TestCheck/6 (0.40s) --- PASS: TestCheck/7 (0.40s) === RUN TestCheckFsError 2022/06/12 08:00:06 DEBUG : Creating backend with remote "non-existent" 2022/06/12 08:00:06 DEBUG : Creating backend with remote "non-existent" 2022/06/12 08:00:06 DEBUG : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/non-existent: Waiting for checks to finish 2022/06/12 08:00:06 ERROR : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/non-existent: error reading source root directory: directory not found 2022/06/12 08:00:06 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/non-existent: 2 differences found 2022/06/12 08:00:06 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/non-existent: 2 errors while checking --- PASS: TestCheckFsError (0.00s) === RUN TestCheckDownload run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" === RUN TestCheckDownload/1 === RUN TestCheckDownload/2 === RUN TestCheckDownload/3 === RUN TestCheckDownload/4 === RUN TestCheckDownload/5 === RUN TestCheckDownload/6 === RUN TestCheckDownload/7 --- PASS: TestCheckDownload (342.18s) --- PASS: TestCheckDownload/1 (1.27s) --- PASS: TestCheckDownload/2 (0.77s) --- PASS: TestCheckDownload/3 (1.29s) --- PASS: TestCheckDownload/4 (0.75s) --- PASS: TestCheckDownload/5 (0.94s) --- PASS: TestCheckDownload/6 (0.76s) --- PASS: TestCheckDownload/7 (0.78s) === RUN TestCheckSizeOnly run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" === RUN TestCheckSizeOnly/1 === RUN TestCheckSizeOnly/2 === RUN TestCheckSizeOnly/3 === RUN TestCheckSizeOnly/4 === RUN TestCheckSizeOnly/5 === RUN TestCheckSizeOnly/6 === RUN TestCheckSizeOnly/7 --- PASS: TestCheckSizeOnly (386.23s) --- PASS: TestCheckSizeOnly/1 (0.40s) --- PASS: TestCheckSizeOnly/2 (0.41s) --- PASS: TestCheckSizeOnly/3 (0.41s) --- PASS: TestCheckSizeOnly/4 (1.41s) --- PASS: TestCheckSizeOnly/5 (0.41s) --- PASS: TestCheckSizeOnly/6 (0.23s) --- PASS: TestCheckSizeOnly/7 (0.27s) === RUN TestCheckEqualReaders --- PASS: TestCheckEqualReaders (0.00s) === RUN TestParseSumFile run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" 2022/06/12 08:13:11 NOTICE: test.sum: improperly formatted checksum line 4 2022/06/12 08:13:11 NOTICE: test.sum: improperly formatted checksum line 5 2022/06/12 08:13:11 NOTICE: test.sum: improperly formatted checksum line 6 2022/06/12 08:13:11 NOTICE: test.sum: 2 warning(s) suppressed... 2022/06/12 08:13:35 NOTICE: test.sum: improperly formatted checksum line 4 2022/06/12 08:13:35 NOTICE: test.sum: improperly formatted checksum line 5 2022/06/12 08:13:35 NOTICE: test.sum: improperly formatted checksum line 6 2022/06/12 08:13:35 NOTICE: test.sum: 2 warning(s) suppressed... --- PASS: TestParseSumFile (104.42s) === RUN TestCheckSum run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" 2022/06/12 08:13:59 DEBUG : Creating backend with remote "TestIA:rclone-integration-test/rclone-test-wefufix0gahiwap4jusexoz3/data" === RUN TestCheckSum/subtest1 === RUN TestCheckSum/subtest2 === RUN TestCheckSum/subtest3 === RUN TestCheckSum/subtest4 === RUN TestCheckSum/subtest5 === RUN TestCheckSum/subtest6 === RUN TestCheckSum/subtest7 --- PASS: TestCheckSum (562.09s) --- PASS: TestCheckSum/subtest1 (1.67s) --- PASS: TestCheckSum/subtest2 (1.65s) --- PASS: TestCheckSum/subtest3 (1.16s) --- PASS: TestCheckSum/subtest4 (1.51s) --- PASS: TestCheckSum/subtest5 (1.31s) --- PASS: TestCheckSum/subtest6 (1.30s) --- PASS: TestCheckSum/subtest7 (1.71s) === RUN TestCheckSumDownload run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" 2022/06/12 08:23:21 DEBUG : Creating backend with remote "TestIA:rclone-integration-test/rclone-test-wefufix0gahiwap4jusexoz3/data" === RUN TestCheckSumDownload/subtest1 === RUN TestCheckSumDownload/subtest2 === RUN TestCheckSumDownload/subtest3 === RUN TestCheckSumDownload/subtest4 === RUN TestCheckSumDownload/subtest5 === RUN TestCheckSumDownload/subtest6 === RUN TestCheckSumDownload/subtest7 --- PASS: TestCheckSumDownload (598.27s) --- PASS: TestCheckSumDownload/subtest1 (1.85s) --- PASS: TestCheckSumDownload/subtest2 (1.38s) --- PASS: TestCheckSumDownload/subtest3 (1.37s) --- PASS: TestCheckSumDownload/subtest4 (1.35s) --- PASS: TestCheckSumDownload/subtest5 (1.34s) --- PASS: TestCheckSumDownload/subtest6 (1.35s) --- PASS: TestCheckSumDownload/subtest7 (2.57s) === RUN TestDeduplicateInteractive run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateInteractive (0.81s) === RUN TestDeduplicateSkip run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSkip (0.79s) === RUN TestDeduplicateSizeOnly run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSizeOnly (0.80s) === RUN TestDeduplicateFirst run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateFirst (0.80s) === RUN TestDeduplicateNewest run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateNewest (0.82s) === RUN TestDeduplicateNewestByHash run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" 2022/06/12 08:35:06 INFO : Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3: Looking for duplicate md5 hashes using newest mode. 2022/06/12 08:35:06 NOTICE: ea3b00b14b3fdddf9e4043bc7e643cbf: Found 3 files with duplicate md5 hashes 2022/06/12 08:35:39 INFO : one: Deleted 2022/06/12 08:36:12 INFO : also/one: Deleted 2022/06/12 08:36:12 NOTICE: ea3b00b14b3fdddf9e4043bc7e643cbf: Deleted 2 extra copies --- PASS: TestDeduplicateNewestByHash (215.02s) === RUN TestDeduplicateOldest run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateOldest (0.48s) === RUN TestDeduplicateLargest run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateLargest (0.47s) === RUN TestDeduplicateSmallest run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSmallest (0.49s) === RUN TestDeduplicateRename run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateRename (0.46s) === RUN TestMergeDirs run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" dedupe_test.go:267: Can't merge directories --- SKIP: TestMergeDirs (0.48s) === RUN TestListDirSorted run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" 2022/06/12 08:40:15 DEBUG : a.txt: Excluded 2022/06/12 08:40:15 DEBUG : sub dir/hello world: Excluded 2022/06/12 08:40:15 DEBUG : sub dir/hello world2: Excluded 2022/06/12 08:40:15 DEBUG : sub dir/hello world: Excluded 2022/06/12 08:40:15 DEBUG : sub dir/hello world2: Excluded 2022/06/12 08:40:16 DEBUG : sub dir/ignore dir: Excluded 2022/06/12 08:40:16 DEBUG : sub dir/ignore dir: Excluded --- PASS: TestListDirSorted (368.10s) === RUN TestListJSON run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" === RUN TestListJSON/Default === RUN TestListJSON/FilesOnly === RUN TestListJSON/DirsOnly === RUN TestListJSON/Recurse === RUN TestListJSON/SubDir === RUN TestListJSON/NoModTime === RUN TestListJSON/NoMimeType === RUN TestListJSON/ShowHash === RUN TestListJSON/HashTypes --- PASS: TestListJSON (204.56s) --- PASS: TestListJSON/Default (0.40s) --- PASS: TestListJSON/FilesOnly (0.40s) --- PASS: TestListJSON/DirsOnly (0.40s) --- PASS: TestListJSON/Recurse (0.40s) --- PASS: TestListJSON/SubDir (0.40s) --- PASS: TestListJSON/NoModTime (0.39s) --- PASS: TestListJSON/NoMimeType (0.40s) --- PASS: TestListJSON/ShowHash (0.42s) --- PASS: TestListJSON/HashTypes (0.39s) === RUN TestStatJSON run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" === RUN TestStatJSON/Root === RUN TestStatJSON/RootFilesOnly === RUN TestStatJSON/RootDirsOnly === RUN TestStatJSON/Dir === RUN TestStatJSON/File === RUN TestStatJSON/NotFound === RUN TestStatJSON/DirFilesOnly === RUN TestStatJSON/FileFilesOnly === RUN TestStatJSON/NotFoundFilesOnly === RUN TestStatJSON/DirDirsOnly === RUN TestStatJSON/FileDirsOnly === RUN TestStatJSON/NotFoundDirsOnly === RUN TestStatJSON/RootNotFound 2022/06/12 08:48:10 DEBUG : Creating backend with remote "TestIA:rclone-integration-test/rclone-test-wefufix0gahiwap4jusexoz3/notfound" --- PASS: TestStatJSON (153.40s) --- PASS: TestStatJSON/Root (0.60s) --- PASS: TestStatJSON/RootFilesOnly (0.00s) --- PASS: TestStatJSON/RootDirsOnly (0.56s) --- PASS: TestStatJSON/Dir (1.09s) --- PASS: TestStatJSON/File (0.53s) --- PASS: TestStatJSON/NotFound (0.76s) --- PASS: TestStatJSON/DirFilesOnly (0.39s) --- PASS: TestStatJSON/FileFilesOnly (0.39s) --- PASS: TestStatJSON/NotFoundFilesOnly (0.38s) --- PASS: TestStatJSON/DirDirsOnly (0.37s) --- PASS: TestStatJSON/FileDirsOnly (0.37s) --- PASS: TestStatJSON/NotFoundDirsOnly (0.38s) --- PASS: TestStatJSON/RootNotFound (0.75s) === RUN TestMkdir run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" 2022/06/12 08:49:07 DEBUG : Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3: Making directory 2022/06/12 08:49:07 DEBUG : Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3: Making directory --- PASS: TestMkdir (1.18s) === RUN TestLsd run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" --- PASS: TestLsd (78.23s) === RUN TestLs run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" --- PASS: TestLs (92.63s) === RUN TestLsWithFilesFrom run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" 2022/06/12 08:53:06 DEBUG : empty space: Excluded --- PASS: TestLsWithFilesFrom (113.42s) === RUN TestLsLong run.go:181: Remote "Internet Archive item rclone-integration-test path rclone-test-wefufix0gahiwap4jusexoz3", Local "Local file system at /tmp/rclone4228179240", Modify Window "1ns" panic: test timed out after 1h0m0s goroutine 3232 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:1788 +0x8e created by time.goFunc /usr/local/go/src/time/sleep.go:180 +0x31 goroutine 1 [chan receive]: testing.(*T).Run(0xc0003c0680, {0x19aa30a, 0x15}, 0x1a54970) /usr/local/go/src/testing/testing.go:1307 +0x375 testing.runTests.func1(0xc0008029f0) /usr/local/go/src/testing/testing.go:1598 +0x6e testing.tRunner(0xc0003c0680, 0xc000957ca0) /usr/local/go/src/testing/testing.go:1259 +0x102 testing.runTests(0xc0004f8800, {0x2ab8780, 0x54, 0x54}, {0xf29e80, 0xc000a0b1a0, 0x2ac62a0}) /usr/local/go/src/testing/testing.go:1596 +0x43f testing.(*M).Run(0xc0004f8800) /usr/local/go/src/testing/testing.go:1504 +0x51d github.com/rclone/rclone/fstest.TestMain(0xc0000001a0) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:70 +0x9e github.com/rclone/rclone/fs/operations_test.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:61 main.main() _testmain.go:213 +0x166 goroutine 7 [select]: go.opencensus.io/stats/view.(*worker).start(0xc0000f7a00) /home/rclone/go/pkg/mod/go.opencensus.io@v0.23.0/stats/view/worker.go:276 +0xb9 created by go.opencensus.io/stats/view.init.0 /home/rclone/go/pkg/mod/go.opencensus.io@v0.23.0/stats/view/worker.go:34 +0x92 goroutine 10 [IO wait]: internal/poll.runtime_pollWait(0x7f22ef5c5f30, 0x72) /usr/local/go/src/runtime/netpoll.go:234 +0x89 internal/poll.(*pollDesc).wait(0xc000166880, 0xc00075a000, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc000166880, {0xc00075a000, 0x112f8, 0x112f8}) /usr/local/go/src/internal/poll/fd_unix.go:167 +0x25a net.(*netFD).Read(0xc000166880, {0xc00075a000, 0xc00057ea00, 0xc000764328}) /usr/local/go/src/net/fd_posix.go:56 +0x29 net.(*conn).Read(0xc00012e008, {0xc00075a000, 0xc000764328, 0x19}) /usr/local/go/src/net/net.go:183 +0x45 github.com/rclone/rclone/fs/fshttp.(*timeoutConn).Read(0xc000110000, {0xc00075a000, 0xd, 0x10000c000971f00}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:104 +0x32 crypto/tls.(*atLeastReader).Read(0xc000ac4558, {0xc00075a000, 0x0, 0x40bb8d}) /usr/local/go/src/crypto/tls/conn.go:777 +0x3d bytes.(*Buffer).ReadFrom(0xc000526cf8, {0x1d6c160, 0xc000ac4558}) /usr/local/go/src/bytes/buffer.go:204 +0x98 crypto/tls.(*Conn).readFromUntil(0xc000526a80, {0x7f22ed4f6230, 0xc000110000}, 0x6fdd) /usr/local/go/src/crypto/tls/conn.go:799 +0xe5 crypto/tls.(*Conn).readRecordOrCCS(0xc000526a80, 0x0) /usr/local/go/src/crypto/tls/conn.go:606 +0x112 crypto/tls.(*Conn).readRecord(...) /usr/local/go/src/crypto/tls/conn.go:574 crypto/tls.(*Conn).Read(0xc000526a80, {0xc000a3d000, 0x1000, 0x0}) /usr/local/go/src/crypto/tls/conn.go:1277 +0x16f bufio.(*Reader).Read(0xc0005655c0, {0xc00056d618, 0x9, 0xc0007b0c30}) /usr/local/go/src/bufio/bufio.go:227 +0x1b4 io.ReadAtLeast({0x1d6bf60, 0xc0005655c0}, {0xc00056d618, 0x9, 0x9}, 0x9) /usr/local/go/src/io/io.go:328 +0x9a io.ReadFull(...) /usr/local/go/src/io/io.go:347 net/http.http2readFrameHeader({0xc00056d618, 0x9, 0xc000984420}, {0x1d6bf60, 0xc0005655c0}) /usr/local/go/src/net/http/h2_bundle.go:1555 +0x6e net/http.(*http2Framer).ReadFrame(0xc00056d5e0) /usr/local/go/src/net/http/h2_bundle.go:1813 +0x95 net/http.(*http2clientConnReadLoop).run(0xc00072bf98) /usr/local/go/src/net/http/h2_bundle.go:8583 +0x130 net/http.(*http2ClientConn).readLoop(0xc00002e000) /usr/local/go/src/net/http/h2_bundle.go:8506 +0x6f created by net/http.(*http2Transport).newClientConn /usr/local/go/src/net/http/h2_bundle.go:7317 +0xb85 goroutine 1355 [chan receive (nil chan), 44 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 384 [chan receive (nil chan), 56 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 468 [chan receive (nil chan), 56 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 411 [chan receive (nil chan), 56 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 295 [chan receive (nil chan), 57 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 359 [chan receive (nil chan), 57 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 1341 [chan receive (nil chan), 44 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 906 [chan receive (nil chan), 51 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 507 [chan receive (nil chan), 56 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 3243 [select]: github.com/rclone/rclone/backend/internetarchive.(*Fs).waitFileUpload(0xc0004fa840, {0x1da4e90, 0xc000040058}, {0x19a5e86, 0x7}, {0xc00092dda0, 0x20}, 0x3c) /home/rclone/go/src/github.com/rclone/rclone/backend/internetarchive/internetarchive.go:943 +0x506 github.com/rclone/rclone/backend/internetarchive.(*Object).Update(0xc0003a78f0, {0x1da4e90, 0xc000040058}, {0x1d6bfa0, 0xc000240ae0}, {0x1dbd790, 0xc0009f5900}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/internetarchive/internetarchive.go:721 +0x9c5 github.com/rclone/rclone/backend/internetarchive.(*Fs).Put(0xc0004fa840, {0x1da4e90, 0xc000040058}, {0x1d6bfa0, 0xc000240ae0}, {0x1dbd790, 0xc0009f5900}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/internetarchive/internetarchive.go:444 +0x1d6 github.com/rclone/rclone/fstest.(*Run).WriteObjectTo(0xc0003a7880, {0x1da4e90, 0xc000040058}, {0x1dd5ea8, 0xc0004fa840}, {0x19a5e86, 0x7}, {0x1a13a8c, 0x3c}, {0x1dcd64ff, ...}, ...) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:277 +0x432 github.com/rclone/rclone/fstest.(*Run).WriteObject(...) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:294 github.com/rclone/rclone/fstest.(*Run).WriteBoth(0xc0003a7880, {0x1da4e90, 0xc000040058}, {0x19a5e86, 0x7}, {0x1a13a8c, 0x3c}, {0x1dcd64ff, 0xeb20d7a72, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:305 +0x125 github.com/rclone/rclone/fs/operations_test.TestLsLong(0xc0007f16c0) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:146 +0xf2 testing.tRunner(0xc0007f16c0, 0x1a54970) /usr/local/go/src/testing/testing.go:1259 +0x102 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1306 +0x35a goroutine 732 [chan receive (nil chan), 53 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 989 [chan receive (nil chan), 50 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 613 [chan receive (nil chan), 54 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 540 [chan receive (nil chan), 56 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 667 [chan receive (nil chan), 53 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 1218 [chan receive (nil chan), 46 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 834 [chan receive (nil chan), 51 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 787 [chan receive (nil chan), 51 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 943 [chan receive (nil chan), 50 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 1253 [chan receive (nil chan), 44 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 3227 [sleep]: time.Sleep(0x2540be400) /usr/local/go/src/runtime/time.go:193 +0x12e github.com/rclone/rclone/backend/internetarchive.(*Fs).waitFileUpload.func1() /home/rclone/go/src/github.com/rclone/rclone/backend/internetarchive/internetarchive.go:885 +0x153 created by github.com/rclone/rclone/backend/internetarchive.(*Fs).waitFileUpload /home/rclone/go/src/github.com/rclone/rclone/backend/internetarchive/internetarchive.go:879 +0x47b goroutine 1125 [chan receive (nil chan), 47 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 1153 [chan receive (nil chan), 47 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 goroutine 1307 [chan receive (nil chan), 44 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:208 +0x45 created by github.com/rclone/rclone/fs/march.(*March).Run /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:206 +0x3a5 "./operations.test -test.v -test.timeout 1h0m0s -remote TestIA:rclone-integration-test -verbose" - Finished ERROR in 1h0m1.031480143s (try 3/5): exit status 2: Failed []