"./operations.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose -test.run '^(TestCheckSumDownload|TestCopyFileCompareDest|TestMultithreadCopy|TestTouchDir)$/^{size:131071_streams:2}$'" - Starting (try 4/5) 2022/05/21 06:20:54 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jamorec2qohereg3xecubed1" 2022/05/21 06:20:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2022/05/21 06:20:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/21 06:20:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/21 06:20:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2022/05/21 06:20:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/21 06:20:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/21 06:20:55 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2022/05/21 06:20:55 DEBUG : Creating backend with remote "/tmp/rclone631141191" === RUN TestMultithreadCopy run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone631141191", Modify Window "1s" === RUN TestMultithreadCopy/{size:131071_streams:2} 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: mkdir [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jamorec2qohereg3xecubed1/file1] === CONT TestMultithreadCopy run.go:287: Failed to put "file1" to "hdfs://127.0.0.1:8020": create /rclone-test-jamorec2qohereg3xecubed1/file1: replication in progress === CONT TestMultithreadCopy/{size:131071_streams:2} testing.go:1169: test executed panic(nil) or runtime.Goexit: subtest may have called FailNow on a parent test 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] --- FAIL: TestMultithreadCopy (0.38s) --- FAIL: TestMultithreadCopy/{size:131071_streams:2} (0.37s) === RUN TestCheckSumDownload run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone631141191", Modify Window "1s" 2022/05/21 06:20:55 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jamorec2qohereg3xecubed1/data" 2022/05/21 06:20:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2022/05/21 06:20:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/21 06:20:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/21 06:20:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2022/05/21 06:20:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/21 06:20:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jamorec2qohereg3xecubed1/data/banana] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jamorec2qohereg3xecubed1/test.sum] run.go:287: Failed to put "test.sum" to "hdfs://127.0.0.1:8020": create /rclone-test-jamorec2qohereg3xecubed1/test.sum: replication in progress 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/data] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jamorec2qohereg3xecubed1/data/banana] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jamorec2qohereg3xecubed1/data] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] --- FAIL: TestCheckSumDownload (0.13s) === RUN TestCopyFileCompareDest run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone631141191", Modify Window "1s" 2022/05/21 06:20:55 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jamorec2qohereg3xecubed1/dst" 2022/05/21 06:20:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2022/05/21 06:20:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/21 06:20:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/21 06:20:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2022/05/21 06:20:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/21 06:20:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jamorec2qohereg3xecubed1/dst/one] 2022/05/21 06:20:55 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jamorec2qohereg3xecubed1/CompareDest" 2022/05/21 06:20:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2022/05/21 06:20:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/21 06:20:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/21 06:20:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2022/05/21 06:20:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/21 06:20:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/21 06:20:55 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jamorec2qohereg3xecubed1/CompareDest" to be canonical "TestHdfs{cNNQW}:rclone-test-jamorec2qohereg3xecubed1/CompareDest" 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jamorec2qohereg3xecubed1/CompareDest/one] 2022/05/21 06:20:55 DEBUG : one: Need to transfer - File not found at Destination 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jamorec2qohereg3xecubed1/dst/one] 2022/05/21 06:20:55 INFO : one: Copied (new) 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/dst] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/dst] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jamorec2qohereg3xecubed1/dst/one] 2022/05/21 06:20:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jamorec2qohereg3xecubed1/CompareDest" for canonical name "TestHdfs{cNNQW}:rclone-test-jamorec2qohereg3xecubed1/CompareDest" 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jamorec2qohereg3xecubed1/CompareDest/one] 2022/05/21 06:20:55 DEBUG : one: Sizes differ (src 5 vs dst 3) 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jamorec2qohereg3xecubed1/dst/one] 2022/05/21 06:20:55 INFO : one: Copied (replaced existing) 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/dst] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jamorec2qohereg3xecubed1/dst/one] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jamorec2qohereg3xecubed1/CompareDest/one] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/dst] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/CompareDest] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jamorec2qohereg3xecubed1/dst/one] 2022/05/21 06:20:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jamorec2qohereg3xecubed1/CompareDest" for canonical name "TestHdfs{cNNQW}:rclone-test-jamorec2qohereg3xecubed1/CompareDest" 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jamorec2qohereg3xecubed1/CompareDest/one] 2022/05/21 06:20:55 DEBUG : one: Size and modification time the same (differ by -123.456789ms, within tolerance 1s) 2022/05/21 06:20:55 DEBUG : one: Destination found in --compare-dest, skipping 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/dst] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/CompareDest] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jamorec2qohereg3xecubed1/CompareDest/two] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/dst] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/CompareDest] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jamorec2qohereg3xecubed1/dst/two] 2022/05/21 06:20:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jamorec2qohereg3xecubed1/CompareDest" for canonical name "TestHdfs{cNNQW}:rclone-test-jamorec2qohereg3xecubed1/CompareDest" 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jamorec2qohereg3xecubed1/CompareDest/two] 2022/05/21 06:20:55 DEBUG : two: Size and modification time the same (differ by -123.456789ms, within tolerance 1s) 2022/05/21 06:20:55 DEBUG : two: Destination found in --compare-dest, skipping 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/dst] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/CompareDest] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jamorec2qohereg3xecubed1/dst/two] 2022/05/21 06:20:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jamorec2qohereg3xecubed1/CompareDest" for canonical name "TestHdfs{cNNQW}:rclone-test-jamorec2qohereg3xecubed1/CompareDest" 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jamorec2qohereg3xecubed1/CompareDest/two] 2022/05/21 06:20:55 DEBUG : two: Size and modification time the same (differ by -123.456789ms, within tolerance 1s) 2022/05/21 06:20:55 DEBUG : two: Destination found in --compare-dest, skipping 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/dst] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/CompareDest] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/dst] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/CompareDest] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jamorec2qohereg3xecubed1/dst/two] 2022/05/21 06:20:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jamorec2qohereg3xecubed1/CompareDest" for canonical name "TestHdfs{cNNQW}:rclone-test-jamorec2qohereg3xecubed1/CompareDest" 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jamorec2qohereg3xecubed1/CompareDest/two] 2022/05/21 06:20:55 DEBUG : two: Sizes differ (src 5 vs dst 3) 2022/05/21 06:20:55 DEBUG : two: Need to transfer - File not found at Destination 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jamorec2qohereg3xecubed1/dst/two] 2022/05/21 06:20:55 INFO : two: Copied (new) 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/CompareDest] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/dst] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/dst] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/CompareDest] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jamorec2qohereg3xecubed1/dst/one] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jamorec2qohereg3xecubed1/dst/two] 2022/05/21 06:20:55 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jamorec2qohereg3xecubed1/CompareDest/one] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jamorec2qohereg3xecubed1/CompareDest/two] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jamorec2qohereg3xecubed1/dst] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jamorec2qohereg3xecubed1/CompareDest] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] --- PASS: TestCopyFileCompareDest (0.36s) === RUN TestTouchDir run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone631141191", Modify Window "1s" 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jamorec2qohereg3xecubed1/potato2] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jamorec2qohereg3xecubed1/empty space] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jamorec2qohereg3xecubed1/sub dir/potato3] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/sub dir] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: Touching "empty space" 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: Touching "potato2" 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/sub dir] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: Touching "sub dir/potato3" 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/sub dir] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jamorec2qohereg3xecubed1/empty space] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jamorec2qohereg3xecubed1/potato2] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1/sub dir] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jamorec2qohereg3xecubed1/sub dir/potato3] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jamorec2qohereg3xecubed1/sub dir] 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jamorec2qohereg3xecubed1] --- PASS: TestTouchDir (0.20s) FAIL 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: Purge remote 2022/05/21 06:20:56 DEBUG : hdfs://127.0.0.1:8020: purge [/rclone-test-jamorec2qohereg3xecubed1] "./operations.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose -test.run '^(TestCheckSumDownload|TestCopyFileCompareDest|TestMultithreadCopy|TestTouchDir)$/^{size:131071_streams:2}$'" - Finished ERROR in 1.291589213s (try 4/5): exit status 1: Failed [TestMultithreadCopy/{size:131071_streams:2} TestCheckSumDownload]