"./sync.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose -test.run '^(TestCopy|TestMoveWithIgnoreExisting|TestServerSideCopy|TestServerSideMoveWithFilter|TestSyncAfterRemovingAFileAndAddingAFileSubDir|TestSyncBasedOnCheckSum|TestSyncConcurrentDelete|TestSyncConcurrentTruncate|TestSyncIgnoreErrors|TestSyncIgnoreTimes|TestSyncSuffixKeepExtension)$'" - Starting (try 2/5) 2022/05/18 05:39:32 DEBUG : Creating backend with remote "TestHdfs:rclone-test-sanubuh8kecakux6bijisus9" 2022/05/18 05:39:32 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2022/05/18 05:39:32 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/18 05:39:32 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/18 05:39:32 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2022/05/18 05:39:32 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/18 05:39:32 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/18 05:39:32 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2022/05/18 05:39:32 DEBUG : Creating backend with remote "/tmp/rclone2249583015" === RUN TestCopy run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone2249583015", Modify Window "1s" 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: mkdir [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/sub dir/hello world] 2022/05/18 05:39:32 ERROR : sub dir/hello world: Failed to copy: create /rclone-test-sanubuh8kecakux6bijisus9/sub dir/hello world: replication in progress sync_test.go:65: Error Trace: sync_test.go:65 Error: Received unexpected error: create /rclone-test-sanubuh8kecakux6bijisus9/sub dir/hello world: replication in progress Test: TestCopy 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/sub dir] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-sanubuh8kecakux6bijisus9/sub dir] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] --- FAIL: TestCopy (0.28s) === RUN TestServerSideCopy run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone2249583015", Modify Window "1s" 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/sub dir/hello world] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/sub dir] 2022/05/18 05:39:32 DEBUG : Creating backend with remote "TestHdfs:rclone-test-sokiwuk2nacobah1xuwedow3" 2022/05/18 05:39:32 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2022/05/18 05:39:32 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/18 05:39:32 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/18 05:39:32 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2022/05/18 05:39:32 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/18 05:39:32 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME sync_test.go:275: Server side copy (if possible) hdfs://127.0.0.1:8020 -> hdfs://127.0.0.1:8020 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sokiwuk2nacobah1xuwedow3] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/sub dir] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: open [/rclone-test-sanubuh8kecakux6bijisus9/sub dir/hello world] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sokiwuk2nacobah1xuwedow3/sub dir/hello world] 2022/05/18 05:39:32 INFO : sub dir/hello world: Copied (new) 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sokiwuk2nacobah1xuwedow3] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sokiwuk2nacobah1xuwedow3/sub dir] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Purge remote 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: purge [/rclone-test-sokiwuk2nacobah1xuwedow3] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/sub dir] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/sub dir/hello world] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-sanubuh8kecakux6bijisus9/sub dir] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] --- PASS: TestServerSideCopy (0.19s) === RUN TestSyncBasedOnCheckSum run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone2249583015", Modify Window "1s" 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/check sum] 2022/05/18 05:39:32 INFO : check sum: Copied (new) 2022/05/18 05:39:32 DEBUG : Waiting for deletions to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 NOTICE: hdfs://127.0.0.1:8020: --checksum is in use but the source and destination have no hashes in common; falling back to --size-only 2022/05/18 05:39:32 DEBUG : check sum: Size of src and dst objects identical 2022/05/18 05:39:32 DEBUG : check sum: Unchanged skipping 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/05/18 05:39:32 DEBUG : Waiting for deletions to finish 2022/05/18 05:39:32 INFO : There was nothing to transfer 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/check sum] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] --- PASS: TestSyncBasedOnCheckSum (0.05s) === RUN TestSyncIgnoreTimes run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone2249583015", Modify Window "1s" 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/existing] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : existing: Size and modification time the same (differ by -499.999999ms, within tolerance 1s) 2022/05/18 05:39:32 DEBUG : existing: Unchanged skipping 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/05/18 05:39:32 DEBUG : Waiting for deletions to finish 2022/05/18 05:39:32 INFO : There was nothing to transfer 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : existing: Transferring unconditionally as --ignore-times is in use 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/existing] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/05/18 05:39:32 INFO : existing: Copied (replaced existing) 2022/05/18 05:39:32 DEBUG : Waiting for deletions to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/existing] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] --- PASS: TestSyncIgnoreTimes (0.05s) === RUN TestSyncIgnoreErrors run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone2249583015", Modify Window "1s" 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/b/potato] run.go:287: Failed to put "b/potato" to "hdfs://127.0.0.1:8020": create /rclone-test-sanubuh8kecakux6bijisus9/b/potato: replication in progress 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/b] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-sanubuh8kecakux6bijisus9/b] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] --- FAIL: TestSyncIgnoreErrors (0.02s) === RUN TestSyncAfterRemovingAFileAndAddingAFileSubDir run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone2249583015", Modify Window "1s" 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/b/potato] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/c/non empty space] 2022/05/18 05:39:32 DEBUG : d: Making directory 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: mkdir [/rclone-test-sanubuh8kecakux6bijisus9/d] 2022/05/18 05:39:32 DEBUG : d/e: Making directory 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: mkdir [/rclone-test-sanubuh8kecakux6bijisus9/d/e] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/d] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/b] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/c] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/d/e] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/b] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/d] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/a/potato2] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/c] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/d/e] 2022/05/18 05:39:32 DEBUG : c/non empty space: Size and modification time the same (differ by -123.456789ms, within tolerance 1s) 2022/05/18 05:39:32 DEBUG : c/non empty space: Unchanged skipping 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/05/18 05:39:32 INFO : a/potato2: Copied (new) 2022/05/18 05:39:32 DEBUG : Waiting for deletions to finish 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/b/potato] 2022/05/18 05:39:32 INFO : b/potato: Deleted 2022/05/18 05:39:32 INFO : d/e: Removing directory 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-sanubuh8kecakux6bijisus9/d/e] 2022/05/18 05:39:32 INFO : d: Removing directory 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-sanubuh8kecakux6bijisus9/d] 2022/05/18 05:39:32 INFO : b: Removing directory 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-sanubuh8kecakux6bijisus9/b] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: deleted 3 directories 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/c] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/a] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/c] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/a] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/c/non empty space] 2022/05/18 05:39:32 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/a/potato2] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-sanubuh8kecakux6bijisus9/c] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-sanubuh8kecakux6bijisus9/a] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] --- PASS: TestSyncAfterRemovingAFileAndAddingAFileSubDir (0.14s) === RUN TestMoveWithIgnoreExisting run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone2249583015", Modify Window "1s" 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/existing] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/existing-b] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/05/18 05:39:33 INFO : existing: Copied (new) 2022/05/18 05:39:33 INFO : existing: Deleted 2022/05/18 05:39:33 INFO : existing-b: Copied (new) 2022/05/18 05:39:33 INFO : existing-b: Deleted 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : existing: Destination exists, skipping 2022/05/18 05:39:33 DEBUG : existing: Not removing source file as destination file exists and --ignore-existing is set 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/05/18 05:39:33 INFO : There was nothing to transfer 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/existing] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/existing-b] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] --- PASS: TestMoveWithIgnoreExisting (0.04s) === RUN TestServerSideMoveWithFilter run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone2249583015", Modify Window "1s" 2022/05/18 05:39:33 DEBUG : Creating backend with remote "TestHdfs:rclone-test-mizihem2kacoyis1losodib9" 2022/05/18 05:39:33 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2022/05/18 05:39:33 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/18 05:39:33 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/18 05:39:33 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2022/05/18 05:39:33 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/18 05:39:33 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/potato2] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/empty space] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/potato3] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] sync_test.go:1215: Server side move (if possible) hdfs://127.0.0.1:8020 -> hdfs://127.0.0.1:8020 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-mizihem2kacoyis1losodib9/empty space] run.go:287: Failed to put "empty space" to "hdfs://127.0.0.1:8020": create /rclone-test-mizihem2kacoyis1losodib9/empty space: replication in progress 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: Purge remote 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: purge [/rclone-test-mizihem2kacoyis1losodib9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/empty space] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/potato2] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/potato3] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] --- FAIL: TestServerSideMoveWithFilter (0.06s) === RUN TestSyncSuffixKeepExtension run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone2249583015", Modify Window "1s" 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/dst/one] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/dst/two] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/dst/three.txt] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/dst] 2022/05/18 05:39:33 DEBUG : Creating backend with remote "TestHdfs:rclone-test-sanubuh8kecakux6bijisus9/dst" 2022/05/18 05:39:33 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2022/05/18 05:39:33 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/18 05:39:33 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/18 05:39:33 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2022/05/18 05:39:33 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/05/18 05:39:33 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-sanubuh8kecakux6bijisus9/dst/one] 2022/05/18 05:39:33 DEBUG : one: Sizes differ (src 4 vs dst 3) 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-sanubuh8kecakux6bijisus9/dst/one-2019-01-01] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: rename [/rclone-test-sanubuh8kecakux6bijisus9/dst/one] to [/rclone-test-sanubuh8kecakux6bijisus9/dst/one-2019-01-01] 2022/05/18 05:39:33 INFO : one: Moved (server-side) to: one-2019-01-01 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/dst/one] 2022/05/18 05:39:33 INFO : one: Copied (new) 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-sanubuh8kecakux6bijisus9/dst/two] 2022/05/18 05:39:33 DEBUG : two: Size and modification time the same (differ by -499.999999ms, within tolerance 1s) 2022/05/18 05:39:33 DEBUG : two: Unchanged skipping 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-sanubuh8kecakux6bijisus9/dst/three.txt] 2022/05/18 05:39:33 DEBUG : three.txt: Sizes differ (src 6 vs dst 5) 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-sanubuh8kecakux6bijisus9/dst/three-2019-01-01.txt] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: rename [/rclone-test-sanubuh8kecakux6bijisus9/dst/three.txt] to [/rclone-test-sanubuh8kecakux6bijisus9/dst/three-2019-01-01.txt] 2022/05/18 05:39:33 INFO : three.txt: Moved (server-side) to: three-2019-01-01.txt 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/dst/three.txt] 2022/05/18 05:39:33 INFO : three.txt: Copied (new) 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/dst] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/dst] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-sanubuh8kecakux6bijisus9/dst/one] 2022/05/18 05:39:33 DEBUG : one: Sizes differ (src 5 vs dst 4) 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-sanubuh8kecakux6bijisus9/dst/one-2019-01-01] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/dst/one-2019-01-01] 2022/05/18 05:39:33 INFO : one-2019-01-01: Deleted 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: rename [/rclone-test-sanubuh8kecakux6bijisus9/dst/one] to [/rclone-test-sanubuh8kecakux6bijisus9/dst/one-2019-01-01] 2022/05/18 05:39:33 INFO : one: Moved (server-side) to: one-2019-01-01 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/dst/one] 2022/05/18 05:39:33 INFO : one: Copied (new) 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-sanubuh8kecakux6bijisus9/dst/two] 2022/05/18 05:39:33 DEBUG : two: Size and modification time the same (differ by -499.999999ms, within tolerance 1s) 2022/05/18 05:39:33 DEBUG : two: Unchanged skipping 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-sanubuh8kecakux6bijisus9/dst/three.txt] 2022/05/18 05:39:33 DEBUG : three.txt: Sizes differ (src 19 vs dst 6) 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-sanubuh8kecakux6bijisus9/dst/three-2019-01-01.txt] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/dst/three-2019-01-01.txt] 2022/05/18 05:39:33 INFO : three-2019-01-01.txt: Deleted 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: rename [/rclone-test-sanubuh8kecakux6bijisus9/dst/three.txt] to [/rclone-test-sanubuh8kecakux6bijisus9/dst/three-2019-01-01.txt] 2022/05/18 05:39:33 INFO : three.txt: Moved (server-side) to: three-2019-01-01.txt 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/dst/three.txt] 2022/05/18 05:39:33 INFO : three.txt: Copied (new) 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/dst] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9/dst] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/dst/one] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/dst/one-2019-01-01] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/dst/three-2019-01-01.txt] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/dst/three.txt] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/dst/two] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-sanubuh8kecakux6bijisus9/dst] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] --- PASS: TestSyncSuffixKeepExtension (0.15s) === RUN TestSyncConcurrentDelete run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone2249583015", Modify Window "1s" 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both0] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only0] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both1] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only1] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both2] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only2] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both3] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only3] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both4] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only4] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both5] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only5] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both6] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only6] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both7] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only7] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both8] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only8] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both10] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only10] run.go:287: Failed to put "only10" to "hdfs://127.0.0.1:8020": create /rclone-test-sanubuh8kecakux6bijisus9/only10: replication in progress 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both0] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both1] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both10] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both2] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both3] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both4] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both5] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both6] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both7] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both8] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only0] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only1] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only2] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only3] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only4] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only5] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only6] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only7] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only8] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] --- FAIL: TestSyncConcurrentDelete (0.29s) === RUN TestSyncConcurrentTruncate run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone2249583015", Modify Window "1s" 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both0] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only0] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both1] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only1] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both2] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only2] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both3] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only3] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both4] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/only4] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-sanubuh8kecakux6bijisus9/both5] run.go:287: Failed to put "both5" to "hdfs://127.0.0.1:8020": create /rclone-test-sanubuh8kecakux6bijisus9/both5: replication in progress 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both0] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both1] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both2] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both3] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/both4] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only0] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only1] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only2] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only3] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-sanubuh8kecakux6bijisus9/only4] 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-sanubuh8kecakux6bijisus9] --- FAIL: TestSyncConcurrentTruncate (0.11s) FAIL 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: Purge remote 2022/05/18 05:39:33 DEBUG : hdfs://127.0.0.1:8020: purge [/rclone-test-sanubuh8kecakux6bijisus9] "./sync.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose -test.run '^(TestCopy|TestMoveWithIgnoreExisting|TestServerSideCopy|TestServerSideMoveWithFilter|TestSyncAfterRemovingAFileAndAddingAFileSubDir|TestSyncBasedOnCheckSum|TestSyncConcurrentDelete|TestSyncConcurrentTruncate|TestSyncIgnoreErrors|TestSyncIgnoreTimes|TestSyncSuffixKeepExtension)$'" - Finished ERROR in 1.539732079s (try 2/5): exit status 1: Failed [TestCopy TestSyncIgnoreErrors TestServerSideMoveWithFilter TestSyncConcurrentDelete TestSyncConcurrentTruncate]