"./sync.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose -test.run '^(TestCopy|TestMoveWithDeleteEmptySrcDirs|TestSyncAfterChangingContentsOnly|TestSyncBackupDirSuffixOnly|TestSyncCompareDest|TestSyncConcurrentDelete|TestSyncDeleteBefore|TestSyncEmptyDirectories|TestSyncWithTrackRenamesStrategyLeaf)$'" - Starting (try 3/5) 2022/06/17 08:03:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jiqovok2wovifez5nebasoy0" 2022/06/17 08:03:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2022/06/17 08:03:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/06/17 08:03:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/06/17 08:03:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2022/06/17 08:03:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/06/17 08:03:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/06/17 08:03:59 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2022/06/17 08:03:59 DEBUG : Creating backend with remote "/tmp/rclone4070727975" === RUN TestCopy run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone4070727975", Modify Window "1s" 2022/06/17 08:03:59 DEBUG : hdfs://127.0.0.1:8020: mkdir [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:03:59 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:03:59 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/06/17 08:03:59 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/06/17 08:03:59 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/sub dir/hello world] 2022/06/17 08:04:00 ERROR : sub dir/hello world: Failed to copy: create /rclone-test-jiqovok2wovifez5nebasoy0/sub dir/hello world: replication in progress sync_test.go:65: Error Trace: sync_test.go:65 Error: Received unexpected error: create /rclone-test-jiqovok2wovifez5nebasoy0/sub dir/hello world: replication in progress Test: TestCopy 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/sub dir] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jiqovok2wovifez5nebasoy0/sub dir] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] --- FAIL: TestCopy (0.21s) === RUN TestSyncEmptyDirectories run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone4070727975", Modify Window "1s" 2022/06/17 08:04:00 DEBUG : sub dir2: Making directory 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/sub dir/hello world] 2022/06/17 08:04:00 ERROR : sub dir/hello world: Failed to copy: create /rclone-test-jiqovok2wovifez5nebasoy0/sub dir/hello world: replication in progress 2022/06/17 08:04:00 DEBUG : sub dir2: Making directory 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: mkdir [/rclone-test-jiqovok2wovifez5nebasoy0/sub dir2] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: failed to copy 2 directories 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: copied 1 directories 2022/06/17 08:04:00 ERROR : hdfs://127.0.0.1:8020: not deleting files as there were IO errors 2022/06/17 08:04:00 ERROR : hdfs://127.0.0.1:8020: not deleting directories as there were IO errors sync_test.go:250: Error Trace: sync_test.go:250 Error: Received unexpected error: create /rclone-test-jiqovok2wovifez5nebasoy0/sub dir/hello world: replication in progress Test: TestSyncEmptyDirectories 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/sub dir2] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/sub dir] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jiqovok2wovifez5nebasoy0/sub dir2] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jiqovok2wovifez5nebasoy0/sub dir] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] --- FAIL: TestSyncEmptyDirectories (0.05s) === RUN TestSyncAfterChangingContentsOnly run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone4070727975", Modify Window "1s" 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/potato] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/06/17 08:04:00 DEBUG : potato: Modification times differ by 119h59m59.876543211s: 2011-12-25 12:59:59.123456789 +0000 UTC, 2011-12-30 12:59:59 +0000 UTC 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/potato] 2022/06/17 08:04:00 INFO : potato: Copied (replaced existing) 2022/06/17 08:04:00 DEBUG : Waiting for deletions to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/potato] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] --- PASS: TestSyncAfterChangingContentsOnly (0.05s) === RUN TestSyncDeleteBefore run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone4070727975", Modify Window "1s" 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/potato] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/empty space] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : Waiting for deletions to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/potato] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/06/17 08:04:00 INFO : potato: Deleted 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/06/17 08:04:00 DEBUG : empty space: Size and modification time the same (differ by -123.456789ms, within tolerance 1s) 2022/06/17 08:04:00 DEBUG : empty space: Unchanged skipping 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/potato2] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/06/17 08:04:00 INFO : potato2: Copied (new) 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/empty space] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/potato2] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] --- PASS: TestSyncDeleteBefore (0.06s) === RUN TestSyncWithTrackRenamesStrategyLeaf run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone4070727975", Modify Window "1s" sync_test.go:1180: Can track renames: true 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 INFO : hdfs://127.0.0.1:8020: Making map for --track-renames 2022/06/17 08:04:00 INFO : hdfs://127.0.0.1:8020: Finished making map for --track-renames 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for renames to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/potato] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/sub/yam] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/06/17 08:04:00 INFO : potato: Copied (new) 2022/06/17 08:04:00 INFO : sub/yam: Copied (new) 2022/06/17 08:04:00 DEBUG : Waiting for deletions to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/sub] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/sub] 2022/06/17 08:04:00 DEBUG : potato: Size and modification time the same (differ by -499.999999ms, within tolerance 1s) 2022/06/17 08:04:00 DEBUG : potato: Unchanged skipping 2022/06/17 08:04:00 INFO : hdfs://127.0.0.1:8020: Making map for --track-renames 2022/06/17 08:04:00 INFO : hdfs://127.0.0.1:8020: Finished making map for --track-renames 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for renames to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jiqovok2wovifez5nebasoy0/yam] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rename [/rclone-test-jiqovok2wovifez5nebasoy0/sub/yam] to [/rclone-test-jiqovok2wovifez5nebasoy0/yam] 2022/06/17 08:04:00 INFO : sub/yam: Moved (server-side) to: yam 2022/06/17 08:04:00 INFO : yam: Renamed from "sub/yam" 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/06/17 08:04:00 DEBUG : Waiting for deletions to finish 2022/06/17 08:04:00 INFO : There was nothing to transfer 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/sub] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/potato] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/yam] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/sub] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jiqovok2wovifez5nebasoy0/sub] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] --- PASS: TestSyncWithTrackRenamesStrategyLeaf (0.07s) === RUN TestMoveWithDeleteEmptySrcDirs run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone4070727975", Modify Window "1s" 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/sub dir/hello world] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/nested/sub dir/file] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/06/17 08:04:00 ERROR : sub dir/hello world: Failed to copy: create /rclone-test-jiqovok2wovifez5nebasoy0/sub dir/hello world: replication in progress 2022/06/17 08:04:00 ERROR : sub dir/hello world: Not deleting source as copy failed: create /rclone-test-jiqovok2wovifez5nebasoy0/sub dir/hello world: replication in progress 2022/06/17 08:04:00 INFO : nested/sub dir/file: Copied (new) 2022/06/17 08:04:00 INFO : nested/sub dir/file: Deleted 2022/06/17 08:04:00 ERROR : Local file system at /tmp/rclone4070727975: not deleting directories as there were IO errors sync_test.go:1295: Error Trace: sync_test.go:1295 Error: Received unexpected error: not deleting directories as there were IO errors Test: TestMoveWithDeleteEmptySrcDirs 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/nested] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/sub dir] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/nested/sub dir] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/nested/sub dir/file] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jiqovok2wovifez5nebasoy0/sub dir] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jiqovok2wovifez5nebasoy0/nested/sub dir] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jiqovok2wovifez5nebasoy0/nested] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] --- FAIL: TestMoveWithDeleteEmptySrcDirs (0.04s) === RUN TestSyncCompareDest run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone4070727975", Modify Window "1s" 2022/06/17 08:04:00 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jiqovok2wovifez5nebasoy0/dst" 2022/06/17 08:04:00 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2022/06/17 08:04:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/06/17 08:04:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/06/17 08:04:00 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2022/06/17 08:04:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/06/17 08:04:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/06/17 08:04:00 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jiqovok2wovifez5nebasoy0/CompareDest" 2022/06/17 08:04:00 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2022/06/17 08:04:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/06/17 08:04:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/06/17 08:04:00 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2022/06/17 08:04:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/06/17 08:04:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/06/17 08:04:00 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jiqovok2wovifez5nebasoy0/CompareDest" to be canonical "TestHdfs{cNNQW}:rclone-test-jiqovok2wovifez5nebasoy0/CompareDest" 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jiqovok2wovifez5nebasoy0/CompareDest/one] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/06/17 08:04:00 INFO : one: Copied (new) 2022/06/17 08:04:00 DEBUG : Waiting for deletions to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jiqovok2wovifez5nebasoy0/CompareDest" for canonical name "TestHdfs{cNNQW}:rclone-test-jiqovok2wovifez5nebasoy0/CompareDest" 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jiqovok2wovifez5nebasoy0/CompareDest/one] 2022/06/17 08:04:00 DEBUG : one: Sizes differ (src 5 vs dst 3) 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one] 2022/06/17 08:04:00 INFO : one: Copied (replaced existing) 2022/06/17 08:04:00 DEBUG : Waiting for deletions to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/CompareDest/one] run.go:287: Failed to put "CompareDest/one" to "hdfs://127.0.0.1:8020": create /rclone-test-jiqovok2wovifez5nebasoy0/CompareDest/one: replication in progress 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/CompareDest] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jiqovok2wovifez5nebasoy0/CompareDest] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] --- FAIL: TestSyncCompareDest (0.09s) === RUN TestSyncBackupDirSuffixOnly run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone4070727975", Modify Window "1s" 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/dst/two] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/dst/three.txt] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jiqovok2wovifez5nebasoy0/dst" 2022/06/17 08:04:00 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2022/06/17 08:04:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/06/17 08:04:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/06/17 08:04:00 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2022/06/17 08:04:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2022/06/17 08:04:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : one: Sizes differ (src 4 vs dst 3) 2022/06/17 08:04:00 DEBUG : two: Size and modification time the same (differ by -499.999999ms, within tolerance 1s) 2022/06/17 08:04:00 DEBUG : two: Unchanged skipping 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one.bak] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rename [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one] to [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one.bak] 2022/06/17 08:04:00 INFO : one: Moved (server-side) to: one.bak 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one] 2022/06/17 08:04:00 INFO : one: Copied (new) 2022/06/17 08:04:00 DEBUG : Waiting for deletions to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jiqovok2wovifez5nebasoy0/dst/three.txt.bak] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rename [/rclone-test-jiqovok2wovifez5nebasoy0/dst/three.txt] to [/rclone-test-jiqovok2wovifez5nebasoy0/dst/three.txt.bak] 2022/06/17 08:04:00 INFO : three.txt: Moved (server-side) to: three.txt.bak 2022/06/17 08:04:00 INFO : three.txt: Moved into backup dir 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/dst/three.txt] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : one.bak: Excluded 2022/06/17 08:04:00 DEBUG : three.txt.bak: Excluded 2022/06/17 08:04:00 DEBUG : one: Sizes differ (src 5 vs dst 4) 2022/06/17 08:04:00 DEBUG : two: Size and modification time the same (differ by -499.999999ms, within tolerance 1s) 2022/06/17 08:04:00 DEBUG : two: Unchanged skipping 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for checks to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one.bak] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one.bak] 2022/06/17 08:04:00 INFO : one.bak: Deleted 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rename [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one] to [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one.bak] 2022/06/17 08:04:00 INFO : one: Moved (server-side) to: one.bak 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Waiting for transfers to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one] 2022/06/17 08:04:00 INFO : one: Copied (new) 2022/06/17 08:04:00 DEBUG : Waiting for deletions to finish 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: new [/rclone-test-jiqovok2wovifez5nebasoy0/dst/three.txt.bak] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/dst/three.txt.bak] 2022/06/17 08:04:00 INFO : three.txt.bak: Deleted 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rename [/rclone-test-jiqovok2wovifez5nebasoy0/dst/three.txt] to [/rclone-test-jiqovok2wovifez5nebasoy0/dst/three.txt.bak] 2022/06/17 08:04:00 INFO : three.txt: Moved (server-side) to: three.txt.bak 2022/06/17 08:04:00 INFO : three.txt: Moved into backup dir 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/dst/one.bak] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/dst/three.txt.bak] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/dst/two] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: rmdir [/rclone-test-jiqovok2wovifez5nebasoy0/dst] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] --- PASS: TestSyncBackupDirSuffixOnly (0.11s) === RUN TestSyncConcurrentDelete run.go:181: Remote "hdfs://127.0.0.1:8020", Local "Local file system at /tmp/rclone4070727975", Modify Window "1s" 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/both0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/only0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/both1] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/only1] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/both2] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/only2] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: update [/rclone-test-jiqovok2wovifez5nebasoy0/both3] run.go:287: Failed to put "both3" to "hdfs://127.0.0.1:8020": create /rclone-test-jiqovok2wovifez5nebasoy0/both3: replication in progress 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/both0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/both1] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/both2] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/only0] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/only1] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: remove [/rclone-test-jiqovok2wovifez5nebasoy0/only2] 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: list [/rclone-test-jiqovok2wovifez5nebasoy0] --- FAIL: TestSyncConcurrentDelete (0.12s) FAIL 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: Purge remote 2022/06/17 08:04:00 DEBUG : hdfs://127.0.0.1:8020: purge [/rclone-test-jiqovok2wovifez5nebasoy0] "./sync.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose -test.run '^(TestCopy|TestMoveWithDeleteEmptySrcDirs|TestSyncAfterChangingContentsOnly|TestSyncBackupDirSuffixOnly|TestSyncCompareDest|TestSyncConcurrentDelete|TestSyncDeleteBefore|TestSyncEmptyDirectories|TestSyncWithTrackRenamesStrategyLeaf)$'" - Finished ERROR in 953.921504ms (try 3/5): exit status 1: Failed [TestCopy TestSyncEmptyDirectories TestMoveWithDeleteEmptySrcDirs TestSyncCompareDest TestSyncConcurrentDelete]