"./bisync.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose -test.run '^TestBisyncLocalRemote$/^(all_changed|compare_all|createemptysrcdirs|nomodtime|rclone_args)$|^TestBisyncRemoteLocal$/^(all_changed|compare_all|createemptysrcdirs|nomodtime|rclone_args)$|^TestBisyncRemoteRemote$/^(all_changed|compare_all|createemptysrcdirs|nomodtime|rclone_args)$'" - Starting (try 4/5) 2025/08/31 01:42:45 DEBUG : Creating backend with remote "TestHdfs:rclone-test-poyoxul6wihu" 2025/08/31 01:42:45 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/08/31 01:42:45 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:42:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:42:45 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:42:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:42:45 DEBUG : Creating backend with remote "/tmp/rclone2780964024" === RUN TestBisyncRemoteLocal 2025/08/31 01:42:45 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cerebak0buhi" 2025/08/31 01:42:45 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:42:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:42:45 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:42:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:42:45 NOTICE: remote: TestHdfs:rclone-test-cerebak0buhi === RUN TestBisyncRemoteLocal/all_changed 2025/08/31 01:42:45 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cerebak0buhi/014245wo" 2025/08/31 01:42:45 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:42:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:42:45 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:42:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:42:45 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cerebak0buhi/014245wo" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo" 2025/08/31 01:42:45 INFO : path1: Making directory 2025/08/31 01:42:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo: mkdir [/rclone-test-cerebak0buhi/014245wo/path1] 2025/08/31 01:42:45 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cerebak0buhi/014245wo/all_changed/path1" 2025/08/31 01:42:45 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:42:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:42:45 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:42:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:42:45 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cerebak0buhi/014245wo/all_changed/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1" 2025/08/31 01:42:45 DEBUG : Creating backend with remote "/tmp/014245wo" 2025/08/31 01:42:45 DEBUG : Creating backend with remote "/tmp/014245wo/all_changed/path2" 2025/08/31 01:42:45 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_all_changed/initial" 2025/08/31 01:42:45 DEBUG : Creating backend with remote "/tmp/014245wo/initdir/test_all_changed-qociviv7" 2025/08/31 01:42:45 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : subdir: Making directory with metadata 2025/08/31 01:42:45 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2025/08/31 01:42:45 DEBUG : Added delayed dir = "subdir", newDst=subdir 2025/08/31 01:42:45 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:45 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt 2025/08/31 01:42:45 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:42:45 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:45 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt 2025/08/31 01:42:45 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:42:45 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:45 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt 2025/08/31 01:42:45 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:42:45 DEBUG : Local file system at /tmp/014245wo/initdir/test_all_changed-qociviv7: Waiting for checks to finish 2025/08/31 01:42:45 DEBUG : Local file system at /tmp/014245wo/initdir/test_all_changed-qociviv7: Waiting for transfers to finish 2025/08/31 01:42:45 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:45 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:45 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:42:45 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt 2025/08/31 01:42:45 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:42:45 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:45 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt 2025/08/31 01:42:45 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:42:45 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:42:45 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:42:45 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:45 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:42:45 INFO : file1.txt: Copied (new) 2025/08/31 01:42:45 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2025/08/31 01:42:45 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:42:45 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:42:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: purge [/rclone-test-cerebak0buhi/014245wo/all_changed/path1] 2025/08/31 01:42:45 DEBUG : Waiting for deletions to finish 2025/08/31 01:42:45 ERROR : error listing: directory not found 2025/08/31 01:42:45 ERROR : Local file system at /tmp/014245wo/all_changed/path2: Failed to list "": directory not found 2025/08/31 01:42:45 DEBUG : removing 1 level 0 directories 2025/08/31 01:42:45 INFO : Local file system at /tmp/014245wo/all_changed/path2: Removing directory 2025/08/31 01:42:45 ERROR : Failed to rmdir: stat /tmp/014245wo/all_changed/path2: no such file or directory 2025/08/31 01:42:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: list [/rclone-test-cerebak0buhi/014245wo/all_changed/path1] 2025/08/31 01:42:45 ERROR : error listing: directory not found 2025/08/31 01:42:45 ERROR : error listing: directory not found 2025/08/31 01:42:45 NOTICE: checking initFs Local file system at /tmp/014245wo/initdir/test_all_changed-qociviv7 2025/08/31 01:42:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: list [/rclone-test-cerebak0buhi/014245wo/all_changed/path1] 2025/08/31 01:42:45 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 INFO : subdir: Making directory 2025/08/31 01:42:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: mkdir [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir] 2025/08/31 01:42:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: update [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/file1.copy1.txt] 2025/08/31 01:42:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: update [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/RCLONE_TEST] 2025/08/31 01:42:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: update [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/file1.copy2.txt] 2025/08/31 01:42:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: update [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/file1.copy3.txt] 2025/08/31 01:42:45 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: Waiting for checks to finish 2025/08/31 01:42:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: Waiting for transfers to finish 2025/08/31 01:42:46 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:42:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: update [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/file1.copy4.txt] 2025/08/31 01:42:46 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:42:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: update [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/file1.copy5.txt] 2025/08/31 01:42:46 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:42:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: update [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/file1.txt] 2025/08/31 01:42:46 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:42:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: update [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir/file20.txt] 2025/08/31 01:42:46 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:42:46 INFO : file1.txt: Copied (new) 2025/08/31 01:42:46 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:42:46 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-cerebak0buhi/014245wo/all_changed/path1/RCLONE_TEST: replication in progress) 2025/08/31 01:42:46 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/08/31 01:42:46 DEBUG : pacer: low level retry 2/10 (error create /rclone-test-cerebak0buhi/014245wo/all_changed/path1/RCLONE_TEST: replication in progress) 2025/08/31 01:42:46 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2025/08/31 01:42:46 DEBUG : pacer: Reducing sleep to 60ms 2025/08/31 01:42:46 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:42:46 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1 2025/08/31 01:42:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: list [/rclone-test-cerebak0buhi/014245wo/all_changed/path1] 2025/08/31 01:42:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: list [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir] 2025/08/31 01:42:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:42:46 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:46 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:46 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:46 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:46 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:46 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:46 DEBUG : subdir: Making directory with metadata 2025/08/31 01:42:46 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2025/08/31 01:42:46 DEBUG : Added delayed dir = "subdir", newDst=subdir 2025/08/31 01:42:46 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:46 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:46 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt 2025/08/31 01:42:46 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:42:46 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:46 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:42:46 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt 2025/08/31 01:42:46 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:42:46 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:42:46 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:42:46 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:46 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:46 DEBUG : Local file system at /tmp/014245wo/all_changed/path2: Waiting for checks to finish 2025/08/31 01:42:46 DEBUG : Local file system at /tmp/014245wo/all_changed/path2: Waiting for transfers to finish 2025/08/31 01:42:46 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:46 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt 2025/08/31 01:42:46 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:42:46 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:42:46 INFO : file1.txt: Copied (new) 2025/08/31 01:42:46 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt 2025/08/31 01:42:46 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:42:46 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:46 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:46 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2025/08/31 01:42:46 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:42:46 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt 2025/08/31 01:42:46 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:42:46 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:42:46 NOTICE: checking path2 Local file system at /tmp/014245wo/all_changed/path2 2025/08/31 01:42:46 NOTICE: (01) : test all-changed 2025/08/31 01:42:46 NOTICE: (02) : test initial bisync 2025/08/31 01:42:46 NOTICE: (03) : bisync resync 2025/08/31 01:42:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: update [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/modtime_write_test] 2025/08/31 01:42:46 DEBUG : pacer: Reducing sleep to 45ms 2025/08/31 01:42:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: remove [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/modtime_write_test] 2025/08/31 01:42:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:42:48 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:42:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:42:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:42:48 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1/" with Path2 "/tmp/014245wo/all_changed/path2/" 2025/08/31 01:42:48 INFO : Copying Path2 files to Path1 2025/08/31 01:42:48 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:42:48 INFO : There was nothing to transfer 2025/08/31 01:42:48 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:42:48 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:42:48 INFO : There was nothing to transfer 2025/08/31 01:42:48 INFO : Resync updating listings 2025/08/31 01:42:48 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1/" vs Path2 "/tmp/014245wo/all_changed/path2/" 2025/08/31 01:42:48 INFO : Bisync successful 2025/08/31 01:42:48 NOTICE: (04) : test change timestamp on all files except RCLONE_TEST 2025/08/31 01:42:48 NOTICE: (05) : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/all_changed/path1/ file* 2025/08/31 01:42:48 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/all_changed/path1/" 2025/08/31 01:42:48 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:48 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:48 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/all_changed/path1/" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1/" 2025/08/31 01:42:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1/: list [/rclone-test-cerebak0buhi/014245wo/all_changed/path1] 2025/08/31 01:42:48 DEBUG : file1.copy1.txt: Set modification time 2005-01-02 2025/08/31 01:42:48 DEBUG : file1.copy2.txt: Set modification time 2005-01-02 2025/08/31 01:42:48 DEBUG : file1.copy3.txt: Set modification time 2005-01-02 2025/08/31 01:42:48 DEBUG : file1.copy4.txt: Set modification time 2005-01-02 2025/08/31 01:42:48 DEBUG : file1.copy5.txt: Set modification time 2005-01-02 2025/08/31 01:42:48 DEBUG : file1.txt: Set modification time 2005-01-02 2025/08/31 01:42:48 NOTICE: (06) : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir file* 2025/08/31 01:42:48 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir" 2025/08/31 01:42:48 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:48 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:48 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir" 2025/08/31 01:42:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir: list [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir] 2025/08/31 01:42:48 DEBUG : file20.txt: Set modification time 2005-01-02 2025/08/31 01:42:48 NOTICE: (07) : test sync should pass 2025/08/31 01:42:48 NOTICE: (08) : bisync 2025/08/31 01:42:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: update [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/modtime_write_test] 2025/08/31 01:42:48 DEBUG : pacer: Reducing sleep to 33.75ms 2025/08/31 01:42:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: remove [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/modtime_write_test] 2025/08/31 01:42:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:42:50 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:42:50 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:42:50 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:42:50 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1/" with Path2 "/tmp/014245wo/all_changed/path2/" 2025/08/31 01:42:50 INFO : Building Path1 and Path2 listings 2025/08/31 01:42:50 INFO : Path1 checking for diffs 2025/08/31 01:42:50 INFO : - Path1 File changed: time (newer) - file1.copy1.txt 2025/08/31 01:42:50 INFO : - Path1 File changed: time (newer) - file1.copy2.txt 2025/08/31 01:42:50 INFO : - Path1 File changed: time (newer) - file1.copy3.txt 2025/08/31 01:42:50 INFO : - Path1 File changed: time (newer) - file1.copy4.txt 2025/08/31 01:42:50 INFO : - Path1 File changed: time (newer) - file1.copy5.txt 2025/08/31 01:42:50 INFO : - Path1 File changed: time (newer) - file1.txt 2025/08/31 01:42:50 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2025/08/31 01:42:50 INFO : Path1: 7 changes:  0 new,  7 modified,  0 deleted 2025/08/31 01:42:50 INFO : (Modified:  7 newer,  0 older) 2025/08/31 01:42:50 INFO : Path2 checking for diffs 2025/08/31 01:42:50 INFO : Applying changes 2025/08/31 01:42:50 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/file1.copy1.txt 2025/08/31 01:42:50 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/file1.copy2.txt 2025/08/31 01:42:50 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/file1.copy3.txt 2025/08/31 01:42:50 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/file1.copy4.txt 2025/08/31 01:42:50 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/file1.copy5.txt 2025/08/31 01:42:50 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/file1.txt 2025/08/31 01:42:50 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/subdir/file20.txt 2025/08/31 01:42:50 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:42:50 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:42:50 INFO : file1.copy1.txt: Copied (replaced existing) 2025/08/31 01:42:50 INFO : file1.copy2.txt: Copied (replaced existing) 2025/08/31 01:42:50 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:42:50 INFO : file1.copy3.txt: Copied (replaced existing) 2025/08/31 01:42:50 INFO : file1.copy5.txt: Copied (replaced existing) 2025/08/31 01:42:50 INFO : file1.copy4.txt: Copied (replaced existing) 2025/08/31 01:42:50 INFO : subdir/file20.txt: Copied (replaced existing) 2025/08/31 01:42:50 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:42:50 INFO : Updating listings 2025/08/31 01:42:50 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1/" vs Path2 "/tmp/014245wo/all_changed/path2/" 2025/08/31 01:42:50 INFO : Bisync successful 2025/08/31 01:42:50 NOTICE: (09) : test change timestamp on all files including RCLONE_TEST 2025/08/31 01:42:50 NOTICE: (10) : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/all_changed/path1/ * 2025/08/31 01:42:50 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/all_changed/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1/" 2025/08/31 01:42:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1/: list [/rclone-test-cerebak0buhi/014245wo/all_changed/path1] 2025/08/31 01:42:50 DEBUG : RCLONE_TEST: Set modification time 2004-01-02 2025/08/31 01:42:50 DEBUG : file1.copy1.txt: Set modification time 2004-01-02 2025/08/31 01:42:50 DEBUG : file1.copy2.txt: Set modification time 2004-01-02 2025/08/31 01:42:50 DEBUG : file1.copy3.txt: Set modification time 2004-01-02 2025/08/31 01:42:50 DEBUG : file1.copy4.txt: Set modification time 2004-01-02 2025/08/31 01:42:50 DEBUG : file1.copy5.txt: Set modification time 2004-01-02 2025/08/31 01:42:50 DEBUG : file1.txt: Set modification time 2004-01-02 2025/08/31 01:42:50 NOTICE: (11) : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir * 2025/08/31 01:42:50 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir" 2025/08/31 01:42:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir: list [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/subdir] 2025/08/31 01:42:50 DEBUG : file20.txt: Set modification time 2004-01-02 2025/08/31 01:42:50 NOTICE: (12) : test sync should fail 2025/08/31 01:42:50 NOTICE: (13) : bisync 2025/08/31 01:42:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: update [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/modtime_write_test] 2025/08/31 01:42:50 DEBUG : pacer: Reducing sleep to 25.3125ms 2025/08/31 01:42:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: remove [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/modtime_write_test] 2025/08/31 01:42:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:42:52 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:42:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:42:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:42:52 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1/" with Path2 "/tmp/014245wo/all_changed/path2/" 2025/08/31 01:42:52 INFO : Building Path1 and Path2 listings 2025/08/31 01:42:52 INFO : Path1 checking for diffs 2025/08/31 01:42:52 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2025/08/31 01:42:52 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2025/08/31 01:42:52 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2025/08/31 01:42:52 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2025/08/31 01:42:52 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2025/08/31 01:42:52 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2025/08/31 01:42:52 INFO : - Path1 File changed: time (older) - file1.txt 2025/08/31 01:42:52 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2025/08/31 01:42:52 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2025/08/31 01:42:52 INFO : (Modified:  1 newer,  7 older) 2025/08/31 01:42:52 INFO : Path2 checking for diffs 2025/08/31 01:42:52 ERROR : Safety abort: all files were changed on Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1/". Run with --force if desired. 2025/08/31 01:42:52 NOTICE: Bisync aborted. Please try again. 2025/08/31 01:42:52 NOTICE: Bisync error: all files were changed 2025/08/31 01:42:52 NOTICE: (14) : test sync with force should pass 2025/08/31 01:42:52 NOTICE: (15) : bisync force 2025/08/31 01:42:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: update [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/modtime_write_test] 2025/08/31 01:42:52 DEBUG : pacer: Reducing sleep to 20ms 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: remove [/rclone-test-cerebak0buhi/014245wo/all_changed/path1/modtime_write_test] 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:42:54 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:42:54 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:42:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:42:54 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1/" with Path2 "/tmp/014245wo/all_changed/path2/" 2025/08/31 01:42:54 INFO : Building Path1 and Path2 listings 2025/08/31 01:42:54 INFO : Path1 checking for diffs 2025/08/31 01:42:54 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2025/08/31 01:42:54 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2025/08/31 01:42:54 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2025/08/31 01:42:54 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2025/08/31 01:42:54 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2025/08/31 01:42:54 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2025/08/31 01:42:54 INFO : - Path1 File changed: time (older) - file1.txt 2025/08/31 01:42:54 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2025/08/31 01:42:54 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2025/08/31 01:42:54 INFO : (Modified:  1 newer,  7 older) 2025/08/31 01:42:54 INFO : Path2 checking for diffs 2025/08/31 01:42:54 INFO : Applying changes 2025/08/31 01:42:54 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/RCLONE_TEST 2025/08/31 01:42:54 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/file1.copy1.txt 2025/08/31 01:42:54 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/file1.copy2.txt 2025/08/31 01:42:54 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/file1.copy3.txt 2025/08/31 01:42:54 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/file1.copy4.txt 2025/08/31 01:42:54 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/file1.copy5.txt 2025/08/31 01:42:54 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/file1.txt 2025/08/31 01:42:54 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/all_changed/path2/subdir/file20.txt 2025/08/31 01:42:54 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:42:54 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:42:54 INFO : file1.copy1.txt: Copied (replaced existing) 2025/08/31 01:42:54 INFO : file1.copy2.txt: Copied (replaced existing) 2025/08/31 01:42:54 INFO : file1.copy3.txt: Copied (replaced existing) 2025/08/31 01:42:54 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:42:54 INFO : file1.copy4.txt: Copied (replaced existing) 2025/08/31 01:42:54 INFO : file1.copy5.txt: Copied (replaced existing) 2025/08/31 01:42:54 INFO : subdir/file20.txt: Copied (replaced existing) 2025/08/31 01:42:54 INFO : RCLONE_TEST: Copied (replaced existing) 2025/08/31 01:42:54 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:42:54 INFO : Updating listings 2025/08/31 01:42:54 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/all_changed/path1/" vs Path2 "/tmp/014245wo/all_changed/path2/" 2025/08/31 01:42:54 INFO : Bisync successful 2025/08/31 01:42:54 NOTICE: ---------------------------------------------------------- 2025/08/31 01:42:54 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:42:54 NOTICE: | @@ -60 +59,0 @@ 2025/08/31 01:42:54 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:42:54 NOTICE: | @@ -132 +130,0 @@ 2025/08/31 01:42:54 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:42:54 NOTICE: ---------------------------------------------------------- 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/all_changed/path1: purge [/rclone-test-cerebak0buhi/014245wo/all_changed/path1] 2025/08/31 01:42:54 DEBUG : Waiting for deletions to finish 2025/08/31 01:42:54 INFO : file1.copy4.txt: Deleted 2025/08/31 01:42:54 INFO : file1.copy1.txt: Deleted 2025/08/31 01:42:54 INFO : file1.copy3.txt: Deleted 2025/08/31 01:42:54 INFO : file1.copy5.txt: Deleted 2025/08/31 01:42:54 INFO : file1.txt: Deleted 2025/08/31 01:42:54 INFO : RCLONE_TEST: Deleted 2025/08/31 01:42:54 INFO : file1.copy2.txt: Deleted 2025/08/31 01:42:54 INFO : subdir/file20.txt: Deleted 2025/08/31 01:42:54 DEBUG : removing 1 level 1 directories 2025/08/31 01:42:54 INFO : subdir: Removing directory 2025/08/31 01:42:54 DEBUG : removing 1 level 0 directories 2025/08/31 01:42:54 INFO : Local file system at /tmp/014245wo/all_changed/path2: Removing directory bisync_test.go:597: TEST all_changed FAILED - 1 MISCOMPARED FILES === RUN TestBisyncRemoteLocal/compare_all 2025/08/31 01:42:54 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cerebak0buhi/014245wo" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo" 2025/08/31 01:42:54 INFO : path1: Making directory 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo: mkdir [/rclone-test-cerebak0buhi/014245wo/path1] 2025/08/31 01:42:54 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cerebak0buhi/014245wo/compare_all/path1" 2025/08/31 01:42:54 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:42:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:42:54 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:42:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:42:54 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cerebak0buhi/014245wo/compare_all/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1" 2025/08/31 01:42:54 DEBUG : Creating backend with remote "/tmp/014245wo/compare_all/path2" 2025/08/31 01:42:54 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_compare_all/initial" 2025/08/31 01:42:54 DEBUG : Creating backend with remote "/tmp/014245wo/initdir/test_compare_all-boqomej4" 2025/08/31 01:42:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : Local file system at /tmp/014245wo/initdir/test_compare_all-boqomej4: Waiting for checks to finish 2025/08/31 01:42:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:42:54 INFO : file1.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:42:54 INFO : file2.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt 2025/08/31 01:42:54 INFO : file4.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt 2025/08/31 01:42:54 INFO : file3.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : Local file system at /tmp/014245wo/initdir/test_compare_all-boqomej4: Waiting for transfers to finish 2025/08/31 01:42:54 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:42:54 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt 2025/08/31 01:42:54 INFO : file5.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:42:54 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt 2025/08/31 01:42:54 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:42:54 INFO : file7.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt 2025/08/31 01:42:54 INFO : file6.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt 2025/08/31 01:42:54 INFO : file8.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_compare_all/modfiles" 2025/08/31 01:42:54 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_compare_all-cawapaq2" 2025/08/31 01:42:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file10.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file11.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : Local file system at /tmp/014245wo/datadir/test_compare_all-cawapaq2: Waiting for checks to finish 2025/08/31 01:42:54 DEBUG : Local file system at /tmp/014245wo/datadir/test_compare_all-cawapaq2: Waiting for transfers to finish 2025/08/31 01:42:54 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2025/08/31 01:42:54 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:42:54 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:42:54 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt 2025/08/31 01:42:54 INFO : file2.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt 2025/08/31 01:42:54 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:42:54 INFO : file1.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt 2025/08/31 01:42:54 INFO : file11.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt 2025/08/31 01:42:54 INFO : file10.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:42:54 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:42:54 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2025/08/31 01:42:54 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt 2025/08/31 01:42:54 INFO : file6.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt 2025/08/31 01:42:54 INFO : file7.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt 2025/08/31 01:42:54 INFO : file5R.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2025/08/31 01:42:54 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt 2025/08/31 01:42:54 INFO : file5L.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: purge [/rclone-test-cerebak0buhi/014245wo/compare_all/path1] 2025/08/31 01:42:54 DEBUG : Waiting for deletions to finish 2025/08/31 01:42:54 ERROR : error listing: directory not found 2025/08/31 01:42:54 ERROR : Local file system at /tmp/014245wo/compare_all/path2: Failed to list "": directory not found 2025/08/31 01:42:54 DEBUG : removing 1 level 0 directories 2025/08/31 01:42:54 INFO : Local file system at /tmp/014245wo/compare_all/path2: Removing directory 2025/08/31 01:42:54 ERROR : Failed to rmdir: stat /tmp/014245wo/compare_all/path2: no such file or directory 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: list [/rclone-test-cerebak0buhi/014245wo/compare_all/path1] 2025/08/31 01:42:54 ERROR : error listing: directory not found 2025/08/31 01:42:54 ERROR : error listing: directory not found 2025/08/31 01:42:54 NOTICE: checking initFs Local file system at /tmp/014245wo/initdir/test_compare_all-boqomej4 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: list [/rclone-test-cerebak0buhi/014245wo/compare_all/path1] 2025/08/31 01:42:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file1.txt] 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: Waiting for checks to finish 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file2.txt] 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: Waiting for transfers to finish 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file3.txt] 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/RCLONE_TEST] 2025/08/31 01:42:54 INFO : file1.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file4.txt] 2025/08/31 01:42:54 INFO : file2.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file5.txt] 2025/08/31 01:42:54 INFO : file3.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file6.txt] 2025/08/31 01:42:54 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file7.txt] 2025/08/31 01:42:54 INFO : file4.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file8.txt] 2025/08/31 01:42:54 INFO : file5.txt: Copied (new) 2025/08/31 01:42:54 INFO : file6.txt: Copied (new) 2025/08/31 01:42:54 INFO : file7.txt: Copied (new) 2025/08/31 01:42:54 INFO : file8.txt: Copied (new) 2025/08/31 01:42:54 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: list [/rclone-test-cerebak0buhi/014245wo/compare_all/path1] 2025/08/31 01:42:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:54 DEBUG : Local file system at /tmp/014245wo/compare_all/path2: Waiting for checks to finish 2025/08/31 01:42:54 DEBUG : Local file system at /tmp/014245wo/compare_all/path2: Waiting for transfers to finish 2025/08/31 01:42:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:42:54 INFO : file1.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt 2025/08/31 01:42:54 INFO : file3.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt 2025/08/31 01:42:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:42:54 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:42:54 INFO : file2.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:42:54 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:42:54 INFO : file4.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt 2025/08/31 01:42:54 INFO : file5.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt 2025/08/31 01:42:54 INFO : file7.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt 2025/08/31 01:42:54 INFO : file6.txt: Copied (new) 2025/08/31 01:42:54 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:54 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt 2025/08/31 01:42:54 INFO : file8.txt: Copied (new) 2025/08/31 01:42:54 NOTICE: checking path2 Local file system at /tmp/014245wo/compare_all/path2 2025/08/31 01:42:54 NOTICE: (01) : test changes compare-all 2025/08/31 01:42:54 NOTICE: (02) : test initial bisync 2025/08/31 01:42:54 NOTICE: (03) : bisync resync compare-all 2025/08/31 01:42:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/modtime_write_test] 2025/08/31 01:42:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: remove [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/modtime_write_test] 2025/08/31 01:42:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:42:56 NOTICE: Local file system at /tmp/014245wo/compare_all/path2: will use md5 for same-side diffs on Path2 only 2025/08/31 01:42:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:42:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/" with Path2 "/tmp/014245wo/compare_all/path2/" 2025/08/31 01:42:56 INFO : Copying Path2 files to Path1 2025/08/31 01:42:56 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:42:56 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:42:56 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:42:57 INFO : Resync updating listings 2025/08/31 01:42:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/" vs Path2 "/tmp/014245wo/compare_all/path2/" 2025/08/31 01:42:57 INFO : Bisync successful 2025/08/31 01:42:57 NOTICE: (04) : test make modifications on both paths 2025/08/31 01:42:57 NOTICE: (05) : test new on path2 - file10 2025/08/31 01:42:57 NOTICE: (06) : touch-copy 2001-01-02 /tmp/014245wo/datadir/test_compare_all-cawapaq2/file10.txt /tmp/014245wo/compare_all/path2/ 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_compare_all-cawapaq2/" 2025/08/31 01:42:57 DEBUG : fs cache: renaming cache item "/tmp/014245wo/datadir/test_compare_all-cawapaq2/" to be canonical "/tmp/014245wo/datadir/test_compare_all-cawapaq2" 2025/08/31 01:42:57 DEBUG : file10.txt: Set modification time 2001-01-02 2025/08/31 01:42:57 DEBUG : copyFile "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file10.txt" to "/tmp/014245wo/compare_all/path2/" as "" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file10.txt" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/compare_all/path2/" 2025/08/31 01:42:57 DEBUG : operations.CopyFile "file10.txt" to "Local file system at /tmp/014245wo/compare_all/path2" as "file10.txt" 2025/08/31 01:42:57 DEBUG : file10.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:57 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:42:57 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt 2025/08/31 01:42:57 INFO : file10.txt: Copied (new) 2025/08/31 01:42:57 NOTICE: (07) : test newer on path2 - file1 2025/08/31 01:42:57 NOTICE: (08) : touch-copy 2001-01-02 /tmp/014245wo/datadir/test_compare_all-cawapaq2/file1.txt /tmp/014245wo/compare_all/path2/ 2025/08/31 01:42:57 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/datadir/test_compare_all-cawapaq2/" for canonical name "/tmp/014245wo/datadir/test_compare_all-cawapaq2" 2025/08/31 01:42:57 DEBUG : file1.txt: Set modification time 2001-01-02 2025/08/31 01:42:57 DEBUG : copyFile "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file1.txt" to "/tmp/014245wo/compare_all/path2/" as "" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file1.txt" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/compare_all/path2/" 2025/08/31 01:42:57 DEBUG : operations.CopyFile "file1.txt" to "Local file system at /tmp/014245wo/compare_all/path2" as "file1.txt" 2025/08/31 01:42:57 DEBUG : file1.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:42:57 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:42:57 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt 2025/08/31 01:42:57 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:42:57 NOTICE: (09) : test new on path1 - file11 2025/08/31 01:42:57 NOTICE: (10) : touch-copy 2001-01-02 /tmp/014245wo/datadir/test_compare_all-cawapaq2/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/ 2025/08/31 01:42:57 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/datadir/test_compare_all-cawapaq2/" for canonical name "/tmp/014245wo/datadir/test_compare_all-cawapaq2" 2025/08/31 01:42:57 DEBUG : file11.txt: Set modification time 2001-01-02 2025/08/31 01:42:57 DEBUG : copyFile "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file11.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/" as "" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file11.txt" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/" 2025/08/31 01:42:57 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:57 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:57 DEBUG : operations.CopyFile "file11.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/" as "file11.txt" 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: new [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file11.txt] 2025/08/31 01:42:57 DEBUG : file11.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file11.txt] 2025/08/31 01:42:57 INFO : file11.txt: Copied (new) 2025/08/31 01:42:57 NOTICE: (11) : test newer on path1 - file2 2025/08/31 01:42:57 NOTICE: (12) : touch-copy 2001-01-02 /tmp/014245wo/datadir/test_compare_all-cawapaq2/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/ 2025/08/31 01:42:57 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/datadir/test_compare_all-cawapaq2/" for canonical name "/tmp/014245wo/datadir/test_compare_all-cawapaq2" 2025/08/31 01:42:57 DEBUG : file2.txt: Set modification time 2001-01-02 2025/08/31 01:42:57 DEBUG : copyFile "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file2.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/" as "" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file2.txt" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/" 2025/08/31 01:42:57 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:57 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:57 DEBUG : operations.CopyFile "file2.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/" as "file2.txt" 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: new [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file2.txt] 2025/08/31 01:42:57 DEBUG : file2.txt: Sizes differ (src 13 vs dst 0) 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file2.txt] 2025/08/31 01:42:57 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:42:57 NOTICE: (13) : test deleted on path2 - file3 2025/08/31 01:42:57 NOTICE: (14) : delete-file /tmp/014245wo/compare_all/path2/file3.txt 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/compare_all/path2/" 2025/08/31 01:42:57 DEBUG : fs cache: renaming cache item "/tmp/014245wo/compare_all/path2/" to be canonical "/tmp/014245wo/compare_all/path2" 2025/08/31 01:42:57 INFO : file3.txt: Deleted 2025/08/31 01:42:57 NOTICE: (15) : test deleted on path1 - file4 2025/08/31 01:42:57 NOTICE: (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/file4.txt 2025/08/31 01:42:57 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/" 2025/08/31 01:42:57 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:57 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:57 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/" 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: new [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file4.txt] 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: remove [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file4.txt] 2025/08/31 01:42:57 INFO : file4.txt: Deleted 2025/08/31 01:42:57 NOTICE: (17) : test deleted on both paths - file8 2025/08/31 01:42:57 NOTICE: (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/file8.txt 2025/08/31 01:42:57 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/" 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: new [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file8.txt] 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: remove [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file8.txt] 2025/08/31 01:42:57 INFO : file8.txt: Deleted 2025/08/31 01:42:57 NOTICE: (19) : delete-file /tmp/014245wo/compare_all/path2/file8.txt 2025/08/31 01:42:57 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/compare_all/path2/" for canonical name "/tmp/014245wo/compare_all/path2" 2025/08/31 01:42:57 INFO : file8.txt: Deleted 2025/08/31 01:42:57 NOTICE: (20) : test changed on both paths - file5 (file5R, file5L) 2025/08/31 01:42:57 NOTICE: (21) : touch-glob 2001-01-02 /tmp/014245wo/datadir/test_compare_all-cawapaq2/ file5R.txt 2025/08/31 01:42:57 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/datadir/test_compare_all-cawapaq2/" for canonical name "/tmp/014245wo/datadir/test_compare_all-cawapaq2" 2025/08/31 01:42:57 DEBUG : file5R.txt: Set modification time 2001-01-02 2025/08/31 01:42:57 NOTICE: (22) : copy-as /tmp/014245wo/datadir/test_compare_all-cawapaq2/file5R.txt /tmp/014245wo/compare_all/path2/ file5.txt 2025/08/31 01:42:57 DEBUG : copyFile "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file5R.txt" to "/tmp/014245wo/compare_all/path2/" as "file5.txt" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file5R.txt" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/compare_all/path2/" 2025/08/31 01:42:57 DEBUG : operations.CopyFile "file5R.txt" to "Local file system at /tmp/014245wo/compare_all/path2" as "file5.txt" 2025/08/31 01:42:57 DEBUG : file5R.txt: Sizes differ (src 39 vs dst 0) 2025/08/31 01:42:57 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2025/08/31 01:42:57 DEBUG : file5.txt.aa998d0a.partial: renamed to: file5.txt 2025/08/31 01:42:57 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2025/08/31 01:42:57 NOTICE: (23) : touch-glob 2001-03-04 /tmp/014245wo/datadir/test_compare_all-cawapaq2/ file5L.txt 2025/08/31 01:42:57 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/datadir/test_compare_all-cawapaq2/" for canonical name "/tmp/014245wo/datadir/test_compare_all-cawapaq2" 2025/08/31 01:42:57 DEBUG : file5L.txt: Set modification time 2001-03-04 2025/08/31 01:42:57 NOTICE: (24) : copy-as /tmp/014245wo/datadir/test_compare_all-cawapaq2/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/ file5.txt 2025/08/31 01:42:57 DEBUG : copyFile "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file5L.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/" as "file5.txt" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file5L.txt" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/" 2025/08/31 01:42:57 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:57 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:57 DEBUG : operations.CopyFile "file5L.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/" as "file5.txt" 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: new [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file5.txt] 2025/08/31 01:42:57 DEBUG : file5L.txt: Sizes differ (src 39 vs dst 0) 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file5.txt] 2025/08/31 01:42:57 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2025/08/31 01:42:57 NOTICE: (25) : test newer on path2 and deleted on path1 - file6 2025/08/31 01:42:57 NOTICE: (26) : touch-copy 2001-01-02 /tmp/014245wo/datadir/test_compare_all-cawapaq2/file6.txt /tmp/014245wo/compare_all/path2/ 2025/08/31 01:42:57 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/datadir/test_compare_all-cawapaq2/" for canonical name "/tmp/014245wo/datadir/test_compare_all-cawapaq2" 2025/08/31 01:42:57 DEBUG : file6.txt: Set modification time 2001-01-02 2025/08/31 01:42:57 DEBUG : copyFile "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file6.txt" to "/tmp/014245wo/compare_all/path2/" as "" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file6.txt" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/compare_all/path2/" 2025/08/31 01:42:57 DEBUG : operations.CopyFile "file6.txt" to "Local file system at /tmp/014245wo/compare_all/path2" as "file6.txt" 2025/08/31 01:42:57 DEBUG : file6.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:42:57 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:42:57 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt 2025/08/31 01:42:57 INFO : file6.txt: Copied (replaced existing) 2025/08/31 01:42:57 NOTICE: (27) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/file6.txt 2025/08/31 01:42:57 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/" 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: new [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file6.txt] 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: remove [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file6.txt] 2025/08/31 01:42:57 INFO : file6.txt: Deleted 2025/08/31 01:42:57 NOTICE: (28) : test newer on path1 and deleted on path2 - file7 2025/08/31 01:42:57 NOTICE: (29) : touch-copy 2001-01-02 /tmp/014245wo/datadir/test_compare_all-cawapaq2/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/ 2025/08/31 01:42:57 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/datadir/test_compare_all-cawapaq2/" for canonical name "/tmp/014245wo/datadir/test_compare_all-cawapaq2" 2025/08/31 01:42:57 DEBUG : file7.txt: Set modification time 2001-01-02 2025/08/31 01:42:57 DEBUG : copyFile "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file7.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/" as "" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_compare_all-cawapaq2/file7.txt" 2025/08/31 01:42:57 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/compare_all/path1/" 2025/08/31 01:42:57 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:57 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:57 DEBUG : operations.CopyFile "file7.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/" as "file7.txt" 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: new [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file7.txt] 2025/08/31 01:42:57 DEBUG : file7.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1/: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/file7.txt] 2025/08/31 01:42:57 INFO : file7.txt: Copied (replaced existing) 2025/08/31 01:42:57 NOTICE: (30) : delete-file /tmp/014245wo/compare_all/path2/file7.txt 2025/08/31 01:42:57 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/compare_all/path2/" for canonical name "/tmp/014245wo/compare_all/path2" 2025/08/31 01:42:57 INFO : file7.txt: Deleted 2025/08/31 01:42:57 NOTICE: (31) : test bisync run 2025/08/31 01:42:57 NOTICE: (32) : bisync compare-all 2025/08/31 01:42:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: update [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/modtime_write_test] 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: remove [/rclone-test-cerebak0buhi/014245wo/compare_all/path1/modtime_write_test] 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:42:59 NOTICE: Local file system at /tmp/014245wo/compare_all/path2: will use md5 for same-side diffs on Path2 only 2025/08/31 01:42:59 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:42:59 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/" with Path2 "/tmp/014245wo/compare_all/path2/" 2025/08/31 01:42:59 INFO : Building Path1 and Path2 listings 2025/08/31 01:42:59 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:42:59 INFO : Path1 checking for diffs 2025/08/31 01:42:59 INFO : - Path1 File changed: size (larger), time (newer), hash - file2.txt 2025/08/31 01:42:59 INFO : - Path1 File was deleted - file4.txt 2025/08/31 01:42:59 INFO : - Path1 File changed: size (larger), time (newer), hash - file5.txt 2025/08/31 01:42:59 INFO : - Path1 File was deleted - file6.txt 2025/08/31 01:42:59 INFO : - Path1 File changed: size (larger), time (newer), hash - file7.txt 2025/08/31 01:42:59 INFO : - Path1 File was deleted - file8.txt 2025/08/31 01:42:59 INFO : - Path1 File is new - file11.txt 2025/08/31 01:42:59 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2025/08/31 01:42:59 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2025/08/31 01:42:59 INFO : Path2 checking for diffs 2025/08/31 01:42:59 INFO : - Path2 File changed: size (larger), time (newer), hash - file1.txt 2025/08/31 01:42:59 INFO : - Path2 File was deleted - file3.txt 2025/08/31 01:42:59 INFO : - Path2 File changed: size (larger), time (newer), hash - file5.txt 2025/08/31 01:42:59 INFO : - Path2 File changed: size (larger), time (newer), hash - file6.txt 2025/08/31 01:42:59 INFO : - Path2 File was deleted - file7.txt 2025/08/31 01:42:59 INFO : - Path2 File was deleted - file8.txt 2025/08/31 01:42:59 INFO : - Path2 File is new - file10.txt 2025/08/31 01:42:59 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2025/08/31 01:42:59 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2025/08/31 01:42:59 INFO : Applying changes 2025/08/31 01:42:59 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/compare_all/path2/file11.txt 2025/08/31 01:42:59 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/compare_all/path2/file2.txt 2025/08/31 01:42:59 INFO : - Path2 Queue delete - /tmp/014245wo/compare_all/path2/file4.txt 2025/08/31 01:42:59 NOTICE: - WARNING New or changed in both paths - file5.txt 2025/08/31 01:42:59 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/file5.txt.conflict1 2025/08/31 01:42:59 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2025/08/31 01:42:59 NOTICE: - Path1 Queue copy to Path2 - /tmp/014245wo/compare_all/path2/file5.txt.conflict1 2025/08/31 01:42:59 NOTICE: - Path2 Renaming Path2 copy - /tmp/014245wo/compare_all/path2/file5.txt.conflict2 2025/08/31 01:42:59 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2025/08/31 01:42:59 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/file5.txt.conflict2 2025/08/31 01:42:59 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/file6.txt 2025/08/31 01:42:59 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/compare_all/path2/file7.txt 2025/08/31 01:42:59 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/file1.txt 2025/08/31 01:42:59 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/file10.txt 2025/08/31 01:42:59 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/file3.txt 2025/08/31 01:42:59 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:42:59 INFO : file10.txt: Copied (new) 2025/08/31 01:42:59 INFO : file6.txt: Copied (new) 2025/08/31 01:42:59 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:42:59 INFO : file5.txt.conflict2: Copied (new) 2025/08/31 01:42:59 INFO : file3.txt: Deleted 2025/08/31 01:42:59 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:42:59 INFO : file11.txt: Copied (new) 2025/08/31 01:42:59 INFO : file5.txt.conflict1: Copied (new) 2025/08/31 01:42:59 INFO : file7.txt: Copied (new) 2025/08/31 01:42:59 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:42:59 INFO : file4.txt: Deleted 2025/08/31 01:42:59 INFO : Updating listings 2025/08/31 01:42:59 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/compare_all/path1/" vs Path2 "/tmp/014245wo/compare_all/path2/" 2025/08/31 01:42:59 INFO : Bisync successful 2025/08/31 01:42:59 NOTICE: ---------------------------------------------------------- 2025/08/31 01:42:59 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:42:59 NOTICE: | @@ -16 +15,0 @@ 2025/08/31 01:42:59 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:42:59 NOTICE: | @@ -18 +16,0 @@ 2025/08/31 01:42:59 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:42:59 NOTICE: ---------------------------------------------------------- 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/compare_all/path1: purge [/rclone-test-cerebak0buhi/014245wo/compare_all/path1] 2025/08/31 01:42:59 DEBUG : Waiting for deletions to finish 2025/08/31 01:42:59 INFO : RCLONE_TEST: Deleted 2025/08/31 01:42:59 INFO : file7.txt: Deleted 2025/08/31 01:42:59 INFO : file6.txt: Deleted 2025/08/31 01:42:59 INFO : file11.txt: Deleted 2025/08/31 01:42:59 INFO : file2.txt: Deleted 2025/08/31 01:42:59 INFO : file5.txt.conflict2: Deleted 2025/08/31 01:42:59 INFO : file5.txt.conflict1: Deleted 2025/08/31 01:42:59 INFO : file10.txt: Deleted 2025/08/31 01:42:59 INFO : file1.txt: Deleted 2025/08/31 01:42:59 DEBUG : removing 1 level 0 directories 2025/08/31 01:42:59 INFO : Local file system at /tmp/014245wo/compare_all/path2: Removing directory bisync_test.go:597: TEST compare_all FAILED - 1 MISCOMPARED FILES === RUN TestBisyncRemoteLocal/createemptysrcdirs 2025/08/31 01:42:59 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cerebak0buhi/014245wo" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo" 2025/08/31 01:42:59 INFO : path1: Making directory 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo: mkdir [/rclone-test-cerebak0buhi/014245wo/path1] 2025/08/31 01:42:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1" 2025/08/31 01:42:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:42:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:42:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:42:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:42:59 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "/tmp/014245wo/createemptysrcdirs/path2" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_createemptysrcdirs/initial" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "/tmp/014245wo/initdir/test_createemptysrcdirs-zesavud1" 2025/08/31 01:42:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt 2025/08/31 01:42:59 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt 2025/08/31 01:42:59 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt 2025/08/31 01:42:59 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt 2025/08/31 01:42:59 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : Local file system at /tmp/014245wo/initdir/test_createemptysrcdirs-zesavud1: Waiting for checks to finish 2025/08/31 01:42:59 DEBUG : Local file system at /tmp/014245wo/initdir/test_createemptysrcdirs-zesavud1: Waiting for transfers to finish 2025/08/31 01:42:59 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt 2025/08/31 01:42:59 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:42:59 INFO : file1.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:42:59 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:42:59 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:42:59 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_createemptysrcdirs/modfiles" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4" 2025/08/31 01:42:59 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : Local file system at /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4: Waiting for checks to finish 2025/08/31 01:42:59 DEBUG : Local file system at /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4: Waiting for transfers to finish 2025/08/31 01:42:59 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : placeholder.txt.4db661ca.partial: renamed to: placeholder.txt 2025/08/31 01:42:59 INFO : placeholder.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: purge [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:42:59 DEBUG : Waiting for deletions to finish 2025/08/31 01:42:59 ERROR : error listing: directory not found 2025/08/31 01:42:59 ERROR : Local file system at /tmp/014245wo/createemptysrcdirs/path2: Failed to list "": directory not found 2025/08/31 01:42:59 DEBUG : removing 1 level 0 directories 2025/08/31 01:42:59 INFO : Local file system at /tmp/014245wo/createemptysrcdirs/path2: Removing directory 2025/08/31 01:42:59 ERROR : Failed to rmdir: stat /tmp/014245wo/createemptysrcdirs/path2: no such file or directory 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:42:59 ERROR : error listing: directory not found 2025/08/31 01:42:59 ERROR : error listing: directory not found 2025/08/31 01:42:59 NOTICE: checking initFs Local file system at /tmp/014245wo/initdir/test_createemptysrcdirs-zesavud1 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:42:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:42:59 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: Waiting for checks to finish 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: Waiting for transfers to finish 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/RCLONE_TEST] 2025/08/31 01:42:59 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:42:59 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:42:59 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:42:59 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/RCLONE_TEST: replication in progress) 2025/08/31 01:42:59 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/08/31 01:42:59 DEBUG : pacer: Reducing sleep to 30ms 2025/08/31 01:42:59 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : pacer: Reducing sleep to 22.5ms 2025/08/31 01:42:59 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : pacer: Reducing sleep to 20ms 2025/08/31 01:42:59 INFO : file1.txt: Copied (new) 2025/08/31 01:42:59 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:42:59 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:42:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:42:59 DEBUG : Local file system at /tmp/014245wo/createemptysrcdirs/path2: Waiting for checks to finish 2025/08/31 01:42:59 DEBUG : Local file system at /tmp/014245wo/createemptysrcdirs/path2: Waiting for transfers to finish 2025/08/31 01:42:59 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt 2025/08/31 01:42:59 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt 2025/08/31 01:42:59 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:42:59 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt 2025/08/31 01:42:59 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt 2025/08/31 01:42:59 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:42:59 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:42:59 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:42:59 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt 2025/08/31 01:42:59 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:42:59 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:42:59 INFO : file1.txt: Copied (new) 2025/08/31 01:42:59 NOTICE: checking path2 Local file system at /tmp/014245wo/createemptysrcdirs/path2 2025/08/31 01:42:59 NOTICE: (01) : test createemptysrcdirs 2025/08/31 01:42:59 NOTICE: (02) : test initial bisync 2025/08/31 01:42:59 NOTICE: (03) : touch-glob 2001-01-02 /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/ placeholder.txt 2025/08/31 01:42:59 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/" 2025/08/31 01:42:59 DEBUG : fs cache: renaming cache item "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/" to be canonical "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4" 2025/08/31 01:42:59 DEBUG : placeholder.txt: Set modification time 2001-01-02 2025/08/31 01:42:59 NOTICE: (04) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.txt 2025/08/31 01:42:59 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:42:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:59 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:42:59 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:42:59 INFO : placeholder.txt: Copied (replaced existing) to: file1.txt 2025/08/31 01:42:59 NOTICE: (05) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy1.txt 2025/08/31 01:42:59 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:42:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:59 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:42:59 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:42:59 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy1.txt 2025/08/31 01:42:59 NOTICE: (06) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy2.txt 2025/08/31 01:42:59 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:42:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:59 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:42:59 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:42:59 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy2.txt 2025/08/31 01:42:59 NOTICE: (07) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy3.txt 2025/08/31 01:42:59 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:42:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:59 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:42:59 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:42:59 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy3.txt 2025/08/31 01:42:59 NOTICE: (08) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy4.txt 2025/08/31 01:42:59 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:42:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:59 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:42:59 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:42:59 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy4.txt 2025/08/31 01:42:59 NOTICE: (09) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy5.txt 2025/08/31 01:42:59 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:42:59 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:42:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:42:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:42:59 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:42:59 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:42:59 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy5.txt 2025/08/31 01:42:59 NOTICE: (10) : bisync resync 2025/08/31 01:42:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" with Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:01 INFO : Copying Path2 files to Path1 2025/08/31 01:43:01 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:43:01 INFO : There was nothing to transfer 2025/08/31 01:43:01 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:43:01 INFO : file1.copy2.txt: Copied (replaced existing) 2025/08/31 01:43:01 INFO : file1.copy1.txt: Copied (replaced existing) 2025/08/31 01:43:01 INFO : file1.copy3.txt: Copied (replaced existing) 2025/08/31 01:43:01 INFO : file1.copy4.txt: Copied (replaced existing) 2025/08/31 01:43:01 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:01 INFO : file1.copy5.txt: Copied (replaced existing) 2025/08/31 01:43:01 INFO : Resync updating listings 2025/08/31 01:43:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" vs Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:01 INFO : Bisync successful 2025/08/31 01:43:01 NOTICE: (11) : test 1. Create an empty dir on Path1 by creating subdir/placeholder.txt and then deleting the placeholder 2025/08/31 01:43:01 NOTICE: (12) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ subdir/placeholder.txt 2025/08/31 01:43:01 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "subdir/placeholder.txt" 2025/08/31 01:43:01 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:01 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "subdir/placeholder.txt" 2025/08/31 01:43:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir/placeholder.txt] 2025/08/31 01:43:01 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir/placeholder.txt] 2025/08/31 01:43:01 INFO : placeholder.txt: Copied (new) to: subdir/placeholder.txt 2025/08/31 01:43:01 NOTICE: (13) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ subdir 2025/08/31 01:43:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:01 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:43:01 NOTICE: (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir/placeholder.txt 2025/08/31 01:43:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir/" 2025/08/31 01:43:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:01 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir/" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir/" 2025/08/31 01:43:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir/placeholder.txt] 2025/08/31 01:43:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir/: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir/placeholder.txt] 2025/08/31 01:43:01 INFO : placeholder.txt: Deleted 2025/08/31 01:43:01 NOTICE: (15) : test 2. Run bisync without --create-empty-src-dirs 2025/08/31 01:43:01 NOTICE: (16) : bisync 2025/08/31 01:43:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:03 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:03 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:03 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" with Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:03 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:03 INFO : Path1 checking for diffs 2025/08/31 01:43:03 INFO : Path2 checking for diffs 2025/08/31 01:43:03 INFO : No changes found 2025/08/31 01:43:03 INFO : Updating listings 2025/08/31 01:43:03 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" vs Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:03 INFO : Bisync successful 2025/08/31 01:43:03 NOTICE: (17) : test 3. Confirm the subdir exists only on Path1 and not Path2 2025/08/31 01:43:03 NOTICE: (18) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ 2025/08/31 01:43:03 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:43:03 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir] 2025/08/31 01:43:03 NOTICE: (19) : list-dirs /tmp/014245wo/createemptysrcdirs/path2/ 2025/08/31 01:43:03 DEBUG : Creating backend with remote "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:03 DEBUG : fs cache: renaming cache item "/tmp/014245wo/createemptysrcdirs/path2/" to be canonical "/tmp/014245wo/createemptysrcdirs/path2" 2025/08/31 01:43:03 NOTICE: (20) : test 4.Run bisync WITH --create-empty-src-dirs 2025/08/31 01:43:03 NOTICE: (21) : bisync create-empty-src-dirs 2025/08/31 01:43:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:05 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" with Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:05 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:05 INFO : Path1 checking for diffs 2025/08/31 01:43:05 INFO : - Path1 File is new - subdir 2025/08/31 01:43:05 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2025/08/31 01:43:05 INFO : Path2 checking for diffs 2025/08/31 01:43:05 INFO : Applying changes 2025/08/31 01:43:05 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/createemptysrcdirs/path2/subdir 2025/08/31 01:43:05 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:05 INFO : There was nothing to transfer 2025/08/31 01:43:05 INFO : subdir: Making directory 2025/08/31 01:43:05 INFO : Updating listings 2025/08/31 01:43:05 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" vs Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:05 INFO : Bisync successful 2025/08/31 01:43:05 NOTICE: (22) : test 5. Confirm the subdir exists on both paths 2025/08/31 01:43:05 NOTICE: (23) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ 2025/08/31 01:43:05 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:43:05 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir] 2025/08/31 01:43:05 NOTICE: (24) : list-dirs /tmp/014245wo/createemptysrcdirs/path2/ 2025/08/31 01:43:05 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/createemptysrcdirs/path2/" for canonical name "/tmp/014245wo/createemptysrcdirs/path2" 2025/08/31 01:43:05 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:05 NOTICE: (25) : test 6. Delete the empty dir on Path1 using purge-children (and also add files so the path isn't empty) 2025/08/31 01:43:05 NOTICE: (26) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:43:05 DEBUG : RCLONE_TEST: Remove file 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/RCLONE_TEST] 2025/08/31 01:43:05 DEBUG : file1.copy1.txt: Remove file 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:43:05 DEBUG : file1.copy2.txt: Remove file 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:43:05 DEBUG : file1.copy3.txt: Remove file 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:43:05 DEBUG : file1.copy4.txt: Remove file 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:43:05 DEBUG : file1.copy5.txt: Remove file 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:43:05 DEBUG : file1.txt: Remove file 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:43:05 DEBUG : subdir: Purge subdir 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: purge [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir] 2025/08/31 01:43:05 NOTICE: (27) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.txt 2025/08/31 01:43:05 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:43:05 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:05 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:05 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:43:05 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:43:05 INFO : placeholder.txt: Copied (new) to: file1.txt 2025/08/31 01:43:05 NOTICE: (28) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy1.txt 2025/08/31 01:43:05 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:43:05 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:05 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:05 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:43:05 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:43:05 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2025/08/31 01:43:05 NOTICE: (29) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy2.txt 2025/08/31 01:43:05 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:43:05 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:05 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:06 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:43:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:43:06 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:43:06 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2025/08/31 01:43:06 NOTICE: (30) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy3.txt 2025/08/31 01:43:06 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:43:06 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:06 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:06 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:06 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:06 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:43:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:43:06 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:43:06 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2025/08/31 01:43:06 NOTICE: (31) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy4.txt 2025/08/31 01:43:06 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:43:06 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:06 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:06 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:06 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:06 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:43:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:43:06 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:43:06 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2025/08/31 01:43:06 NOTICE: (32) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy5.txt 2025/08/31 01:43:06 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:43:06 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:06 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:06 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:06 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:06 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:43:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:43:06 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:43:06 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2025/08/31 01:43:06 NOTICE: (33) : test 7. Run bisync without --create-empty-src-dirs 2025/08/31 01:43:06 NOTICE: (34) : bisync 2025/08/31 01:43:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:06 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test: replication in progress) 2025/08/31 01:43:06 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/08/31 01:43:06 DEBUG : pacer: Reducing sleep to 30ms 2025/08/31 01:43:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:08 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:08 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" with Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:08 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:08 INFO : Path1 checking for diffs 2025/08/31 01:43:08 INFO : - Path1 File was deleted - RCLONE_TEST 2025/08/31 01:43:08 INFO : - Path1 File was deleted - subdir 2025/08/31 01:43:08 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2025/08/31 01:43:08 INFO : Path2 checking for diffs 2025/08/31 01:43:08 INFO : - Path2 File was deleted - subdir 2025/08/31 01:43:08 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2025/08/31 01:43:08 INFO : Applying changes 2025/08/31 01:43:08 INFO : - Path2 Queue delete - /tmp/014245wo/createemptysrcdirs/path2/RCLONE_TEST 2025/08/31 01:43:08 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:08 INFO : RCLONE_TEST: Deleted 2025/08/31 01:43:08 INFO : There was nothing to transfer 2025/08/31 01:43:08 INFO : Updating listings 2025/08/31 01:43:08 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" vs Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:08 INFO : Bisync successful 2025/08/31 01:43:08 NOTICE: (35) : test 8. Confirm the subdir exists only on Path2 and not Path1 2025/08/31 01:43:08 NOTICE: (36) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ 2025/08/31 01:43:08 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:43:08 NOTICE: (37) : list-dirs /tmp/014245wo/createemptysrcdirs/path2/ 2025/08/31 01:43:08 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/createemptysrcdirs/path2/" for canonical name "/tmp/014245wo/createemptysrcdirs/path2" 2025/08/31 01:43:08 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:08 NOTICE: (38) : test 9. Reset, do the delete again, and run bisync WITH --create-empty-src-dirs 2025/08/31 01:43:08 NOTICE: (39) : bisync resync create-empty-src-dirs 2025/08/31 01:43:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:08 DEBUG : pacer: Reducing sleep to 22.5ms 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:10 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:10 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" with Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:10 INFO : Copying Path2 files to Path1 2025/08/31 01:43:10 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:43:10 INFO : subdir: Making directory 2025/08/31 01:43:10 INFO : There was nothing to transfer 2025/08/31 01:43:10 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:43:10 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:10 INFO : There was nothing to transfer 2025/08/31 01:43:10 INFO : Resync updating listings 2025/08/31 01:43:10 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" vs Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:10 INFO : Bisync successful 2025/08/31 01:43:10 NOTICE: (40) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ 2025/08/31 01:43:10 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:43:10 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir] 2025/08/31 01:43:10 NOTICE: (41) : list-dirs /tmp/014245wo/createemptysrcdirs/path2/ 2025/08/31 01:43:10 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/createemptysrcdirs/path2/" for canonical name "/tmp/014245wo/createemptysrcdirs/path2" 2025/08/31 01:43:10 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:10 NOTICE: (42) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:43:10 DEBUG : file1.copy1.txt: Remove file 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:43:10 DEBUG : file1.copy2.txt: Remove file 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:43:10 DEBUG : file1.copy3.txt: Remove file 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:43:10 DEBUG : file1.copy4.txt: Remove file 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:43:10 DEBUG : file1.copy5.txt: Remove file 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:43:10 DEBUG : file1.txt: Remove file 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:43:10 DEBUG : subdir: Purge subdir 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: purge [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/subdir] 2025/08/31 01:43:10 NOTICE: (43) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.txt 2025/08/31 01:43:10 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:43:10 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:10 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:43:10 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:43:10 INFO : placeholder.txt: Copied (new) to: file1.txt 2025/08/31 01:43:10 NOTICE: (44) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy1.txt 2025/08/31 01:43:10 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:43:10 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:10 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:43:10 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:43:10 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2025/08/31 01:43:10 NOTICE: (45) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy2.txt 2025/08/31 01:43:10 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:43:10 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:10 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:43:10 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:43:10 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2025/08/31 01:43:10 NOTICE: (46) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy3.txt 2025/08/31 01:43:10 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:43:10 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:10 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:43:10 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:43:10 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2025/08/31 01:43:10 NOTICE: (47) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy4.txt 2025/08/31 01:43:10 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:43:10 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:10 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:43:10 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:43:10 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2025/08/31 01:43:10 NOTICE: (48) : copy-as /tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ file1.copy5.txt 2025/08/31 01:43:10 DEBUG : copyFile "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:43:10 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_createemptysrcdirs-fiperuh4/placeholder.txt" 2025/08/31 01:43:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:10 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: new [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:43:10 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:43:10 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2025/08/31 01:43:10 NOTICE: (49) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ 2025/08/31 01:43:10 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:43:10 NOTICE: (50) : list-dirs /tmp/014245wo/createemptysrcdirs/path2/ 2025/08/31 01:43:10 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/createemptysrcdirs/path2/" for canonical name "/tmp/014245wo/createemptysrcdirs/path2" 2025/08/31 01:43:10 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:10 NOTICE: (51) : bisync create-empty-src-dirs 2025/08/31 01:43:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:10 DEBUG : pacer: Reducing sleep to 20ms 2025/08/31 01:43:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:12 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:12 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" with Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:12 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:12 INFO : Path1 checking for diffs 2025/08/31 01:43:12 INFO : - Path1 File was deleted - subdir 2025/08/31 01:43:12 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2025/08/31 01:43:12 INFO : Path2 checking for diffs 2025/08/31 01:43:12 INFO : Applying changes 2025/08/31 01:43:12 INFO : - Path2 Queue delete - /tmp/014245wo/createemptysrcdirs/path2/subdir 2025/08/31 01:43:12 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:12 INFO : There was nothing to transfer 2025/08/31 01:43:12 INFO : subdir: Removing directory 2025/08/31 01:43:12 INFO : Updating listings 2025/08/31 01:43:12 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" vs Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:12 INFO : Bisync successful 2025/08/31 01:43:12 NOTICE: (52) : test 10. Confirm the subdir has been removed on both paths 2025/08/31 01:43:12 NOTICE: (53) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/ 2025/08/31 01:43:12 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" 2025/08/31 01:43:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/: list [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:43:12 NOTICE: (54) : list-dirs /tmp/014245wo/createemptysrcdirs/path2/ 2025/08/31 01:43:12 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/createemptysrcdirs/path2/" for canonical name "/tmp/014245wo/createemptysrcdirs/path2" 2025/08/31 01:43:12 NOTICE: (55) : test 11. bisync again (because if we leave subdir in listings, test will fail due to mismatched modtime) 2025/08/31 01:43:12 NOTICE: (56) : bisync create-empty-src-dirs 2025/08/31 01:43:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: update [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: remove [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:14 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:14 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:14 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" with Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:14 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:14 INFO : Path1 checking for diffs 2025/08/31 01:43:14 INFO : Path2 checking for diffs 2025/08/31 01:43:14 INFO : No changes found 2025/08/31 01:43:14 INFO : Updating listings 2025/08/31 01:43:14 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1/" vs Path2 "/tmp/014245wo/createemptysrcdirs/path2/" 2025/08/31 01:43:14 INFO : Bisync successful 2025/08/31 01:43:14 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:14 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:43:14 NOTICE: | @@ -26 +25,0 @@ 2025/08/31 01:43:14 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:14 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1: purge [/rclone-test-cerebak0buhi/014245wo/createemptysrcdirs/path1] 2025/08/31 01:43:14 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:14 INFO : file1.copy1.txt: Deleted 2025/08/31 01:43:14 INFO : file1.copy2.txt: Deleted 2025/08/31 01:43:14 INFO : file1.copy4.txt: Deleted 2025/08/31 01:43:14 INFO : file1.copy3.txt: Deleted 2025/08/31 01:43:14 INFO : file1.copy5.txt: Deleted 2025/08/31 01:43:14 INFO : file1.txt: Deleted 2025/08/31 01:43:14 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:14 INFO : Local file system at /tmp/014245wo/createemptysrcdirs/path2: Removing directory bisync_test.go:597: TEST createemptysrcdirs FAILED - 1 MISCOMPARED FILES === RUN TestBisyncRemoteLocal/nomodtime 2025/08/31 01:43:14 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cerebak0buhi/014245wo" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo" 2025/08/31 01:43:14 INFO : path1: Making directory 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo: mkdir [/rclone-test-cerebak0buhi/014245wo/path1] 2025/08/31 01:43:14 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cerebak0buhi/014245wo/nomodtime/path1" 2025/08/31 01:43:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:14 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cerebak0buhi/014245wo/nomodtime/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/nomodtime/path2" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_nomodtime/initial" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/initdir/test_nomodtime-fifeziy4" 2025/08/31 01:43:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:43:14 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:43:14 INFO : file1.txt: Copied (new) 2025/08/31 01:43:14 INFO : file2.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : Local file system at /tmp/014245wo/initdir/test_nomodtime-fifeziy4: Waiting for checks to finish 2025/08/31 01:43:14 DEBUG : Local file system at /tmp/014245wo/initdir/test_nomodtime-fifeziy4: Waiting for transfers to finish 2025/08/31 01:43:14 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt 2025/08/31 01:43:14 INFO : file3.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt 2025/08/31 01:43:14 INFO : file5.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt 2025/08/31 01:43:14 INFO : file4.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:14 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt 2025/08/31 01:43:14 INFO : file6.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:14 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:14 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt 2025/08/31 01:43:14 INFO : file7.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt 2025/08/31 01:43:14 INFO : file8.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_nomodtime/modfiles" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_nomodtime-hiciret1" 2025/08/31 01:43:14 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file10.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file11.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:14 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:14 DEBUG : file10.txt.7d45770.partial: renamed to: file10.txt 2025/08/31 01:43:14 INFO : file10.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file1.txt.7d45770.partial: renamed to: file1.txt 2025/08/31 01:43:14 INFO : file1.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : Local file system at /tmp/014245wo/datadir/test_nomodtime-hiciret1: Waiting for checks to finish 2025/08/31 01:43:14 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2025/08/31 01:43:14 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:14 DEBUG : file2.txt.21f2ec7f.partial: renamed to: file2.txt 2025/08/31 01:43:14 INFO : file2.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file11.txt.7d45770.partial: renamed to: file11.txt 2025/08/31 01:43:14 INFO : file11.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : Local file system at /tmp/014245wo/datadir/test_nomodtime-hiciret1: Waiting for transfers to finish 2025/08/31 01:43:14 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2025/08/31 01:43:14 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2025/08/31 01:43:14 DEBUG : file5R.txt.9ed658ed.partial: renamed to: file5R.txt 2025/08/31 01:43:14 INFO : file5R.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file5L.txt.9ed658ed.partial: renamed to: file5L.txt 2025/08/31 01:43:14 INFO : file5L.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:14 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:14 DEBUG : file7.txt.7d45770.partial: renamed to: file7.txt 2025/08/31 01:43:14 INFO : file7.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file6.txt.7d45770.partial: renamed to: file6.txt 2025/08/31 01:43:14 INFO : file6.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: purge [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1] 2025/08/31 01:43:14 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:14 ERROR : error listing: directory not found 2025/08/31 01:43:14 ERROR : Local file system at /tmp/014245wo/nomodtime/path2: Failed to list "": directory not found 2025/08/31 01:43:14 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:14 INFO : Local file system at /tmp/014245wo/nomodtime/path2: Removing directory 2025/08/31 01:43:14 ERROR : Failed to rmdir: stat /tmp/014245wo/nomodtime/path2: no such file or directory 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: list [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1] 2025/08/31 01:43:14 ERROR : error listing: directory not found 2025/08/31 01:43:14 ERROR : error listing: directory not found 2025/08/31 01:43:14 NOTICE: checking initFs Local file system at /tmp/014245wo/initdir/test_nomodtime-fifeziy4 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: list [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1] 2025/08/31 01:43:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/RCLONE_TEST] 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file1.txt] 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: Waiting for checks to finish 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: Waiting for transfers to finish 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file2.txt] 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file3.txt] 2025/08/31 01:43:14 INFO : file1.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file4.txt] 2025/08/31 01:43:14 INFO : file2.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file5.txt] 2025/08/31 01:43:14 INFO : file3.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file6.txt] 2025/08/31 01:43:14 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file7.txt] 2025/08/31 01:43:14 INFO : file4.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file8.txt] 2025/08/31 01:43:14 INFO : file5.txt: Copied (new) 2025/08/31 01:43:14 INFO : file6.txt: Copied (new) 2025/08/31 01:43:14 INFO : file7.txt: Copied (new) 2025/08/31 01:43:14 INFO : file8.txt: Copied (new) 2025/08/31 01:43:14 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: list [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1] 2025/08/31 01:43:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:14 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:43:14 INFO : file1.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : Local file system at /tmp/014245wo/nomodtime/path2: Waiting for checks to finish 2025/08/31 01:43:14 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : Local file system at /tmp/014245wo/nomodtime/path2: Waiting for transfers to finish 2025/08/31 01:43:14 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt 2025/08/31 01:43:14 INFO : file4.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:14 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:14 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt 2025/08/31 01:43:14 INFO : file6.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt 2025/08/31 01:43:14 INFO : file7.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt 2025/08/31 01:43:14 INFO : file8.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt 2025/08/31 01:43:14 INFO : file3.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:43:14 INFO : file2.txt: Copied (new) 2025/08/31 01:43:14 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:14 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt 2025/08/31 01:43:14 INFO : file5.txt: Copied (new) 2025/08/31 01:43:14 NOTICE: checking path2 Local file system at /tmp/014245wo/nomodtime/path2 2025/08/31 01:43:14 NOTICE: (01) : test changes 2025/08/31 01:43:14 NOTICE: (02) : test initial bisync 2025/08/31 01:43:14 NOTICE: (03) : bisync resync nomodtime 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:14 NOTICE: Local file system at /tmp/014245wo/nomodtime/path2: will use md5 for same-side diffs on Path2 only 2025/08/31 01:43:14 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:43:14 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" with Path2 "/tmp/014245wo/nomodtime/path2/" 2025/08/31 01:43:14 INFO : Copying Path2 files to Path1 2025/08/31 01:43:14 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:43:14 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:43:14 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:43:14 INFO : Resync updating listings 2025/08/31 01:43:14 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" vs Path2 "/tmp/014245wo/nomodtime/path2/" 2025/08/31 01:43:14 INFO : Bisync successful 2025/08/31 01:43:14 NOTICE: (04) : test make modifications on both paths 2025/08/31 01:43:14 NOTICE: (05) : test new on path2 - file10 2025/08/31 01:43:14 NOTICE: (06) : copy-file /tmp/014245wo/datadir/test_nomodtime-hiciret1/file10.txt /tmp/014245wo/nomodtime/path2/ 2025/08/31 01:43:14 DEBUG : copyFile "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file10.txt" to "/tmp/014245wo/nomodtime/path2/" as "" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file10.txt" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/nomodtime/path2/" 2025/08/31 01:43:14 DEBUG : operations.CopyFile "file10.txt" to "Local file system at /tmp/014245wo/nomodtime/path2" as "file10.txt" 2025/08/31 01:43:14 DEBUG : file10.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:14 DEBUG : file10.txt.7d45770.partial: renamed to: file10.txt 2025/08/31 01:43:14 INFO : file10.txt: Copied (new) 2025/08/31 01:43:14 NOTICE: (07) : test changed on path2 - file1 2025/08/31 01:43:14 NOTICE: (08) : copy-file /tmp/014245wo/datadir/test_nomodtime-hiciret1/file1.txt /tmp/014245wo/nomodtime/path2/ 2025/08/31 01:43:14 DEBUG : copyFile "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file1.txt" to "/tmp/014245wo/nomodtime/path2/" as "" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file1.txt" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/nomodtime/path2/" 2025/08/31 01:43:14 DEBUG : operations.CopyFile "file1.txt" to "Local file system at /tmp/014245wo/nomodtime/path2" as "file1.txt" 2025/08/31 01:43:14 DEBUG : file1.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:43:14 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:14 DEBUG : file1.txt.7d45770.partial: renamed to: file1.txt 2025/08/31 01:43:14 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:14 NOTICE: (09) : test new on path1 - file11 2025/08/31 01:43:14 NOTICE: (10) : copy-file /tmp/014245wo/datadir/test_nomodtime-hiciret1/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/ 2025/08/31 01:43:14 DEBUG : copyFile "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file11.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" as "" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file11.txt" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" 2025/08/31 01:43:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:14 DEBUG : operations.CopyFile "file11.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" as "file11.txt" 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: new [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file11.txt] 2025/08/31 01:43:14 DEBUG : file11.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file11.txt] 2025/08/31 01:43:14 INFO : file11.txt: Copied (new) 2025/08/31 01:43:14 NOTICE: (11) : test changed on path1 - file2 2025/08/31 01:43:14 NOTICE: (12) : copy-file /tmp/014245wo/datadir/test_nomodtime-hiciret1/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/ 2025/08/31 01:43:14 DEBUG : copyFile "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file2.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" as "" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file2.txt" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" 2025/08/31 01:43:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:14 DEBUG : operations.CopyFile "file2.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" as "file2.txt" 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: new [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file2.txt] 2025/08/31 01:43:14 DEBUG : file2.txt: Sizes differ (src 13 vs dst 0) 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file2.txt] 2025/08/31 01:43:14 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:43:14 NOTICE: (13) : test deleted on path2 - file3 2025/08/31 01:43:14 NOTICE: (14) : delete-file /tmp/014245wo/nomodtime/path2/file3.txt 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/nomodtime/path2/" 2025/08/31 01:43:14 DEBUG : fs cache: renaming cache item "/tmp/014245wo/nomodtime/path2/" to be canonical "/tmp/014245wo/nomodtime/path2" 2025/08/31 01:43:14 INFO : file3.txt: Deleted 2025/08/31 01:43:14 NOTICE: (15) : test deleted on path1 - file4 2025/08/31 01:43:14 NOTICE: (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file4.txt 2025/08/31 01:43:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" 2025/08/31 01:43:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:14 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: new [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file4.txt] 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: remove [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file4.txt] 2025/08/31 01:43:14 INFO : file4.txt: Deleted 2025/08/31 01:43:14 NOTICE: (17) : test deleted on both paths - file8 2025/08/31 01:43:14 NOTICE: (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file8.txt 2025/08/31 01:43:14 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: new [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file8.txt] 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: remove [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file8.txt] 2025/08/31 01:43:14 INFO : file8.txt: Deleted 2025/08/31 01:43:14 NOTICE: (19) : delete-file /tmp/014245wo/nomodtime/path2/file8.txt 2025/08/31 01:43:14 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/nomodtime/path2/" for canonical name "/tmp/014245wo/nomodtime/path2" 2025/08/31 01:43:14 INFO : file8.txt: Deleted 2025/08/31 01:43:14 NOTICE: (20) : test changed on both paths - file5 (file5R, file5L) 2025/08/31 01:43:14 NOTICE: (21) : copy-as /tmp/014245wo/datadir/test_nomodtime-hiciret1/file5R.txt /tmp/014245wo/nomodtime/path2/ file5.txt 2025/08/31 01:43:14 DEBUG : copyFile "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file5R.txt" to "/tmp/014245wo/nomodtime/path2/" as "file5.txt" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file5R.txt" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/nomodtime/path2/" 2025/08/31 01:43:14 DEBUG : operations.CopyFile "file5R.txt" to "Local file system at /tmp/014245wo/nomodtime/path2" as "file5.txt" 2025/08/31 01:43:14 DEBUG : file5R.txt: Sizes differ (src 39 vs dst 0) 2025/08/31 01:43:14 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2025/08/31 01:43:14 DEBUG : file5.txt.9ed658ed.partial: renamed to: file5.txt 2025/08/31 01:43:14 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2025/08/31 01:43:14 NOTICE: (22) : copy-as /tmp/014245wo/datadir/test_nomodtime-hiciret1/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/ file5.txt 2025/08/31 01:43:14 DEBUG : copyFile "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file5L.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" as "file5.txt" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file5L.txt" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" 2025/08/31 01:43:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:14 DEBUG : operations.CopyFile "file5L.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" as "file5.txt" 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: new [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file5.txt] 2025/08/31 01:43:14 DEBUG : file5L.txt: Sizes differ (src 39 vs dst 0) 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file5.txt] 2025/08/31 01:43:14 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2025/08/31 01:43:14 NOTICE: (23) : test changed on path2 and deleted on path1 - file6 2025/08/31 01:43:14 NOTICE: (24) : copy-file /tmp/014245wo/datadir/test_nomodtime-hiciret1/file6.txt /tmp/014245wo/nomodtime/path2/ 2025/08/31 01:43:14 DEBUG : copyFile "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file6.txt" to "/tmp/014245wo/nomodtime/path2/" as "" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file6.txt" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/nomodtime/path2/" 2025/08/31 01:43:14 DEBUG : operations.CopyFile "file6.txt" to "Local file system at /tmp/014245wo/nomodtime/path2" as "file6.txt" 2025/08/31 01:43:14 DEBUG : file6.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:43:14 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:14 DEBUG : file6.txt.7d45770.partial: renamed to: file6.txt 2025/08/31 01:43:14 INFO : file6.txt: Copied (replaced existing) 2025/08/31 01:43:14 NOTICE: (25) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file6.txt 2025/08/31 01:43:14 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: new [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file6.txt] 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: remove [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file6.txt] 2025/08/31 01:43:14 INFO : file6.txt: Deleted 2025/08/31 01:43:14 NOTICE: (26) : test changed on path1 and deleted on path2 - file7 2025/08/31 01:43:14 NOTICE: (27) : copy-file /tmp/014245wo/datadir/test_nomodtime-hiciret1/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/ 2025/08/31 01:43:14 DEBUG : copyFile "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file7.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" as "" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_nomodtime-hiciret1/file7.txt" 2025/08/31 01:43:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" 2025/08/31 01:43:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:14 DEBUG : operations.CopyFile "file7.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" as "file7.txt" 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: new [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file7.txt] 2025/08/31 01:43:14 DEBUG : file7.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/: update [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file7.txt] 2025/08/31 01:43:14 INFO : file7.txt: Copied (replaced existing) 2025/08/31 01:43:14 NOTICE: (28) : delete-file /tmp/014245wo/nomodtime/path2/file7.txt 2025/08/31 01:43:14 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/nomodtime/path2/" for canonical name "/tmp/014245wo/nomodtime/path2" 2025/08/31 01:43:14 INFO : file7.txt: Deleted 2025/08/31 01:43:14 NOTICE: (29) : test bisync run 2025/08/31 01:43:14 NOTICE: (30) : bisync nomodtime 2025/08/31 01:43:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:14 NOTICE: Local file system at /tmp/014245wo/nomodtime/path2: will use md5 for same-side diffs on Path2 only 2025/08/31 01:43:14 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:43:14 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" with Path2 "/tmp/014245wo/nomodtime/path2/" 2025/08/31 01:43:14 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:14 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:43:14 INFO : Path1 checking for diffs 2025/08/31 01:43:14 INFO : - Path1 File changed: size (larger), hash - file2.txt 2025/08/31 01:43:14 INFO : - Path1 File was deleted - file4.txt 2025/08/31 01:43:14 INFO : - Path1 File changed: size (larger), hash - file5.txt 2025/08/31 01:43:14 INFO : - Path1 File was deleted - file6.txt 2025/08/31 01:43:14 INFO : - Path1 File changed: size (larger), hash - file7.txt 2025/08/31 01:43:14 INFO : - Path1 File was deleted - file8.txt 2025/08/31 01:43:14 INFO : - Path1 File is new - file11.txt 2025/08/31 01:43:14 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2025/08/31 01:43:14 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2025/08/31 01:43:14 INFO : Path2 checking for diffs 2025/08/31 01:43:14 INFO : - Path2 File changed: size (larger), hash - file1.txt 2025/08/31 01:43:14 INFO : - Path2 File was deleted - file3.txt 2025/08/31 01:43:14 INFO : - Path2 File changed: size (larger), hash - file5.txt 2025/08/31 01:43:14 INFO : - Path2 File changed: size (larger), hash - file6.txt 2025/08/31 01:43:14 INFO : - Path2 File was deleted - file7.txt 2025/08/31 01:43:14 INFO : - Path2 File was deleted - file8.txt 2025/08/31 01:43:14 INFO : - Path2 File is new - file10.txt 2025/08/31 01:43:14 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2025/08/31 01:43:14 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2025/08/31 01:43:14 INFO : Applying changes 2025/08/31 01:43:14 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/nomodtime/path2/file11.txt 2025/08/31 01:43:14 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/nomodtime/path2/file2.txt 2025/08/31 01:43:14 INFO : - Path2 Queue delete - /tmp/014245wo/nomodtime/path2/file4.txt 2025/08/31 01:43:14 NOTICE: - WARNING New or changed in both paths - file5.txt 2025/08/31 01:43:14 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file5.txt.conflict1 2025/08/31 01:43:14 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2025/08/31 01:43:14 NOTICE: - Path1 Queue copy to Path2 - /tmp/014245wo/nomodtime/path2/file5.txt.conflict1 2025/08/31 01:43:14 NOTICE: - Path2 Renaming Path2 copy - /tmp/014245wo/nomodtime/path2/file5.txt.conflict2 2025/08/31 01:43:14 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2025/08/31 01:43:14 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file5.txt.conflict2 2025/08/31 01:43:14 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file6.txt 2025/08/31 01:43:14 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/nomodtime/path2/file7.txt 2025/08/31 01:43:14 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file1.txt 2025/08/31 01:43:14 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file10.txt 2025/08/31 01:43:14 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/file3.txt 2025/08/31 01:43:14 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:43:14 INFO : file10.txt: Copied (new) 2025/08/31 01:43:14 INFO : file5.txt.conflict2: Copied (new) 2025/08/31 01:43:14 INFO : file6.txt: Copied (new) 2025/08/31 01:43:14 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:14 INFO : file3.txt: Deleted 2025/08/31 01:43:14 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:14 INFO : file11.txt: Copied (new) 2025/08/31 01:43:15 INFO : file5.txt.conflict1: Copied (new) 2025/08/31 01:43:15 INFO : file7.txt: Copied (new) 2025/08/31 01:43:15 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:43:15 INFO : file4.txt: Deleted 2025/08/31 01:43:15 INFO : Updating listings 2025/08/31 01:43:15 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/nomodtime/path1/" vs Path2 "/tmp/014245wo/nomodtime/path2/" 2025/08/31 01:43:15 INFO : Bisync successful 2025/08/31 01:43:15 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:15 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:43:15 NOTICE: | @@ -16 +15,0 @@ 2025/08/31 01:43:15 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:15 NOTICE: | @@ -18 +16,0 @@ 2025/08/31 01:43:15 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:15 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/nomodtime/path1: purge [/rclone-test-cerebak0buhi/014245wo/nomodtime/path1] 2025/08/31 01:43:15 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:15 INFO : RCLONE_TEST: Deleted 2025/08/31 01:43:15 INFO : file11.txt: Deleted 2025/08/31 01:43:15 INFO : file7.txt: Deleted 2025/08/31 01:43:15 INFO : file6.txt: Deleted 2025/08/31 01:43:15 INFO : file1.txt: Deleted 2025/08/31 01:43:15 INFO : file5.txt.conflict1: Deleted 2025/08/31 01:43:15 INFO : file5.txt.conflict2: Deleted 2025/08/31 01:43:15 INFO : file2.txt: Deleted 2025/08/31 01:43:15 INFO : file10.txt: Deleted 2025/08/31 01:43:15 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:15 INFO : Local file system at /tmp/014245wo/nomodtime/path2: Removing directory bisync_test.go:597: TEST nomodtime FAILED - 1 MISCOMPARED FILES === RUN TestBisyncRemoteLocal/rclone_args 2025/08/31 01:43:15 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cerebak0buhi/014245wo" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo" 2025/08/31 01:43:15 INFO : path1: Making directory 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo: mkdir [/rclone-test-cerebak0buhi/014245wo/path1] 2025/08/31 01:43:15 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cerebak0buhi/014245wo/rclone_args/path1" 2025/08/31 01:43:15 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:15 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:15 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cerebak0buhi/014245wo/rclone_args/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1" 2025/08/31 01:43:15 DEBUG : Creating backend with remote "/tmp/014245wo/rclone_args/path2" 2025/08/31 01:43:15 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rclone_args/initial" 2025/08/31 01:43:15 DEBUG : Creating backend with remote "/tmp/014245wo/initdir/test_rclone_args-lenaqux3" 2025/08/31 01:43:15 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : subdir: Making directory with metadata 2025/08/31 01:43:15 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2025/08/31 01:43:15 DEBUG : Added delayed dir = "subdir", newDst=subdir 2025/08/31 01:43:15 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:15 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:43:15 INFO : file2.txt: Copied (new) 2025/08/31 01:43:15 DEBUG : Local file system at /tmp/014245wo/initdir/test_rclone_args-lenaqux3: Waiting for checks to finish 2025/08/31 01:43:15 DEBUG : Local file system at /tmp/014245wo/initdir/test_rclone_args-lenaqux3: Waiting for transfers to finish 2025/08/31 01:43:15 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:15 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:15 DEBUG : subdir/file21.txt.5028a97.partial: renamed to: subdir/file21.txt 2025/08/31 01:43:15 INFO : subdir/file21.txt: Copied (new) 2025/08/31 01:43:15 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2025/08/31 01:43:15 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:43:15 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:15 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:15 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:15 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2025/08/31 01:43:15 DEBUG : file1.txt.dae86b42.partial: renamed to: file1.txt 2025/08/31 01:43:15 INFO : file1.txt: Copied (new) 2025/08/31 01:43:15 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:15 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rclone_args/modfiles" 2025/08/31 01:43:15 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0" 2025/08/31 01:43:15 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : file21.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : Local file system at /tmp/014245wo/datadir/test_rclone_args-buqimib0: Waiting for checks to finish 2025/08/31 01:43:15 DEBUG : Local file system at /tmp/014245wo/datadir/test_rclone_args-buqimib0: Waiting for transfers to finish 2025/08/31 01:43:15 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:15 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:15 DEBUG : file20.txt.b4075ff1.partial: renamed to: file20.txt 2025/08/31 01:43:15 INFO : file20.txt: Copied (new) 2025/08/31 01:43:15 DEBUG : file21.txt.b4075ff1.partial: renamed to: file21.txt 2025/08/31 01:43:15 INFO : file21.txt: Copied (new) 2025/08/31 01:43:15 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:15 DEBUG : file2.txt.6bedbe24.partial: renamed to: file2.txt 2025/08/31 01:43:15 INFO : file2.txt: Copied (new) 2025/08/31 01:43:15 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:15 DEBUG : file1.txt.6bedbe24.partial: renamed to: file1.txt 2025/08/31 01:43:15 INFO : file1.txt: Copied (new) 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: purge [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1] 2025/08/31 01:43:15 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:15 ERROR : error listing: directory not found 2025/08/31 01:43:15 ERROR : Local file system at /tmp/014245wo/rclone_args/path2: Failed to list "": directory not found 2025/08/31 01:43:15 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:15 INFO : Local file system at /tmp/014245wo/rclone_args/path2: Removing directory 2025/08/31 01:43:15 ERROR : Failed to rmdir: stat /tmp/014245wo/rclone_args/path2: no such file or directory 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: list [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1] 2025/08/31 01:43:15 ERROR : error listing: directory not found 2025/08/31 01:43:15 ERROR : error listing: directory not found 2025/08/31 01:43:15 NOTICE: checking initFs Local file system at /tmp/014245wo/initdir/test_rclone_args-lenaqux3 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: list [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1] 2025/08/31 01:43:15 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 INFO : subdir: Making directory 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: mkdir [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir] 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file1.txt] 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file2.txt] 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/RCLONE_TEST] 2025/08/31 01:43:15 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: Waiting for checks to finish 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: Waiting for transfers to finish 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:43:15 INFO : file2.txt: Copied (new) 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/file21.txt] 2025/08/31 01:43:15 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:43:15 INFO : file1.txt: Copied (new) 2025/08/31 01:43:15 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:15 INFO : subdir/file21.txt: Copied (new) 2025/08/31 01:43:15 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: list [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1] 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: list [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir] 2025/08/31 01:43:15 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : subdir: Making directory with metadata 2025/08/31 01:43:15 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2025/08/31 01:43:15 DEBUG : Added delayed dir = "subdir", newDst=subdir 2025/08/31 01:43:15 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:15 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:15 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:43:15 INFO : file2.txt: Copied (new) 2025/08/31 01:43:15 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:15 DEBUG : subdir/file21.txt.5028a97.partial: renamed to: subdir/file21.txt 2025/08/31 01:43:15 INFO : subdir/file21.txt: Copied (new) 2025/08/31 01:43:15 DEBUG : Local file system at /tmp/014245wo/rclone_args/path2: Waiting for checks to finish 2025/08/31 01:43:15 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2025/08/31 01:43:15 DEBUG : file1.txt.dae86b42.partial: renamed to: file1.txt 2025/08/31 01:43:15 INFO : file1.txt: Copied (new) 2025/08/31 01:43:15 DEBUG : Local file system at /tmp/014245wo/rclone_args/path2: Waiting for transfers to finish 2025/08/31 01:43:15 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:15 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2025/08/31 01:43:15 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:43:15 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:15 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:15 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:15 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:15 NOTICE: checking path2 Local file system at /tmp/014245wo/rclone_args/path2 2025/08/31 01:43:15 NOTICE: (01) : test rclone-args 2025/08/31 01:43:15 NOTICE: (02) : touch-glob 2001-01-02 /tmp/014245wo/datadir/test_rclone_args-buqimib0/ * 2025/08/31 01:43:15 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/" 2025/08/31 01:43:15 DEBUG : fs cache: renaming cache item "/tmp/014245wo/datadir/test_rclone_args-buqimib0/" to be canonical "/tmp/014245wo/datadir/test_rclone_args-buqimib0" 2025/08/31 01:43:15 DEBUG : file21.txt: Set modification time 2001-01-02 2025/08/31 01:43:15 DEBUG : file1.txt: Set modification time 2001-01-02 2025/08/31 01:43:15 DEBUG : file2.txt: Set modification time 2001-01-02 2025/08/31 01:43:15 DEBUG : file20.txt: Set modification time 2001-01-02 2025/08/31 01:43:15 NOTICE: (03) : test initial bisync 2025/08/31 01:43:15 NOTICE: (04) : bisync resync checksum 2025/08/31 01:43:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: remove [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:17 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:17 NOTICE: Local file system at /tmp/014245wo/rclone_args/path2: will use md5 for same-side diffs on Path2 only 2025/08/31 01:43:17 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:43:17 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" with Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:17 INFO : Copying Path2 files to Path1 2025/08/31 01:43:17 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:43:17 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:43:17 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:43:17 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:17 INFO : Resync updating listings 2025/08/31 01:43:17 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" vs Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:17 INFO : Bisync successful 2025/08/31 01:43:17 NOTICE: (05) : test place newer files on both paths 2025/08/31 01:43:17 NOTICE: (06) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/ 2025/08/31 01:43:17 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file1.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" as "" 2025/08/31 01:43:17 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file1.txt" 2025/08/31 01:43:17 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" 2025/08/31 01:43:17 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:17 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:17 DEBUG : operations.CopyFile "file1.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" as "file1.txt" 2025/08/31 01:43:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/: new [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file1.txt] 2025/08/31 01:43:17 DEBUG : file1.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:43:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file1.txt] 2025/08/31 01:43:17 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:17 NOTICE: (07) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file2.txt /tmp/014245wo/rclone_args/path2/ 2025/08/31 01:43:17 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file2.txt" to "/tmp/014245wo/rclone_args/path2/" as "" 2025/08/31 01:43:17 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file2.txt" 2025/08/31 01:43:17 DEBUG : Creating backend with remote "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:17 DEBUG : operations.CopyFile "file2.txt" to "Local file system at /tmp/014245wo/rclone_args/path2" as "file2.txt" 2025/08/31 01:43:17 DEBUG : file2.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:43:17 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:17 DEBUG : file2.txt.925c801f.partial: renamed to: file2.txt 2025/08/31 01:43:17 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:43:17 NOTICE: (08) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir 2025/08/31 01:43:17 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file20.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir" as "" 2025/08/31 01:43:17 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file20.txt" 2025/08/31 01:43:17 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir" 2025/08/31 01:43:17 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:17 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:17 DEBUG : operations.CopyFile "file20.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir" as "file20.txt" 2025/08/31 01:43:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir: new [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:43:17 DEBUG : file20.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:43:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:43:17 INFO : file20.txt: Copied (replaced existing) 2025/08/31 01:43:17 NOTICE: (09) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt /tmp/014245wo/rclone_args/path2/subdir 2025/08/31 01:43:17 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt" to "/tmp/014245wo/rclone_args/path2/subdir" as "" 2025/08/31 01:43:17 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt" 2025/08/31 01:43:17 DEBUG : Creating backend with remote "/tmp/014245wo/rclone_args/path2/subdir" 2025/08/31 01:43:17 DEBUG : operations.CopyFile "file21.txt" to "Local file system at /tmp/014245wo/rclone_args/path2/subdir" as "file21.txt" 2025/08/31 01:43:17 DEBUG : file21.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:43:17 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:17 INFO : file21.txt: Updated modification time in destination 2025/08/31 01:43:17 DEBUG : file21.txt: Unchanged skipping 2025/08/31 01:43:17 NOTICE: (10) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/ file1.txt 2025/08/31 01:43:17 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" 2025/08/31 01:43:17 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:17 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:17 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" 2025/08/31 01:43:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/: list [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1] 2025/08/31 01:43:17 DEBUG : file1.txt: Set modification time 2001-01-02 2025/08/31 01:43:17 NOTICE: (11) : touch-glob 2001-01-02 /tmp/014245wo/rclone_args/path2/ file2.txt 2025/08/31 01:43:17 DEBUG : Creating backend with remote "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:17 DEBUG : fs cache: renaming cache item "/tmp/014245wo/rclone_args/path2/" to be canonical "/tmp/014245wo/rclone_args/path2" 2025/08/31 01:43:17 DEBUG : file2.txt: Set modification time 2001-01-02 2025/08/31 01:43:17 NOTICE: (12) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/ file20.txt 2025/08/31 01:43:17 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/" 2025/08/31 01:43:17 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:17 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:17 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/" to be canonical "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/" 2025/08/31 01:43:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/: list [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir] 2025/08/31 01:43:17 DEBUG : file20.txt: Set modification time 2001-01-02 2025/08/31 01:43:17 NOTICE: (13) : touch-glob 2001-01-02 /tmp/014245wo/rclone_args/path2/subdir/ file21.txt 2025/08/31 01:43:17 DEBUG : Creating backend with remote "/tmp/014245wo/rclone_args/path2/subdir/" 2025/08/31 01:43:17 DEBUG : fs cache: renaming cache item "/tmp/014245wo/rclone_args/path2/subdir/" to be canonical "/tmp/014245wo/rclone_args/path2/subdir" 2025/08/31 01:43:17 DEBUG : file21.txt: Set modification time 2001-01-02 2025/08/31 01:43:17 NOTICE: (14) : test run bisync with custom options 2025/08/31 01:43:17 NOTICE: (15) : bisync checksum 2025/08/31 01:43:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: remove [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:19 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:19 NOTICE: Local file system at /tmp/014245wo/rclone_args/path2: will use md5 for same-side diffs on Path2 only 2025/08/31 01:43:19 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:43:19 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" with Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:19 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:19 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:43:19 INFO : Path1 checking for diffs 2025/08/31 01:43:19 INFO : - Path1 File changed: hash - file1.txt 2025/08/31 01:43:19 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2025/08/31 01:43:19 INFO : (Modified:  1 hash differs) 2025/08/31 01:43:19 INFO : Path2 checking for diffs 2025/08/31 01:43:19 INFO : - Path2 File changed: size (larger), hash - file2.txt 2025/08/31 01:43:19 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2025/08/31 01:43:19 INFO : (Modified:  1 larger,  0 smaller,  1 hash differs) 2025/08/31 01:43:19 INFO : Applying changes 2025/08/31 01:43:19 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/rclone_args/path2/file1.txt 2025/08/31 01:43:19 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file2.txt 2025/08/31 01:43:19 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:43:19 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:43:19 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:19 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:19 INFO : Updating listings 2025/08/31 01:43:19 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" vs Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:19 INFO : Bisync successful 2025/08/31 01:43:19 NOTICE: (16) : touch-glob 2007-07-23 /tmp/014245wo/datadir/test_rclone_args-buqimib0/ * 2025/08/31 01:43:19 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/datadir/test_rclone_args-buqimib0/" for canonical name "/tmp/014245wo/datadir/test_rclone_args-buqimib0" 2025/08/31 01:43:19 DEBUG : file21.txt: Set modification time 2007-07-23 2025/08/31 01:43:19 DEBUG : file1.txt: Set modification time 2007-07-23 2025/08/31 01:43:19 DEBUG : file2.txt: Set modification time 2007-07-23 2025/08/31 01:43:19 DEBUG : file20.txt: Set modification time 2007-07-23 2025/08/31 01:43:19 NOTICE: (17) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/ 2025/08/31 01:43:19 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file1.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" as "" 2025/08/31 01:43:19 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file1.txt" 2025/08/31 01:43:19 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" 2025/08/31 01:43:19 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:19 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:19 DEBUG : operations.CopyFile "file1.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" as "file1.txt" 2025/08/31 01:43:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/: new [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file1.txt] 2025/08/31 01:43:19 DEBUG : file1.txt: Modification times differ by -57432h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2001-01-02 00:00:00 +0000 UTC 2025/08/31 01:43:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file1.txt] 2025/08/31 01:43:19 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:19 NOTICE: (18) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file2.txt /tmp/014245wo/rclone_args/path2/ 2025/08/31 01:43:19 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file2.txt" to "/tmp/014245wo/rclone_args/path2/" as "" 2025/08/31 01:43:19 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file2.txt" 2025/08/31 01:43:19 DEBUG : Creating backend with remote "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:19 DEBUG : operations.CopyFile "file2.txt" to "Local file system at /tmp/014245wo/rclone_args/path2" as "file2.txt" 2025/08/31 01:43:19 DEBUG : file2.txt: Modification times differ by -57432h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2001-01-02 00:00:00 +0000 UTC 2025/08/31 01:43:19 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:19 INFO : file2.txt: Updated modification time in destination 2025/08/31 01:43:19 DEBUG : file2.txt: Unchanged skipping 2025/08/31 01:43:19 NOTICE: (19) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir 2025/08/31 01:43:19 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file20.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir" as "" 2025/08/31 01:43:19 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file20.txt" 2025/08/31 01:43:19 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir" 2025/08/31 01:43:19 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:19 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:19 DEBUG : operations.CopyFile "file20.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir" as "file20.txt" 2025/08/31 01:43:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir: new [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:43:19 DEBUG : file20.txt: Modification times differ by -57432h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2001-01-02 00:00:00 +0000 UTC 2025/08/31 01:43:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:43:19 INFO : file20.txt: Copied (replaced existing) 2025/08/31 01:43:19 NOTICE: (20) : copy-as /tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt /tmp/014245wo/rclone_args/path2/ file1.txt 2025/08/31 01:43:19 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt" to "/tmp/014245wo/rclone_args/path2/" as "file1.txt" 2025/08/31 01:43:19 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt" 2025/08/31 01:43:19 DEBUG : Creating backend with remote "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:19 DEBUG : operations.CopyFile "file21.txt" to "Local file system at /tmp/014245wo/rclone_args/path2" as "file1.txt" 2025/08/31 01:43:19 DEBUG : file21.txt: Sizes differ (src 0 vs dst 19) 2025/08/31 01:43:19 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:19 DEBUG : file1.txt.1e01f43a.partial: renamed to: file1.txt 2025/08/31 01:43:19 INFO : file21.txt: Copied (replaced existing) to: file1.txt 2025/08/31 01:43:19 NOTICE: (21) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/ file1.txt 2025/08/31 01:43:19 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" 2025/08/31 01:43:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/: list [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1] 2025/08/31 01:43:19 DEBUG : file1.txt: Set modification time 2007-07-23 2025/08/31 01:43:19 NOTICE: (22) : touch-glob 2007-07-23 /tmp/014245wo/rclone_args/path2/ file2.txt 2025/08/31 01:43:19 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/rclone_args/path2/" for canonical name "/tmp/014245wo/rclone_args/path2" 2025/08/31 01:43:19 DEBUG : file2.txt: Set modification time 2007-07-23 2025/08/31 01:43:19 NOTICE: (23) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/ file20.txt 2025/08/31 01:43:19 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/" 2025/08/31 01:43:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/: list [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir] 2025/08/31 01:43:19 DEBUG : file20.txt: Set modification time 2007-07-23 2025/08/31 01:43:19 NOTICE: (24) : touch-glob 2007-07-23 /tmp/014245wo/rclone_args/path2/subdir/ file21.txt 2025/08/31 01:43:19 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/rclone_args/path2/subdir/" for canonical name "/tmp/014245wo/rclone_args/path2/subdir" 2025/08/31 01:43:19 DEBUG : file21.txt: Set modification time 2007-07-23 2025/08/31 01:43:19 NOTICE: (25) : bisync size-only 2025/08/31 01:43:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: remove [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:21 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:21 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:21 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:21 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" with Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:21 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:21 INFO : Path1 checking for diffs 2025/08/31 01:43:21 INFO : Path2 checking for diffs 2025/08/31 01:43:21 INFO : - Path2 File changed: size (smaller) - file1.txt 2025/08/31 01:43:21 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2025/08/31 01:43:21 INFO : (Modified:  0 larger,  1 smaller) 2025/08/31 01:43:21 INFO : Applying changes 2025/08/31 01:43:21 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file1.txt 2025/08/31 01:43:21 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:43:21 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:21 INFO : Updating listings 2025/08/31 01:43:21 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" vs Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:21 INFO : Bisync successful 2025/08/31 01:43:21 NOTICE: (26) : bisync resync 2025/08/31 01:43:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: remove [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:23 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:23 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:23 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:23 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" with Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:23 INFO : Copying Path2 files to Path1 2025/08/31 01:43:23 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:43:23 INFO : There was nothing to transfer 2025/08/31 01:43:23 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:43:23 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:23 INFO : subdir/file21.txt: Copied (replaced existing) 2025/08/31 01:43:23 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:43:23 INFO : subdir/file20.txt: Copied (replaced existing) 2025/08/31 01:43:23 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:23 INFO : Resync updating listings 2025/08/31 01:43:23 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" vs Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:23 INFO : Bisync successful 2025/08/31 01:43:23 NOTICE: (27) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/ 2025/08/31 01:43:23 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file1.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" as "" 2025/08/31 01:43:23 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file1.txt" 2025/08/31 01:43:23 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" 2025/08/31 01:43:23 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:23 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:23 DEBUG : operations.CopyFile "file1.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" as "file1.txt" 2025/08/31 01:43:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/: new [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file1.txt] 2025/08/31 01:43:23 DEBUG : file1.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:43:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file1.txt] 2025/08/31 01:43:23 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:23 NOTICE: (28) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file2.txt /tmp/014245wo/rclone_args/path2/ 2025/08/31 01:43:23 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file2.txt" to "/tmp/014245wo/rclone_args/path2/" as "" 2025/08/31 01:43:23 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file2.txt" 2025/08/31 01:43:23 DEBUG : Creating backend with remote "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:23 DEBUG : operations.CopyFile "file2.txt" to "Local file system at /tmp/014245wo/rclone_args/path2" as "file2.txt" 2025/08/31 01:43:23 DEBUG : file2.txt: Modification times differ by -57432h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2001-01-02 00:00:00 +0000 UTC 2025/08/31 01:43:23 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:23 INFO : file2.txt: Updated modification time in destination 2025/08/31 01:43:23 DEBUG : file2.txt: Unchanged skipping 2025/08/31 01:43:23 NOTICE: (29) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir 2025/08/31 01:43:23 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file20.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir" as "" 2025/08/31 01:43:23 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file20.txt" 2025/08/31 01:43:23 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir" 2025/08/31 01:43:23 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:23 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:23 DEBUG : operations.CopyFile "file20.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir" as "file20.txt" 2025/08/31 01:43:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir: new [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:43:23 DEBUG : file20.txt: Size and modification time the same (differ by 0s, within tolerance 1s) 2025/08/31 01:43:23 DEBUG : file20.txt: Unchanged skipping 2025/08/31 01:43:23 NOTICE: (30) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt /tmp/014245wo/rclone_args/path2/subdir 2025/08/31 01:43:23 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt" to "/tmp/014245wo/rclone_args/path2/subdir" as "" 2025/08/31 01:43:23 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt" 2025/08/31 01:43:23 DEBUG : Creating backend with remote "/tmp/014245wo/rclone_args/path2/subdir" 2025/08/31 01:43:23 DEBUG : operations.CopyFile "file21.txt" to "Local file system at /tmp/014245wo/rclone_args/path2/subdir" as "file21.txt" 2025/08/31 01:43:23 DEBUG : file21.txt: Modification times differ by -66240h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:43:23 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:23 INFO : file21.txt: Updated modification time in destination 2025/08/31 01:43:23 DEBUG : file21.txt: Unchanged skipping 2025/08/31 01:43:23 NOTICE: (31) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/ file1.txt 2025/08/31 01:43:23 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" 2025/08/31 01:43:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/: list [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1] 2025/08/31 01:43:23 DEBUG : file1.txt: Set modification time 2007-07-23 2025/08/31 01:43:23 NOTICE: (32) : touch-glob 2007-07-23 /tmp/014245wo/rclone_args/path2/ file2.txt 2025/08/31 01:43:23 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/rclone_args/path2/" for canonical name "/tmp/014245wo/rclone_args/path2" 2025/08/31 01:43:23 DEBUG : file2.txt: Set modification time 2007-07-23 2025/08/31 01:43:23 NOTICE: (33) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/ file20.txt 2025/08/31 01:43:23 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/" 2025/08/31 01:43:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/: list [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir] 2025/08/31 01:43:23 DEBUG : file20.txt: Set modification time 2007-07-23 2025/08/31 01:43:23 NOTICE: (34) : touch-glob 2007-07-23 /tmp/014245wo/rclone_args/path2/subdir/ file21.txt 2025/08/31 01:43:23 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/rclone_args/path2/subdir/" for canonical name "/tmp/014245wo/rclone_args/path2/subdir" 2025/08/31 01:43:23 DEBUG : file21.txt: Set modification time 2007-07-23 2025/08/31 01:43:23 NOTICE: (35) : bisync ignore-size 2025/08/31 01:43:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: remove [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:25 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:25 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:25 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": false, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:25 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" with Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:25 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:25 INFO : Path1 checking for diffs 2025/08/31 01:43:25 INFO : Path2 checking for diffs 2025/08/31 01:43:25 INFO : - Path2 File changed: time (newer) - file2.txt 2025/08/31 01:43:25 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2025/08/31 01:43:25 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2025/08/31 01:43:25 INFO : (Modified:  2 newer,  0 older) 2025/08/31 01:43:25 INFO : Applying changes 2025/08/31 01:43:25 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file2.txt 2025/08/31 01:43:25 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/file21.txt 2025/08/31 01:43:25 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:43:25 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:43:25 INFO : subdir/file21.txt: Copied (replaced existing) 2025/08/31 01:43:25 INFO : Updating listings 2025/08/31 01:43:25 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" vs Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:25 INFO : Bisync successful 2025/08/31 01:43:25 NOTICE: (36) : bisync resync compare-all 2025/08/31 01:43:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: remove [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:27 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:27 NOTICE: Local file system at /tmp/014245wo/rclone_args/path2: will use md5 for same-side diffs on Path2 only 2025/08/31 01:43:27 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:43:27 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" with Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:27 INFO : Copying Path2 files to Path1 2025/08/31 01:43:27 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:43:27 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:43:27 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:43:27 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:27 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:27 INFO : Resync updating listings 2025/08/31 01:43:27 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" vs Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:27 INFO : Bisync successful 2025/08/31 01:43:27 NOTICE: (37) : copy-as /tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt /tmp/014245wo/rclone_args/path2/ file2.txt 2025/08/31 01:43:27 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt" to "/tmp/014245wo/rclone_args/path2/" as "file2.txt" 2025/08/31 01:43:27 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt" 2025/08/31 01:43:27 DEBUG : Creating backend with remote "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:27 DEBUG : operations.CopyFile "file21.txt" to "Local file system at /tmp/014245wo/rclone_args/path2" as "file2.txt" 2025/08/31 01:43:27 DEBUG : file21.txt: Sizes differ (src 0 vs dst 19) 2025/08/31 01:43:27 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:27 DEBUG : file2.txt.1e01f43a.partial: renamed to: file2.txt 2025/08/31 01:43:27 INFO : file21.txt: Copied (replaced existing) to: file2.txt 2025/08/31 01:43:27 NOTICE: (38) : touch-glob 2023-08-26 /tmp/014245wo/datadir/test_rclone_args-buqimib0/ * 2025/08/31 01:43:27 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/datadir/test_rclone_args-buqimib0/" for canonical name "/tmp/014245wo/datadir/test_rclone_args-buqimib0" 2025/08/31 01:43:27 DEBUG : file21.txt: Set modification time 2023-08-26 2025/08/31 01:43:27 DEBUG : file1.txt: Set modification time 2023-08-26 2025/08/31 01:43:27 DEBUG : file2.txt: Set modification time 2023-08-26 2025/08/31 01:43:27 DEBUG : file20.txt: Set modification time 2023-08-26 2025/08/31 01:43:27 NOTICE: (39) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/ 2025/08/31 01:43:27 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file1.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" as "" 2025/08/31 01:43:27 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file1.txt" 2025/08/31 01:43:27 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" 2025/08/31 01:43:27 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:27 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:27 DEBUG : operations.CopyFile "file1.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" as "file1.txt" 2025/08/31 01:43:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/: new [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file1.txt] 2025/08/31 01:43:27 DEBUG : file1.txt: Modification times differ by -141072h0m0s: 2023-08-26 00:00:00 +0000 UTC, 2007-07-23 00:00:00 +0000 UTC 2025/08/31 01:43:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file1.txt] 2025/08/31 01:43:27 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:27 NOTICE: (40) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir 2025/08/31 01:43:27 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file20.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir" as "" 2025/08/31 01:43:27 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file20.txt" 2025/08/31 01:43:27 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir" 2025/08/31 01:43:27 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:27 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:27 DEBUG : operations.CopyFile "file20.txt" to "hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir" as "file20.txt" 2025/08/31 01:43:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir: new [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:43:27 DEBUG : file20.txt: Modification times differ by -141072h0m0s: 2023-08-26 00:00:00 +0000 UTC, 2007-07-23 00:00:00 +0000 UTC 2025/08/31 01:43:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:43:27 INFO : file20.txt: Copied (replaced existing) 2025/08/31 01:43:27 NOTICE: (41) : copy-file /tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt /tmp/014245wo/rclone_args/path2/subdir 2025/08/31 01:43:27 DEBUG : copyFile "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt" to "/tmp/014245wo/rclone_args/path2/subdir" as "" 2025/08/31 01:43:27 DEBUG : Creating backend with remote "/tmp/014245wo/datadir/test_rclone_args-buqimib0/file21.txt" 2025/08/31 01:43:27 DEBUG : Creating backend with remote "/tmp/014245wo/rclone_args/path2/subdir" 2025/08/31 01:43:27 DEBUG : operations.CopyFile "file21.txt" to "Local file system at /tmp/014245wo/rclone_args/path2/subdir" as "file21.txt" 2025/08/31 01:43:27 DEBUG : file21.txt: Modification times differ by -141072h0m0s: 2023-08-26 00:00:00 +0000 UTC, 2007-07-23 00:00:00 +0000 UTC 2025/08/31 01:43:27 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:27 INFO : file21.txt: Updated modification time in destination 2025/08/31 01:43:27 DEBUG : file21.txt: Unchanged skipping 2025/08/31 01:43:27 NOTICE: (42) : touch-glob 2007-07-23 /tmp/014245wo/rclone_args/path2/ file2.txt 2025/08/31 01:43:27 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/rclone_args/path2/" for canonical name "/tmp/014245wo/rclone_args/path2" 2025/08/31 01:43:28 DEBUG : file2.txt: Set modification time 2007-07-23 2025/08/31 01:43:28 NOTICE: (43) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/ file1.txt 2025/08/31 01:43:28 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" 2025/08/31 01:43:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/: list [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1] 2025/08/31 01:43:28 DEBUG : file1.txt: Set modification time 2023-08-26 2025/08/31 01:43:28 NOTICE: (44) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/ file20.txt 2025/08/31 01:43:28 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/" for canonical name "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/" 2025/08/31 01:43:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/: list [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir] 2025/08/31 01:43:28 DEBUG : file20.txt: Set modification time 2023-08-26 2025/08/31 01:43:28 NOTICE: (45) : touch-glob 2023-08-26 /tmp/014245wo/rclone_args/path2/subdir/ file21.txt 2025/08/31 01:43:28 DEBUG : fs cache: switching user supplied name "/tmp/014245wo/rclone_args/path2/subdir/" for canonical name "/tmp/014245wo/rclone_args/path2/subdir" 2025/08/31 01:43:28 DEBUG : file21.txt: Set modification time 2023-08-26 2025/08/31 01:43:28 NOTICE: (46) : bisync compare-all 2025/08/31 01:43:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: update [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: remove [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1/modtime_write_test] 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:30 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:30 NOTICE: Local file system at /tmp/014245wo/rclone_args/path2: will use md5 for same-side diffs on Path2 only 2025/08/31 01:43:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:43:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" with Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:30 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:30 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:43:30 INFO : Path1 checking for diffs 2025/08/31 01:43:30 INFO : - Path1 File changed: time (newer) - file1.txt 2025/08/31 01:43:30 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2025/08/31 01:43:30 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2025/08/31 01:43:30 INFO : (Modified:  2 newer,  0 older) 2025/08/31 01:43:30 INFO : Path2 checking for diffs 2025/08/31 01:43:30 INFO : - Path2 File changed: size (smaller), hash - file2.txt 2025/08/31 01:43:30 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2025/08/31 01:43:30 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2025/08/31 01:43:30 INFO : (Modified:  1 newer,  0 older,  0 larger,  1 smaller,  1 hash differs) 2025/08/31 01:43:30 INFO : Applying changes 2025/08/31 01:43:30 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/rclone_args/path2/file1.txt 2025/08/31 01:43:30 INFO : - Path1 Queue copy to Path2 - /tmp/014245wo/rclone_args/path2/subdir/file20.txt 2025/08/31 01:43:30 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/file2.txt 2025/08/31 01:43:30 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/subdir/file21.txt 2025/08/31 01:43:30 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:43:30 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:43:30 INFO : subdir/file21.txt: Copied (replaced existing) 2025/08/31 01:43:30 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:30 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:30 INFO : subdir/file20.txt: Copied (replaced existing) 2025/08/31 01:43:30 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:30 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:30 INFO : Updating listings 2025/08/31 01:43:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cerebak0buhi/014245wo/rclone_args/path1/" vs Path2 "/tmp/014245wo/rclone_args/path2/" 2025/08/31 01:43:30 INFO : Bisync successful 2025/08/31 01:43:30 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:30 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:43:30 NOTICE: | @@ -17 +16,0 @@ 2025/08/31 01:43:30 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:30 NOTICE: | @@ -19 +17,0 @@ 2025/08/31 01:43:30 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:30 NOTICE: | @@ -110 +107,0 @@ 2025/08/31 01:43:30 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:30 NOTICE: | @@ -145 +141,0 @@ 2025/08/31 01:43:30 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:30 NOTICE: | @@ -162 +157,0 @@ 2025/08/31 01:43:30 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:30 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi/014245wo/rclone_args/path1: purge [/rclone-test-cerebak0buhi/014245wo/rclone_args/path1] 2025/08/31 01:43:30 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:30 INFO : subdir/file20.txt: Deleted 2025/08/31 01:43:30 INFO : file1.txt: Deleted 2025/08/31 01:43:30 INFO : subdir/file21.txt: Deleted 2025/08/31 01:43:30 INFO : RCLONE_TEST: Deleted 2025/08/31 01:43:30 INFO : file2.txt: Deleted 2025/08/31 01:43:30 DEBUG : removing 1 level 1 directories 2025/08/31 01:43:30 INFO : subdir: Removing directory 2025/08/31 01:43:30 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:30 INFO : Local file system at /tmp/014245wo/rclone_args/path2: Removing directory bisync_test.go:597: TEST rclone_args FAILED - 1 MISCOMPARED FILES 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi: Purge remote 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cerebak0buhi: purge [/rclone-test-cerebak0buhi] --- FAIL: TestBisyncRemoteLocal (44.25s) --- FAIL: TestBisyncRemoteLocal/all_changed (8.75s) --- FAIL: TestBisyncRemoteLocal/compare_all (4.72s) --- FAIL: TestBisyncRemoteLocal/createemptysrcdirs (15.02s) --- FAIL: TestBisyncRemoteLocal/nomodtime (0.64s) --- FAIL: TestBisyncRemoteLocal/rclone_args (15.11s) === RUN TestBisyncLocalRemote 2025/08/31 01:43:30 DEBUG : Creating backend with remote "TestHdfs:rclone-test-riyipah4toci" 2025/08/31 01:43:30 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:30 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:30 NOTICE: remote: TestHdfs:rclone-test-riyipah4toci === RUN TestBisyncLocalRemote/all_changed 2025/08/31 01:43:30 DEBUG : Creating backend with remote "/tmp/014330xu" 2025/08/31 01:43:30 DEBUG : Creating backend with remote "/tmp/014330xu/all_changed/path1" 2025/08/31 01:43:30 DEBUG : Creating backend with remote "TestHdfs:rclone-test-riyipah4toci/014330xu" 2025/08/31 01:43:30 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:30 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:30 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-riyipah4toci/014330xu" to be canonical "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu" 2025/08/31 01:43:30 INFO : path2: Making directory 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu: mkdir [/rclone-test-riyipah4toci/014330xu/path2] 2025/08/31 01:43:30 DEBUG : Creating backend with remote "TestHdfs:rclone-test-riyipah4toci/014330xu/all_changed/path2" 2025/08/31 01:43:30 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:30 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:30 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-riyipah4toci/014330xu/all_changed/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2" 2025/08/31 01:43:30 DEBUG : Creating backend with remote "/tmp/014330xu/initdir/test_all_changed-qofohut0" 2025/08/31 01:43:30 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : subdir: Making directory with metadata 2025/08/31 01:43:30 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2025/08/31 01:43:30 DEBUG : Added delayed dir = "subdir", newDst=subdir 2025/08/31 01:43:30 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : Local file system at /tmp/014330xu/initdir/test_all_changed-qofohut0: Waiting for checks to finish 2025/08/31 01:43:30 DEBUG : Local file system at /tmp/014330xu/initdir/test_all_changed-qofohut0: Waiting for transfers to finish 2025/08/31 01:43:30 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt 2025/08/31 01:43:30 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt 2025/08/31 01:43:30 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt 2025/08/31 01:43:30 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt 2025/08/31 01:43:30 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2025/08/31 01:43:30 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:43:30 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:43:30 INFO : file1.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt 2025/08/31 01:43:30 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:30 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:30 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:30 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:30 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:30 ERROR : error listing: directory not found 2025/08/31 01:43:30 ERROR : Local file system at /tmp/014330xu/all_changed/path1: Failed to list "": directory not found 2025/08/31 01:43:30 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:30 INFO : Local file system at /tmp/014330xu/all_changed/path1: Removing directory 2025/08/31 01:43:30 ERROR : Failed to rmdir: stat /tmp/014330xu/all_changed/path1: no such file or directory 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: purge [/rclone-test-riyipah4toci/014330xu/all_changed/path2] 2025/08/31 01:43:30 ERROR : error listing: directory not found 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: list [/rclone-test-riyipah4toci/014330xu/all_changed/path2] 2025/08/31 01:43:30 ERROR : error listing: directory not found 2025/08/31 01:43:30 NOTICE: checking initFs Local file system at /tmp/014330xu/initdir/test_all_changed-qofohut0 2025/08/31 01:43:30 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : subdir: Making directory with metadata 2025/08/31 01:43:30 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2025/08/31 01:43:30 DEBUG : Added delayed dir = "subdir", newDst=subdir 2025/08/31 01:43:30 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : Local file system at /tmp/014330xu/all_changed/path1: Waiting for checks to finish 2025/08/31 01:43:30 DEBUG : Local file system at /tmp/014330xu/all_changed/path1: Waiting for transfers to finish 2025/08/31 01:43:30 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt 2025/08/31 01:43:30 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt 2025/08/31 01:43:30 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:30 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt 2025/08/31 01:43:30 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:30 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:30 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt 2025/08/31 01:43:30 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:43:30 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 INFO : file1.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2025/08/31 01:43:30 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:30 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt 2025/08/31 01:43:30 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:43:30 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:30 NOTICE: checking Path1 Local file system at /tmp/014330xu/all_changed/path1 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: list [/rclone-test-riyipah4toci/014330xu/all_changed/path2] 2025/08/31 01:43:30 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 INFO : subdir: Making directory 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: mkdir [/rclone-test-riyipah4toci/014330xu/all_changed/path2/subdir] 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: update [/rclone-test-riyipah4toci/014330xu/all_changed/path2/RCLONE_TEST] 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: update [/rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy1.txt] 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: update [/rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy2.txt] 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: update [/rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy3.txt] 2025/08/31 01:43:30 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: Waiting for checks to finish 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: Waiting for transfers to finish 2025/08/31 01:43:30 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: update [/rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy4.txt] 2025/08/31 01:43:30 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: update [/rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy5.txt] 2025/08/31 01:43:30 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: update [/rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.txt] 2025/08/31 01:43:30 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: update [/rclone-test-riyipah4toci/014330xu/all_changed/path2/subdir/file20.txt] 2025/08/31 01:43:30 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:43:30 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:43:30 INFO : file1.txt: Copied (new) 2025/08/31 01:43:30 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:43:30 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: list [/rclone-test-riyipah4toci/014330xu/all_changed/path2] 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: list [/rclone-test-riyipah4toci/014330xu/all_changed/path2/subdir] 2025/08/31 01:43:30 NOTICE: (01) : test all-changed 2025/08/31 01:43:30 NOTICE: (02) : test initial bisync 2025/08/31 01:43:30 NOTICE: (03) : bisync resync 2025/08/31 01:43:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: update [/rclone-test-riyipah4toci/014330xu/all_changed/path2/modtime_write_test] 2025/08/31 01:43:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: remove [/rclone-test-riyipah4toci/014330xu/all_changed/path2/modtime_write_test] 2025/08/31 01:43:32 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:32 INFO : Synching Path1 "/tmp/014330xu/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/" 2025/08/31 01:43:32 INFO : Copying Path2 files to Path1 2025/08/31 01:43:32 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:43:32 INFO : There was nothing to transfer 2025/08/31 01:43:32 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:43:32 INFO : There was nothing to transfer 2025/08/31 01:43:32 INFO : Resync updating listings 2025/08/31 01:43:32 INFO : Validating listings for Path1 "/tmp/014330xu/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/" 2025/08/31 01:43:32 INFO : Bisync successful 2025/08/31 01:43:32 NOTICE: (04) : test change timestamp on all files except RCLONE_TEST 2025/08/31 01:43:32 NOTICE: (05) : touch-glob 2005-01-02 /tmp/014330xu/all_changed/path1/ file* 2025/08/31 01:43:32 DEBUG : Creating backend with remote "/tmp/014330xu/all_changed/path1/" 2025/08/31 01:43:32 DEBUG : fs cache: renaming cache item "/tmp/014330xu/all_changed/path1/" to be canonical "/tmp/014330xu/all_changed/path1" 2025/08/31 01:43:32 DEBUG : file1.copy1.txt: Set modification time 2005-01-02 2025/08/31 01:43:32 DEBUG : file1.txt: Set modification time 2005-01-02 2025/08/31 01:43:32 DEBUG : file1.copy5.txt: Set modification time 2005-01-02 2025/08/31 01:43:32 DEBUG : file1.copy4.txt: Set modification time 2005-01-02 2025/08/31 01:43:32 DEBUG : file1.copy3.txt: Set modification time 2005-01-02 2025/08/31 01:43:32 DEBUG : file1.copy2.txt: Set modification time 2005-01-02 2025/08/31 01:43:32 NOTICE: (06) : touch-glob 2005-01-02 /tmp/014330xu/all_changed/path1/subdir file* 2025/08/31 01:43:32 DEBUG : Creating backend with remote "/tmp/014330xu/all_changed/path1/subdir" 2025/08/31 01:43:32 DEBUG : file20.txt: Set modification time 2005-01-02 2025/08/31 01:43:32 NOTICE: (07) : test sync should pass 2025/08/31 01:43:32 NOTICE: (08) : bisync 2025/08/31 01:43:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: update [/rclone-test-riyipah4toci/014330xu/all_changed/path2/modtime_write_test] 2025/08/31 01:43:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: remove [/rclone-test-riyipah4toci/014330xu/all_changed/path2/modtime_write_test] 2025/08/31 01:43:34 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:34 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:34 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:34 INFO : Synching Path1 "/tmp/014330xu/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/" 2025/08/31 01:43:34 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:34 INFO : Path1 checking for diffs 2025/08/31 01:43:34 INFO : - Path1 File changed: time (newer) - file1.copy1.txt 2025/08/31 01:43:34 INFO : - Path1 File changed: time (newer) - file1.copy2.txt 2025/08/31 01:43:34 INFO : - Path1 File changed: time (newer) - file1.copy3.txt 2025/08/31 01:43:34 INFO : - Path1 File changed: time (newer) - file1.copy4.txt 2025/08/31 01:43:34 INFO : - Path1 File changed: time (newer) - file1.copy5.txt 2025/08/31 01:43:34 INFO : - Path1 File changed: time (newer) - file1.txt 2025/08/31 01:43:34 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2025/08/31 01:43:34 INFO : Path1: 7 changes:  0 new,  7 modified,  0 deleted 2025/08/31 01:43:34 INFO : (Modified:  7 newer,  0 older) 2025/08/31 01:43:34 INFO : Path2 checking for diffs 2025/08/31 01:43:34 INFO : Applying changes 2025/08/31 01:43:34 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy1.txt 2025/08/31 01:43:34 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy2.txt 2025/08/31 01:43:34 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy3.txt 2025/08/31 01:43:34 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy4.txt 2025/08/31 01:43:34 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy5.txt 2025/08/31 01:43:34 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.txt 2025/08/31 01:43:34 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/subdir/file20.txt 2025/08/31 01:43:34 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:34 INFO : file1.copy1.txt: Copied (replaced existing) 2025/08/31 01:43:34 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:34 INFO : file1.copy2.txt: Copied (replaced existing) 2025/08/31 01:43:34 INFO : file1.copy3.txt: Copied (replaced existing) 2025/08/31 01:43:34 INFO : file1.copy4.txt: Copied (replaced existing) 2025/08/31 01:43:34 INFO : file1.copy5.txt: Copied (replaced existing) 2025/08/31 01:43:34 INFO : subdir/file20.txt: Copied (replaced existing) 2025/08/31 01:43:34 INFO : Updating listings 2025/08/31 01:43:34 INFO : Validating listings for Path1 "/tmp/014330xu/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/" 2025/08/31 01:43:34 INFO : Bisync successful 2025/08/31 01:43:34 NOTICE: (09) : test change timestamp on all files including RCLONE_TEST 2025/08/31 01:43:34 NOTICE: (10) : touch-glob 2004-01-02 /tmp/014330xu/all_changed/path1/ * 2025/08/31 01:43:34 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/all_changed/path1/" for canonical name "/tmp/014330xu/all_changed/path1" 2025/08/31 01:43:34 DEBUG : file1.copy1.txt: Set modification time 2004-01-02 2025/08/31 01:43:34 DEBUG : file1.txt: Set modification time 2004-01-02 2025/08/31 01:43:34 DEBUG : file1.copy5.txt: Set modification time 2004-01-02 2025/08/31 01:43:34 DEBUG : RCLONE_TEST: Set modification time 2004-01-02 2025/08/31 01:43:34 DEBUG : file1.copy4.txt: Set modification time 2004-01-02 2025/08/31 01:43:34 DEBUG : file1.copy3.txt: Set modification time 2004-01-02 2025/08/31 01:43:34 DEBUG : file1.copy2.txt: Set modification time 2004-01-02 2025/08/31 01:43:34 NOTICE: (11) : touch-glob 2004-01-02 /tmp/014330xu/all_changed/path1/subdir * 2025/08/31 01:43:34 DEBUG : file20.txt: Set modification time 2004-01-02 2025/08/31 01:43:34 NOTICE: (12) : test sync should fail 2025/08/31 01:43:34 NOTICE: (13) : bisync 2025/08/31 01:43:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: update [/rclone-test-riyipah4toci/014330xu/all_changed/path2/modtime_write_test] 2025/08/31 01:43:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: remove [/rclone-test-riyipah4toci/014330xu/all_changed/path2/modtime_write_test] 2025/08/31 01:43:36 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:36 INFO : Synching Path1 "/tmp/014330xu/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/" 2025/08/31 01:43:36 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:36 INFO : Path1 checking for diffs 2025/08/31 01:43:36 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2025/08/31 01:43:36 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2025/08/31 01:43:36 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2025/08/31 01:43:36 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2025/08/31 01:43:36 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2025/08/31 01:43:36 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2025/08/31 01:43:36 INFO : - Path1 File changed: time (older) - file1.txt 2025/08/31 01:43:36 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2025/08/31 01:43:36 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2025/08/31 01:43:36 INFO : (Modified:  1 newer,  7 older) 2025/08/31 01:43:36 INFO : Path2 checking for diffs 2025/08/31 01:43:36 ERROR : Safety abort: all files were changed on Path1 "/tmp/014330xu/all_changed/path1/". Run with --force if desired. 2025/08/31 01:43:36 NOTICE: Bisync aborted. Please try again. 2025/08/31 01:43:36 NOTICE: Bisync error: all files were changed 2025/08/31 01:43:36 NOTICE: (14) : test sync with force should pass 2025/08/31 01:43:36 NOTICE: (15) : bisync force 2025/08/31 01:43:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: update [/rclone-test-riyipah4toci/014330xu/all_changed/path2/modtime_write_test] 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: remove [/rclone-test-riyipah4toci/014330xu/all_changed/path2/modtime_write_test] 2025/08/31 01:43:38 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:38 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:38 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:38 INFO : Synching Path1 "/tmp/014330xu/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/" 2025/08/31 01:43:38 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:38 INFO : Path1 checking for diffs 2025/08/31 01:43:38 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2025/08/31 01:43:38 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2025/08/31 01:43:38 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2025/08/31 01:43:38 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2025/08/31 01:43:38 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2025/08/31 01:43:38 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2025/08/31 01:43:38 INFO : - Path1 File changed: time (older) - file1.txt 2025/08/31 01:43:38 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2025/08/31 01:43:38 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2025/08/31 01:43:38 INFO : (Modified:  1 newer,  7 older) 2025/08/31 01:43:38 INFO : Path2 checking for diffs 2025/08/31 01:43:38 INFO : Applying changes 2025/08/31 01:43:38 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/RCLONE_TEST 2025/08/31 01:43:38 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy1.txt 2025/08/31 01:43:38 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy2.txt 2025/08/31 01:43:38 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy3.txt 2025/08/31 01:43:38 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy4.txt 2025/08/31 01:43:38 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.copy5.txt 2025/08/31 01:43:38 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/file1.txt 2025/08/31 01:43:38 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/subdir/file20.txt 2025/08/31 01:43:38 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:38 INFO : file1.copy2.txt: Copied (replaced existing) 2025/08/31 01:43:38 INFO : file1.copy3.txt: Copied (replaced existing) 2025/08/31 01:43:38 INFO : file1.copy4.txt: Copied (replaced existing) 2025/08/31 01:43:38 INFO : RCLONE_TEST: Copied (replaced existing) 2025/08/31 01:43:38 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:38 INFO : file1.copy5.txt: Copied (replaced existing) 2025/08/31 01:43:38 INFO : file1.copy1.txt: Copied (replaced existing) 2025/08/31 01:43:38 INFO : subdir/file20.txt: Copied (replaced existing) 2025/08/31 01:43:38 INFO : Updating listings 2025/08/31 01:43:38 INFO : Validating listings for Path1 "/tmp/014330xu/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/all_changed/path2/" 2025/08/31 01:43:38 INFO : Bisync successful 2025/08/31 01:43:38 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:38 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:43:38 NOTICE: | @@ -60 +59,0 @@ 2025/08/31 01:43:38 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:38 NOTICE: | @@ -132 +130,0 @@ 2025/08/31 01:43:38 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:38 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:38 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:38 INFO : file1.copy2.txt: Deleted 2025/08/31 01:43:38 INFO : file1.copy3.txt: Deleted 2025/08/31 01:43:38 INFO : RCLONE_TEST: Deleted 2025/08/31 01:43:38 INFO : file1.copy4.txt: Deleted 2025/08/31 01:43:38 INFO : file1.copy1.txt: Deleted 2025/08/31 01:43:38 INFO : file1.copy5.txt: Deleted 2025/08/31 01:43:38 INFO : subdir/file20.txt: Deleted 2025/08/31 01:43:38 INFO : file1.txt: Deleted 2025/08/31 01:43:38 DEBUG : removing 1 level 1 directories 2025/08/31 01:43:38 INFO : subdir: Removing directory 2025/08/31 01:43:38 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:38 INFO : Local file system at /tmp/014330xu/all_changed/path1: Removing directory 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/all_changed/path2: purge [/rclone-test-riyipah4toci/014330xu/all_changed/path2] bisync_test.go:597: TEST all_changed FAILED - 1 MISCOMPARED FILES === RUN TestBisyncLocalRemote/compare_all 2025/08/31 01:43:38 DEBUG : Creating backend with remote "/tmp/014330xu/compare_all/path1" 2025/08/31 01:43:38 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-riyipah4toci/014330xu" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu" 2025/08/31 01:43:38 INFO : path2: Making directory 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu: mkdir [/rclone-test-riyipah4toci/014330xu/path2] 2025/08/31 01:43:38 DEBUG : Creating backend with remote "TestHdfs:rclone-test-riyipah4toci/014330xu/compare_all/path2" 2025/08/31 01:43:38 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:38 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:38 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:38 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:38 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:38 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:38 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-riyipah4toci/014330xu/compare_all/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2" 2025/08/31 01:43:38 DEBUG : Creating backend with remote "/tmp/014330xu/initdir/test_compare_all-ripilux0" 2025/08/31 01:43:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : Local file system at /tmp/014330xu/initdir/test_compare_all-ripilux0: Waiting for checks to finish 2025/08/31 01:43:38 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : Local file system at /tmp/014330xu/initdir/test_compare_all-ripilux0: Waiting for transfers to finish 2025/08/31 01:43:38 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:43:38 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:43:38 INFO : file2.txt: Copied (new) 2025/08/31 01:43:38 INFO : file1.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt 2025/08/31 01:43:38 INFO : file4.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt 2025/08/31 01:43:38 INFO : file3.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:38 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt 2025/08/31 01:43:38 INFO : file6.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:38 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:38 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt 2025/08/31 01:43:38 INFO : file5.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt 2025/08/31 01:43:38 INFO : file7.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt 2025/08/31 01:43:38 INFO : file8.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_compare_all-lecocag0" 2025/08/31 01:43:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file10.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file11.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:38 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt 2025/08/31 01:43:38 INFO : file10.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : Local file system at /tmp/014330xu/datadir/test_compare_all-lecocag0: Waiting for checks to finish 2025/08/31 01:43:38 DEBUG : Local file system at /tmp/014330xu/datadir/test_compare_all-lecocag0: Waiting for transfers to finish 2025/08/31 01:43:38 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:38 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt 2025/08/31 01:43:38 INFO : file11.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2025/08/31 01:43:38 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:38 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt 2025/08/31 01:43:38 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt 2025/08/31 01:43:38 INFO : file2.txt: Copied (new) 2025/08/31 01:43:38 INFO : file1.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2025/08/31 01:43:38 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2025/08/31 01:43:38 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt 2025/08/31 01:43:38 INFO : file5R.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt 2025/08/31 01:43:38 INFO : file5L.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:38 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt 2025/08/31 01:43:38 INFO : file7.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:38 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt 2025/08/31 01:43:38 INFO : file6.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:38 ERROR : error listing: directory not found 2025/08/31 01:43:38 ERROR : Local file system at /tmp/014330xu/compare_all/path1: Failed to list "": directory not found 2025/08/31 01:43:38 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:38 INFO : Local file system at /tmp/014330xu/compare_all/path1: Removing directory 2025/08/31 01:43:38 ERROR : Failed to rmdir: stat /tmp/014330xu/compare_all/path1: no such file or directory 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: purge [/rclone-test-riyipah4toci/014330xu/compare_all/path2] 2025/08/31 01:43:38 ERROR : error listing: directory not found 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: list [/rclone-test-riyipah4toci/014330xu/compare_all/path2] 2025/08/31 01:43:38 ERROR : error listing: directory not found 2025/08/31 01:43:38 NOTICE: checking initFs Local file system at /tmp/014330xu/initdir/test_compare_all-ripilux0 2025/08/31 01:43:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:43:38 INFO : file2.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : Local file system at /tmp/014330xu/compare_all/path1: Waiting for checks to finish 2025/08/31 01:43:38 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:38 DEBUG : Local file system at /tmp/014330xu/compare_all/path1: Waiting for transfers to finish 2025/08/31 01:43:38 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt 2025/08/31 01:43:38 INFO : file4.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:38 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:38 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt 2025/08/31 01:43:38 INFO : file3.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:43:38 INFO : file1.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt 2025/08/31 01:43:38 INFO : file6.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt 2025/08/31 01:43:38 INFO : file5.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt 2025/08/31 01:43:38 INFO : file8.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:38 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt 2025/08/31 01:43:38 INFO : file7.txt: Copied (new) 2025/08/31 01:43:38 NOTICE: checking Path1 Local file system at /tmp/014330xu/compare_all/path1 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: list [/rclone-test-riyipah4toci/014330xu/compare_all/path2] 2025/08/31 01:43:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: Waiting for checks to finish 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/RCLONE_TEST] 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file2.txt] 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file1.txt] 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file3.txt] 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: Waiting for transfers to finish 2025/08/31 01:43:38 INFO : file2.txt: Copied (new) 2025/08/31 01:43:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file4.txt] 2025/08/31 01:43:39 INFO : file1.txt: Copied (new) 2025/08/31 01:43:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file5.txt] 2025/08/31 01:43:39 INFO : file3.txt: Copied (new) 2025/08/31 01:43:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file6.txt] 2025/08/31 01:43:39 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file7.txt] 2025/08/31 01:43:39 INFO : file4.txt: Copied (new) 2025/08/31 01:43:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file8.txt] 2025/08/31 01:43:39 INFO : file5.txt: Copied (new) 2025/08/31 01:43:39 INFO : file6.txt: Copied (new) 2025/08/31 01:43:39 INFO : file7.txt: Copied (new) 2025/08/31 01:43:39 INFO : file8.txt: Copied (new) 2025/08/31 01:43:39 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2 2025/08/31 01:43:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: list [/rclone-test-riyipah4toci/014330xu/compare_all/path2] 2025/08/31 01:43:39 NOTICE: (01) : test changes compare-all 2025/08/31 01:43:39 NOTICE: (02) : test initial bisync 2025/08/31 01:43:39 NOTICE: (03) : bisync resync compare-all 2025/08/31 01:43:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/modtime_write_test] 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: remove [/rclone-test-riyipah4toci/014330xu/compare_all/path2/modtime_write_test] 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:41 NOTICE: Local file system at /tmp/014330xu/compare_all/path1: will use md5 for same-side diffs on Path1 only 2025/08/31 01:43:41 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:43:41 INFO : Synching Path1 "/tmp/014330xu/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/" 2025/08/31 01:43:41 INFO : Copying Path2 files to Path1 2025/08/31 01:43:41 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:43:41 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:43:41 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:43:41 INFO : Resync updating listings 2025/08/31 01:43:41 INFO : Validating listings for Path1 "/tmp/014330xu/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/" 2025/08/31 01:43:41 INFO : Bisync successful 2025/08/31 01:43:41 NOTICE: (04) : test make modifications on both paths 2025/08/31 01:43:41 NOTICE: (05) : test new on path2 - file10 2025/08/31 01:43:41 NOTICE: (06) : touch-copy 2001-01-02 /tmp/014330xu/datadir/test_compare_all-lecocag0/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/ 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_compare_all-lecocag0/" 2025/08/31 01:43:41 DEBUG : fs cache: renaming cache item "/tmp/014330xu/datadir/test_compare_all-lecocag0/" to be canonical "/tmp/014330xu/datadir/test_compare_all-lecocag0" 2025/08/31 01:43:41 DEBUG : file10.txt: Set modification time 2001-01-02 2025/08/31 01:43:41 DEBUG : copyFile "/tmp/014330xu/datadir/test_compare_all-lecocag0/file10.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/" as "" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_compare_all-lecocag0/file10.txt" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/" 2025/08/31 01:43:41 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:41 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:41 DEBUG : operations.CopyFile "file10.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/" as "file10.txt" 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: new [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file10.txt] 2025/08/31 01:43:41 DEBUG : file10.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file10.txt] 2025/08/31 01:43:41 INFO : file10.txt: Copied (new) 2025/08/31 01:43:41 NOTICE: (07) : test newer on path2 - file1 2025/08/31 01:43:41 NOTICE: (08) : touch-copy 2001-01-02 /tmp/014330xu/datadir/test_compare_all-lecocag0/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/ 2025/08/31 01:43:41 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/datadir/test_compare_all-lecocag0/" for canonical name "/tmp/014330xu/datadir/test_compare_all-lecocag0" 2025/08/31 01:43:41 DEBUG : file1.txt: Set modification time 2001-01-02 2025/08/31 01:43:41 DEBUG : copyFile "/tmp/014330xu/datadir/test_compare_all-lecocag0/file1.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/" as "" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_compare_all-lecocag0/file1.txt" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/" 2025/08/31 01:43:41 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:41 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:41 DEBUG : operations.CopyFile "file1.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/" as "file1.txt" 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: new [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file1.txt] 2025/08/31 01:43:41 DEBUG : file1.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file1.txt] 2025/08/31 01:43:41 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:41 NOTICE: (09) : test new on path1 - file11 2025/08/31 01:43:41 NOTICE: (10) : touch-copy 2001-01-02 /tmp/014330xu/datadir/test_compare_all-lecocag0/file11.txt /tmp/014330xu/compare_all/path1/ 2025/08/31 01:43:41 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/datadir/test_compare_all-lecocag0/" for canonical name "/tmp/014330xu/datadir/test_compare_all-lecocag0" 2025/08/31 01:43:41 DEBUG : file11.txt: Set modification time 2001-01-02 2025/08/31 01:43:41 DEBUG : copyFile "/tmp/014330xu/datadir/test_compare_all-lecocag0/file11.txt" to "/tmp/014330xu/compare_all/path1/" as "" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_compare_all-lecocag0/file11.txt" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/compare_all/path1/" 2025/08/31 01:43:41 DEBUG : operations.CopyFile "file11.txt" to "Local file system at /tmp/014330xu/compare_all/path1" as "file11.txt" 2025/08/31 01:43:41 DEBUG : file11.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:41 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:41 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt 2025/08/31 01:43:41 INFO : file11.txt: Copied (new) 2025/08/31 01:43:41 NOTICE: (11) : test newer on path1 - file2 2025/08/31 01:43:41 NOTICE: (12) : touch-copy 2001-01-02 /tmp/014330xu/datadir/test_compare_all-lecocag0/file2.txt /tmp/014330xu/compare_all/path1/ 2025/08/31 01:43:41 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/datadir/test_compare_all-lecocag0/" for canonical name "/tmp/014330xu/datadir/test_compare_all-lecocag0" 2025/08/31 01:43:41 DEBUG : file2.txt: Set modification time 2001-01-02 2025/08/31 01:43:41 DEBUG : copyFile "/tmp/014330xu/datadir/test_compare_all-lecocag0/file2.txt" to "/tmp/014330xu/compare_all/path1/" as "" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_compare_all-lecocag0/file2.txt" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/compare_all/path1/" 2025/08/31 01:43:41 DEBUG : operations.CopyFile "file2.txt" to "Local file system at /tmp/014330xu/compare_all/path1" as "file2.txt" 2025/08/31 01:43:41 DEBUG : file2.txt: Sizes differ (src 13 vs dst 0) 2025/08/31 01:43:41 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2025/08/31 01:43:41 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt 2025/08/31 01:43:41 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:43:41 NOTICE: (13) : test deleted on path2 - file3 2025/08/31 01:43:41 NOTICE: (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/file3.txt 2025/08/31 01:43:41 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/" 2025/08/31 01:43:41 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:41 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:41 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/" to be canonical "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/" 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: new [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file3.txt] 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: remove [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file3.txt] 2025/08/31 01:43:41 INFO : file3.txt: Deleted 2025/08/31 01:43:41 NOTICE: (15) : test deleted on path1 - file4 2025/08/31 01:43:41 NOTICE: (16) : delete-file /tmp/014330xu/compare_all/path1/file4.txt 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/compare_all/path1/" 2025/08/31 01:43:41 DEBUG : fs cache: renaming cache item "/tmp/014330xu/compare_all/path1/" to be canonical "/tmp/014330xu/compare_all/path1" 2025/08/31 01:43:41 INFO : file4.txt: Deleted 2025/08/31 01:43:41 NOTICE: (17) : test deleted on both paths - file8 2025/08/31 01:43:41 NOTICE: (18) : delete-file /tmp/014330xu/compare_all/path1/file8.txt 2025/08/31 01:43:41 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/compare_all/path1/" for canonical name "/tmp/014330xu/compare_all/path1" 2025/08/31 01:43:41 INFO : file8.txt: Deleted 2025/08/31 01:43:41 NOTICE: (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/file8.txt 2025/08/31 01:43:41 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/" 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: new [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file8.txt] 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: remove [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file8.txt] 2025/08/31 01:43:41 INFO : file8.txt: Deleted 2025/08/31 01:43:41 NOTICE: (20) : test changed on both paths - file5 (file5R, file5L) 2025/08/31 01:43:41 NOTICE: (21) : touch-glob 2001-01-02 /tmp/014330xu/datadir/test_compare_all-lecocag0/ file5R.txt 2025/08/31 01:43:41 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/datadir/test_compare_all-lecocag0/" for canonical name "/tmp/014330xu/datadir/test_compare_all-lecocag0" 2025/08/31 01:43:41 DEBUG : file5R.txt: Set modification time 2001-01-02 2025/08/31 01:43:41 NOTICE: (22) : copy-as /tmp/014330xu/datadir/test_compare_all-lecocag0/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/ file5.txt 2025/08/31 01:43:41 DEBUG : copyFile "/tmp/014330xu/datadir/test_compare_all-lecocag0/file5R.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/" as "file5.txt" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_compare_all-lecocag0/file5R.txt" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/" 2025/08/31 01:43:41 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:41 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:41 DEBUG : operations.CopyFile "file5R.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/" as "file5.txt" 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: new [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file5.txt] 2025/08/31 01:43:41 DEBUG : file5R.txt: Sizes differ (src 39 vs dst 0) 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file5.txt] 2025/08/31 01:43:41 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2025/08/31 01:43:41 NOTICE: (23) : touch-glob 2001-03-04 /tmp/014330xu/datadir/test_compare_all-lecocag0/ file5L.txt 2025/08/31 01:43:41 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/datadir/test_compare_all-lecocag0/" for canonical name "/tmp/014330xu/datadir/test_compare_all-lecocag0" 2025/08/31 01:43:41 DEBUG : file5L.txt: Set modification time 2001-03-04 2025/08/31 01:43:41 NOTICE: (24) : copy-as /tmp/014330xu/datadir/test_compare_all-lecocag0/file5L.txt /tmp/014330xu/compare_all/path1/ file5.txt 2025/08/31 01:43:41 DEBUG : copyFile "/tmp/014330xu/datadir/test_compare_all-lecocag0/file5L.txt" to "/tmp/014330xu/compare_all/path1/" as "file5.txt" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_compare_all-lecocag0/file5L.txt" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/compare_all/path1/" 2025/08/31 01:43:41 DEBUG : operations.CopyFile "file5L.txt" to "Local file system at /tmp/014330xu/compare_all/path1" as "file5.txt" 2025/08/31 01:43:41 DEBUG : file5L.txt: Sizes differ (src 39 vs dst 0) 2025/08/31 01:43:41 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2025/08/31 01:43:41 DEBUG : file5.txt.c32cc336.partial: renamed to: file5.txt 2025/08/31 01:43:41 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2025/08/31 01:43:41 NOTICE: (25) : test newer on path2 and deleted on path1 - file6 2025/08/31 01:43:41 NOTICE: (26) : touch-copy 2001-01-02 /tmp/014330xu/datadir/test_compare_all-lecocag0/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/ 2025/08/31 01:43:41 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/datadir/test_compare_all-lecocag0/" for canonical name "/tmp/014330xu/datadir/test_compare_all-lecocag0" 2025/08/31 01:43:41 DEBUG : file6.txt: Set modification time 2001-01-02 2025/08/31 01:43:41 DEBUG : copyFile "/tmp/014330xu/datadir/test_compare_all-lecocag0/file6.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/" as "" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_compare_all-lecocag0/file6.txt" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/" 2025/08/31 01:43:41 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:41 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:41 DEBUG : operations.CopyFile "file6.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/" as "file6.txt" 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: new [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file6.txt] 2025/08/31 01:43:41 DEBUG : file6.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file6.txt] 2025/08/31 01:43:41 INFO : file6.txt: Copied (replaced existing) 2025/08/31 01:43:41 NOTICE: (27) : delete-file /tmp/014330xu/compare_all/path1/file6.txt 2025/08/31 01:43:41 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/compare_all/path1/" for canonical name "/tmp/014330xu/compare_all/path1" 2025/08/31 01:43:41 INFO : file6.txt: Deleted 2025/08/31 01:43:41 NOTICE: (28) : test newer on path1 and deleted on path2 - file7 2025/08/31 01:43:41 NOTICE: (29) : touch-copy 2001-01-02 /tmp/014330xu/datadir/test_compare_all-lecocag0/file7.txt /tmp/014330xu/compare_all/path1/ 2025/08/31 01:43:41 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/datadir/test_compare_all-lecocag0/" for canonical name "/tmp/014330xu/datadir/test_compare_all-lecocag0" 2025/08/31 01:43:41 DEBUG : file7.txt: Set modification time 2001-01-02 2025/08/31 01:43:41 DEBUG : copyFile "/tmp/014330xu/datadir/test_compare_all-lecocag0/file7.txt" to "/tmp/014330xu/compare_all/path1/" as "" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_compare_all-lecocag0/file7.txt" 2025/08/31 01:43:41 DEBUG : Creating backend with remote "/tmp/014330xu/compare_all/path1/" 2025/08/31 01:43:41 DEBUG : operations.CopyFile "file7.txt" to "Local file system at /tmp/014330xu/compare_all/path1" as "file7.txt" 2025/08/31 01:43:41 DEBUG : file7.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:43:41 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:41 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt 2025/08/31 01:43:41 INFO : file7.txt: Copied (replaced existing) 2025/08/31 01:43:41 NOTICE: (30) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/file7.txt 2025/08/31 01:43:41 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/compare_all/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/" 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: new [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file7.txt] 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2/: remove [/rclone-test-riyipah4toci/014330xu/compare_all/path2/file7.txt] 2025/08/31 01:43:41 INFO : file7.txt: Deleted 2025/08/31 01:43:41 NOTICE: (31) : test bisync run 2025/08/31 01:43:41 NOTICE: (32) : bisync compare-all 2025/08/31 01:43:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: update [/rclone-test-riyipah4toci/014330xu/compare_all/path2/modtime_write_test] 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: remove [/rclone-test-riyipah4toci/014330xu/compare_all/path2/modtime_write_test] 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:43 NOTICE: Local file system at /tmp/014330xu/compare_all/path1: will use md5 for same-side diffs on Path1 only 2025/08/31 01:43:43 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:43:43 INFO : Synching Path1 "/tmp/014330xu/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/" 2025/08/31 01:43:43 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:43 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:43:43 INFO : Path1 checking for diffs 2025/08/31 01:43:43 INFO : - Path1 File changed: size (larger), time (newer), hash - file2.txt 2025/08/31 01:43:43 INFO : - Path1 File was deleted - file4.txt 2025/08/31 01:43:43 INFO : - Path1 File changed: size (larger), time (newer), hash - file5.txt 2025/08/31 01:43:43 INFO : - Path1 File was deleted - file6.txt 2025/08/31 01:43:43 INFO : - Path1 File changed: size (larger), time (newer), hash - file7.txt 2025/08/31 01:43:43 INFO : - Path1 File was deleted - file8.txt 2025/08/31 01:43:43 INFO : - Path1 File is new - file11.txt 2025/08/31 01:43:43 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2025/08/31 01:43:43 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2025/08/31 01:43:43 INFO : Path2 checking for diffs 2025/08/31 01:43:43 INFO : - Path2 File changed: size (larger), time (newer), hash - file1.txt 2025/08/31 01:43:43 INFO : - Path2 File was deleted - file3.txt 2025/08/31 01:43:43 INFO : - Path2 File changed: size (larger), time (newer), hash - file5.txt 2025/08/31 01:43:43 INFO : - Path2 File changed: size (larger), time (newer), hash - file6.txt 2025/08/31 01:43:43 INFO : - Path2 File was deleted - file7.txt 2025/08/31 01:43:43 INFO : - Path2 File was deleted - file8.txt 2025/08/31 01:43:43 INFO : - Path2 File is new - file10.txt 2025/08/31 01:43:43 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2025/08/31 01:43:43 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2025/08/31 01:43:43 INFO : Applying changes 2025/08/31 01:43:43 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/file11.txt 2025/08/31 01:43:43 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/file2.txt 2025/08/31 01:43:43 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/file4.txt 2025/08/31 01:43:43 NOTICE: - WARNING New or changed in both paths - file5.txt 2025/08/31 01:43:43 NOTICE: - Path1 Renaming Path1 copy - /tmp/014330xu/compare_all/path1/file5.txt.conflict1 2025/08/31 01:43:43 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2025/08/31 01:43:43 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/file5.txt.conflict1 2025/08/31 01:43:43 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/file5.txt.conflict2 2025/08/31 01:43:43 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2025/08/31 01:43:43 NOTICE: - Path2 Queue copy to Path1 - /tmp/014330xu/compare_all/path1/file5.txt.conflict2 2025/08/31 01:43:43 INFO : - Path2 Queue copy to Path1 - /tmp/014330xu/compare_all/path1/file6.txt 2025/08/31 01:43:43 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/file7.txt 2025/08/31 01:43:43 INFO : - Path2 Queue copy to Path1 - /tmp/014330xu/compare_all/path1/file1.txt 2025/08/31 01:43:43 INFO : - Path2 Queue copy to Path1 - /tmp/014330xu/compare_all/path1/file10.txt 2025/08/31 01:43:43 INFO : - Path1 Queue delete - /tmp/014330xu/compare_all/path1/file3.txt 2025/08/31 01:43:43 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:43:43 INFO : file10.txt: Copied (new) 2025/08/31 01:43:43 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:43 INFO : file5.txt.conflict2: Copied (new) 2025/08/31 01:43:43 INFO : file6.txt: Copied (new) 2025/08/31 01:43:43 INFO : file3.txt: Deleted 2025/08/31 01:43:43 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:43 INFO : file11.txt: Copied (new) 2025/08/31 01:43:43 INFO : file7.txt: Copied (new) 2025/08/31 01:43:43 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:43:43 INFO : file5.txt.conflict1: Copied (new) 2025/08/31 01:43:43 INFO : file4.txt: Deleted 2025/08/31 01:43:43 INFO : Updating listings 2025/08/31 01:43:43 INFO : Validating listings for Path1 "/tmp/014330xu/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/compare_all/path2/" 2025/08/31 01:43:43 INFO : Bisync successful 2025/08/31 01:43:43 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:43 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:43:43 NOTICE: | @@ -16 +15,0 @@ 2025/08/31 01:43:43 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:43 NOTICE: | @@ -18 +16,0 @@ 2025/08/31 01:43:43 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:43 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:43 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:43 INFO : RCLONE_TEST: Deleted 2025/08/31 01:43:43 INFO : file7.txt: Deleted 2025/08/31 01:43:43 INFO : file6.txt: Deleted 2025/08/31 01:43:43 INFO : file5.txt.conflict1: Deleted 2025/08/31 01:43:43 INFO : file2.txt: Deleted 2025/08/31 01:43:43 INFO : file11.txt: Deleted 2025/08/31 01:43:43 INFO : file1.txt: Deleted 2025/08/31 01:43:43 INFO : file5.txt.conflict2: Deleted 2025/08/31 01:43:43 INFO : file10.txt: Deleted 2025/08/31 01:43:43 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:43 INFO : Local file system at /tmp/014330xu/compare_all/path1: Removing directory 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/compare_all/path2: purge [/rclone-test-riyipah4toci/014330xu/compare_all/path2] bisync_test.go:597: TEST compare_all FAILED - 1 MISCOMPARED FILES === RUN TestBisyncLocalRemote/createemptysrcdirs 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1" 2025/08/31 01:43:43 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-riyipah4toci/014330xu" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu" 2025/08/31 01:43:43 INFO : path2: Making directory 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu: mkdir [/rclone-test-riyipah4toci/014330xu/path2] 2025/08/31 01:43:43 DEBUG : Creating backend with remote "TestHdfs:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2" 2025/08/31 01:43:43 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:43 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:43 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:43 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:43 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:43 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:43 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/initdir/test_createemptysrcdirs-necewud1" 2025/08/31 01:43:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : Local file system at /tmp/014330xu/initdir/test_createemptysrcdirs-necewud1: Waiting for checks to finish 2025/08/31 01:43:43 DEBUG : Local file system at /tmp/014330xu/initdir/test_createemptysrcdirs-necewud1: Waiting for transfers to finish 2025/08/31 01:43:43 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt 2025/08/31 01:43:43 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt 2025/08/31 01:43:43 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:43 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt 2025/08/31 01:43:43 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:43 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:43 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt 2025/08/31 01:43:43 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt 2025/08/31 01:43:43 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:43:43 INFO : file1.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0" 2025/08/31 01:43:43 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : Local file system at /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0: Waiting for checks to finish 2025/08/31 01:43:43 DEBUG : Local file system at /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0: Waiting for transfers to finish 2025/08/31 01:43:43 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : placeholder.txt.4db661ca.partial: renamed to: placeholder.txt 2025/08/31 01:43:43 INFO : placeholder.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:43 ERROR : error listing: directory not found 2025/08/31 01:43:43 ERROR : Local file system at /tmp/014330xu/createemptysrcdirs/path1: Failed to list "": directory not found 2025/08/31 01:43:43 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:43 INFO : Local file system at /tmp/014330xu/createemptysrcdirs/path1: Removing directory 2025/08/31 01:43:43 ERROR : Failed to rmdir: stat /tmp/014330xu/createemptysrcdirs/path1: no such file or directory 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: purge [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2] 2025/08/31 01:43:43 ERROR : error listing: directory not found 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2] 2025/08/31 01:43:43 ERROR : error listing: directory not found 2025/08/31 01:43:43 NOTICE: checking initFs Local file system at /tmp/014330xu/initdir/test_createemptysrcdirs-necewud1 2025/08/31 01:43:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt 2025/08/31 01:43:43 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : Local file system at /tmp/014330xu/createemptysrcdirs/path1: Waiting for checks to finish 2025/08/31 01:43:43 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt 2025/08/31 01:43:43 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : Local file system at /tmp/014330xu/createemptysrcdirs/path1: Waiting for transfers to finish 2025/08/31 01:43:43 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt 2025/08/31 01:43:43 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt 2025/08/31 01:43:43 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt 2025/08/31 01:43:43 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:43:43 INFO : file1.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:43 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:43 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:43 NOTICE: checking Path1 Local file system at /tmp/014330xu/createemptysrcdirs/path1 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2] 2025/08/31 01:43:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/RCLONE_TEST] 2025/08/31 01:43:43 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/file1.copy1.txt] 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: Waiting for checks to finish 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: Waiting for transfers to finish 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/file1.copy2.txt] 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/file1.copy3.txt] 2025/08/31 01:43:43 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/file1.copy4.txt] 2025/08/31 01:43:43 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/file1.copy5.txt] 2025/08/31 01:43:43 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/file1.txt] 2025/08/31 01:43:43 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:43 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:43:43 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:43:43 INFO : file1.txt: Copied (new) 2025/08/31 01:43:43 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2] 2025/08/31 01:43:43 NOTICE: (01) : test createemptysrcdirs 2025/08/31 01:43:43 NOTICE: (02) : test initial bisync 2025/08/31 01:43:43 NOTICE: (03) : touch-glob 2001-01-02 /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/ placeholder.txt 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/" 2025/08/31 01:43:43 DEBUG : fs cache: renaming cache item "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/" to be canonical "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0" 2025/08/31 01:43:43 DEBUG : placeholder.txt: Set modification time 2001-01-02 2025/08/31 01:43:43 NOTICE: (04) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.txt 2025/08/31 01:43:43 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:43 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.txt" 2025/08/31 01:43:43 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:43:43 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 INFO : placeholder.txt: Updated modification time in destination 2025/08/31 01:43:43 DEBUG : placeholder.txt: Unchanged skipping 2025/08/31 01:43:43 NOTICE: (05) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy1.txt 2025/08/31 01:43:43 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:43 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy1.txt" 2025/08/31 01:43:43 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:43:43 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 INFO : placeholder.txt: Updated modification time in destination 2025/08/31 01:43:43 DEBUG : placeholder.txt: Unchanged skipping 2025/08/31 01:43:43 NOTICE: (06) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy2.txt 2025/08/31 01:43:43 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:43 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy2.txt" 2025/08/31 01:43:43 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:43:43 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 INFO : placeholder.txt: Updated modification time in destination 2025/08/31 01:43:43 DEBUG : placeholder.txt: Unchanged skipping 2025/08/31 01:43:43 NOTICE: (07) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy3.txt 2025/08/31 01:43:43 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:43 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy3.txt" 2025/08/31 01:43:43 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:43:43 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 INFO : placeholder.txt: Updated modification time in destination 2025/08/31 01:43:43 DEBUG : placeholder.txt: Unchanged skipping 2025/08/31 01:43:43 NOTICE: (08) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy4.txt 2025/08/31 01:43:43 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:43 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy4.txt" 2025/08/31 01:43:43 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:43:43 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 INFO : placeholder.txt: Updated modification time in destination 2025/08/31 01:43:43 DEBUG : placeholder.txt: Unchanged skipping 2025/08/31 01:43:43 NOTICE: (09) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy5.txt 2025/08/31 01:43:43 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:43 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:43 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy5.txt" 2025/08/31 01:43:43 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:43:43 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:43 INFO : placeholder.txt: Updated modification time in destination 2025/08/31 01:43:43 DEBUG : placeholder.txt: Unchanged skipping 2025/08/31 01:43:43 NOTICE: (10) : bisync resync 2025/08/31 01:43:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: remove [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:45 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:45 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:45 INFO : Synching Path1 "/tmp/014330xu/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:45 INFO : Copying Path2 files to Path1 2025/08/31 01:43:45 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:43:45 INFO : There was nothing to transfer 2025/08/31 01:43:45 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:43:45 INFO : file1.copy2.txt: Copied (replaced existing) 2025/08/31 01:43:45 INFO : file1.copy1.txt: Copied (replaced existing) 2025/08/31 01:43:45 INFO : file1.copy3.txt: Copied (replaced existing) 2025/08/31 01:43:45 INFO : file1.copy5.txt: Copied (replaced existing) 2025/08/31 01:43:45 INFO : file1.copy4.txt: Copied (replaced existing) 2025/08/31 01:43:46 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:46 INFO : Resync updating listings 2025/08/31 01:43:46 INFO : Validating listings for Path1 "/tmp/014330xu/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:46 INFO : Bisync successful 2025/08/31 01:43:46 NOTICE: (11) : test 1. Create an empty dir on Path1 by creating subdir/placeholder.txt and then deleting the placeholder 2025/08/31 01:43:46 NOTICE: (12) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ subdir/placeholder.txt 2025/08/31 01:43:46 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "subdir/placeholder.txt" 2025/08/31 01:43:46 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:46 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:46 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "subdir/placeholder.txt" 2025/08/31 01:43:46 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:46 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:46 DEBUG : subdir/placeholder.txt.4db661ca.partial: renamed to: subdir/placeholder.txt 2025/08/31 01:43:46 INFO : placeholder.txt: Copied (new) to: subdir/placeholder.txt 2025/08/31 01:43:46 NOTICE: (13) : touch-glob 2001-01-02 /tmp/014330xu/createemptysrcdirs/path1/ subdir 2025/08/31 01:43:46 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:46 DEBUG : fs cache: renaming cache item "/tmp/014330xu/createemptysrcdirs/path1/" to be canonical "/tmp/014330xu/createemptysrcdirs/path1" 2025/08/31 01:43:46 NOTICE: (14) : delete-file /tmp/014330xu/createemptysrcdirs/path1/subdir/placeholder.txt 2025/08/31 01:43:46 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/subdir/" 2025/08/31 01:43:46 DEBUG : fs cache: renaming cache item "/tmp/014330xu/createemptysrcdirs/path1/subdir/" to be canonical "/tmp/014330xu/createemptysrcdirs/path1/subdir" 2025/08/31 01:43:46 INFO : placeholder.txt: Deleted 2025/08/31 01:43:46 NOTICE: (15) : test 2. Run bisync without --create-empty-src-dirs 2025/08/31 01:43:46 NOTICE: (16) : bisync 2025/08/31 01:43:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: remove [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:48 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:48 INFO : Synching Path1 "/tmp/014330xu/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:48 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:48 INFO : Path1 checking for diffs 2025/08/31 01:43:48 INFO : Path2 checking for diffs 2025/08/31 01:43:48 INFO : No changes found 2025/08/31 01:43:48 INFO : Updating listings 2025/08/31 01:43:48 INFO : Validating listings for Path1 "/tmp/014330xu/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:48 INFO : Bisync successful 2025/08/31 01:43:48 NOTICE: (17) : test 3. Confirm the subdir exists only on Path1 and not Path2 2025/08/31 01:43:48 NOTICE: (18) : list-dirs /tmp/014330xu/createemptysrcdirs/path1/ 2025/08/31 01:43:48 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/createemptysrcdirs/path1/" for canonical name "/tmp/014330xu/createemptysrcdirs/path1" 2025/08/31 01:43:48 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:48 NOTICE: (19) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/ 2025/08/31 01:43:48 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:48 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:48 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:48 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" to be canonical "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2] 2025/08/31 01:43:48 NOTICE: (20) : test 4.Run bisync WITH --create-empty-src-dirs 2025/08/31 01:43:48 NOTICE: (21) : bisync create-empty-src-dirs 2025/08/31 01:43:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: remove [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:50 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:50 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:50 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:50 INFO : Synching Path1 "/tmp/014330xu/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:50 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:50 INFO : Path1 checking for diffs 2025/08/31 01:43:50 INFO : - Path1 File is new - subdir 2025/08/31 01:43:50 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2025/08/31 01:43:50 INFO : Path2 checking for diffs 2025/08/31 01:43:50 INFO : Applying changes 2025/08/31 01:43:50 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/subdir 2025/08/31 01:43:50 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:50 INFO : There was nothing to transfer 2025/08/31 01:43:50 INFO : subdir: Making directory 2025/08/31 01:43:50 INFO : Updating listings 2025/08/31 01:43:50 INFO : Validating listings for Path1 "/tmp/014330xu/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:50 INFO : Bisync successful 2025/08/31 01:43:50 NOTICE: (22) : test 5. Confirm the subdir exists on both paths 2025/08/31 01:43:50 NOTICE: (23) : list-dirs /tmp/014330xu/createemptysrcdirs/path1/ 2025/08/31 01:43:50 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/createemptysrcdirs/path1/" for canonical name "/tmp/014330xu/createemptysrcdirs/path1" 2025/08/31 01:43:50 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:50 NOTICE: (24) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/ 2025/08/31 01:43:50 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2] 2025/08/31 01:43:50 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/subdir] 2025/08/31 01:43:50 NOTICE: (25) : test 6. Delete the empty dir on Path1 using purge-children (and also add files so the path isn't empty) 2025/08/31 01:43:50 NOTICE: (26) : purge-children /tmp/014330xu/createemptysrcdirs/path1/ 2025/08/31 01:43:50 DEBUG : subdir: Purge subdir 2025/08/31 01:43:50 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:50 DEBUG : removing 1 level 1 directories 2025/08/31 01:43:50 INFO : subdir: Removing directory 2025/08/31 01:43:50 DEBUG : file1.copy1.txt: Remove file 2025/08/31 01:43:50 DEBUG : file1.txt: Remove file 2025/08/31 01:43:50 DEBUG : file1.copy5.txt: Remove file 2025/08/31 01:43:50 DEBUG : RCLONE_TEST: Remove file 2025/08/31 01:43:50 DEBUG : file1.copy4.txt: Remove file 2025/08/31 01:43:50 DEBUG : file1.copy3.txt: Remove file 2025/08/31 01:43:50 DEBUG : file1.copy2.txt: Remove file 2025/08/31 01:43:50 NOTICE: (27) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.txt 2025/08/31 01:43:50 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:43:50 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:50 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:50 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.txt" 2025/08/31 01:43:50 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:50 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:50 DEBUG : file1.txt.4db661ca.partial: renamed to: file1.txt 2025/08/31 01:43:50 INFO : placeholder.txt: Copied (new) to: file1.txt 2025/08/31 01:43:50 NOTICE: (28) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy1.txt 2025/08/31 01:43:50 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:43:50 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:50 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:50 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy1.txt" 2025/08/31 01:43:50 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:50 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:50 DEBUG : file1.copy1.txt.4db661ca.partial: renamed to: file1.copy1.txt 2025/08/31 01:43:50 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2025/08/31 01:43:50 NOTICE: (29) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy2.txt 2025/08/31 01:43:50 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:43:50 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:50 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:50 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy2.txt" 2025/08/31 01:43:50 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:50 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:50 DEBUG : file1.copy2.txt.4db661ca.partial: renamed to: file1.copy2.txt 2025/08/31 01:43:50 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2025/08/31 01:43:50 NOTICE: (30) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy3.txt 2025/08/31 01:43:50 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:43:50 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:50 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:50 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy3.txt" 2025/08/31 01:43:50 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:50 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:50 DEBUG : file1.copy3.txt.4db661ca.partial: renamed to: file1.copy3.txt 2025/08/31 01:43:50 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2025/08/31 01:43:50 NOTICE: (31) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy4.txt 2025/08/31 01:43:50 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:43:50 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:50 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:50 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy4.txt" 2025/08/31 01:43:50 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:50 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:50 DEBUG : file1.copy4.txt.4db661ca.partial: renamed to: file1.copy4.txt 2025/08/31 01:43:50 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2025/08/31 01:43:50 NOTICE: (32) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy5.txt 2025/08/31 01:43:50 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:43:50 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:50 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:50 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy5.txt" 2025/08/31 01:43:50 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:50 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:50 DEBUG : file1.copy5.txt.4db661ca.partial: renamed to: file1.copy5.txt 2025/08/31 01:43:50 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2025/08/31 01:43:50 NOTICE: (33) : test 7. Run bisync without --create-empty-src-dirs 2025/08/31 01:43:50 NOTICE: (34) : bisync 2025/08/31 01:43:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: remove [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:52 INFO : Synching Path1 "/tmp/014330xu/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:52 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:52 INFO : Path1 checking for diffs 2025/08/31 01:43:52 INFO : - Path1 File was deleted - RCLONE_TEST 2025/08/31 01:43:52 INFO : - Path1 File was deleted - subdir 2025/08/31 01:43:52 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2025/08/31 01:43:52 INFO : Path2 checking for diffs 2025/08/31 01:43:52 INFO : - Path2 File was deleted - subdir 2025/08/31 01:43:52 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2025/08/31 01:43:52 INFO : Applying changes 2025/08/31 01:43:52 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/RCLONE_TEST 2025/08/31 01:43:52 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:52 INFO : RCLONE_TEST: Deleted 2025/08/31 01:43:52 INFO : There was nothing to transfer 2025/08/31 01:43:52 INFO : Updating listings 2025/08/31 01:43:52 INFO : Validating listings for Path1 "/tmp/014330xu/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:52 INFO : Bisync successful 2025/08/31 01:43:52 NOTICE: (35) : test 8. Confirm the subdir exists only on Path2 and not Path1 2025/08/31 01:43:52 NOTICE: (36) : list-dirs /tmp/014330xu/createemptysrcdirs/path1/ 2025/08/31 01:43:52 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/createemptysrcdirs/path1/" for canonical name "/tmp/014330xu/createemptysrcdirs/path1" 2025/08/31 01:43:52 NOTICE: (37) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/ 2025/08/31 01:43:52 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2] 2025/08/31 01:43:52 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/subdir] 2025/08/31 01:43:52 NOTICE: (38) : test 9. Reset, do the delete again, and run bisync WITH --create-empty-src-dirs 2025/08/31 01:43:52 NOTICE: (39) : bisync resync create-empty-src-dirs 2025/08/31 01:43:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: remove [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:54 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:54 INFO : Synching Path1 "/tmp/014330xu/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:54 INFO : Copying Path2 files to Path1 2025/08/31 01:43:54 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:43:54 INFO : subdir: Made directory with metadata (mtime=2025-08-31T01:43:50.102Z) 2025/08/31 01:43:54 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:54 INFO : There was nothing to transfer 2025/08/31 01:43:54 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:43:54 INFO : There was nothing to transfer 2025/08/31 01:43:54 INFO : Resync updating listings 2025/08/31 01:43:54 INFO : Validating listings for Path1 "/tmp/014330xu/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:54 INFO : Bisync successful 2025/08/31 01:43:54 NOTICE: (40) : list-dirs /tmp/014330xu/createemptysrcdirs/path1/ 2025/08/31 01:43:54 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/createemptysrcdirs/path1/" for canonical name "/tmp/014330xu/createemptysrcdirs/path1" 2025/08/31 01:43:54 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:54 NOTICE: (41) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/ 2025/08/31 01:43:54 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2] 2025/08/31 01:43:54 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/subdir] 2025/08/31 01:43:54 NOTICE: (42) : purge-children /tmp/014330xu/createemptysrcdirs/path1/ 2025/08/31 01:43:54 DEBUG : subdir: Purge subdir 2025/08/31 01:43:54 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:54 DEBUG : removing 1 level 1 directories 2025/08/31 01:43:54 INFO : subdir: Removing directory 2025/08/31 01:43:54 DEBUG : file1.copy1.txt: Remove file 2025/08/31 01:43:54 DEBUG : file1.txt: Remove file 2025/08/31 01:43:54 DEBUG : file1.copy5.txt: Remove file 2025/08/31 01:43:54 DEBUG : file1.copy4.txt: Remove file 2025/08/31 01:43:54 DEBUG : file1.copy3.txt: Remove file 2025/08/31 01:43:54 DEBUG : file1.copy2.txt: Remove file 2025/08/31 01:43:54 NOTICE: (43) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.txt 2025/08/31 01:43:54 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:43:54 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:54 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:54 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.txt" 2025/08/31 01:43:54 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:54 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:54 DEBUG : file1.txt.4db661ca.partial: renamed to: file1.txt 2025/08/31 01:43:54 INFO : placeholder.txt: Copied (new) to: file1.txt 2025/08/31 01:43:54 NOTICE: (44) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy1.txt 2025/08/31 01:43:54 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:43:54 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:54 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:54 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy1.txt" 2025/08/31 01:43:54 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:54 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:54 DEBUG : file1.copy1.txt.4db661ca.partial: renamed to: file1.copy1.txt 2025/08/31 01:43:54 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2025/08/31 01:43:54 NOTICE: (45) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy2.txt 2025/08/31 01:43:54 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:43:54 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:54 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:54 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy2.txt" 2025/08/31 01:43:54 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:54 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:54 DEBUG : file1.copy2.txt.4db661ca.partial: renamed to: file1.copy2.txt 2025/08/31 01:43:54 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2025/08/31 01:43:54 NOTICE: (46) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy3.txt 2025/08/31 01:43:54 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:43:54 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:54 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:54 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy3.txt" 2025/08/31 01:43:54 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:54 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:54 DEBUG : file1.copy3.txt.4db661ca.partial: renamed to: file1.copy3.txt 2025/08/31 01:43:54 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2025/08/31 01:43:54 NOTICE: (47) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy4.txt 2025/08/31 01:43:54 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:43:54 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:54 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:54 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy4.txt" 2025/08/31 01:43:54 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:54 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:54 DEBUG : file1.copy4.txt.4db661ca.partial: renamed to: file1.copy4.txt 2025/08/31 01:43:54 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2025/08/31 01:43:54 NOTICE: (48) : copy-as /tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt /tmp/014330xu/createemptysrcdirs/path1/ file1.copy5.txt 2025/08/31 01:43:54 DEBUG : copyFile "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" to "/tmp/014330xu/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:43:54 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_createemptysrcdirs-yagoxuc0/placeholder.txt" 2025/08/31 01:43:54 DEBUG : Creating backend with remote "/tmp/014330xu/createemptysrcdirs/path1/" 2025/08/31 01:43:54 DEBUG : operations.CopyFile "placeholder.txt" to "Local file system at /tmp/014330xu/createemptysrcdirs/path1" as "file1.copy5.txt" 2025/08/31 01:43:54 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:54 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:54 DEBUG : file1.copy5.txt.4db661ca.partial: renamed to: file1.copy5.txt 2025/08/31 01:43:54 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2025/08/31 01:43:54 NOTICE: (49) : list-dirs /tmp/014330xu/createemptysrcdirs/path1/ 2025/08/31 01:43:54 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/createemptysrcdirs/path1/" for canonical name "/tmp/014330xu/createemptysrcdirs/path1" 2025/08/31 01:43:54 NOTICE: (50) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/ 2025/08/31 01:43:54 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2] 2025/08/31 01:43:54 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:43:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/subdir] 2025/08/31 01:43:54 NOTICE: (51) : bisync create-empty-src-dirs 2025/08/31 01:43:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: remove [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:56 INFO : Synching Path1 "/tmp/014330xu/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:56 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:56 INFO : Path1 checking for diffs 2025/08/31 01:43:56 INFO : - Path1 File was deleted - subdir 2025/08/31 01:43:56 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2025/08/31 01:43:56 INFO : Path2 checking for diffs 2025/08/31 01:43:56 INFO : Applying changes 2025/08/31 01:43:56 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/subdir 2025/08/31 01:43:56 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:56 INFO : There was nothing to transfer 2025/08/31 01:43:56 INFO : subdir: Removing directory 2025/08/31 01:43:56 INFO : Updating listings 2025/08/31 01:43:56 INFO : Validating listings for Path1 "/tmp/014330xu/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:56 INFO : Bisync successful 2025/08/31 01:43:56 NOTICE: (52) : test 10. Confirm the subdir has been removed on both paths 2025/08/31 01:43:56 NOTICE: (53) : list-dirs /tmp/014330xu/createemptysrcdirs/path1/ 2025/08/31 01:43:56 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/createemptysrcdirs/path1/" for canonical name "/tmp/014330xu/createemptysrcdirs/path1" 2025/08/31 01:43:56 NOTICE: (54) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/ 2025/08/31 01:43:56 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/: list [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2] 2025/08/31 01:43:56 NOTICE: (55) : test 11. bisync again (because if we leave subdir in listings, test will fail due to mismatched modtime) 2025/08/31 01:43:56 NOTICE: (56) : bisync create-empty-src-dirs 2025/08/31 01:43:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: update [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: remove [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:43:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:43:58 INFO : Synching Path1 "/tmp/014330xu/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:58 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:58 INFO : Path1 checking for diffs 2025/08/31 01:43:58 INFO : Path2 checking for diffs 2025/08/31 01:43:58 INFO : No changes found 2025/08/31 01:43:58 INFO : Updating listings 2025/08/31 01:43:58 INFO : Validating listings for Path1 "/tmp/014330xu/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2/" 2025/08/31 01:43:58 INFO : Bisync successful 2025/08/31 01:43:58 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:58 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:43:58 NOTICE: | @@ -26 +25,0 @@ 2025/08/31 01:43:58 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:58 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:58 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:58 INFO : file1.copy1.txt: Deleted 2025/08/31 01:43:58 INFO : file1.copy2.txt: Deleted 2025/08/31 01:43:58 INFO : file1.copy4.txt: Deleted 2025/08/31 01:43:58 INFO : file1.copy3.txt: Deleted 2025/08/31 01:43:58 INFO : file1.copy5.txt: Deleted 2025/08/31 01:43:58 INFO : file1.txt: Deleted 2025/08/31 01:43:58 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:58 INFO : Local file system at /tmp/014330xu/createemptysrcdirs/path1: Removing directory 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2: purge [/rclone-test-riyipah4toci/014330xu/createemptysrcdirs/path2] bisync_test.go:597: TEST createemptysrcdirs FAILED - 1 MISCOMPARED FILES === RUN TestBisyncLocalRemote/nomodtime 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/nomodtime/path1" 2025/08/31 01:43:58 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-riyipah4toci/014330xu" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu" 2025/08/31 01:43:58 INFO : path2: Making directory 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu: mkdir [/rclone-test-riyipah4toci/014330xu/path2] 2025/08/31 01:43:58 DEBUG : Creating backend with remote "TestHdfs:rclone-test-riyipah4toci/014330xu/nomodtime/path2" 2025/08/31 01:43:58 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:58 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:58 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-riyipah4toci/014330xu/nomodtime/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/initdir/test_nomodtime-xelatof7" 2025/08/31 01:43:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : Local file system at /tmp/014330xu/initdir/test_nomodtime-xelatof7: Waiting for checks to finish 2025/08/31 01:43:58 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:43:58 INFO : file2.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:43:58 INFO : file1.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : Local file system at /tmp/014330xu/initdir/test_nomodtime-xelatof7: Waiting for transfers to finish 2025/08/31 01:43:58 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt 2025/08/31 01:43:58 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:58 INFO : file3.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:58 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:58 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt 2025/08/31 01:43:58 INFO : file5.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt 2025/08/31 01:43:58 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 INFO : file4.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt 2025/08/31 01:43:58 INFO : file7.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt 2025/08/31 01:43:58 INFO : file6.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt 2025/08/31 01:43:58 INFO : file8.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_nomodtime-femijec7" 2025/08/31 01:43:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file10.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file11.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:58 DEBUG : Local file system at /tmp/014330xu/datadir/test_nomodtime-femijec7: Waiting for checks to finish 2025/08/31 01:43:58 DEBUG : file1.txt.7d45770.partial: renamed to: file1.txt 2025/08/31 01:43:58 INFO : file1.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:58 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:58 DEBUG : file10.txt.7d45770.partial: renamed to: file10.txt 2025/08/31 01:43:58 DEBUG : Local file system at /tmp/014330xu/datadir/test_nomodtime-femijec7: Waiting for transfers to finish 2025/08/31 01:43:58 INFO : file10.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file11.txt.7d45770.partial: renamed to: file11.txt 2025/08/31 01:43:58 INFO : file11.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2025/08/31 01:43:58 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2025/08/31 01:43:58 DEBUG : file5L.txt.9ed658ed.partial: renamed to: file5L.txt 2025/08/31 01:43:58 INFO : file5L.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2025/08/31 01:43:58 DEBUG : file2.txt.21f2ec7f.partial: renamed to: file2.txt 2025/08/31 01:43:58 INFO : file2.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file5R.txt.9ed658ed.partial: renamed to: file5R.txt 2025/08/31 01:43:58 INFO : file5R.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:58 DEBUG : file7.txt.7d45770.partial: renamed to: file7.txt 2025/08/31 01:43:58 INFO : file7.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:58 DEBUG : file6.txt.7d45770.partial: renamed to: file6.txt 2025/08/31 01:43:58 INFO : file6.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:58 ERROR : error listing: directory not found 2025/08/31 01:43:58 ERROR : Local file system at /tmp/014330xu/nomodtime/path1: Failed to list "": directory not found 2025/08/31 01:43:58 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:58 INFO : Local file system at /tmp/014330xu/nomodtime/path1: Removing directory 2025/08/31 01:43:58 ERROR : Failed to rmdir: stat /tmp/014330xu/nomodtime/path1: no such file or directory 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: purge [/rclone-test-riyipah4toci/014330xu/nomodtime/path2] 2025/08/31 01:43:58 ERROR : error listing: directory not found 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: list [/rclone-test-riyipah4toci/014330xu/nomodtime/path2] 2025/08/31 01:43:58 ERROR : error listing: directory not found 2025/08/31 01:43:58 NOTICE: checking initFs Local file system at /tmp/014330xu/initdir/test_nomodtime-xelatof7 2025/08/31 01:43:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : Local file system at /tmp/014330xu/nomodtime/path1: Waiting for checks to finish 2025/08/31 01:43:58 DEBUG : Local file system at /tmp/014330xu/nomodtime/path1: Waiting for transfers to finish 2025/08/31 01:43:58 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:43:58 INFO : file2.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:43:58 INFO : file1.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt 2025/08/31 01:43:58 INFO : file3.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:58 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:58 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:58 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt 2025/08/31 01:43:58 INFO : file5.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt 2025/08/31 01:43:58 INFO : file4.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt 2025/08/31 01:43:58 INFO : file7.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt 2025/08/31 01:43:58 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:58 INFO : file6.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt 2025/08/31 01:43:58 INFO : file8.txt: Copied (new) 2025/08/31 01:43:58 NOTICE: checking Path1 Local file system at /tmp/014330xu/nomodtime/path1 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: list [/rclone-test-riyipah4toci/014330xu/nomodtime/path2] 2025/08/31 01:43:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/RCLONE_TEST] 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: Waiting for checks to finish 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file3.txt] 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file2.txt] 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file1.txt] 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: Waiting for transfers to finish 2025/08/31 01:43:58 INFO : file3.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file4.txt] 2025/08/31 01:43:58 INFO : file2.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file5.txt] 2025/08/31 01:43:58 INFO : file1.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file6.txt] 2025/08/31 01:43:58 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file7.txt] 2025/08/31 01:43:58 INFO : file4.txt: Copied (new) 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file8.txt] 2025/08/31 01:43:58 INFO : file5.txt: Copied (new) 2025/08/31 01:43:58 INFO : file6.txt: Copied (new) 2025/08/31 01:43:58 INFO : file7.txt: Copied (new) 2025/08/31 01:43:58 INFO : file8.txt: Copied (new) 2025/08/31 01:43:58 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: list [/rclone-test-riyipah4toci/014330xu/nomodtime/path2] 2025/08/31 01:43:58 NOTICE: (01) : test changes 2025/08/31 01:43:58 NOTICE: (02) : test initial bisync 2025/08/31 01:43:58 NOTICE: (03) : bisync resync nomodtime 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:58 NOTICE: Local file system at /tmp/014330xu/nomodtime/path1: will use md5 for same-side diffs on Path1 only 2025/08/31 01:43:58 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:43:58 INFO : Synching Path1 "/tmp/014330xu/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/" 2025/08/31 01:43:58 INFO : Copying Path2 files to Path1 2025/08/31 01:43:58 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:43:58 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:43:58 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:43:58 INFO : Resync updating listings 2025/08/31 01:43:58 INFO : Validating listings for Path1 "/tmp/014330xu/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/" 2025/08/31 01:43:58 INFO : Bisync successful 2025/08/31 01:43:58 NOTICE: (04) : test make modifications on both paths 2025/08/31 01:43:58 NOTICE: (05) : test new on path2 - file10 2025/08/31 01:43:58 NOTICE: (06) : copy-file /tmp/014330xu/datadir/test_nomodtime-femijec7/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/ 2025/08/31 01:43:58 DEBUG : copyFile "/tmp/014330xu/datadir/test_nomodtime-femijec7/file10.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/" as "" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_nomodtime-femijec7/file10.txt" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/" 2025/08/31 01:43:58 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:58 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:58 DEBUG : operations.CopyFile "file10.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/" as "file10.txt" 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: new [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file10.txt] 2025/08/31 01:43:58 DEBUG : file10.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file10.txt] 2025/08/31 01:43:58 INFO : file10.txt: Copied (new) 2025/08/31 01:43:58 NOTICE: (07) : test changed on path2 - file1 2025/08/31 01:43:58 NOTICE: (08) : copy-file /tmp/014330xu/datadir/test_nomodtime-femijec7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/ 2025/08/31 01:43:58 DEBUG : copyFile "/tmp/014330xu/datadir/test_nomodtime-femijec7/file1.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/" as "" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_nomodtime-femijec7/file1.txt" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/" 2025/08/31 01:43:58 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:58 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:58 DEBUG : operations.CopyFile "file1.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/" as "file1.txt" 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: new [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file1.txt] 2025/08/31 01:43:58 DEBUG : file1.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file1.txt] 2025/08/31 01:43:58 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:58 NOTICE: (09) : test new on path1 - file11 2025/08/31 01:43:58 NOTICE: (10) : copy-file /tmp/014330xu/datadir/test_nomodtime-femijec7/file11.txt /tmp/014330xu/nomodtime/path1/ 2025/08/31 01:43:58 DEBUG : copyFile "/tmp/014330xu/datadir/test_nomodtime-femijec7/file11.txt" to "/tmp/014330xu/nomodtime/path1/" as "" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_nomodtime-femijec7/file11.txt" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/nomodtime/path1/" 2025/08/31 01:43:58 DEBUG : operations.CopyFile "file11.txt" to "Local file system at /tmp/014330xu/nomodtime/path1" as "file11.txt" 2025/08/31 01:43:58 DEBUG : file11.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:58 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:58 DEBUG : file11.txt.7d45770.partial: renamed to: file11.txt 2025/08/31 01:43:58 INFO : file11.txt: Copied (new) 2025/08/31 01:43:58 NOTICE: (11) : test changed on path1 - file2 2025/08/31 01:43:58 NOTICE: (12) : copy-file /tmp/014330xu/datadir/test_nomodtime-femijec7/file2.txt /tmp/014330xu/nomodtime/path1/ 2025/08/31 01:43:58 DEBUG : copyFile "/tmp/014330xu/datadir/test_nomodtime-femijec7/file2.txt" to "/tmp/014330xu/nomodtime/path1/" as "" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_nomodtime-femijec7/file2.txt" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/nomodtime/path1/" 2025/08/31 01:43:58 DEBUG : operations.CopyFile "file2.txt" to "Local file system at /tmp/014330xu/nomodtime/path1" as "file2.txt" 2025/08/31 01:43:58 DEBUG : file2.txt: Sizes differ (src 13 vs dst 0) 2025/08/31 01:43:58 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2025/08/31 01:43:58 DEBUG : file2.txt.21f2ec7f.partial: renamed to: file2.txt 2025/08/31 01:43:58 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:43:58 NOTICE: (13) : test deleted on path2 - file3 2025/08/31 01:43:58 NOTICE: (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/file3.txt 2025/08/31 01:43:58 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/" 2025/08/31 01:43:58 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:58 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:58 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/" to be canonical "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/" 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: new [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file3.txt] 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: remove [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file3.txt] 2025/08/31 01:43:58 INFO : file3.txt: Deleted 2025/08/31 01:43:58 NOTICE: (15) : test deleted on path1 - file4 2025/08/31 01:43:58 NOTICE: (16) : delete-file /tmp/014330xu/nomodtime/path1/file4.txt 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/nomodtime/path1/" 2025/08/31 01:43:58 DEBUG : fs cache: renaming cache item "/tmp/014330xu/nomodtime/path1/" to be canonical "/tmp/014330xu/nomodtime/path1" 2025/08/31 01:43:58 INFO : file4.txt: Deleted 2025/08/31 01:43:58 NOTICE: (17) : test deleted on both paths - file8 2025/08/31 01:43:58 NOTICE: (18) : delete-file /tmp/014330xu/nomodtime/path1/file8.txt 2025/08/31 01:43:58 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/nomodtime/path1/" for canonical name "/tmp/014330xu/nomodtime/path1" 2025/08/31 01:43:58 INFO : file8.txt: Deleted 2025/08/31 01:43:58 NOTICE: (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/file8.txt 2025/08/31 01:43:58 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/" 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: new [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file8.txt] 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: remove [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file8.txt] 2025/08/31 01:43:58 INFO : file8.txt: Deleted 2025/08/31 01:43:58 NOTICE: (20) : test changed on both paths - file5 (file5R, file5L) 2025/08/31 01:43:58 NOTICE: (21) : copy-as /tmp/014330xu/datadir/test_nomodtime-femijec7/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/ file5.txt 2025/08/31 01:43:58 DEBUG : copyFile "/tmp/014330xu/datadir/test_nomodtime-femijec7/file5R.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/" as "file5.txt" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_nomodtime-femijec7/file5R.txt" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/" 2025/08/31 01:43:58 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:58 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:58 DEBUG : operations.CopyFile "file5R.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/" as "file5.txt" 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: new [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file5.txt] 2025/08/31 01:43:58 DEBUG : file5R.txt: Sizes differ (src 39 vs dst 0) 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file5.txt] 2025/08/31 01:43:58 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2025/08/31 01:43:58 NOTICE: (22) : copy-as /tmp/014330xu/datadir/test_nomodtime-femijec7/file5L.txt /tmp/014330xu/nomodtime/path1/ file5.txt 2025/08/31 01:43:58 DEBUG : copyFile "/tmp/014330xu/datadir/test_nomodtime-femijec7/file5L.txt" to "/tmp/014330xu/nomodtime/path1/" as "file5.txt" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_nomodtime-femijec7/file5L.txt" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/nomodtime/path1/" 2025/08/31 01:43:58 DEBUG : operations.CopyFile "file5L.txt" to "Local file system at /tmp/014330xu/nomodtime/path1" as "file5.txt" 2025/08/31 01:43:58 DEBUG : file5L.txt: Sizes differ (src 39 vs dst 0) 2025/08/31 01:43:58 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2025/08/31 01:43:58 DEBUG : file5.txt.9ed658ed.partial: renamed to: file5.txt 2025/08/31 01:43:58 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2025/08/31 01:43:58 NOTICE: (23) : test changed on path2 and deleted on path1 - file6 2025/08/31 01:43:58 NOTICE: (24) : copy-file /tmp/014330xu/datadir/test_nomodtime-femijec7/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/ 2025/08/31 01:43:58 DEBUG : copyFile "/tmp/014330xu/datadir/test_nomodtime-femijec7/file6.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/" as "" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_nomodtime-femijec7/file6.txt" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/" 2025/08/31 01:43:58 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:58 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:58 DEBUG : operations.CopyFile "file6.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/" as "file6.txt" 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: new [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file6.txt] 2025/08/31 01:43:58 DEBUG : file6.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: update [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file6.txt] 2025/08/31 01:43:58 INFO : file6.txt: Copied (replaced existing) 2025/08/31 01:43:58 NOTICE: (25) : delete-file /tmp/014330xu/nomodtime/path1/file6.txt 2025/08/31 01:43:58 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/nomodtime/path1/" for canonical name "/tmp/014330xu/nomodtime/path1" 2025/08/31 01:43:58 INFO : file6.txt: Deleted 2025/08/31 01:43:58 NOTICE: (26) : test changed on path1 and deleted on path2 - file7 2025/08/31 01:43:58 NOTICE: (27) : copy-file /tmp/014330xu/datadir/test_nomodtime-femijec7/file7.txt /tmp/014330xu/nomodtime/path1/ 2025/08/31 01:43:58 DEBUG : copyFile "/tmp/014330xu/datadir/test_nomodtime-femijec7/file7.txt" to "/tmp/014330xu/nomodtime/path1/" as "" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_nomodtime-femijec7/file7.txt" 2025/08/31 01:43:58 DEBUG : Creating backend with remote "/tmp/014330xu/nomodtime/path1/" 2025/08/31 01:43:58 DEBUG : operations.CopyFile "file7.txt" to "Local file system at /tmp/014330xu/nomodtime/path1" as "file7.txt" 2025/08/31 01:43:58 DEBUG : file7.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:43:58 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:58 DEBUG : file7.txt.7d45770.partial: renamed to: file7.txt 2025/08/31 01:43:58 INFO : file7.txt: Copied (replaced existing) 2025/08/31 01:43:58 NOTICE: (28) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/file7.txt 2025/08/31 01:43:58 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/nomodtime/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/" 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: new [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file7.txt] 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2/: remove [/rclone-test-riyipah4toci/014330xu/nomodtime/path2/file7.txt] 2025/08/31 01:43:58 INFO : file7.txt: Deleted 2025/08/31 01:43:58 NOTICE: (29) : test bisync run 2025/08/31 01:43:58 NOTICE: (30) : bisync nomodtime 2025/08/31 01:43:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:43:58 NOTICE: Local file system at /tmp/014330xu/nomodtime/path1: will use md5 for same-side diffs on Path1 only 2025/08/31 01:43:58 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:43:58 INFO : Synching Path1 "/tmp/014330xu/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/" 2025/08/31 01:43:58 INFO : Building Path1 and Path2 listings 2025/08/31 01:43:58 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:43:58 INFO : Path1 checking for diffs 2025/08/31 01:43:58 INFO : - Path1 File changed: size (larger), hash - file2.txt 2025/08/31 01:43:58 INFO : - Path1 File was deleted - file4.txt 2025/08/31 01:43:58 INFO : - Path1 File changed: size (larger), hash - file5.txt 2025/08/31 01:43:58 INFO : - Path1 File was deleted - file6.txt 2025/08/31 01:43:58 INFO : - Path1 File changed: size (larger), hash - file7.txt 2025/08/31 01:43:58 INFO : - Path1 File was deleted - file8.txt 2025/08/31 01:43:58 INFO : - Path1 File is new - file11.txt 2025/08/31 01:43:58 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2025/08/31 01:43:58 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2025/08/31 01:43:58 INFO : Path2 checking for diffs 2025/08/31 01:43:58 INFO : - Path2 File changed: size (larger), hash - file1.txt 2025/08/31 01:43:58 INFO : - Path2 File was deleted - file3.txt 2025/08/31 01:43:58 INFO : - Path2 File changed: size (larger), hash - file5.txt 2025/08/31 01:43:58 INFO : - Path2 File changed: size (larger), hash - file6.txt 2025/08/31 01:43:58 INFO : - Path2 File was deleted - file7.txt 2025/08/31 01:43:58 INFO : - Path2 File was deleted - file8.txt 2025/08/31 01:43:58 INFO : - Path2 File is new - file10.txt 2025/08/31 01:43:58 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2025/08/31 01:43:58 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2025/08/31 01:43:58 INFO : Applying changes 2025/08/31 01:43:58 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/file11.txt 2025/08/31 01:43:58 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/file2.txt 2025/08/31 01:43:58 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/file4.txt 2025/08/31 01:43:58 NOTICE: - WARNING New or changed in both paths - file5.txt 2025/08/31 01:43:58 NOTICE: - Path1 Renaming Path1 copy - /tmp/014330xu/nomodtime/path1/file5.txt.conflict1 2025/08/31 01:43:58 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2025/08/31 01:43:58 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/file5.txt.conflict1 2025/08/31 01:43:58 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/file5.txt.conflict2 2025/08/31 01:43:58 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2025/08/31 01:43:58 NOTICE: - Path2 Queue copy to Path1 - /tmp/014330xu/nomodtime/path1/file5.txt.conflict2 2025/08/31 01:43:58 INFO : - Path2 Queue copy to Path1 - /tmp/014330xu/nomodtime/path1/file6.txt 2025/08/31 01:43:58 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/file7.txt 2025/08/31 01:43:58 INFO : - Path2 Queue copy to Path1 - /tmp/014330xu/nomodtime/path1/file1.txt 2025/08/31 01:43:58 INFO : - Path2 Queue copy to Path1 - /tmp/014330xu/nomodtime/path1/file10.txt 2025/08/31 01:43:58 INFO : - Path1 Queue delete - /tmp/014330xu/nomodtime/path1/file3.txt 2025/08/31 01:43:58 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:43:58 INFO : file10.txt: Copied (new) 2025/08/31 01:43:58 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:43:58 INFO : file5.txt.conflict2: Copied (new) 2025/08/31 01:43:58 INFO : file6.txt: Copied (new) 2025/08/31 01:43:58 INFO : file3.txt: Deleted 2025/08/31 01:43:58 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:43:58 INFO : file11.txt: Copied (new) 2025/08/31 01:43:58 INFO : file5.txt.conflict1: Copied (new) 2025/08/31 01:43:58 INFO : file7.txt: Copied (new) 2025/08/31 01:43:58 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:43:58 INFO : file4.txt: Deleted 2025/08/31 01:43:59 INFO : Updating listings 2025/08/31 01:43:59 INFO : Validating listings for Path1 "/tmp/014330xu/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/nomodtime/path2/" 2025/08/31 01:43:59 INFO : Bisync successful 2025/08/31 01:43:59 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:59 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:43:59 NOTICE: | @@ -16 +15,0 @@ 2025/08/31 01:43:59 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:59 NOTICE: | @@ -18 +16,0 @@ 2025/08/31 01:43:59 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:43:59 NOTICE: ---------------------------------------------------------- 2025/08/31 01:43:59 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:59 INFO : file11.txt: Deleted 2025/08/31 01:43:59 INFO : file6.txt: Deleted 2025/08/31 01:43:59 INFO : file7.txt: Deleted 2025/08/31 01:43:59 INFO : file2.txt: Deleted 2025/08/31 01:43:59 INFO : RCLONE_TEST: Deleted 2025/08/31 01:43:59 INFO : file10.txt: Deleted 2025/08/31 01:43:59 INFO : file1.txt: Deleted 2025/08/31 01:43:59 INFO : file5.txt.conflict1: Deleted 2025/08/31 01:43:59 INFO : file5.txt.conflict2: Deleted 2025/08/31 01:43:59 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:59 INFO : Local file system at /tmp/014330xu/nomodtime/path1: Removing directory 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/nomodtime/path2: purge [/rclone-test-riyipah4toci/014330xu/nomodtime/path2] bisync_test.go:597: TEST nomodtime FAILED - 1 MISCOMPARED FILES === RUN TestBisyncLocalRemote/rclone_args 2025/08/31 01:43:59 DEBUG : Creating backend with remote "/tmp/014330xu/rclone_args/path1" 2025/08/31 01:43:59 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-riyipah4toci/014330xu" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu" 2025/08/31 01:43:59 INFO : path2: Making directory 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu: mkdir [/rclone-test-riyipah4toci/014330xu/path2] 2025/08/31 01:43:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-riyipah4toci/014330xu/rclone_args/path2" 2025/08/31 01:43:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:43:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:43:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:43:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:43:59 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-riyipah4toci/014330xu/rclone_args/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2" 2025/08/31 01:43:59 DEBUG : Creating backend with remote "/tmp/014330xu/initdir/test_rclone_args-jurehuf6" 2025/08/31 01:43:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : subdir: Making directory with metadata 2025/08/31 01:43:59 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2025/08/31 01:43:59 DEBUG : Added delayed dir = "subdir", newDst=subdir 2025/08/31 01:43:59 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : Local file system at /tmp/014330xu/initdir/test_rclone_args-jurehuf6: Waiting for checks to finish 2025/08/31 01:43:59 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:59 DEBUG : Local file system at /tmp/014330xu/initdir/test_rclone_args-jurehuf6: Waiting for transfers to finish 2025/08/31 01:43:59 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:59 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:43:59 INFO : file2.txt: Copied (new) 2025/08/31 01:43:59 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2025/08/31 01:43:59 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:43:59 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:59 DEBUG : subdir/file21.txt.5028a97.partial: renamed to: subdir/file21.txt 2025/08/31 01:43:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:59 INFO : subdir/file21.txt: Copied (new) 2025/08/31 01:43:59 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:59 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2025/08/31 01:43:59 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:59 DEBUG : file1.txt.dae86b42.partial: renamed to: file1.txt 2025/08/31 01:43:59 INFO : file1.txt: Copied (new) 2025/08/31 01:43:59 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:59 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2" 2025/08/31 01:43:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : file21.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:59 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:59 DEBUG : file20.txt.b4075ff1.partial: renamed to: file20.txt 2025/08/31 01:43:59 INFO : file20.txt: Copied (new) 2025/08/31 01:43:59 DEBUG : Local file system at /tmp/014330xu/datadir/test_rclone_args-puwodew2: Waiting for checks to finish 2025/08/31 01:43:59 DEBUG : file21.txt.b4075ff1.partial: renamed to: file21.txt 2025/08/31 01:43:59 INFO : file21.txt: Copied (new) 2025/08/31 01:43:59 DEBUG : Local file system at /tmp/014330xu/datadir/test_rclone_args-puwodew2: Waiting for transfers to finish 2025/08/31 01:43:59 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:59 DEBUG : file1.txt.6bedbe24.partial: renamed to: file1.txt 2025/08/31 01:43:59 INFO : file1.txt: Copied (new) 2025/08/31 01:43:59 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:43:59 DEBUG : file2.txt.6bedbe24.partial: renamed to: file2.txt 2025/08/31 01:43:59 INFO : file2.txt: Copied (new) 2025/08/31 01:43:59 DEBUG : Waiting for deletions to finish 2025/08/31 01:43:59 ERROR : error listing: directory not found 2025/08/31 01:43:59 ERROR : Local file system at /tmp/014330xu/rclone_args/path1: Failed to list "": directory not found 2025/08/31 01:43:59 DEBUG : removing 1 level 0 directories 2025/08/31 01:43:59 INFO : Local file system at /tmp/014330xu/rclone_args/path1: Removing directory 2025/08/31 01:43:59 ERROR : Failed to rmdir: stat /tmp/014330xu/rclone_args/path1: no such file or directory 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: purge [/rclone-test-riyipah4toci/014330xu/rclone_args/path2] 2025/08/31 01:43:59 ERROR : error listing: directory not found 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: list [/rclone-test-riyipah4toci/014330xu/rclone_args/path2] 2025/08/31 01:43:59 ERROR : error listing: directory not found 2025/08/31 01:43:59 NOTICE: checking initFs Local file system at /tmp/014330xu/initdir/test_rclone_args-jurehuf6 2025/08/31 01:43:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : subdir: Making directory with metadata 2025/08/31 01:43:59 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2025/08/31 01:43:59 DEBUG : Added delayed dir = "subdir", newDst=subdir 2025/08/31 01:43:59 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : Local file system at /tmp/014330xu/rclone_args/path1: Waiting for checks to finish 2025/08/31 01:43:59 DEBUG : Local file system at /tmp/014330xu/rclone_args/path1: Waiting for transfers to finish 2025/08/31 01:43:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:43:59 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:59 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:43:59 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:59 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2025/08/31 01:43:59 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:43:59 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:59 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:43:59 INFO : file2.txt: Copied (new) 2025/08/31 01:43:59 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:43:59 DEBUG : subdir/file21.txt.5028a97.partial: renamed to: subdir/file21.txt 2025/08/31 01:43:59 INFO : subdir/file21.txt: Copied (new) 2025/08/31 01:43:59 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2025/08/31 01:43:59 DEBUG : file1.txt.dae86b42.partial: renamed to: file1.txt 2025/08/31 01:43:59 INFO : file1.txt: Copied (new) 2025/08/31 01:43:59 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:43:59 NOTICE: checking Path1 Local file system at /tmp/014330xu/rclone_args/path1 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: list [/rclone-test-riyipah4toci/014330xu/rclone_args/path2] 2025/08/31 01:43:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 INFO : subdir: Making directory 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: mkdir [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir] 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/file2.txt] 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/file1.txt] 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/RCLONE_TEST] 2025/08/31 01:43:59 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/file20.txt] 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: Waiting for checks to finish 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: Waiting for transfers to finish 2025/08/31 01:43:59 INFO : file2.txt: Copied (new) 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:43:59 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:43:59 INFO : file1.txt: Copied (new) 2025/08/31 01:43:59 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:43:59 INFO : subdir/file21.txt: Copied (new) 2025/08/31 01:43:59 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: list [/rclone-test-riyipah4toci/014330xu/rclone_args/path2] 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: list [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir] 2025/08/31 01:43:59 NOTICE: (01) : test rclone-args 2025/08/31 01:43:59 NOTICE: (02) : touch-glob 2001-01-02 /tmp/014330xu/datadir/test_rclone_args-puwodew2/ * 2025/08/31 01:43:59 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/" 2025/08/31 01:43:59 DEBUG : fs cache: renaming cache item "/tmp/014330xu/datadir/test_rclone_args-puwodew2/" to be canonical "/tmp/014330xu/datadir/test_rclone_args-puwodew2" 2025/08/31 01:43:59 DEBUG : file21.txt: Set modification time 2001-01-02 2025/08/31 01:43:59 DEBUG : file1.txt: Set modification time 2001-01-02 2025/08/31 01:43:59 DEBUG : file2.txt: Set modification time 2001-01-02 2025/08/31 01:43:59 DEBUG : file20.txt: Set modification time 2001-01-02 2025/08/31 01:43:59 NOTICE: (03) : test initial bisync 2025/08/31 01:43:59 NOTICE: (04) : bisync resync checksum 2025/08/31 01:43:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: remove [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:01 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:44:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:01 NOTICE: Local file system at /tmp/014330xu/rclone_args/path1: will use md5 for same-side diffs on Path1 only 2025/08/31 01:44:01 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:44:01 INFO : Synching Path1 "/tmp/014330xu/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:01 INFO : Copying Path2 files to Path1 2025/08/31 01:44:01 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:44:01 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:44:01 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:44:01 INFO : Resync updating listings 2025/08/31 01:44:01 INFO : Validating listings for Path1 "/tmp/014330xu/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:01 INFO : Bisync successful 2025/08/31 01:44:01 NOTICE: (05) : test place newer files on both paths 2025/08/31 01:44:01 NOTICE: (06) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file1.txt /tmp/014330xu/rclone_args/path1/ 2025/08/31 01:44:01 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file1.txt" to "/tmp/014330xu/rclone_args/path1/" as "" 2025/08/31 01:44:01 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file1.txt" 2025/08/31 01:44:01 DEBUG : Creating backend with remote "/tmp/014330xu/rclone_args/path1/" 2025/08/31 01:44:01 DEBUG : operations.CopyFile "file1.txt" to "Local file system at /tmp/014330xu/rclone_args/path1" as "file1.txt" 2025/08/31 01:44:01 DEBUG : file1.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:44:01 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 (Local file system at /tmp/014330xu/datadir/test_rclone_args-puwodew2) 2025/08/31 01:44:01 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c (Local file system at /tmp/014330xu/rclone_args/path1) 2025/08/31 01:44:01 DEBUG : file1.txt: md5 differ 2025/08/31 01:44:01 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:44:01 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt 2025/08/31 01:44:01 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:44:01 NOTICE: (07) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/ 2025/08/31 01:44:01 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file2.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" as "" 2025/08/31 01:44:01 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file2.txt" 2025/08/31 01:44:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:01 DEBUG : operations.CopyFile "file2.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/" as "file2.txt" 2025/08/31 01:44:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: new [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/file2.txt] 2025/08/31 01:44:01 DEBUG : file2.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:44:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/file2.txt] 2025/08/31 01:44:01 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:44:01 NOTICE: (08) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file20.txt /tmp/014330xu/rclone_args/path1/subdir 2025/08/31 01:44:01 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file20.txt" to "/tmp/014330xu/rclone_args/path1/subdir" as "" 2025/08/31 01:44:01 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file20.txt" 2025/08/31 01:44:01 DEBUG : Creating backend with remote "/tmp/014330xu/rclone_args/path1/subdir" 2025/08/31 01:44:01 DEBUG : operations.CopyFile "file20.txt" to "Local file system at /tmp/014330xu/rclone_args/path1/subdir" as "file20.txt" 2025/08/31 01:44:01 DEBUG : file20.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:44:01 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:01 INFO : file20.txt: Updated modification time in destination 2025/08/31 01:44:01 DEBUG : file20.txt: Unchanged skipping 2025/08/31 01:44:01 NOTICE: (09) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir 2025/08/31 01:44:01 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir" as "" 2025/08/31 01:44:01 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt" 2025/08/31 01:44:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir" 2025/08/31 01:44:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:01 DEBUG : operations.CopyFile "file21.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir" as "file21.txt" 2025/08/31 01:44:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir: new [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:44:01 DEBUG : file21.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:44:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:44:01 INFO : file21.txt: Copied (replaced existing) 2025/08/31 01:44:01 NOTICE: (10) : touch-glob 2001-01-02 /tmp/014330xu/rclone_args/path1/ file1.txt 2025/08/31 01:44:01 DEBUG : Creating backend with remote "/tmp/014330xu/rclone_args/path1/" 2025/08/31 01:44:01 DEBUG : fs cache: renaming cache item "/tmp/014330xu/rclone_args/path1/" to be canonical "/tmp/014330xu/rclone_args/path1" 2025/08/31 01:44:01 DEBUG : file1.txt: Set modification time 2001-01-02 2025/08/31 01:44:01 NOTICE: (11) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/ file2.txt 2025/08/31 01:44:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:01 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" to be canonical "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: list [/rclone-test-riyipah4toci/014330xu/rclone_args/path2] 2025/08/31 01:44:01 DEBUG : file2.txt: Set modification time 2001-01-02 2025/08/31 01:44:01 NOTICE: (12) : touch-glob 2001-01-02 /tmp/014330xu/rclone_args/path1/subdir/ file20.txt 2025/08/31 01:44:01 DEBUG : Creating backend with remote "/tmp/014330xu/rclone_args/path1/subdir/" 2025/08/31 01:44:01 DEBUG : fs cache: renaming cache item "/tmp/014330xu/rclone_args/path1/subdir/" to be canonical "/tmp/014330xu/rclone_args/path1/subdir" 2025/08/31 01:44:01 DEBUG : file20.txt: Set modification time 2001-01-02 2025/08/31 01:44:01 NOTICE: (13) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/ file21.txt 2025/08/31 01:44:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/" 2025/08/31 01:44:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:01 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/" to be canonical "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/" 2025/08/31 01:44:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/: list [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir] 2025/08/31 01:44:01 DEBUG : file21.txt: Set modification time 2001-01-02 2025/08/31 01:44:01 NOTICE: (14) : test run bisync with custom options 2025/08/31 01:44:01 NOTICE: (15) : bisync checksum 2025/08/31 01:44:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: remove [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:03 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:44:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:03 NOTICE: Local file system at /tmp/014330xu/rclone_args/path1: will use md5 for same-side diffs on Path1 only 2025/08/31 01:44:03 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:44:03 INFO : Synching Path1 "/tmp/014330xu/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:03 INFO : Building Path1 and Path2 listings 2025/08/31 01:44:03 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:44:03 INFO : Path1 checking for diffs 2025/08/31 01:44:03 INFO : - Path1 File changed: hash - file1.txt 2025/08/31 01:44:03 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2025/08/31 01:44:03 INFO : (Modified:  1 hash differs) 2025/08/31 01:44:03 INFO : Path2 checking for diffs 2025/08/31 01:44:03 INFO : - Path2 File changed: size (larger), hash - file2.txt 2025/08/31 01:44:03 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2025/08/31 01:44:03 INFO : (Modified:  1 larger,  0 smaller,  1 hash differs) 2025/08/31 01:44:03 INFO : Applying changes 2025/08/31 01:44:03 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/file1.txt 2025/08/31 01:44:03 INFO : - Path2 Queue copy to Path1 - /tmp/014330xu/rclone_args/path1/file2.txt 2025/08/31 01:44:03 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:44:03 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:44:03 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:44:03 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:44:03 INFO : Updating listings 2025/08/31 01:44:03 INFO : Validating listings for Path1 "/tmp/014330xu/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:03 INFO : Bisync successful 2025/08/31 01:44:03 NOTICE: (16) : touch-glob 2007-07-23 /tmp/014330xu/datadir/test_rclone_args-puwodew2/ * 2025/08/31 01:44:03 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/datadir/test_rclone_args-puwodew2/" for canonical name "/tmp/014330xu/datadir/test_rclone_args-puwodew2" 2025/08/31 01:44:03 DEBUG : file21.txt: Set modification time 2007-07-23 2025/08/31 01:44:03 DEBUG : file1.txt: Set modification time 2007-07-23 2025/08/31 01:44:03 DEBUG : file2.txt: Set modification time 2007-07-23 2025/08/31 01:44:03 DEBUG : file20.txt: Set modification time 2007-07-23 2025/08/31 01:44:03 NOTICE: (17) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file1.txt /tmp/014330xu/rclone_args/path1/ 2025/08/31 01:44:03 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file1.txt" to "/tmp/014330xu/rclone_args/path1/" as "" 2025/08/31 01:44:03 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file1.txt" 2025/08/31 01:44:03 DEBUG : Creating backend with remote "/tmp/014330xu/rclone_args/path1/" 2025/08/31 01:44:03 DEBUG : operations.CopyFile "file1.txt" to "Local file system at /tmp/014330xu/rclone_args/path1" as "file1.txt" 2025/08/31 01:44:03 DEBUG : file1.txt: Modification times differ by -57432h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2001-01-02 00:00:00 +0000 UTC 2025/08/31 01:44:03 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:44:03 INFO : file1.txt: Updated modification time in destination 2025/08/31 01:44:03 DEBUG : file1.txt: Unchanged skipping 2025/08/31 01:44:03 NOTICE: (18) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/ 2025/08/31 01:44:03 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file2.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" as "" 2025/08/31 01:44:03 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file2.txt" 2025/08/31 01:44:03 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:03 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:03 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:03 DEBUG : operations.CopyFile "file2.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/" as "file2.txt" 2025/08/31 01:44:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: new [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/file2.txt] 2025/08/31 01:44:03 DEBUG : file2.txt: Modification times differ by -57432h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2001-01-02 00:00:00 +0000 UTC 2025/08/31 01:44:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/file2.txt] 2025/08/31 01:44:03 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:44:03 NOTICE: (19) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file20.txt /tmp/014330xu/rclone_args/path1/subdir 2025/08/31 01:44:03 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file20.txt" to "/tmp/014330xu/rclone_args/path1/subdir" as "" 2025/08/31 01:44:03 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file20.txt" 2025/08/31 01:44:03 DEBUG : Creating backend with remote "/tmp/014330xu/rclone_args/path1/subdir" 2025/08/31 01:44:03 DEBUG : operations.CopyFile "file20.txt" to "Local file system at /tmp/014330xu/rclone_args/path1/subdir" as "file20.txt" 2025/08/31 01:44:03 DEBUG : file20.txt: Modification times differ by -57432h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2001-01-02 00:00:00 +0000 UTC 2025/08/31 01:44:03 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:03 INFO : file20.txt: Updated modification time in destination 2025/08/31 01:44:03 DEBUG : file20.txt: Unchanged skipping 2025/08/31 01:44:03 NOTICE: (20) : copy-as /tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/ file1.txt 2025/08/31 01:44:03 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" as "file1.txt" 2025/08/31 01:44:03 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt" 2025/08/31 01:44:03 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:03 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:03 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:03 DEBUG : operations.CopyFile "file21.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/" as "file1.txt" 2025/08/31 01:44:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: new [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/file1.txt] 2025/08/31 01:44:03 DEBUG : file21.txt: Sizes differ (src 0 vs dst 19) 2025/08/31 01:44:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/file1.txt] 2025/08/31 01:44:03 INFO : file21.txt: Copied (replaced existing) to: file1.txt 2025/08/31 01:44:03 NOTICE: (21) : touch-glob 2007-07-23 /tmp/014330xu/rclone_args/path1/ file1.txt 2025/08/31 01:44:03 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/rclone_args/path1/" for canonical name "/tmp/014330xu/rclone_args/path1" 2025/08/31 01:44:03 DEBUG : file1.txt: Set modification time 2007-07-23 2025/08/31 01:44:03 NOTICE: (22) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/ file2.txt 2025/08/31 01:44:03 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: list [/rclone-test-riyipah4toci/014330xu/rclone_args/path2] 2025/08/31 01:44:03 DEBUG : file2.txt: Set modification time 2007-07-23 2025/08/31 01:44:03 NOTICE: (23) : touch-glob 2007-07-23 /tmp/014330xu/rclone_args/path1/subdir/ file20.txt 2025/08/31 01:44:03 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/rclone_args/path1/subdir/" for canonical name "/tmp/014330xu/rclone_args/path1/subdir" 2025/08/31 01:44:03 DEBUG : file20.txt: Set modification time 2007-07-23 2025/08/31 01:44:03 NOTICE: (24) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/ file21.txt 2025/08/31 01:44:03 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/" 2025/08/31 01:44:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/: list [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir] 2025/08/31 01:44:03 DEBUG : file21.txt: Set modification time 2007-07-23 2025/08/31 01:44:03 NOTICE: (25) : bisync size-only 2025/08/31 01:44:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: remove [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:05 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:44:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:44:05 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:44:05 INFO : Synching Path1 "/tmp/014330xu/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:05 INFO : Building Path1 and Path2 listings 2025/08/31 01:44:05 INFO : Path1 checking for diffs 2025/08/31 01:44:05 INFO : Path2 checking for diffs 2025/08/31 01:44:05 INFO : - Path2 File changed: size (smaller) - file1.txt 2025/08/31 01:44:05 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2025/08/31 01:44:05 INFO : (Modified:  0 larger,  1 smaller) 2025/08/31 01:44:05 INFO : Applying changes 2025/08/31 01:44:05 INFO : - Path2 Queue copy to Path1 - /tmp/014330xu/rclone_args/path1/file1.txt 2025/08/31 01:44:05 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:44:05 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:44:05 INFO : Updating listings 2025/08/31 01:44:05 INFO : Validating listings for Path1 "/tmp/014330xu/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:05 INFO : Bisync successful 2025/08/31 01:44:05 NOTICE: (26) : bisync resync 2025/08/31 01:44:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: remove [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:07 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:44:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:07 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:44:07 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:44:07 INFO : Synching Path1 "/tmp/014330xu/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:07 INFO : Copying Path2 files to Path1 2025/08/31 01:44:07 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:44:07 INFO : There was nothing to transfer 2025/08/31 01:44:07 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:44:07 INFO : subdir/file20.txt: Copied (replaced existing) 2025/08/31 01:44:07 INFO : subdir/file21.txt: Copied (replaced existing) 2025/08/31 01:44:07 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:44:07 INFO : Resync updating listings 2025/08/31 01:44:07 INFO : Validating listings for Path1 "/tmp/014330xu/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:07 INFO : Bisync successful 2025/08/31 01:44:07 NOTICE: (27) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file1.txt /tmp/014330xu/rclone_args/path1/ 2025/08/31 01:44:07 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file1.txt" to "/tmp/014330xu/rclone_args/path1/" as "" 2025/08/31 01:44:07 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file1.txt" 2025/08/31 01:44:07 DEBUG : Creating backend with remote "/tmp/014330xu/rclone_args/path1/" 2025/08/31 01:44:07 DEBUG : operations.CopyFile "file1.txt" to "Local file system at /tmp/014330xu/rclone_args/path1" as "file1.txt" 2025/08/31 01:44:07 DEBUG : file1.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:44:07 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:44:07 DEBUG : file1.txt.c1eb15ef.partial: renamed to: file1.txt 2025/08/31 01:44:07 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:44:07 NOTICE: (28) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/ 2025/08/31 01:44:07 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file2.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" as "" 2025/08/31 01:44:07 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file2.txt" 2025/08/31 01:44:07 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:07 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:07 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:07 DEBUG : operations.CopyFile "file2.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/" as "file2.txt" 2025/08/31 01:44:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: new [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/file2.txt] 2025/08/31 01:44:07 DEBUG : file2.txt: Modification times differ by -57432h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2001-01-02 00:00:00 +0000 UTC 2025/08/31 01:44:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/file2.txt] 2025/08/31 01:44:07 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:44:07 NOTICE: (29) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file20.txt /tmp/014330xu/rclone_args/path1/subdir 2025/08/31 01:44:07 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file20.txt" to "/tmp/014330xu/rclone_args/path1/subdir" as "" 2025/08/31 01:44:07 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file20.txt" 2025/08/31 01:44:07 DEBUG : Creating backend with remote "/tmp/014330xu/rclone_args/path1/subdir" 2025/08/31 01:44:07 DEBUG : operations.CopyFile "file20.txt" to "Local file system at /tmp/014330xu/rclone_args/path1/subdir" as "file20.txt" 2025/08/31 01:44:07 DEBUG : file20.txt: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/08/31 01:44:07 DEBUG : file20.txt: Unchanged skipping 2025/08/31 01:44:07 NOTICE: (30) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir 2025/08/31 01:44:07 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir" as "" 2025/08/31 01:44:07 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt" 2025/08/31 01:44:07 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir" 2025/08/31 01:44:07 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:07 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:07 DEBUG : operations.CopyFile "file21.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir" as "file21.txt" 2025/08/31 01:44:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir: new [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:44:07 DEBUG : file21.txt: Modification times differ by -66240h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:44:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:44:07 INFO : file21.txt: Copied (replaced existing) 2025/08/31 01:44:07 NOTICE: (31) : touch-glob 2007-07-23 /tmp/014330xu/rclone_args/path1/ file1.txt 2025/08/31 01:44:07 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/rclone_args/path1/" for canonical name "/tmp/014330xu/rclone_args/path1" 2025/08/31 01:44:07 DEBUG : file1.txt: Set modification time 2007-07-23 2025/08/31 01:44:07 NOTICE: (32) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/ file2.txt 2025/08/31 01:44:07 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: list [/rclone-test-riyipah4toci/014330xu/rclone_args/path2] 2025/08/31 01:44:07 DEBUG : file2.txt: Set modification time 2007-07-23 2025/08/31 01:44:07 NOTICE: (33) : touch-glob 2007-07-23 /tmp/014330xu/rclone_args/path1/subdir/ file20.txt 2025/08/31 01:44:07 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/rclone_args/path1/subdir/" for canonical name "/tmp/014330xu/rclone_args/path1/subdir" 2025/08/31 01:44:07 DEBUG : file20.txt: Set modification time 2007-07-23 2025/08/31 01:44:07 NOTICE: (34) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/ file21.txt 2025/08/31 01:44:07 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/" 2025/08/31 01:44:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/: list [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir] 2025/08/31 01:44:07 DEBUG : file21.txt: Set modification time 2007-07-23 2025/08/31 01:44:07 NOTICE: (35) : bisync ignore-size 2025/08/31 01:44:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: remove [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:09 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:44:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:44:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": false, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2025/08/31 01:44:09 INFO : Synching Path1 "/tmp/014330xu/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:09 INFO : Building Path1 and Path2 listings 2025/08/31 01:44:09 INFO : Path1 checking for diffs 2025/08/31 01:44:09 INFO : Path2 checking for diffs 2025/08/31 01:44:09 INFO : - Path2 File changed: time (newer) - file2.txt 2025/08/31 01:44:09 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2025/08/31 01:44:09 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2025/08/31 01:44:09 INFO : (Modified:  2 newer,  0 older) 2025/08/31 01:44:09 INFO : Applying changes 2025/08/31 01:44:09 INFO : - Path2 Queue copy to Path1 - /tmp/014330xu/rclone_args/path1/file2.txt 2025/08/31 01:44:09 INFO : - Path2 Queue copy to Path1 - /tmp/014330xu/rclone_args/path1/subdir/file21.txt 2025/08/31 01:44:09 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:44:09 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:44:09 INFO : subdir/file21.txt: Copied (replaced existing) 2025/08/31 01:44:09 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:44:09 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:44:09 INFO : Updating listings 2025/08/31 01:44:09 INFO : Validating listings for Path1 "/tmp/014330xu/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:09 INFO : Bisync successful 2025/08/31 01:44:09 NOTICE: (36) : bisync resync compare-all 2025/08/31 01:44:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: remove [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:11 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:44:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:11 NOTICE: Local file system at /tmp/014330xu/rclone_args/path1: will use md5 for same-side diffs on Path1 only 2025/08/31 01:44:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:44:11 INFO : Synching Path1 "/tmp/014330xu/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:11 INFO : Copying Path2 files to Path1 2025/08/31 01:44:11 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:44:11 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:44:11 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:44:11 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:44:11 INFO : Resync updating listings 2025/08/31 01:44:11 INFO : Validating listings for Path1 "/tmp/014330xu/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:11 INFO : Bisync successful 2025/08/31 01:44:11 NOTICE: (37) : copy-as /tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/ file2.txt 2025/08/31 01:44:11 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" as "file2.txt" 2025/08/31 01:44:11 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt" 2025/08/31 01:44:11 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:11 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:11 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:11 DEBUG : operations.CopyFile "file21.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/" as "file2.txt" 2025/08/31 01:44:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: new [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/file2.txt] 2025/08/31 01:44:11 DEBUG : file21.txt: Sizes differ (src 0 vs dst 19) 2025/08/31 01:44:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/file2.txt] 2025/08/31 01:44:11 INFO : file21.txt: Copied (replaced existing) to: file2.txt 2025/08/31 01:44:11 NOTICE: (38) : touch-glob 2023-08-26 /tmp/014330xu/datadir/test_rclone_args-puwodew2/ * 2025/08/31 01:44:11 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/datadir/test_rclone_args-puwodew2/" for canonical name "/tmp/014330xu/datadir/test_rclone_args-puwodew2" 2025/08/31 01:44:11 DEBUG : file21.txt: Set modification time 2023-08-26 2025/08/31 01:44:11 DEBUG : file1.txt: Set modification time 2023-08-26 2025/08/31 01:44:11 DEBUG : file2.txt: Set modification time 2023-08-26 2025/08/31 01:44:11 DEBUG : file20.txt: Set modification time 2023-08-26 2025/08/31 01:44:11 NOTICE: (39) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file1.txt /tmp/014330xu/rclone_args/path1/ 2025/08/31 01:44:11 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file1.txt" to "/tmp/014330xu/rclone_args/path1/" as "" 2025/08/31 01:44:11 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file1.txt" 2025/08/31 01:44:11 DEBUG : Creating backend with remote "/tmp/014330xu/rclone_args/path1/" 2025/08/31 01:44:11 DEBUG : operations.CopyFile "file1.txt" to "Local file system at /tmp/014330xu/rclone_args/path1" as "file1.txt" 2025/08/31 01:44:11 DEBUG : file1.txt: Modification times differ by -141072h0m0s: 2023-08-26 00:00:00 +0000 UTC, 2007-07-23 00:00:00 +0000 UTC 2025/08/31 01:44:11 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:44:11 INFO : file1.txt: Updated modification time in destination 2025/08/31 01:44:11 DEBUG : file1.txt: Unchanged skipping 2025/08/31 01:44:11 NOTICE: (40) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file20.txt /tmp/014330xu/rclone_args/path1/subdir 2025/08/31 01:44:11 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file20.txt" to "/tmp/014330xu/rclone_args/path1/subdir" as "" 2025/08/31 01:44:11 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file20.txt" 2025/08/31 01:44:11 DEBUG : Creating backend with remote "/tmp/014330xu/rclone_args/path1/subdir" 2025/08/31 01:44:11 DEBUG : operations.CopyFile "file20.txt" to "Local file system at /tmp/014330xu/rclone_args/path1/subdir" as "file20.txt" 2025/08/31 01:44:11 DEBUG : file20.txt: Modification times differ by -141072h0m0s: 2023-08-26 00:00:00 +0000 UTC, 2007-07-23 00:00:00 +0000 UTC 2025/08/31 01:44:11 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:11 INFO : file20.txt: Updated modification time in destination 2025/08/31 01:44:11 DEBUG : file20.txt: Unchanged skipping 2025/08/31 01:44:11 NOTICE: (41) : copy-file /tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir 2025/08/31 01:44:11 DEBUG : copyFile "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir" as "" 2025/08/31 01:44:11 DEBUG : Creating backend with remote "/tmp/014330xu/datadir/test_rclone_args-puwodew2/file21.txt" 2025/08/31 01:44:11 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir" 2025/08/31 01:44:11 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:11 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:11 DEBUG : operations.CopyFile "file21.txt" to "hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir" as "file21.txt" 2025/08/31 01:44:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir: new [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:44:11 DEBUG : file21.txt: Modification times differ by -141072h0m0s: 2023-08-26 00:00:00 +0000 UTC, 2007-07-23 00:00:00 +0000 UTC 2025/08/31 01:44:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:44:11 INFO : file21.txt: Copied (replaced existing) 2025/08/31 01:44:11 NOTICE: (42) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/ file2.txt 2025/08/31 01:44:11 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/: list [/rclone-test-riyipah4toci/014330xu/rclone_args/path2] 2025/08/31 01:44:11 DEBUG : file2.txt: Set modification time 2007-07-23 2025/08/31 01:44:11 NOTICE: (43) : touch-glob 2023-08-26 /tmp/014330xu/rclone_args/path1/ file1.txt 2025/08/31 01:44:11 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/rclone_args/path1/" for canonical name "/tmp/014330xu/rclone_args/path1" 2025/08/31 01:44:11 DEBUG : file1.txt: Set modification time 2023-08-26 2025/08/31 01:44:11 NOTICE: (44) : touch-glob 2023-08-26 /tmp/014330xu/rclone_args/path1/subdir/ file20.txt 2025/08/31 01:44:11 DEBUG : fs cache: switching user supplied name "/tmp/014330xu/rclone_args/path1/subdir/" for canonical name "/tmp/014330xu/rclone_args/path1/subdir" 2025/08/31 01:44:11 DEBUG : file20.txt: Set modification time 2023-08-26 2025/08/31 01:44:11 NOTICE: (45) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/ file21.txt 2025/08/31 01:44:11 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/" for canonical name "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/" 2025/08/31 01:44:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/: list [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir] 2025/08/31 01:44:11 DEBUG : file21.txt: Set modification time 2023-08-26 2025/08/31 01:44:11 NOTICE: (46) : bisync compare-all 2025/08/31 01:44:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: update [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: remove [/rclone-test-riyipah4toci/014330xu/rclone_args/path2/modtime_write_test] 2025/08/31 01:44:13 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:44:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:13 NOTICE: Local file system at /tmp/014330xu/rclone_args/path1: will use md5 for same-side diffs on Path1 only 2025/08/31 01:44:13 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2025/08/31 01:44:13 INFO : Synching Path1 "/tmp/014330xu/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:13 INFO : Building Path1 and Path2 listings 2025/08/31 01:44:13 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:44:13 INFO : Path1 checking for diffs 2025/08/31 01:44:13 INFO : - Path1 File changed: time (newer) - file1.txt 2025/08/31 01:44:13 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2025/08/31 01:44:13 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2025/08/31 01:44:13 INFO : (Modified:  2 newer,  0 older) 2025/08/31 01:44:13 INFO : Path2 checking for diffs 2025/08/31 01:44:13 INFO : - Path2 File changed: size (smaller), hash - file2.txt 2025/08/31 01:44:13 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2025/08/31 01:44:13 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2025/08/31 01:44:13 INFO : (Modified:  1 newer,  0 older,  0 larger,  1 smaller,  1 hash differs) 2025/08/31 01:44:13 INFO : Applying changes 2025/08/31 01:44:13 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/file1.txt 2025/08/31 01:44:13 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/subdir/file20.txt 2025/08/31 01:44:13 INFO : - Path2 Queue copy to Path1 - /tmp/014330xu/rclone_args/path1/file2.txt 2025/08/31 01:44:13 INFO : - Path2 Queue copy to Path1 - /tmp/014330xu/rclone_args/path1/subdir/file21.txt 2025/08/31 01:44:13 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:44:13 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:44:13 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:44:13 INFO : subdir/file21.txt: Copied (replaced existing) 2025/08/31 01:44:13 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:44:13 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:44:13 INFO : subdir/file20.txt: Copied (replaced existing) 2025/08/31 01:44:13 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:44:13 INFO : Updating listings 2025/08/31 01:44:13 INFO : Validating listings for Path1 "/tmp/014330xu/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-riyipah4toci/014330xu/rclone_args/path2/" 2025/08/31 01:44:13 INFO : Bisync successful 2025/08/31 01:44:14 NOTICE: ---------------------------------------------------------- 2025/08/31 01:44:14 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:44:14 NOTICE: | @@ -17 +16,0 @@ 2025/08/31 01:44:14 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:44:14 NOTICE: | @@ -19 +17,0 @@ 2025/08/31 01:44:14 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:44:14 NOTICE: | @@ -110 +107,0 @@ 2025/08/31 01:44:14 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:44:14 NOTICE: | @@ -145 +141,0 @@ 2025/08/31 01:44:14 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:44:14 NOTICE: | @@ -162 +157,0 @@ 2025/08/31 01:44:14 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:44:14 NOTICE: ---------------------------------------------------------- 2025/08/31 01:44:14 DEBUG : Waiting for deletions to finish 2025/08/31 01:44:14 INFO : file1.txt: Deleted 2025/08/31 01:44:14 INFO : RCLONE_TEST: Deleted 2025/08/31 01:44:14 INFO : file2.txt: Deleted 2025/08/31 01:44:14 INFO : subdir/file20.txt: Deleted 2025/08/31 01:44:14 INFO : subdir/file21.txt: Deleted 2025/08/31 01:44:14 DEBUG : removing 1 level 1 directories 2025/08/31 01:44:14 INFO : subdir: Removing directory 2025/08/31 01:44:14 DEBUG : removing 1 level 0 directories 2025/08/31 01:44:14 INFO : Local file system at /tmp/014330xu/rclone_args/path1: Removing directory 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci/014330xu/rclone_args/path2: purge [/rclone-test-riyipah4toci/014330xu/rclone_args/path2] bisync_test.go:597: TEST rclone_args FAILED - 1 MISCOMPARED FILES 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci: Purge remote 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-riyipah4toci: purge [/rclone-test-riyipah4toci] --- FAIL: TestBisyncLocalRemote (43.90s) --- FAIL: TestBisyncLocalRemote/all_changed (8.75s) --- FAIL: TestBisyncLocalRemote/compare_all (4.72s) --- FAIL: TestBisyncLocalRemote/createemptysrcdirs (14.77s) --- FAIL: TestBisyncLocalRemote/nomodtime (0.62s) --- FAIL: TestBisyncLocalRemote/rclone_args (15.02s) === RUN TestBisyncRemoteRemote 2025/08/31 01:44:14 DEBUG : Creating backend with remote "TestHdfs:rclone-test-qasofaq0pisu" 2025/08/31 01:44:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:14 NOTICE: remote: TestHdfs:rclone-test-qasofaq0pisu === RUN TestBisyncRemoteRemote/all_changed 2025/08/31 01:44:14 DEBUG : Creating backend with remote "TestHdfs:rclone-test-qasofaq0pisu/014414fa" 2025/08/31 01:44:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:14 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-qasofaq0pisu/014414fa" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa" 2025/08/31 01:44:14 INFO : path1: Making directory 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa: mkdir [/rclone-test-qasofaq0pisu/014414fa/path1] 2025/08/31 01:44:14 DEBUG : Creating backend with remote "TestHdfs:rclone-test-qasofaq0pisu/014414fa/all_changed/path1" 2025/08/31 01:44:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:14 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-qasofaq0pisu/014414fa/all_changed/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1" 2025/08/31 01:44:14 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-qasofaq0pisu/014414fa" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa" 2025/08/31 01:44:14 INFO : path2: Making directory 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa: mkdir [/rclone-test-qasofaq0pisu/014414fa/path2] 2025/08/31 01:44:14 DEBUG : Creating backend with remote "TestHdfs:rclone-test-qasofaq0pisu/014414fa/all_changed/path2" 2025/08/31 01:44:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:14 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-qasofaq0pisu/014414fa/all_changed/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2" 2025/08/31 01:44:14 DEBUG : Creating backend with remote "/tmp/014414fa/initdir/test_all_changed-rakesid9" 2025/08/31 01:44:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:14 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt 2025/08/31 01:44:14 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:44:14 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : subdir: Making directory with metadata 2025/08/31 01:44:14 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:44:14 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:44:14 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:14 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt 2025/08/31 01:44:14 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:14 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt 2025/08/31 01:44:14 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:44:14 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2025/08/31 01:44:14 DEBUG : Added delayed dir = "subdir", newDst=subdir 2025/08/31 01:44:14 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:14 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:44:14 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt 2025/08/31 01:44:14 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:44:14 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:44:14 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:14 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:14 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt 2025/08/31 01:44:14 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:44:14 INFO : file1.txt: Copied (new) 2025/08/31 01:44:14 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:44:14 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:14 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2025/08/31 01:44:14 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:44:14 DEBUG : Local file system at /tmp/014414fa/initdir/test_all_changed-rakesid9: Waiting for checks to finish 2025/08/31 01:44:14 DEBUG : Local file system at /tmp/014414fa/initdir/test_all_changed-rakesid9: Waiting for transfers to finish 2025/08/31 01:44:14 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: purge [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: purge [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: list [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1] 2025/08/31 01:44:14 ERROR : error listing: directory not found 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: list [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2] 2025/08/31 01:44:14 ERROR : error listing: directory not found 2025/08/31 01:44:14 NOTICE: checking initFs Local file system at /tmp/014414fa/initdir/test_all_changed-rakesid9 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: list [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1] 2025/08/31 01:44:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 INFO : subdir: Making directory 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: mkdir [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/RCLONE_TEST] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/file1.copy3.txt] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/file1.copy1.txt] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/file1.copy2.txt] 2025/08/31 01:44:14 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: Waiting for checks to finish 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: Waiting for transfers to finish 2025/08/31 01:44:14 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/file1.copy4.txt] 2025/08/31 01:44:14 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/file1.copy5.txt] 2025/08/31 01:44:14 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/file1.txt] 2025/08/31 01:44:14 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir/file20.txt] 2025/08/31 01:44:14 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:44:14 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:44:14 INFO : file1.txt: Copied (new) 2025/08/31 01:44:14 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:44:14 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: list [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: list [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: list [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2] 2025/08/31 01:44:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 INFO : subdir: Making directory 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: mkdir [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/subdir] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/RCLONE_TEST] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy1.txt] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy2.txt] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy3.txt] 2025/08/31 01:44:14 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: Waiting for checks to finish 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: Waiting for transfers to finish 2025/08/31 01:44:14 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy4.txt] 2025/08/31 01:44:14 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy5.txt] 2025/08/31 01:44:14 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.txt] 2025/08/31 01:44:14 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/subdir/file20.txt] 2025/08/31 01:44:14 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:44:14 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:44:14 INFO : file1.txt: Copied (new) 2025/08/31 01:44:14 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:44:14 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: list [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2] 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: list [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/subdir] 2025/08/31 01:44:14 NOTICE: (01) : test all-changed 2025/08/31 01:44:14 NOTICE: (02) : test initial bisync 2025/08/31 01:44:14 NOTICE: (03) : bisync resync 2025/08/31 01:44:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/modtime_write_test] 2025/08/31 01:44:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: remove [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/modtime_write_test] 2025/08/31 01:44:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/modtime_write_test] 2025/08/31 01:44:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: remove [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/modtime_write_test] 2025/08/31 01:44:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:18 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:44:18 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:44:18 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/" 2025/08/31 01:44:18 INFO : Copying Path2 files to Path1 2025/08/31 01:44:18 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:44:18 INFO : There was nothing to transfer 2025/08/31 01:44:18 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:44:18 INFO : There was nothing to transfer 2025/08/31 01:44:18 INFO : Resync updating listings 2025/08/31 01:44:18 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/" 2025/08/31 01:44:18 INFO : Bisync successful 2025/08/31 01:44:18 NOTICE: (04) : test change timestamp on all files except RCLONE_TEST 2025/08/31 01:44:18 NOTICE: (05) : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/all_changed/path1/ file* 2025/08/31 01:44:18 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/all_changed/path1/" 2025/08/31 01:44:18 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:18 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:18 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/all_changed/path1/" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1/" 2025/08/31 01:44:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/: list [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1] 2025/08/31 01:44:18 DEBUG : file1.copy1.txt: Set modification time 2005-01-02 2025/08/31 01:44:18 DEBUG : file1.copy2.txt: Set modification time 2005-01-02 2025/08/31 01:44:18 DEBUG : file1.copy3.txt: Set modification time 2005-01-02 2025/08/31 01:44:18 DEBUG : file1.copy4.txt: Set modification time 2005-01-02 2025/08/31 01:44:18 DEBUG : file1.copy5.txt: Set modification time 2005-01-02 2025/08/31 01:44:18 DEBUG : file1.txt: Set modification time 2005-01-02 2025/08/31 01:44:18 NOTICE: (06) : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir file* 2025/08/31 01:44:18 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir" 2025/08/31 01:44:18 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:18 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:18 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir" 2025/08/31 01:44:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir: list [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir] 2025/08/31 01:44:18 DEBUG : file20.txt: Set modification time 2005-01-02 2025/08/31 01:44:18 NOTICE: (07) : test sync should pass 2025/08/31 01:44:18 NOTICE: (08) : bisync 2025/08/31 01:44:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/modtime_write_test] 2025/08/31 01:44:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: remove [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/modtime_write_test] 2025/08/31 01:44:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/modtime_write_test] 2025/08/31 01:44:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: remove [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/modtime_write_test] 2025/08/31 01:44:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:22 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:44:22 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:44:22 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/" 2025/08/31 01:44:22 INFO : Building Path1 and Path2 listings 2025/08/31 01:44:22 INFO : Path1 checking for diffs 2025/08/31 01:44:22 INFO : - Path1 File changed: time (newer) - file1.copy1.txt 2025/08/31 01:44:22 INFO : - Path1 File changed: time (newer) - file1.copy2.txt 2025/08/31 01:44:22 INFO : - Path1 File changed: time (newer) - file1.copy3.txt 2025/08/31 01:44:22 INFO : - Path1 File changed: time (newer) - file1.copy4.txt 2025/08/31 01:44:22 INFO : - Path1 File changed: time (newer) - file1.copy5.txt 2025/08/31 01:44:22 INFO : - Path1 File changed: time (newer) - file1.txt 2025/08/31 01:44:22 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2025/08/31 01:44:22 INFO : Path1: 7 changes:  0 new,  7 modified,  0 deleted 2025/08/31 01:44:22 INFO : (Modified:  7 newer,  0 older) 2025/08/31 01:44:22 INFO : Path2 checking for diffs 2025/08/31 01:44:22 INFO : Applying changes 2025/08/31 01:44:22 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy1.txt 2025/08/31 01:44:22 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy2.txt 2025/08/31 01:44:22 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy3.txt 2025/08/31 01:44:22 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy4.txt 2025/08/31 01:44:22 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy5.txt 2025/08/31 01:44:22 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.txt 2025/08/31 01:44:22 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/subdir/file20.txt 2025/08/31 01:44:22 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:44:22 INFO : file1.copy1.txt: Copied (replaced existing) 2025/08/31 01:44:22 INFO : file1.copy2.txt: Copied (replaced existing) 2025/08/31 01:44:22 INFO : file1.copy3.txt: Copied (replaced existing) 2025/08/31 01:44:22 INFO : file1.copy4.txt: Copied (replaced existing) 2025/08/31 01:44:22 INFO : file1.copy5.txt: Copied (replaced existing) 2025/08/31 01:44:22 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:44:22 INFO : subdir/file20.txt: Copied (replaced existing) 2025/08/31 01:44:22 INFO : Updating listings 2025/08/31 01:44:22 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/" 2025/08/31 01:44:22 INFO : Bisync successful 2025/08/31 01:44:22 NOTICE: (09) : test change timestamp on all files including RCLONE_TEST 2025/08/31 01:44:22 NOTICE: (10) : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/all_changed/path1/ * 2025/08/31 01:44:22 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/all_changed/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1/" 2025/08/31 01:44:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/: list [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1] 2025/08/31 01:44:22 DEBUG : RCLONE_TEST: Set modification time 2004-01-02 2025/08/31 01:44:22 DEBUG : file1.copy1.txt: Set modification time 2004-01-02 2025/08/31 01:44:22 DEBUG : file1.copy2.txt: Set modification time 2004-01-02 2025/08/31 01:44:22 DEBUG : file1.copy3.txt: Set modification time 2004-01-02 2025/08/31 01:44:22 DEBUG : file1.copy4.txt: Set modification time 2004-01-02 2025/08/31 01:44:22 DEBUG : file1.copy5.txt: Set modification time 2004-01-02 2025/08/31 01:44:22 DEBUG : file1.txt: Set modification time 2004-01-02 2025/08/31 01:44:22 NOTICE: (11) : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir * 2025/08/31 01:44:22 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir" 2025/08/31 01:44:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir: list [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/subdir] 2025/08/31 01:44:22 DEBUG : file20.txt: Set modification time 2004-01-02 2025/08/31 01:44:22 NOTICE: (12) : test sync should fail 2025/08/31 01:44:22 NOTICE: (13) : bisync 2025/08/31 01:44:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/modtime_write_test] 2025/08/31 01:44:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: remove [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/modtime_write_test] 2025/08/31 01:44:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/modtime_write_test] 2025/08/31 01:44:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: remove [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/modtime_write_test] 2025/08/31 01:44:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:26 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:44:26 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:44:26 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/" 2025/08/31 01:44:26 INFO : Building Path1 and Path2 listings 2025/08/31 01:44:26 INFO : Path1 checking for diffs 2025/08/31 01:44:26 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2025/08/31 01:44:26 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2025/08/31 01:44:26 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2025/08/31 01:44:26 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2025/08/31 01:44:26 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2025/08/31 01:44:26 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2025/08/31 01:44:26 INFO : - Path1 File changed: time (older) - file1.txt 2025/08/31 01:44:26 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2025/08/31 01:44:26 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2025/08/31 01:44:26 INFO : (Modified:  1 newer,  7 older) 2025/08/31 01:44:26 INFO : Path2 checking for diffs 2025/08/31 01:44:26 ERROR : Safety abort: all files were changed on Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1/". Run with --force if desired. 2025/08/31 01:44:26 NOTICE: Bisync aborted. Please try again. 2025/08/31 01:44:26 NOTICE: Bisync error: all files were changed 2025/08/31 01:44:26 NOTICE: (14) : test sync with force should pass 2025/08/31 01:44:26 NOTICE: (15) : bisync force 2025/08/31 01:44:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/modtime_write_test] 2025/08/31 01:44:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: remove [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1/modtime_write_test] 2025/08/31 01:44:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: update [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/modtime_write_test] 2025/08/31 01:44:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: remove [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2/modtime_write_test] 2025/08/31 01:44:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:44:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:44:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/" 2025/08/31 01:44:30 INFO : Building Path1 and Path2 listings 2025/08/31 01:44:30 INFO : Path1 checking for diffs 2025/08/31 01:44:30 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2025/08/31 01:44:30 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2025/08/31 01:44:30 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2025/08/31 01:44:30 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2025/08/31 01:44:30 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2025/08/31 01:44:30 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2025/08/31 01:44:30 INFO : - Path1 File changed: time (older) - file1.txt 2025/08/31 01:44:30 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2025/08/31 01:44:30 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2025/08/31 01:44:30 INFO : (Modified:  1 newer,  7 older) 2025/08/31 01:44:30 INFO : Path2 checking for diffs 2025/08/31 01:44:30 INFO : Applying changes 2025/08/31 01:44:30 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/RCLONE_TEST 2025/08/31 01:44:30 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy1.txt 2025/08/31 01:44:30 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy2.txt 2025/08/31 01:44:30 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy3.txt 2025/08/31 01:44:30 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy4.txt 2025/08/31 01:44:30 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.copy5.txt 2025/08/31 01:44:30 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/file1.txt 2025/08/31 01:44:30 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/subdir/file20.txt 2025/08/31 01:44:30 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:44:30 INFO : file1.copy1.txt: Copied (replaced existing) 2025/08/31 01:44:30 INFO : file1.copy3.txt: Copied (replaced existing) 2025/08/31 01:44:30 INFO : file1.copy2.txt: Copied (replaced existing) 2025/08/31 01:44:30 INFO : file1.copy4.txt: Copied (replaced existing) 2025/08/31 01:44:30 INFO : RCLONE_TEST: Copied (replaced existing) 2025/08/31 01:44:30 INFO : file1.copy5.txt: Copied (replaced existing) 2025/08/31 01:44:30 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:44:31 INFO : subdir/file20.txt: Copied (replaced existing) 2025/08/31 01:44:31 INFO : Updating listings 2025/08/31 01:44:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/all_changed/path2/" 2025/08/31 01:44:31 INFO : Bisync successful 2025/08/31 01:44:31 NOTICE: ---------------------------------------------------------- 2025/08/31 01:44:31 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:44:31 NOTICE: | @@ -60 +59,0 @@ 2025/08/31 01:44:31 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:44:31 NOTICE: | @@ -132 +130,0 @@ 2025/08/31 01:44:31 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:44:31 NOTICE: ---------------------------------------------------------- 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path1: purge [/rclone-test-qasofaq0pisu/014414fa/all_changed/path1] 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/all_changed/path2: purge [/rclone-test-qasofaq0pisu/014414fa/all_changed/path2] bisync_test.go:597: TEST all_changed FAILED - 1 MISCOMPARED FILES === RUN TestBisyncRemoteRemote/compare_all 2025/08/31 01:44:31 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-qasofaq0pisu/014414fa" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa" 2025/08/31 01:44:31 INFO : path1: Making directory 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa: mkdir [/rclone-test-qasofaq0pisu/014414fa/path1] 2025/08/31 01:44:31 DEBUG : Creating backend with remote "TestHdfs:rclone-test-qasofaq0pisu/014414fa/compare_all/path1" 2025/08/31 01:44:31 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:31 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:31 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-qasofaq0pisu/014414fa/compare_all/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1" 2025/08/31 01:44:31 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-qasofaq0pisu/014414fa" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa" 2025/08/31 01:44:31 INFO : path2: Making directory 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa: mkdir [/rclone-test-qasofaq0pisu/014414fa/path2] 2025/08/31 01:44:31 DEBUG : Creating backend with remote "TestHdfs:rclone-test-qasofaq0pisu/014414fa/compare_all/path2" 2025/08/31 01:44:31 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:31 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:31 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-qasofaq0pisu/014414fa/compare_all/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2" 2025/08/31 01:44:31 DEBUG : Creating backend with remote "/tmp/014414fa/initdir/test_compare_all-qibozun1" 2025/08/31 01:44:31 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : Local file system at /tmp/014414fa/initdir/test_compare_all-qibozun1: Waiting for checks to finish 2025/08/31 01:44:31 DEBUG : Local file system at /tmp/014414fa/initdir/test_compare_all-qibozun1: Waiting for transfers to finish 2025/08/31 01:44:31 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:31 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:44:31 INFO : file1.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:31 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:44:31 INFO : file2.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:31 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt 2025/08/31 01:44:31 INFO : file3.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:44:31 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:44:31 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:44:31 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:31 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt 2025/08/31 01:44:31 INFO : file6.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:31 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt 2025/08/31 01:44:31 INFO : file4.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:31 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt 2025/08/31 01:44:31 INFO : file8.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:31 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt 2025/08/31 01:44:31 INFO : file7.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:31 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt 2025/08/31 01:44:31 INFO : file5.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_compare_all-hidoziq0" 2025/08/31 01:44:31 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file10.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file11.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : Local file system at /tmp/014414fa/datadir/test_compare_all-hidoziq0: Waiting for checks to finish 2025/08/31 01:44:31 DEBUG : Local file system at /tmp/014414fa/datadir/test_compare_all-hidoziq0: Waiting for transfers to finish 2025/08/31 01:44:31 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:44:31 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt 2025/08/31 01:44:31 INFO : file1.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:44:31 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:44:31 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt 2025/08/31 01:44:31 INFO : file11.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt 2025/08/31 01:44:31 INFO : file10.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2025/08/31 01:44:31 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt 2025/08/31 01:44:31 INFO : file2.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:44:31 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2025/08/31 01:44:31 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt 2025/08/31 01:44:31 INFO : file6.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt 2025/08/31 01:44:31 INFO : file5R.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2025/08/31 01:44:31 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt 2025/08/31 01:44:31 INFO : file5L.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:44:31 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt 2025/08/31 01:44:31 INFO : file7.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: purge [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1] 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: purge [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2] 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: list [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1] 2025/08/31 01:44:31 ERROR : error listing: directory not found 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: list [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2] 2025/08/31 01:44:31 ERROR : error listing: directory not found 2025/08/31 01:44:31 NOTICE: checking initFs Local file system at /tmp/014414fa/initdir/test_compare_all-qibozun1 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: list [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1] 2025/08/31 01:44:31 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/RCLONE_TEST] 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file2.txt] 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file1.txt] 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: Waiting for checks to finish 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: Waiting for transfers to finish 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file3.txt] 2025/08/31 01:44:31 INFO : file2.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file4.txt] 2025/08/31 01:44:31 INFO : file1.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file5.txt] 2025/08/31 01:44:31 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file6.txt] 2025/08/31 01:44:31 INFO : file3.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file7.txt] 2025/08/31 01:44:31 INFO : file4.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file8.txt] 2025/08/31 01:44:31 INFO : file5.txt: Copied (new) 2025/08/31 01:44:31 INFO : file6.txt: Copied (new) 2025/08/31 01:44:31 INFO : file7.txt: Copied (new) 2025/08/31 01:44:31 INFO : file8.txt: Copied (new) 2025/08/31 01:44:31 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: list [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1] 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: list [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2] 2025/08/31 01:44:31 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/RCLONE_TEST] 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file1.txt] 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file2.txt] 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: Waiting for checks to finish 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: Waiting for transfers to finish 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file3.txt] 2025/08/31 01:44:31 INFO : file3.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file4.txt] 2025/08/31 01:44:31 INFO : file1.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file5.txt] 2025/08/31 01:44:31 INFO : file2.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file6.txt] 2025/08/31 01:44:31 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file7.txt] 2025/08/31 01:44:31 INFO : file4.txt: Copied (new) 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file8.txt] 2025/08/31 01:44:31 INFO : file5.txt: Copied (new) 2025/08/31 01:44:31 INFO : file6.txt: Copied (new) 2025/08/31 01:44:31 INFO : file7.txt: Copied (new) 2025/08/31 01:44:31 INFO : file8.txt: Copied (new) 2025/08/31 01:44:31 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: list [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2] 2025/08/31 01:44:31 NOTICE: (01) : test changes compare-all 2025/08/31 01:44:31 NOTICE: (02) : test initial bisync 2025/08/31 01:44:31 NOTICE: (03) : bisync resync compare-all 2025/08/31 01:44:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/modtime_write_test] 2025/08/31 01:44:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: remove [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/modtime_write_test] 2025/08/31 01:44:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/modtime_write_test] 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: remove [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/modtime_write_test] 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:35 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2025/08/31 01:44:35 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" 2025/08/31 01:44:35 INFO : Copying Path2 files to Path1 2025/08/31 01:44:35 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:44:35 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:44:35 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:44:35 INFO : Resync updating listings 2025/08/31 01:44:35 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" 2025/08/31 01:44:35 INFO : Bisync successful 2025/08/31 01:44:35 NOTICE: (04) : test make modifications on both paths 2025/08/31 01:44:35 NOTICE: (05) : test new on path2 - file10 2025/08/31 01:44:35 NOTICE: (06) : touch-copy 2001-01-02 /tmp/014414fa/datadir/test_compare_all-hidoziq0/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/ 2025/08/31 01:44:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_compare_all-hidoziq0/" 2025/08/31 01:44:35 DEBUG : fs cache: renaming cache item "/tmp/014414fa/datadir/test_compare_all-hidoziq0/" to be canonical "/tmp/014414fa/datadir/test_compare_all-hidoziq0" 2025/08/31 01:44:35 DEBUG : file10.txt: Set modification time 2001-01-02 2025/08/31 01:44:35 DEBUG : copyFile "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file10.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" as "" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file10.txt" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" 2025/08/31 01:44:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:35 DEBUG : operations.CopyFile "file10.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" as "file10.txt" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file10.txt] 2025/08/31 01:44:35 DEBUG : file10.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file10.txt] 2025/08/31 01:44:35 INFO : file10.txt: Copied (new) 2025/08/31 01:44:35 NOTICE: (07) : test newer on path2 - file1 2025/08/31 01:44:35 NOTICE: (08) : touch-copy 2001-01-02 /tmp/014414fa/datadir/test_compare_all-hidoziq0/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/ 2025/08/31 01:44:35 DEBUG : fs cache: switching user supplied name "/tmp/014414fa/datadir/test_compare_all-hidoziq0/" for canonical name "/tmp/014414fa/datadir/test_compare_all-hidoziq0" 2025/08/31 01:44:35 DEBUG : file1.txt: Set modification time 2001-01-02 2025/08/31 01:44:35 DEBUG : copyFile "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file1.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" as "" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file1.txt" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" 2025/08/31 01:44:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:35 DEBUG : operations.CopyFile "file1.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" as "file1.txt" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file1.txt] 2025/08/31 01:44:35 DEBUG : file1.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file1.txt] 2025/08/31 01:44:35 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:44:35 NOTICE: (09) : test new on path1 - file11 2025/08/31 01:44:35 NOTICE: (10) : touch-copy 2001-01-02 /tmp/014414fa/datadir/test_compare_all-hidoziq0/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/ 2025/08/31 01:44:35 DEBUG : fs cache: switching user supplied name "/tmp/014414fa/datadir/test_compare_all-hidoziq0/" for canonical name "/tmp/014414fa/datadir/test_compare_all-hidoziq0" 2025/08/31 01:44:35 DEBUG : file11.txt: Set modification time 2001-01-02 2025/08/31 01:44:35 DEBUG : copyFile "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file11.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" as "" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file11.txt" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" 2025/08/31 01:44:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:35 DEBUG : operations.CopyFile "file11.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" as "file11.txt" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file11.txt] 2025/08/31 01:44:35 DEBUG : file11.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file11.txt] 2025/08/31 01:44:35 INFO : file11.txt: Copied (new) 2025/08/31 01:44:35 NOTICE: (11) : test newer on path1 - file2 2025/08/31 01:44:35 NOTICE: (12) : touch-copy 2001-01-02 /tmp/014414fa/datadir/test_compare_all-hidoziq0/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/ 2025/08/31 01:44:35 DEBUG : fs cache: switching user supplied name "/tmp/014414fa/datadir/test_compare_all-hidoziq0/" for canonical name "/tmp/014414fa/datadir/test_compare_all-hidoziq0" 2025/08/31 01:44:35 DEBUG : file2.txt: Set modification time 2001-01-02 2025/08/31 01:44:35 DEBUG : copyFile "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file2.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" as "" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file2.txt" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" 2025/08/31 01:44:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:35 DEBUG : operations.CopyFile "file2.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" as "file2.txt" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file2.txt] 2025/08/31 01:44:35 DEBUG : file2.txt: Sizes differ (src 13 vs dst 0) 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file2.txt] 2025/08/31 01:44:35 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:44:35 NOTICE: (13) : test deleted on path2 - file3 2025/08/31 01:44:35 NOTICE: (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file3.txt 2025/08/31 01:44:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" 2025/08/31 01:44:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:35 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file3.txt] 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: remove [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file3.txt] 2025/08/31 01:44:35 INFO : file3.txt: Deleted 2025/08/31 01:44:35 NOTICE: (15) : test deleted on path1 - file4 2025/08/31 01:44:35 NOTICE: (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file4.txt 2025/08/31 01:44:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" 2025/08/31 01:44:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:35 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file4.txt] 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: remove [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file4.txt] 2025/08/31 01:44:35 INFO : file4.txt: Deleted 2025/08/31 01:44:35 NOTICE: (17) : test deleted on both paths - file8 2025/08/31 01:44:35 NOTICE: (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file8.txt 2025/08/31 01:44:35 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file8.txt] 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: remove [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file8.txt] 2025/08/31 01:44:35 INFO : file8.txt: Deleted 2025/08/31 01:44:35 NOTICE: (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file8.txt 2025/08/31 01:44:35 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file8.txt] 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: remove [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file8.txt] 2025/08/31 01:44:35 INFO : file8.txt: Deleted 2025/08/31 01:44:35 NOTICE: (20) : test changed on both paths - file5 (file5R, file5L) 2025/08/31 01:44:35 NOTICE: (21) : touch-glob 2001-01-02 /tmp/014414fa/datadir/test_compare_all-hidoziq0/ file5R.txt 2025/08/31 01:44:35 DEBUG : fs cache: switching user supplied name "/tmp/014414fa/datadir/test_compare_all-hidoziq0/" for canonical name "/tmp/014414fa/datadir/test_compare_all-hidoziq0" 2025/08/31 01:44:35 DEBUG : file5R.txt: Set modification time 2001-01-02 2025/08/31 01:44:35 NOTICE: (22) : copy-as /tmp/014414fa/datadir/test_compare_all-hidoziq0/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/ file5.txt 2025/08/31 01:44:35 DEBUG : copyFile "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file5R.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" as "file5.txt" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file5R.txt" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" 2025/08/31 01:44:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:35 DEBUG : operations.CopyFile "file5R.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" as "file5.txt" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file5.txt] 2025/08/31 01:44:35 DEBUG : file5R.txt: Sizes differ (src 39 vs dst 0) 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file5.txt] 2025/08/31 01:44:35 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2025/08/31 01:44:35 NOTICE: (23) : touch-glob 2001-03-04 /tmp/014414fa/datadir/test_compare_all-hidoziq0/ file5L.txt 2025/08/31 01:44:35 DEBUG : fs cache: switching user supplied name "/tmp/014414fa/datadir/test_compare_all-hidoziq0/" for canonical name "/tmp/014414fa/datadir/test_compare_all-hidoziq0" 2025/08/31 01:44:35 DEBUG : file5L.txt: Set modification time 2001-03-04 2025/08/31 01:44:35 NOTICE: (24) : copy-as /tmp/014414fa/datadir/test_compare_all-hidoziq0/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/ file5.txt 2025/08/31 01:44:35 DEBUG : copyFile "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file5L.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" as "file5.txt" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file5L.txt" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" 2025/08/31 01:44:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:35 DEBUG : operations.CopyFile "file5L.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" as "file5.txt" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file5.txt] 2025/08/31 01:44:35 DEBUG : file5L.txt: Sizes differ (src 39 vs dst 0) 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file5.txt] 2025/08/31 01:44:35 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2025/08/31 01:44:35 NOTICE: (25) : test newer on path2 and deleted on path1 - file6 2025/08/31 01:44:35 NOTICE: (26) : touch-copy 2001-01-02 /tmp/014414fa/datadir/test_compare_all-hidoziq0/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/ 2025/08/31 01:44:35 DEBUG : fs cache: switching user supplied name "/tmp/014414fa/datadir/test_compare_all-hidoziq0/" for canonical name "/tmp/014414fa/datadir/test_compare_all-hidoziq0" 2025/08/31 01:44:35 DEBUG : file6.txt: Set modification time 2001-01-02 2025/08/31 01:44:35 DEBUG : copyFile "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file6.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" as "" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file6.txt" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" 2025/08/31 01:44:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:35 DEBUG : operations.CopyFile "file6.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" as "file6.txt" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file6.txt] 2025/08/31 01:44:35 DEBUG : file6.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file6.txt] 2025/08/31 01:44:35 INFO : file6.txt: Copied (replaced existing) 2025/08/31 01:44:35 NOTICE: (27) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file6.txt 2025/08/31 01:44:35 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file6.txt] 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: remove [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file6.txt] 2025/08/31 01:44:35 INFO : file6.txt: Deleted 2025/08/31 01:44:35 NOTICE: (28) : test newer on path1 and deleted on path2 - file7 2025/08/31 01:44:35 NOTICE: (29) : touch-copy 2001-01-02 /tmp/014414fa/datadir/test_compare_all-hidoziq0/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/ 2025/08/31 01:44:35 DEBUG : fs cache: switching user supplied name "/tmp/014414fa/datadir/test_compare_all-hidoziq0/" for canonical name "/tmp/014414fa/datadir/test_compare_all-hidoziq0" 2025/08/31 01:44:35 DEBUG : file7.txt: Set modification time 2001-01-02 2025/08/31 01:44:35 DEBUG : copyFile "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file7.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" as "" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_compare_all-hidoziq0/file7.txt" 2025/08/31 01:44:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" 2025/08/31 01:44:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:35 DEBUG : operations.CopyFile "file7.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" as "file7.txt" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file7.txt] 2025/08/31 01:44:35 DEBUG : file7.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file7.txt] 2025/08/31 01:44:35 INFO : file7.txt: Copied (replaced existing) 2025/08/31 01:44:35 NOTICE: (30) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file7.txt 2025/08/31 01:44:35 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: new [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file7.txt] 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/: remove [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file7.txt] 2025/08/31 01:44:35 INFO : file7.txt: Deleted 2025/08/31 01:44:35 NOTICE: (31) : test bisync run 2025/08/31 01:44:35 NOTICE: (32) : bisync compare-all 2025/08/31 01:44:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/modtime_write_test] 2025/08/31 01:44:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: remove [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1/modtime_write_test] 2025/08/31 01:44:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: update [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/modtime_write_test] 2025/08/31 01:44:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: remove [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2/modtime_write_test] 2025/08/31 01:44:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2025/08/31 01:44:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" 2025/08/31 01:44:39 INFO : Building Path1 and Path2 listings 2025/08/31 01:44:39 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:44:39 INFO : Path1 checking for diffs 2025/08/31 01:44:39 INFO : - Path1 File changed: size (larger), time (newer), hash - file2.txt 2025/08/31 01:44:39 INFO : - Path1 File was deleted - file4.txt 2025/08/31 01:44:39 INFO : - Path1 File changed: size (larger), time (newer), hash - file5.txt 2025/08/31 01:44:39 INFO : - Path1 File was deleted - file6.txt 2025/08/31 01:44:39 INFO : - Path1 File changed: size (larger), time (newer), hash - file7.txt 2025/08/31 01:44:39 INFO : - Path1 File was deleted - file8.txt 2025/08/31 01:44:39 INFO : - Path1 File is new - file11.txt 2025/08/31 01:44:39 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2025/08/31 01:44:39 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2025/08/31 01:44:39 INFO : Path2 checking for diffs 2025/08/31 01:44:39 INFO : - Path2 File changed: size (larger), time (newer), hash - file1.txt 2025/08/31 01:44:39 INFO : - Path2 File was deleted - file3.txt 2025/08/31 01:44:39 INFO : - Path2 File changed: size (larger), time (newer), hash - file5.txt 2025/08/31 01:44:39 INFO : - Path2 File changed: size (larger), time (newer), hash - file6.txt 2025/08/31 01:44:39 INFO : - Path2 File was deleted - file7.txt 2025/08/31 01:44:39 INFO : - Path2 File was deleted - file8.txt 2025/08/31 01:44:39 INFO : - Path2 File is new - file10.txt 2025/08/31 01:44:39 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2025/08/31 01:44:39 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2025/08/31 01:44:39 INFO : Applying changes 2025/08/31 01:44:39 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file11.txt 2025/08/31 01:44:39 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file2.txt 2025/08/31 01:44:39 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file4.txt 2025/08/31 01:44:39 NOTICE: - WARNING New or changed in both paths - file5.txt 2025/08/31 01:44:39 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file5.txt.conflict1 2025/08/31 01:44:39 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2025/08/31 01:44:39 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file5.txt.conflict1 2025/08/31 01:44:39 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file5.txt.conflict2 2025/08/31 01:44:39 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2025/08/31 01:44:39 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file5.txt.conflict2 2025/08/31 01:44:39 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file6.txt 2025/08/31 01:44:39 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/file7.txt 2025/08/31 01:44:39 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file1.txt 2025/08/31 01:44:39 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file10.txt 2025/08/31 01:44:39 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/file3.txt 2025/08/31 01:44:39 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:44:40 INFO : file10.txt: Copied (new) 2025/08/31 01:44:40 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:44:40 INFO : file5.txt.conflict2: Copied (new) 2025/08/31 01:44:40 INFO : file6.txt: Copied (new) 2025/08/31 01:44:40 INFO : file3.txt: Deleted 2025/08/31 01:44:40 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:44:40 INFO : file11.txt: Copied (new) 2025/08/31 01:44:40 INFO : file5.txt.conflict1: Copied (new) 2025/08/31 01:44:40 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:44:40 INFO : file7.txt: Copied (new) 2025/08/31 01:44:40 INFO : file4.txt: Deleted 2025/08/31 01:44:40 INFO : Updating listings 2025/08/31 01:44:40 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/compare_all/path2/" 2025/08/31 01:44:40 INFO : Bisync successful 2025/08/31 01:44:40 NOTICE: ---------------------------------------------------------- 2025/08/31 01:44:40 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:44:40 NOTICE: | @@ -16 +15,0 @@ 2025/08/31 01:44:40 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:44:40 NOTICE: | @@ -18 +16,0 @@ 2025/08/31 01:44:40 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:44:40 NOTICE: ---------------------------------------------------------- 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path1: purge [/rclone-test-qasofaq0pisu/014414fa/compare_all/path1] 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/compare_all/path2: purge [/rclone-test-qasofaq0pisu/014414fa/compare_all/path2] bisync_test.go:597: TEST compare_all FAILED - 1 MISCOMPARED FILES === RUN TestBisyncRemoteRemote/createemptysrcdirs 2025/08/31 01:44:40 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-qasofaq0pisu/014414fa" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa" 2025/08/31 01:44:40 INFO : path1: Making directory 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa: mkdir [/rclone-test-qasofaq0pisu/014414fa/path1] 2025/08/31 01:44:40 DEBUG : Creating backend with remote "TestHdfs:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1" 2025/08/31 01:44:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:40 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1" 2025/08/31 01:44:40 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-qasofaq0pisu/014414fa" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa" 2025/08/31 01:44:40 INFO : path2: Making directory 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa: mkdir [/rclone-test-qasofaq0pisu/014414fa/path2] 2025/08/31 01:44:40 DEBUG : Creating backend with remote "TestHdfs:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2" 2025/08/31 01:44:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:44:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:44:40 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "/tmp/014414fa/initdir/test_createemptysrcdirs-gafoqes5" 2025/08/31 01:44:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:40 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt 2025/08/31 01:44:40 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:44:40 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:40 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt 2025/08/31 01:44:40 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:44:40 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:44:40 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:44:40 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:44:40 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:40 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt 2025/08/31 01:44:40 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:44:40 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:40 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:44:40 INFO : file1.txt: Copied (new) 2025/08/31 01:44:40 DEBUG : Local file system at /tmp/014414fa/initdir/test_createemptysrcdirs-gafoqes5: Waiting for checks to finish 2025/08/31 01:44:40 DEBUG : Local file system at /tmp/014414fa/initdir/test_createemptysrcdirs-gafoqes5: Waiting for transfers to finish 2025/08/31 01:44:40 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:40 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt 2025/08/31 01:44:40 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:44:40 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:40 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt 2025/08/31 01:44:40 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:44:40 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0" 2025/08/31 01:44:40 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : Local file system at /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0: Waiting for checks to finish 2025/08/31 01:44:40 DEBUG : Local file system at /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0: Waiting for transfers to finish 2025/08/31 01:44:40 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:44:40 DEBUG : placeholder.txt.4db661ca.partial: renamed to: placeholder.txt 2025/08/31 01:44:40 INFO : placeholder.txt: Copied (new) 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: purge [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: purge [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2] 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:44:40 ERROR : error listing: directory not found 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2] 2025/08/31 01:44:40 ERROR : error listing: directory not found 2025/08/31 01:44:40 NOTICE: checking initFs Local file system at /tmp/014414fa/initdir/test_createemptysrcdirs-gafoqes5 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:44:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/RCLONE_TEST] 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: Waiting for checks to finish 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: Waiting for transfers to finish 2025/08/31 01:44:40 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:44:40 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:44:40 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:44:40 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:44:40 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:44:40 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:44:40 INFO : file1.txt: Copied (new) 2025/08/31 01:44:40 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2] 2025/08/31 01:44:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/RCLONE_TEST] 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/file1.copy1.txt] 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/file1.copy2.txt] 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: Waiting for checks to finish 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: Waiting for transfers to finish 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/file1.copy3.txt] 2025/08/31 01:44:40 INFO : file1.copy1.txt: Copied (new) 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/file1.copy4.txt] 2025/08/31 01:44:40 INFO : file1.copy2.txt: Copied (new) 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/file1.copy5.txt] 2025/08/31 01:44:40 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/file1.txt] 2025/08/31 01:44:40 INFO : file1.copy3.txt: Copied (new) 2025/08/31 01:44:40 INFO : file1.copy4.txt: Copied (new) 2025/08/31 01:44:40 INFO : file1.copy5.txt: Copied (new) 2025/08/31 01:44:40 INFO : file1.txt: Copied (new) 2025/08/31 01:44:40 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2] 2025/08/31 01:44:40 NOTICE: (01) : test createemptysrcdirs 2025/08/31 01:44:40 NOTICE: (02) : test initial bisync 2025/08/31 01:44:40 NOTICE: (03) : touch-glob 2001-01-02 /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/ placeholder.txt 2025/08/31 01:44:40 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/" 2025/08/31 01:44:40 DEBUG : fs cache: renaming cache item "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/" to be canonical "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0" 2025/08/31 01:44:40 DEBUG : placeholder.txt: Set modification time 2001-01-02 2025/08/31 01:44:40 NOTICE: (04) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.txt 2025/08/31 01:44:40 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:40 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:44:40 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:44:40 INFO : placeholder.txt: Copied (replaced existing) to: file1.txt 2025/08/31 01:44:40 NOTICE: (05) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy1.txt 2025/08/31 01:44:40 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:40 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:44:40 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:44:40 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy1.txt 2025/08/31 01:44:40 NOTICE: (06) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy2.txt 2025/08/31 01:44:40 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:40 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:44:40 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:44:40 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy2.txt 2025/08/31 01:44:40 NOTICE: (07) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy3.txt 2025/08/31 01:44:40 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:40 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:44:40 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:44:40 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy3.txt 2025/08/31 01:44:40 NOTICE: (08) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy4.txt 2025/08/31 01:44:40 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:40 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:44:40 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:44:40 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy4.txt 2025/08/31 01:44:40 NOTICE: (09) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy5.txt 2025/08/31 01:44:40 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:40 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:40 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:44:40 DEBUG : placeholder.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:44:40 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy5.txt 2025/08/31 01:44:40 NOTICE: (10) : bisync resync 2025/08/31 01:44:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:44:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:44:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:44:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:44:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:44:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:44:44 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:44:44 INFO : Copying Path2 files to Path1 2025/08/31 01:44:44 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:44:44 INFO : There was nothing to transfer 2025/08/31 01:44:44 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:44:44 INFO : file1.copy1.txt: Copied (replaced existing) 2025/08/31 01:44:44 INFO : file1.copy2.txt: Copied (replaced existing) 2025/08/31 01:44:44 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:44:44 INFO : file1.copy3.txt: Copied (replaced existing) 2025/08/31 01:44:44 INFO : file1.copy4.txt: Copied (replaced existing) 2025/08/31 01:44:44 INFO : file1.copy5.txt: Copied (replaced existing) 2025/08/31 01:44:44 INFO : Resync updating listings 2025/08/31 01:44:44 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:44:44 INFO : Bisync successful 2025/08/31 01:44:44 NOTICE: (11) : test 1. Create an empty dir on Path1 by creating subdir/placeholder.txt and then deleting the placeholder 2025/08/31 01:44:44 NOTICE: (12) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ subdir/placeholder.txt 2025/08/31 01:44:44 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "subdir/placeholder.txt" 2025/08/31 01:44:44 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:44 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:44 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:44 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:44 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "subdir/placeholder.txt" 2025/08/31 01:44:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir/placeholder.txt] 2025/08/31 01:44:44 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir/placeholder.txt] 2025/08/31 01:44:44 INFO : placeholder.txt: Copied (new) to: subdir/placeholder.txt 2025/08/31 01:44:44 NOTICE: (13) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ subdir 2025/08/31 01:44:44 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:44 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:44 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:44 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:44:44 NOTICE: (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir/placeholder.txt 2025/08/31 01:44:44 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir/" 2025/08/31 01:44:44 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:44 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:44 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir/" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir/" 2025/08/31 01:44:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir/placeholder.txt] 2025/08/31 01:44:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir/: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir/placeholder.txt] 2025/08/31 01:44:44 INFO : placeholder.txt: Deleted 2025/08/31 01:44:44 NOTICE: (15) : test 2. Run bisync without --create-empty-src-dirs 2025/08/31 01:44:44 NOTICE: (16) : bisync 2025/08/31 01:44:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:44:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:44:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:44:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:44:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:44:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:44:48 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:44:48 INFO : Building Path1 and Path2 listings 2025/08/31 01:44:48 INFO : Path1 checking for diffs 2025/08/31 01:44:48 INFO : Path2 checking for diffs 2025/08/31 01:44:48 INFO : No changes found 2025/08/31 01:44:48 INFO : Updating listings 2025/08/31 01:44:48 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:44:48 INFO : Bisync successful 2025/08/31 01:44:48 NOTICE: (17) : test 3. Confirm the subdir exists only on Path1 and not Path2 2025/08/31 01:44:48 NOTICE: (18) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ 2025/08/31 01:44:48 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:44:48 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:44:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir] 2025/08/31 01:44:48 NOTICE: (19) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/ 2025/08/31 01:44:48 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:44:48 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:48 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:48 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:44:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2] 2025/08/31 01:44:48 NOTICE: (20) : test 4.Run bisync WITH --create-empty-src-dirs 2025/08/31 01:44:48 NOTICE: (21) : bisync create-empty-src-dirs 2025/08/31 01:44:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:44:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:44:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:44:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:44:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:44:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:44:53 INFO : Building Path1 and Path2 listings 2025/08/31 01:44:53 INFO : Path1 checking for diffs 2025/08/31 01:44:53 INFO : - Path1 File is new - subdir 2025/08/31 01:44:53 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2025/08/31 01:44:53 INFO : Path2 checking for diffs 2025/08/31 01:44:53 INFO : Applying changes 2025/08/31 01:44:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/subdir 2025/08/31 01:44:53 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:44:53 INFO : There was nothing to transfer 2025/08/31 01:44:53 INFO : subdir: Making directory 2025/08/31 01:44:53 INFO : Updating listings 2025/08/31 01:44:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:44:53 INFO : Bisync successful 2025/08/31 01:44:53 NOTICE: (22) : test 5. Confirm the subdir exists on both paths 2025/08/31 01:44:53 NOTICE: (23) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ 2025/08/31 01:44:53 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:44:53 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir] 2025/08/31 01:44:53 NOTICE: (24) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/ 2025/08/31 01:44:53 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2] 2025/08/31 01:44:53 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/subdir] 2025/08/31 01:44:53 NOTICE: (25) : test 6. Delete the empty dir on Path1 using purge-children (and also add files so the path isn't empty) 2025/08/31 01:44:53 NOTICE: (26) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:44:53 DEBUG : RCLONE_TEST: Remove file 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/RCLONE_TEST] 2025/08/31 01:44:53 DEBUG : file1.copy1.txt: Remove file 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:44:53 DEBUG : file1.copy2.txt: Remove file 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:44:53 DEBUG : file1.copy3.txt: Remove file 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:44:53 DEBUG : file1.copy4.txt: Remove file 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:44:53 DEBUG : file1.copy5.txt: Remove file 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:44:53 DEBUG : file1.txt: Remove file 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:44:53 DEBUG : subdir: Purge subdir 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: purge [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir] 2025/08/31 01:44:53 NOTICE: (27) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.txt 2025/08/31 01:44:53 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:44:53 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:53 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:53 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:44:53 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:44:53 INFO : placeholder.txt: Copied (new) to: file1.txt 2025/08/31 01:44:53 NOTICE: (28) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy1.txt 2025/08/31 01:44:53 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:44:53 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:53 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:53 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:44:53 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:44:53 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2025/08/31 01:44:53 NOTICE: (29) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy2.txt 2025/08/31 01:44:53 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:44:53 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:53 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:53 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:44:53 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:44:53 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2025/08/31 01:44:53 NOTICE: (30) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy3.txt 2025/08/31 01:44:53 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:44:53 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:53 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:53 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:44:53 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:44:53 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2025/08/31 01:44:53 NOTICE: (31) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy4.txt 2025/08/31 01:44:53 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:44:53 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:53 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:53 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:44:53 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:44:53 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2025/08/31 01:44:53 NOTICE: (32) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy5.txt 2025/08/31 01:44:53 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:44:53 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:44:53 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:44:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:44:53 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:44:53 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:44:53 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2025/08/31 01:44:53 NOTICE: (33) : test 7. Run bisync without --create-empty-src-dirs 2025/08/31 01:44:53 NOTICE: (34) : bisync 2025/08/31 01:44:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:44:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:44:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:44:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:44:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:44:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:44:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:44:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:44:57 INFO : Building Path1 and Path2 listings 2025/08/31 01:44:57 INFO : Path1 checking for diffs 2025/08/31 01:44:57 INFO : - Path1 File was deleted - RCLONE_TEST 2025/08/31 01:44:57 INFO : - Path1 File was deleted - subdir 2025/08/31 01:44:57 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2025/08/31 01:44:57 INFO : Path2 checking for diffs 2025/08/31 01:44:57 INFO : - Path2 File was deleted - subdir 2025/08/31 01:44:57 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2025/08/31 01:44:57 INFO : Applying changes 2025/08/31 01:44:57 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/RCLONE_TEST 2025/08/31 01:44:57 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:44:57 INFO : RCLONE_TEST: Deleted 2025/08/31 01:44:57 INFO : There was nothing to transfer 2025/08/31 01:44:57 INFO : Updating listings 2025/08/31 01:44:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:44:57 INFO : Bisync successful 2025/08/31 01:44:57 NOTICE: (35) : test 8. Confirm the subdir exists only on Path2 and not Path1 2025/08/31 01:44:57 NOTICE: (36) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ 2025/08/31 01:44:57 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:44:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:44:57 NOTICE: (37) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/ 2025/08/31 01:44:57 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:44:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2] 2025/08/31 01:44:57 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:44:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/subdir] 2025/08/31 01:44:57 NOTICE: (38) : test 9. Reset, do the delete again, and run bisync WITH --create-empty-src-dirs 2025/08/31 01:44:57 NOTICE: (39) : bisync resync create-empty-src-dirs 2025/08/31 01:44:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:44:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:44:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:45:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:45:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:45:01 INFO : Copying Path2 files to Path1 2025/08/31 01:45:01 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:45:01 INFO : subdir: Making directory 2025/08/31 01:45:01 INFO : There was nothing to transfer 2025/08/31 01:45:01 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:45:01 INFO : There was nothing to transfer 2025/08/31 01:45:01 INFO : Resync updating listings 2025/08/31 01:45:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:45:01 INFO : Bisync successful 2025/08/31 01:45:01 NOTICE: (40) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ 2025/08/31 01:45:01 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:45:01 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir] 2025/08/31 01:45:01 NOTICE: (41) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/ 2025/08/31 01:45:01 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2] 2025/08/31 01:45:01 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/subdir] 2025/08/31 01:45:01 NOTICE: (42) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:45:01 DEBUG : file1.copy1.txt: Remove file 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:45:01 DEBUG : file1.copy2.txt: Remove file 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:45:01 DEBUG : file1.copy3.txt: Remove file 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:45:01 DEBUG : file1.copy4.txt: Remove file 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:45:01 DEBUG : file1.copy5.txt: Remove file 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:45:01 DEBUG : file1.txt: Remove file 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:45:01 DEBUG : subdir: Purge subdir 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: purge [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/subdir] 2025/08/31 01:45:01 NOTICE: (43) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.txt 2025/08/31 01:45:01 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:45:01 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:45:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:45:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:01 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.txt" 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:45:01 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.txt] 2025/08/31 01:45:01 INFO : placeholder.txt: Copied (new) to: file1.txt 2025/08/31 01:45:01 NOTICE: (44) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy1.txt 2025/08/31 01:45:01 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:45:01 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:45:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:45:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:01 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy1.txt" 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:45:01 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy1.txt] 2025/08/31 01:45:01 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2025/08/31 01:45:01 NOTICE: (45) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy2.txt 2025/08/31 01:45:01 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:45:01 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:45:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:45:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:01 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy2.txt" 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:45:01 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy2.txt] 2025/08/31 01:45:01 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2025/08/31 01:45:01 NOTICE: (46) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy3.txt 2025/08/31 01:45:01 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:45:01 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:45:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:45:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:01 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy3.txt" 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:45:01 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy3.txt] 2025/08/31 01:45:01 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2025/08/31 01:45:01 NOTICE: (47) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy4.txt 2025/08/31 01:45:01 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:45:01 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:45:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:45:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:01 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy4.txt" 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:45:01 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy4.txt] 2025/08/31 01:45:01 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2025/08/31 01:45:01 NOTICE: (48) : copy-as /tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ file1.copy5.txt 2025/08/31 01:45:01 DEBUG : copyFile "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:45:01 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_createemptysrcdirs-jejemoh0/placeholder.txt" 2025/08/31 01:45:01 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:45:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:01 DEBUG : operations.CopyFile "placeholder.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" as "file1.copy5.txt" 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: new [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:45:01 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/file1.copy5.txt] 2025/08/31 01:45:01 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2025/08/31 01:45:01 NOTICE: (49) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ 2025/08/31 01:45:01 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:45:01 NOTICE: (50) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/ 2025/08/31 01:45:01 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2] 2025/08/31 01:45:01 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/subdir] 2025/08/31 01:45:01 NOTICE: (51) : bisync create-empty-src-dirs 2025/08/31 01:45:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:45:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:45:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:45:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:45:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:45:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:45:05 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:45:05 INFO : Building Path1 and Path2 listings 2025/08/31 01:45:05 INFO : Path1 checking for diffs 2025/08/31 01:45:05 INFO : - Path1 File was deleted - subdir 2025/08/31 01:45:05 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2025/08/31 01:45:05 INFO : Path2 checking for diffs 2025/08/31 01:45:05 INFO : Applying changes 2025/08/31 01:45:05 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/subdir 2025/08/31 01:45:05 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:45:05 INFO : There was nothing to transfer 2025/08/31 01:45:05 INFO : subdir: Removing directory 2025/08/31 01:45:05 INFO : Updating listings 2025/08/31 01:45:05 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:45:05 INFO : Bisync successful 2025/08/31 01:45:05 NOTICE: (52) : test 10. Confirm the subdir has been removed on both paths 2025/08/31 01:45:05 NOTICE: (53) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/ 2025/08/31 01:45:05 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" 2025/08/31 01:45:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:45:05 NOTICE: (54) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/ 2025/08/31 01:45:05 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:45:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/: list [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2] 2025/08/31 01:45:05 NOTICE: (55) : test 11. bisync again (because if we leave subdir in listings, test will fail due to mismatched modtime) 2025/08/31 01:45:05 NOTICE: (56) : bisync create-empty-src-dirs 2025/08/31 01:45:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:45:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/modtime_write_test] 2025/08/31 01:45:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: update [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: remove [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/modtime_write_test] 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:45:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:45:09 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:45:09 INFO : Building Path1 and Path2 listings 2025/08/31 01:45:09 INFO : Path1 checking for diffs 2025/08/31 01:45:09 INFO : Path2 checking for diffs 2025/08/31 01:45:09 INFO : No changes found 2025/08/31 01:45:09 INFO : Updating listings 2025/08/31 01:45:09 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2/" 2025/08/31 01:45:09 INFO : Bisync successful 2025/08/31 01:45:09 NOTICE: ---------------------------------------------------------- 2025/08/31 01:45:09 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:45:09 NOTICE: | @@ -26 +25,0 @@ 2025/08/31 01:45:09 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:45:09 NOTICE: ---------------------------------------------------------- 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1: purge [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path1] 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2: purge [/rclone-test-qasofaq0pisu/014414fa/createemptysrcdirs/path2] bisync_test.go:597: TEST createemptysrcdirs FAILED - 1 MISCOMPARED FILES === RUN TestBisyncRemoteRemote/nomodtime 2025/08/31 01:45:09 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-qasofaq0pisu/014414fa" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa" 2025/08/31 01:45:09 INFO : path1: Making directory 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa: mkdir [/rclone-test-qasofaq0pisu/014414fa/path1] 2025/08/31 01:45:09 DEBUG : Creating backend with remote "TestHdfs:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1" 2025/08/31 01:45:09 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:45:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:45:09 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:45:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:45:09 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1" 2025/08/31 01:45:09 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-qasofaq0pisu/014414fa" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa" 2025/08/31 01:45:09 INFO : path2: Making directory 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa: mkdir [/rclone-test-qasofaq0pisu/014414fa/path2] 2025/08/31 01:45:09 DEBUG : Creating backend with remote "TestHdfs:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2" 2025/08/31 01:45:09 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:45:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:45:09 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:45:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:45:09 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2" 2025/08/31 01:45:09 DEBUG : Creating backend with remote "/tmp/014414fa/initdir/test_nomodtime-buhoxoq1" 2025/08/31 01:45:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:09 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:09 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/08/31 01:45:09 INFO : file1.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:45:09 INFO : file2.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:09 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:09 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt 2025/08/31 01:45:09 INFO : file4.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:09 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt 2025/08/31 01:45:09 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt 2025/08/31 01:45:09 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:09 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt 2025/08/31 01:45:09 INFO : file6.txt: Copied (new) 2025/08/31 01:45:09 INFO : file3.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:09 DEBUG : Local file system at /tmp/014414fa/initdir/test_nomodtime-buhoxoq1: Waiting for checks to finish 2025/08/31 01:45:09 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt 2025/08/31 01:45:09 INFO : file7.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : Local file system at /tmp/014414fa/initdir/test_nomodtime-buhoxoq1: Waiting for transfers to finish 2025/08/31 01:45:09 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:45:09 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:09 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:45:09 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:45:09 INFO : file5.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt 2025/08/31 01:45:09 INFO : file8.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_nomodtime-vajapup2" 2025/08/31 01:45:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file10.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file11.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:45:09 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:45:09 DEBUG : file10.txt.7d45770.partial: renamed to: file10.txt 2025/08/31 01:45:09 INFO : file10.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:45:09 DEBUG : file11.txt.7d45770.partial: renamed to: file11.txt 2025/08/31 01:45:09 DEBUG : file1.txt.7d45770.partial: renamed to: file1.txt 2025/08/31 01:45:09 INFO : file1.txt: Copied (new) 2025/08/31 01:45:09 INFO : file11.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : Local file system at /tmp/014414fa/datadir/test_nomodtime-vajapup2: Waiting for checks to finish 2025/08/31 01:45:09 DEBUG : Local file system at /tmp/014414fa/datadir/test_nomodtime-vajapup2: Waiting for transfers to finish 2025/08/31 01:45:09 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2025/08/31 01:45:09 DEBUG : file2.txt.21f2ec7f.partial: renamed to: file2.txt 2025/08/31 01:45:09 INFO : file2.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2025/08/31 01:45:09 DEBUG : file5L.txt.9ed658ed.partial: renamed to: file5L.txt 2025/08/31 01:45:09 INFO : file5L.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:45:09 DEBUG : file6.txt.7d45770.partial: renamed to: file6.txt 2025/08/31 01:45:09 INFO : file6.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2025/08/31 01:45:09 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:45:09 DEBUG : file5R.txt.9ed658ed.partial: renamed to: file5R.txt 2025/08/31 01:45:09 INFO : file5R.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : file7.txt.7d45770.partial: renamed to: file7.txt 2025/08/31 01:45:09 INFO : file7.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: purge [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1] 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: purge [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2] 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: list [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1] 2025/08/31 01:45:09 ERROR : error listing: directory not found 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: list [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2] 2025/08/31 01:45:09 ERROR : error listing: directory not found 2025/08/31 01:45:09 NOTICE: checking initFs Local file system at /tmp/014414fa/initdir/test_nomodtime-buhoxoq1 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: list [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1] 2025/08/31 01:45:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/RCLONE_TEST] 2025/08/31 01:45:09 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: Waiting for checks to finish 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: Waiting for transfers to finish 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file1.txt] 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file3.txt] 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file2.txt] 2025/08/31 01:45:09 INFO : file3.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file4.txt] 2025/08/31 01:45:09 INFO : file1.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file5.txt] 2025/08/31 01:45:09 INFO : file2.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file6.txt] 2025/08/31 01:45:09 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file7.txt] 2025/08/31 01:45:09 INFO : file4.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file8.txt] 2025/08/31 01:45:09 INFO : file5.txt: Copied (new) 2025/08/31 01:45:09 INFO : file6.txt: Copied (new) 2025/08/31 01:45:09 INFO : file7.txt: Copied (new) 2025/08/31 01:45:09 INFO : file8.txt: Copied (new) 2025/08/31 01:45:09 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: list [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1] 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: list [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2] 2025/08/31 01:45:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file3.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file4.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file5.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file6.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file7.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : file8.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/RCLONE_TEST] 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file1.txt] 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file2.txt] 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: Waiting for checks to finish 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: Waiting for transfers to finish 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file3.txt] 2025/08/31 01:45:09 INFO : file1.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file4.txt] 2025/08/31 01:45:09 INFO : file2.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file5.txt] 2025/08/31 01:45:09 INFO : file3.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file6.txt] 2025/08/31 01:45:09 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file7.txt] 2025/08/31 01:45:09 INFO : file4.txt: Copied (new) 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file8.txt] 2025/08/31 01:45:09 INFO : file5.txt: Copied (new) 2025/08/31 01:45:09 INFO : file6.txt: Copied (new) 2025/08/31 01:45:09 INFO : file7.txt: Copied (new) 2025/08/31 01:45:09 INFO : file8.txt: Copied (new) 2025/08/31 01:45:09 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: list [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2] 2025/08/31 01:45:09 NOTICE: (01) : test changes 2025/08/31 01:45:09 NOTICE: (02) : test initial bisync 2025/08/31 01:45:09 NOTICE: (03) : bisync resync nomodtime 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:09 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2025/08/31 01:45:09 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" 2025/08/31 01:45:09 INFO : Copying Path2 files to Path1 2025/08/31 01:45:09 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:45:09 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:45:09 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:45:10 INFO : Resync updating listings 2025/08/31 01:45:10 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" 2025/08/31 01:45:10 INFO : Bisync successful 2025/08/31 01:45:10 NOTICE: (04) : test make modifications on both paths 2025/08/31 01:45:10 NOTICE: (05) : test new on path2 - file10 2025/08/31 01:45:10 NOTICE: (06) : copy-file /tmp/014414fa/datadir/test_nomodtime-vajapup2/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/ 2025/08/31 01:45:10 DEBUG : copyFile "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file10.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" as "" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file10.txt" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" 2025/08/31 01:45:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:10 DEBUG : operations.CopyFile "file10.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" as "file10.txt" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file10.txt] 2025/08/31 01:45:10 DEBUG : file10.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file10.txt] 2025/08/31 01:45:10 INFO : file10.txt: Copied (new) 2025/08/31 01:45:10 NOTICE: (07) : test changed on path2 - file1 2025/08/31 01:45:10 NOTICE: (08) : copy-file /tmp/014414fa/datadir/test_nomodtime-vajapup2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/ 2025/08/31 01:45:10 DEBUG : copyFile "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file1.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" as "" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file1.txt" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" 2025/08/31 01:45:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:10 DEBUG : operations.CopyFile "file1.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" as "file1.txt" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file1.txt] 2025/08/31 01:45:10 DEBUG : file1.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file1.txt] 2025/08/31 01:45:10 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:45:10 NOTICE: (09) : test new on path1 - file11 2025/08/31 01:45:10 NOTICE: (10) : copy-file /tmp/014414fa/datadir/test_nomodtime-vajapup2/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/ 2025/08/31 01:45:10 DEBUG : copyFile "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file11.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" as "" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file11.txt" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" 2025/08/31 01:45:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:10 DEBUG : operations.CopyFile "file11.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" as "file11.txt" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file11.txt] 2025/08/31 01:45:10 DEBUG : file11.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file11.txt] 2025/08/31 01:45:10 INFO : file11.txt: Copied (new) 2025/08/31 01:45:10 NOTICE: (11) : test changed on path1 - file2 2025/08/31 01:45:10 NOTICE: (12) : copy-file /tmp/014414fa/datadir/test_nomodtime-vajapup2/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/ 2025/08/31 01:45:10 DEBUG : copyFile "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file2.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" as "" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file2.txt" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" 2025/08/31 01:45:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:10 DEBUG : operations.CopyFile "file2.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" as "file2.txt" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file2.txt] 2025/08/31 01:45:10 DEBUG : file2.txt: Sizes differ (src 13 vs dst 0) 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file2.txt] 2025/08/31 01:45:10 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:45:10 NOTICE: (13) : test deleted on path2 - file3 2025/08/31 01:45:10 NOTICE: (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file3.txt 2025/08/31 01:45:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" 2025/08/31 01:45:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:10 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file3.txt] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: remove [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file3.txt] 2025/08/31 01:45:10 INFO : file3.txt: Deleted 2025/08/31 01:45:10 NOTICE: (15) : test deleted on path1 - file4 2025/08/31 01:45:10 NOTICE: (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file4.txt 2025/08/31 01:45:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" 2025/08/31 01:45:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:10 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file4.txt] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: remove [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file4.txt] 2025/08/31 01:45:10 INFO : file4.txt: Deleted 2025/08/31 01:45:10 NOTICE: (17) : test deleted on both paths - file8 2025/08/31 01:45:10 NOTICE: (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file8.txt 2025/08/31 01:45:10 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file8.txt] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: remove [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file8.txt] 2025/08/31 01:45:10 INFO : file8.txt: Deleted 2025/08/31 01:45:10 NOTICE: (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file8.txt 2025/08/31 01:45:10 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file8.txt] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: remove [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file8.txt] 2025/08/31 01:45:10 INFO : file8.txt: Deleted 2025/08/31 01:45:10 NOTICE: (20) : test changed on both paths - file5 (file5R, file5L) 2025/08/31 01:45:10 NOTICE: (21) : copy-as /tmp/014414fa/datadir/test_nomodtime-vajapup2/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/ file5.txt 2025/08/31 01:45:10 DEBUG : copyFile "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file5R.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" as "file5.txt" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file5R.txt" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" 2025/08/31 01:45:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:10 DEBUG : operations.CopyFile "file5R.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" as "file5.txt" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file5.txt] 2025/08/31 01:45:10 DEBUG : file5R.txt: Sizes differ (src 39 vs dst 0) 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file5.txt] 2025/08/31 01:45:10 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2025/08/31 01:45:10 NOTICE: (22) : copy-as /tmp/014414fa/datadir/test_nomodtime-vajapup2/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/ file5.txt 2025/08/31 01:45:10 DEBUG : copyFile "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file5L.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" as "file5.txt" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file5L.txt" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" 2025/08/31 01:45:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:10 DEBUG : operations.CopyFile "file5L.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" as "file5.txt" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file5.txt] 2025/08/31 01:45:10 DEBUG : file5L.txt: Sizes differ (src 39 vs dst 0) 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file5.txt] 2025/08/31 01:45:10 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2025/08/31 01:45:10 NOTICE: (23) : test changed on path2 and deleted on path1 - file6 2025/08/31 01:45:10 NOTICE: (24) : copy-file /tmp/014414fa/datadir/test_nomodtime-vajapup2/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/ 2025/08/31 01:45:10 DEBUG : copyFile "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file6.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" as "" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file6.txt" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" 2025/08/31 01:45:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:10 DEBUG : operations.CopyFile "file6.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" as "file6.txt" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file6.txt] 2025/08/31 01:45:10 DEBUG : file6.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file6.txt] 2025/08/31 01:45:10 INFO : file6.txt: Copied (replaced existing) 2025/08/31 01:45:10 NOTICE: (25) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file6.txt 2025/08/31 01:45:10 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file6.txt] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: remove [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file6.txt] 2025/08/31 01:45:10 INFO : file6.txt: Deleted 2025/08/31 01:45:10 NOTICE: (26) : test changed on path1 and deleted on path2 - file7 2025/08/31 01:45:10 NOTICE: (27) : copy-file /tmp/014414fa/datadir/test_nomodtime-vajapup2/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/ 2025/08/31 01:45:10 DEBUG : copyFile "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file7.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" as "" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_nomodtime-vajapup2/file7.txt" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" 2025/08/31 01:45:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:10 DEBUG : operations.CopyFile "file7.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" as "file7.txt" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file7.txt] 2025/08/31 01:45:10 DEBUG : file7.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/: update [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file7.txt] 2025/08/31 01:45:10 INFO : file7.txt: Copied (replaced existing) 2025/08/31 01:45:10 NOTICE: (28) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file7.txt 2025/08/31 01:45:10 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: new [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file7.txt] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/: remove [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file7.txt] 2025/08/31 01:45:10 INFO : file7.txt: Deleted 2025/08/31 01:45:10 NOTICE: (29) : test bisync run 2025/08/31 01:45:10 NOTICE: (30) : bisync nomodtime 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:10 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2025/08/31 01:45:10 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" 2025/08/31 01:45:10 INFO : Building Path1 and Path2 listings 2025/08/31 01:45:10 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:45:10 INFO : Path1 checking for diffs 2025/08/31 01:45:10 INFO : - Path1 File changed: size (larger), hash - file2.txt 2025/08/31 01:45:10 INFO : - Path1 File was deleted - file4.txt 2025/08/31 01:45:10 INFO : - Path1 File changed: size (larger), hash - file5.txt 2025/08/31 01:45:10 INFO : - Path1 File was deleted - file6.txt 2025/08/31 01:45:10 INFO : - Path1 File changed: size (larger), hash - file7.txt 2025/08/31 01:45:10 INFO : - Path1 File was deleted - file8.txt 2025/08/31 01:45:10 INFO : - Path1 File is new - file11.txt 2025/08/31 01:45:10 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2025/08/31 01:45:10 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2025/08/31 01:45:10 INFO : Path2 checking for diffs 2025/08/31 01:45:10 INFO : - Path2 File changed: size (larger), hash - file1.txt 2025/08/31 01:45:10 INFO : - Path2 File was deleted - file3.txt 2025/08/31 01:45:10 INFO : - Path2 File changed: size (larger), hash - file5.txt 2025/08/31 01:45:10 INFO : - Path2 File changed: size (larger), hash - file6.txt 2025/08/31 01:45:10 INFO : - Path2 File was deleted - file7.txt 2025/08/31 01:45:10 INFO : - Path2 File was deleted - file8.txt 2025/08/31 01:45:10 INFO : - Path2 File is new - file10.txt 2025/08/31 01:45:10 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2025/08/31 01:45:10 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2025/08/31 01:45:10 INFO : Applying changes 2025/08/31 01:45:10 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file11.txt 2025/08/31 01:45:10 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file2.txt 2025/08/31 01:45:10 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file4.txt 2025/08/31 01:45:10 NOTICE: - WARNING New or changed in both paths - file5.txt 2025/08/31 01:45:10 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file5.txt.conflict1 2025/08/31 01:45:10 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2025/08/31 01:45:10 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file5.txt.conflict1 2025/08/31 01:45:10 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file5.txt.conflict2 2025/08/31 01:45:10 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2025/08/31 01:45:10 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file5.txt.conflict2 2025/08/31 01:45:10 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file6.txt 2025/08/31 01:45:10 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/file7.txt 2025/08/31 01:45:10 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file1.txt 2025/08/31 01:45:10 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file10.txt 2025/08/31 01:45:10 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/file3.txt 2025/08/31 01:45:10 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:45:10 INFO : file10.txt: Copied (new) 2025/08/31 01:45:10 INFO : file5.txt.conflict2: Copied (new) 2025/08/31 01:45:10 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:45:10 INFO : file6.txt: Copied (new) 2025/08/31 01:45:10 INFO : file3.txt: Deleted 2025/08/31 01:45:10 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:45:10 INFO : file11.txt: Copied (new) 2025/08/31 01:45:10 INFO : file5.txt.conflict1: Copied (new) 2025/08/31 01:45:10 INFO : file7.txt: Copied (new) 2025/08/31 01:45:10 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:45:10 INFO : file4.txt: Deleted 2025/08/31 01:45:10 INFO : Updating listings 2025/08/31 01:45:10 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/nomodtime/path2/" 2025/08/31 01:45:10 INFO : Bisync successful 2025/08/31 01:45:10 NOTICE: ---------------------------------------------------------- 2025/08/31 01:45:10 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:45:10 NOTICE: | @@ -16 +15,0 @@ 2025/08/31 01:45:10 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:45:10 NOTICE: | @@ -18 +16,0 @@ 2025/08/31 01:45:10 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:45:10 NOTICE: ---------------------------------------------------------- 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1: purge [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path1] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2: purge [/rclone-test-qasofaq0pisu/014414fa/nomodtime/path2] bisync_test.go:597: TEST nomodtime FAILED - 1 MISCOMPARED FILES === RUN TestBisyncRemoteRemote/rclone_args 2025/08/31 01:45:10 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-qasofaq0pisu/014414fa" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa" 2025/08/31 01:45:10 INFO : path1: Making directory 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa: mkdir [/rclone-test-qasofaq0pisu/014414fa/path1] 2025/08/31 01:45:10 DEBUG : Creating backend with remote "TestHdfs:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1" 2025/08/31 01:45:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:45:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:45:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:45:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:45:10 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1" 2025/08/31 01:45:10 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-qasofaq0pisu/014414fa" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa" 2025/08/31 01:45:10 INFO : path2: Making directory 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa: mkdir [/rclone-test-qasofaq0pisu/014414fa/path2] 2025/08/31 01:45:10 DEBUG : Creating backend with remote "TestHdfs:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2" 2025/08/31 01:45:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:45:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:45:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2025/08/31 01:45:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2025/08/31 01:45:10 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2" 2025/08/31 01:45:10 DEBUG : Creating backend with remote "/tmp/014414fa/initdir/test_rclone_args-gehixum9" 2025/08/31 01:45:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : subdir: Making directory with metadata 2025/08/31 01:45:10 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2025/08/31 01:45:10 DEBUG : Added delayed dir = "subdir", newDst=subdir 2025/08/31 01:45:10 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : Local file system at /tmp/014414fa/initdir/test_rclone_args-gehixum9: Waiting for checks to finish 2025/08/31 01:45:10 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/08/31 01:45:10 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/08/31 01:45:10 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:45:10 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:10 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2025/08/31 01:45:10 INFO : file2.txt: Copied (new) 2025/08/31 01:45:10 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:10 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2025/08/31 01:45:10 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:45:10 DEBUG : Local file system at /tmp/014414fa/initdir/test_rclone_args-gehixum9: Waiting for transfers to finish 2025/08/31 01:45:10 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2025/08/31 01:45:10 DEBUG : file1.txt.dae86b42.partial: renamed to: file1.txt 2025/08/31 01:45:10 INFO : file1.txt: Copied (new) 2025/08/31 01:45:10 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:10 DEBUG : subdir/file21.txt.5028a97.partial: renamed to: subdir/file21.txt 2025/08/31 01:45:10 INFO : subdir/file21.txt: Copied (new) 2025/08/31 01:45:10 INFO : subdir: Set directory modification time (using SetModTime) 2025/08/31 01:45:10 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1" 2025/08/31 01:45:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : file21.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:10 DEBUG : file20.txt.b4075ff1.partial: renamed to: file20.txt 2025/08/31 01:45:10 INFO : file20.txt: Copied (new) 2025/08/31 01:45:10 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/08/31 01:45:10 DEBUG : file21.txt.b4075ff1.partial: renamed to: file21.txt 2025/08/31 01:45:10 INFO : file21.txt: Copied (new) 2025/08/31 01:45:10 DEBUG : Local file system at /tmp/014414fa/datadir/test_rclone_args-mopageb1: Waiting for checks to finish 2025/08/31 01:45:10 DEBUG : Local file system at /tmp/014414fa/datadir/test_rclone_args-mopageb1: Waiting for transfers to finish 2025/08/31 01:45:10 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:45:10 DEBUG : file1.txt.6bedbe24.partial: renamed to: file1.txt 2025/08/31 01:45:10 INFO : file1.txt: Copied (new) 2025/08/31 01:45:10 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2025/08/31 01:45:10 DEBUG : file2.txt.6bedbe24.partial: renamed to: file2.txt 2025/08/31 01:45:10 INFO : file2.txt: Copied (new) 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: purge [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: purge [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1] 2025/08/31 01:45:10 ERROR : error listing: directory not found 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2] 2025/08/31 01:45:10 ERROR : error listing: directory not found 2025/08/31 01:45:10 NOTICE: checking initFs Local file system at /tmp/014414fa/initdir/test_rclone_args-gehixum9 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1] 2025/08/31 01:45:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 INFO : subdir: Making directory 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: mkdir [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/RCLONE_TEST] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file1.txt] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file2.txt] 2025/08/31 01:45:10 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: Waiting for checks to finish 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: Waiting for transfers to finish 2025/08/31 01:45:10 INFO : file2.txt: Copied (new) 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/file21.txt] 2025/08/31 01:45:10 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:45:10 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:45:10 INFO : file1.txt: Copied (new) 2025/08/31 01:45:10 INFO : subdir/file21.txt: Copied (new) 2025/08/31 01:45:10 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2] 2025/08/31 01:45:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 INFO : subdir: Making directory 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/RCLONE_TEST] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: mkdir [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file2.txt] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file1.txt] 2025/08/31 01:45:10 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/file20.txt] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: Waiting for checks to finish 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: Waiting for transfers to finish 2025/08/31 01:45:10 INFO : subdir/file20.txt: Copied (new) 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:45:10 INFO : file2.txt: Copied (new) 2025/08/31 01:45:10 INFO : RCLONE_TEST: Copied (new) 2025/08/31 01:45:10 INFO : file1.txt: Copied (new) 2025/08/31 01:45:10 INFO : subdir/file21.txt: Copied (new) 2025/08/31 01:45:10 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2] 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir] 2025/08/31 01:45:10 NOTICE: (01) : test rclone-args 2025/08/31 01:45:10 NOTICE: (02) : touch-glob 2001-01-02 /tmp/014414fa/datadir/test_rclone_args-mopageb1/ * 2025/08/31 01:45:10 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/" 2025/08/31 01:45:10 DEBUG : fs cache: renaming cache item "/tmp/014414fa/datadir/test_rclone_args-mopageb1/" to be canonical "/tmp/014414fa/datadir/test_rclone_args-mopageb1" 2025/08/31 01:45:10 DEBUG : file21.txt: Set modification time 2001-01-02 2025/08/31 01:45:10 DEBUG : file1.txt: Set modification time 2001-01-02 2025/08/31 01:45:10 DEBUG : file2.txt: Set modification time 2001-01-02 2025/08/31 01:45:10 DEBUG : file20.txt: Set modification time 2001-01-02 2025/08/31 01:45:10 NOTICE: (03) : test initial bisync 2025/08/31 01:45:10 NOTICE: (04) : bisync resync checksum 2025/08/31 01:45:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:10 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test: replication in progress) 2025/08/31 01:45:10 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/08/31 01:45:10 DEBUG : pacer: Reducing sleep to 30ms 2025/08/31 01:45:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:14 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2025/08/31 01:45:14 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:14 INFO : Copying Path2 files to Path1 2025/08/31 01:45:14 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:45:14 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:45:14 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:45:14 INFO : Resync updating listings 2025/08/31 01:45:14 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:14 INFO : Bisync successful 2025/08/31 01:45:14 NOTICE: (05) : test place newer files on both paths 2025/08/31 01:45:14 NOTICE: (06) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/ 2025/08/31 01:45:14 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file1.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" as "" 2025/08/31 01:45:14 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file1.txt" 2025/08/31 01:45:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" 2025/08/31 01:45:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:14 DEBUG : operations.CopyFile "file1.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" as "file1.txt" 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file1.txt] 2025/08/31 01:45:14 DEBUG : file1.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file1.txt] 2025/08/31 01:45:14 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:45:14 NOTICE: (07) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/ 2025/08/31 01:45:14 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file2.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" as "" 2025/08/31 01:45:14 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file2.txt" 2025/08/31 01:45:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:14 DEBUG : operations.CopyFile "file2.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" as "file2.txt" 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file2.txt] 2025/08/31 01:45:14 DEBUG : file2.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file2.txt] 2025/08/31 01:45:14 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:45:14 NOTICE: (08) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir 2025/08/31 01:45:14 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file20.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir" as "" 2025/08/31 01:45:14 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file20.txt" 2025/08/31 01:45:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir" 2025/08/31 01:45:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:14 DEBUG : operations.CopyFile "file20.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir" as "file20.txt" 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:45:14 DEBUG : file20.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:45:14 INFO : file20.txt: Copied (replaced existing) 2025/08/31 01:45:14 NOTICE: (09) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir 2025/08/31 01:45:14 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir" as "" 2025/08/31 01:45:14 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt" 2025/08/31 01:45:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir" 2025/08/31 01:45:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:14 DEBUG : operations.CopyFile "file21.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir" as "file21.txt" 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:45:14 DEBUG : file21.txt: Modification times differ by -8808h0m0s: 2001-01-02 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:45:14 INFO : file21.txt: Copied (replaced existing) 2025/08/31 01:45:14 NOTICE: (10) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/ file1.txt 2025/08/31 01:45:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" 2025/08/31 01:45:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:14 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1] 2025/08/31 01:45:14 DEBUG : file1.txt: Set modification time 2001-01-02 2025/08/31 01:45:14 NOTICE: (11) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/ file2.txt 2025/08/31 01:45:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:14 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2] 2025/08/31 01:45:14 DEBUG : file2.txt: Set modification time 2001-01-02 2025/08/31 01:45:14 NOTICE: (12) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/ file20.txt 2025/08/31 01:45:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/" 2025/08/31 01:45:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:14 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/" 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir] 2025/08/31 01:45:14 DEBUG : file20.txt: Set modification time 2001-01-02 2025/08/31 01:45:14 NOTICE: (13) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/ file21.txt 2025/08/31 01:45:14 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/" 2025/08/31 01:45:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:14 DEBUG : fs cache: renaming cache item "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/" to be canonical "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/" 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir] 2025/08/31 01:45:14 DEBUG : file21.txt: Set modification time 2001-01-02 2025/08/31 01:45:14 NOTICE: (14) : test run bisync with custom options 2025/08/31 01:45:14 NOTICE: (15) : bisync checksum 2025/08/31 01:45:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:14 DEBUG : pacer: Reducing sleep to 22.5ms 2025/08/31 01:45:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:18 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2025/08/31 01:45:18 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:18 INFO : Building Path1 and Path2 listings 2025/08/31 01:45:18 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:45:19 INFO : Path1 checking for diffs 2025/08/31 01:45:19 INFO : - Path1 File changed: hash - file1.txt 2025/08/31 01:45:19 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2025/08/31 01:45:19 INFO : (Modified:  1 hash differs) 2025/08/31 01:45:19 INFO : Path2 checking for diffs 2025/08/31 01:45:19 INFO : - Path2 File changed: size (larger), hash - file2.txt 2025/08/31 01:45:19 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2025/08/31 01:45:19 INFO : (Modified:  1 larger,  0 smaller,  1 hash differs) 2025/08/31 01:45:19 INFO : Applying changes 2025/08/31 01:45:19 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file1.txt 2025/08/31 01:45:19 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file2.txt 2025/08/31 01:45:19 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:45:19 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:45:19 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:45:19 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:45:19 INFO : Updating listings 2025/08/31 01:45:19 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:19 INFO : Bisync successful 2025/08/31 01:45:19 NOTICE: (16) : touch-glob 2007-07-23 /tmp/014414fa/datadir/test_rclone_args-mopageb1/ * 2025/08/31 01:45:19 DEBUG : fs cache: switching user supplied name "/tmp/014414fa/datadir/test_rclone_args-mopageb1/" for canonical name "/tmp/014414fa/datadir/test_rclone_args-mopageb1" 2025/08/31 01:45:19 DEBUG : file21.txt: Set modification time 2007-07-23 2025/08/31 01:45:19 DEBUG : file1.txt: Set modification time 2007-07-23 2025/08/31 01:45:19 DEBUG : file2.txt: Set modification time 2007-07-23 2025/08/31 01:45:19 DEBUG : file20.txt: Set modification time 2007-07-23 2025/08/31 01:45:19 NOTICE: (17) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/ 2025/08/31 01:45:19 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file1.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" as "" 2025/08/31 01:45:19 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file1.txt" 2025/08/31 01:45:19 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" 2025/08/31 01:45:19 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:19 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:19 DEBUG : operations.CopyFile "file1.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" as "file1.txt" 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file1.txt] 2025/08/31 01:45:19 DEBUG : file1.txt: Modification times differ by -57432h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2001-01-02 00:00:00 +0000 UTC 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file1.txt] 2025/08/31 01:45:19 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:45:19 NOTICE: (18) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/ 2025/08/31 01:45:19 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file2.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" as "" 2025/08/31 01:45:19 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file2.txt" 2025/08/31 01:45:19 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:19 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:19 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:19 DEBUG : operations.CopyFile "file2.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" as "file2.txt" 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file2.txt] 2025/08/31 01:45:19 DEBUG : file2.txt: Modification times differ by -57432h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2001-01-02 00:00:00 +0000 UTC 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file2.txt] 2025/08/31 01:45:19 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:45:19 NOTICE: (19) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir 2025/08/31 01:45:19 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file20.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir" as "" 2025/08/31 01:45:19 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file20.txt" 2025/08/31 01:45:19 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir" 2025/08/31 01:45:19 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:19 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:19 DEBUG : operations.CopyFile "file20.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir" as "file20.txt" 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:45:19 DEBUG : file20.txt: Modification times differ by -57432h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2001-01-02 00:00:00 +0000 UTC 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:45:19 INFO : file20.txt: Copied (replaced existing) 2025/08/31 01:45:19 NOTICE: (20) : copy-as /tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/ file1.txt 2025/08/31 01:45:19 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" as "file1.txt" 2025/08/31 01:45:19 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt" 2025/08/31 01:45:19 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:19 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:19 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:19 DEBUG : operations.CopyFile "file21.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" as "file1.txt" 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file1.txt] 2025/08/31 01:45:19 DEBUG : file21.txt: Sizes differ (src 0 vs dst 19) 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file1.txt] 2025/08/31 01:45:19 INFO : file21.txt: Copied (replaced existing) to: file1.txt 2025/08/31 01:45:19 NOTICE: (21) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/ file1.txt 2025/08/31 01:45:19 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1] 2025/08/31 01:45:19 DEBUG : file1.txt: Set modification time 2007-07-23 2025/08/31 01:45:19 NOTICE: (22) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/ file2.txt 2025/08/31 01:45:19 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2] 2025/08/31 01:45:19 DEBUG : file2.txt: Set modification time 2007-07-23 2025/08/31 01:45:19 NOTICE: (23) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/ file20.txt 2025/08/31 01:45:19 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/" 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir] 2025/08/31 01:45:19 DEBUG : file20.txt: Set modification time 2007-07-23 2025/08/31 01:45:19 NOTICE: (24) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/ file21.txt 2025/08/31 01:45:19 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/" 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir] 2025/08/31 01:45:19 DEBUG : file21.txt: Set modification time 2007-07-23 2025/08/31 01:45:19 NOTICE: (25) : bisync size-only 2025/08/31 01:45:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:23 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:45:23 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:45:23 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:23 INFO : Building Path1 and Path2 listings 2025/08/31 01:45:23 INFO : Path1 checking for diffs 2025/08/31 01:45:23 INFO : Path2 checking for diffs 2025/08/31 01:45:23 INFO : - Path2 File changed: size (smaller) - file1.txt 2025/08/31 01:45:23 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2025/08/31 01:45:23 INFO : (Modified:  0 larger,  1 smaller) 2025/08/31 01:45:23 INFO : Applying changes 2025/08/31 01:45:23 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file1.txt 2025/08/31 01:45:23 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:45:23 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:45:23 INFO : Updating listings 2025/08/31 01:45:23 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:23 INFO : Bisync successful 2025/08/31 01:45:23 NOTICE: (26) : bisync resync 2025/08/31 01:45:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:27 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:45:27 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:45:27 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:27 INFO : Copying Path2 files to Path1 2025/08/31 01:45:27 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:45:27 INFO : There was nothing to transfer 2025/08/31 01:45:27 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:45:27 INFO : subdir/file20.txt: Copied (replaced existing) 2025/08/31 01:45:27 INFO : subdir/file21.txt: Copied (replaced existing) 2025/08/31 01:45:27 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:45:27 INFO : Resync updating listings 2025/08/31 01:45:27 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:27 INFO : Bisync successful 2025/08/31 01:45:27 NOTICE: (27) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/ 2025/08/31 01:45:27 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file1.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" as "" 2025/08/31 01:45:27 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file1.txt" 2025/08/31 01:45:27 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" 2025/08/31 01:45:27 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:27 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:27 DEBUG : operations.CopyFile "file1.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" as "file1.txt" 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file1.txt] 2025/08/31 01:45:27 DEBUG : file1.txt: Sizes differ (src 19 vs dst 0) 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file1.txt] 2025/08/31 01:45:27 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:45:27 NOTICE: (28) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/ 2025/08/31 01:45:27 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file2.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" as "" 2025/08/31 01:45:27 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file2.txt" 2025/08/31 01:45:27 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:27 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:27 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:27 DEBUG : operations.CopyFile "file2.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" as "file2.txt" 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file2.txt] 2025/08/31 01:45:27 DEBUG : file2.txt: Modification times differ by -57432h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2001-01-02 00:00:00 +0000 UTC 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file2.txt] 2025/08/31 01:45:27 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:45:27 NOTICE: (29) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir 2025/08/31 01:45:27 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file20.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir" as "" 2025/08/31 01:45:27 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file20.txt" 2025/08/31 01:45:27 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir" 2025/08/31 01:45:27 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:27 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:27 DEBUG : operations.CopyFile "file20.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir" as "file20.txt" 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:45:27 DEBUG : file20.txt: Size and modification time the same (differ by 0s, within tolerance 1s) 2025/08/31 01:45:27 DEBUG : file20.txt: Unchanged skipping 2025/08/31 01:45:27 NOTICE: (30) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir 2025/08/31 01:45:27 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir" as "" 2025/08/31 01:45:27 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt" 2025/08/31 01:45:27 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir" 2025/08/31 01:45:27 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:27 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:27 DEBUG : operations.CopyFile "file21.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir" as "file21.txt" 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:45:27 DEBUG : file21.txt: Modification times differ by -66240h0m0s: 2007-07-23 00:00:00 +0000 UTC, 2000-01-01 00:00:00 +0000 UTC 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:45:27 INFO : file21.txt: Copied (replaced existing) 2025/08/31 01:45:27 NOTICE: (31) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/ file1.txt 2025/08/31 01:45:27 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1] 2025/08/31 01:45:27 DEBUG : file1.txt: Set modification time 2007-07-23 2025/08/31 01:45:27 NOTICE: (32) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/ file2.txt 2025/08/31 01:45:27 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2] 2025/08/31 01:45:27 DEBUG : file2.txt: Set modification time 2007-07-23 2025/08/31 01:45:27 NOTICE: (33) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/ file20.txt 2025/08/31 01:45:27 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/" 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir] 2025/08/31 01:45:27 DEBUG : file20.txt: Set modification time 2007-07-23 2025/08/31 01:45:27 NOTICE: (34) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/ file21.txt 2025/08/31 01:45:27 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/" 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir] 2025/08/31 01:45:27 DEBUG : file21.txt: Set modification time 2007-07-23 2025/08/31 01:45:27 NOTICE: (35) : bisync ignore-size 2025/08/31 01:45:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:27 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test: replication in progress) 2025/08/31 01:45:27 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/08/31 01:45:27 DEBUG : pacer: Reducing sleep to 30ms 2025/08/31 01:45:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:29 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test: replication in progress) 2025/08/31 01:45:29 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/08/31 01:45:29 DEBUG : pacer: Reducing sleep to 30ms 2025/08/31 01:45:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/08/31 01:45:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": false, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/08/31 01:45:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:31 INFO : Building Path1 and Path2 listings 2025/08/31 01:45:31 INFO : Path1 checking for diffs 2025/08/31 01:45:31 INFO : Path2 checking for diffs 2025/08/31 01:45:31 INFO : - Path2 File changed: time (newer) - file2.txt 2025/08/31 01:45:31 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2025/08/31 01:45:31 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2025/08/31 01:45:31 INFO : (Modified:  2 newer,  0 older) 2025/08/31 01:45:31 INFO : Applying changes 2025/08/31 01:45:31 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file2.txt 2025/08/31 01:45:31 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/file21.txt 2025/08/31 01:45:31 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:45:31 INFO : subdir/file21.txt: Copied (replaced existing) 2025/08/31 01:45:31 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:45:31 INFO : Updating listings 2025/08/31 01:45:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:31 INFO : Bisync successful 2025/08/31 01:45:31 NOTICE: (36) : bisync resync compare-all 2025/08/31 01:45:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:33 DEBUG : pacer: Reducing sleep to 22.5ms 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:35 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2025/08/31 01:45:35 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:35 INFO : Copying Path2 files to Path1 2025/08/31 01:45:35 INFO : - Path2 Resync is copying files to - Path1 2025/08/31 01:45:35 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:45:35 INFO : - Path1 Resync is copying files to - Path2 2025/08/31 01:45:35 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:45:35 INFO : Resync updating listings 2025/08/31 01:45:35 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:35 INFO : Bisync successful 2025/08/31 01:45:35 NOTICE: (37) : copy-as /tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/ file2.txt 2025/08/31 01:45:35 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" as "file2.txt" 2025/08/31 01:45:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt" 2025/08/31 01:45:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:35 DEBUG : operations.CopyFile "file21.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" as "file2.txt" 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file2.txt] 2025/08/31 01:45:35 DEBUG : file21.txt: Sizes differ (src 0 vs dst 19) 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file2.txt] 2025/08/31 01:45:35 INFO : file21.txt: Copied (replaced existing) to: file2.txt 2025/08/31 01:45:35 NOTICE: (38) : touch-glob 2023-08-26 /tmp/014414fa/datadir/test_rclone_args-mopageb1/ * 2025/08/31 01:45:35 DEBUG : fs cache: switching user supplied name "/tmp/014414fa/datadir/test_rclone_args-mopageb1/" for canonical name "/tmp/014414fa/datadir/test_rclone_args-mopageb1" 2025/08/31 01:45:35 DEBUG : file21.txt: Set modification time 2023-08-26 2025/08/31 01:45:35 DEBUG : file1.txt: Set modification time 2023-08-26 2025/08/31 01:45:35 DEBUG : file2.txt: Set modification time 2023-08-26 2025/08/31 01:45:35 DEBUG : file20.txt: Set modification time 2023-08-26 2025/08/31 01:45:35 NOTICE: (39) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/ 2025/08/31 01:45:35 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file1.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" as "" 2025/08/31 01:45:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file1.txt" 2025/08/31 01:45:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" 2025/08/31 01:45:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:35 DEBUG : operations.CopyFile "file1.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" as "file1.txt" 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file1.txt] 2025/08/31 01:45:35 DEBUG : file1.txt: Modification times differ by -141072h0m0s: 2023-08-26 00:00:00 +0000 UTC, 2007-07-23 00:00:00 +0000 UTC 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file1.txt] 2025/08/31 01:45:35 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:45:35 NOTICE: (40) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir 2025/08/31 01:45:35 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file20.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir" as "" 2025/08/31 01:45:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file20.txt" 2025/08/31 01:45:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir" 2025/08/31 01:45:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:35 DEBUG : operations.CopyFile "file20.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir" as "file20.txt" 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:45:35 DEBUG : file20.txt: Modification times differ by -141072h0m0s: 2023-08-26 00:00:00 +0000 UTC, 2007-07-23 00:00:00 +0000 UTC 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/file20.txt] 2025/08/31 01:45:35 INFO : file20.txt: Copied (replaced existing) 2025/08/31 01:45:35 NOTICE: (41) : copy-file /tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir 2025/08/31 01:45:35 DEBUG : copyFile "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt" to "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir" as "" 2025/08/31 01:45:35 DEBUG : Creating backend with remote "/tmp/014414fa/datadir/test_rclone_args-mopageb1/file21.txt" 2025/08/31 01:45:35 DEBUG : Creating backend with remote "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir" 2025/08/31 01:45:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2025/08/31 01:45:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2025/08/31 01:45:35 DEBUG : operations.CopyFile "file21.txt" to "hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir" as "file21.txt" 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir: new [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:45:35 DEBUG : file21.txt: Modification times differ by -141072h0m0s: 2023-08-26 00:00:00 +0000 UTC, 2007-07-23 00:00:00 +0000 UTC 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/file21.txt] 2025/08/31 01:45:35 INFO : file21.txt: Copied (replaced existing) 2025/08/31 01:45:35 NOTICE: (42) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/ file2.txt 2025/08/31 01:45:35 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2] 2025/08/31 01:45:35 DEBUG : file2.txt: Set modification time 2007-07-23 2025/08/31 01:45:35 NOTICE: (43) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/ file1.txt 2025/08/31 01:45:35 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1] 2025/08/31 01:45:35 DEBUG : file1.txt: Set modification time 2023-08-26 2025/08/31 01:45:35 NOTICE: (44) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/ file20.txt 2025/08/31 01:45:35 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/" 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir] 2025/08/31 01:45:35 DEBUG : file20.txt: Set modification time 2023-08-26 2025/08/31 01:45:35 NOTICE: (45) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/ file21.txt 2025/08/31 01:45:35 DEBUG : fs cache: switching user supplied name "TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/" for canonical name "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/" 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/: list [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir] 2025/08/31 01:45:35 DEBUG : file21.txt: Set modification time 2023-08-26 2025/08/31 01:45:35 NOTICE: (46) : bisync compare-all 2025/08/31 01:45:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/modtime_write_test] 2025/08/31 01:45:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: update [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: remove [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/modtime_write_test] 2025/08/31 01:45:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: Skipping jamDirTimes as remote does not support DirSetModTime or MkdirMetadata 2025/08/31 01:45:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2025/08/31 01:45:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:39 INFO : Building Path1 and Path2 listings 2025/08/31 01:45:39 INFO : TestHdfs{cNNQW}: Downloading hashes... 2025/08/31 01:45:39 INFO : Path1 checking for diffs 2025/08/31 01:45:39 INFO : - Path1 File changed: time (newer) - file1.txt 2025/08/31 01:45:39 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2025/08/31 01:45:39 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2025/08/31 01:45:39 INFO : (Modified:  2 newer,  0 older) 2025/08/31 01:45:39 INFO : Path2 checking for diffs 2025/08/31 01:45:39 INFO : - Path2 File changed: size (smaller), hash - file2.txt 2025/08/31 01:45:39 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2025/08/31 01:45:39 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2025/08/31 01:45:39 INFO : (Modified:  1 newer,  0 older,  0 larger,  1 smaller,  1 hash differs) 2025/08/31 01:45:39 INFO : Applying changes 2025/08/31 01:45:39 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/file1.txt 2025/08/31 01:45:39 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/subdir/file20.txt 2025/08/31 01:45:39 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/file2.txt 2025/08/31 01:45:39 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/subdir/file21.txt 2025/08/31 01:45:39 INFO : - Path2 Do queued copies to - Path1 2025/08/31 01:45:39 INFO : file2.txt: Copied (replaced existing) 2025/08/31 01:45:39 INFO : subdir/file21.txt: Copied (replaced existing) 2025/08/31 01:45:39 INFO : - Path1 Do queued copies to - Path2 2025/08/31 01:45:40 INFO : subdir/file20.txt: Copied (replaced existing) 2025/08/31 01:45:40 INFO : file1.txt: Copied (replaced existing) 2025/08/31 01:45:40 INFO : Updating listings 2025/08/31 01:45:40 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-qasofaq0pisu/014414fa/rclone_args/path2/" 2025/08/31 01:45:40 INFO : Bisync successful 2025/08/31 01:45:40 NOTICE: ---------------------------------------------------------- 2025/08/31 01:45:40 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/08/31 01:45:40 NOTICE: | @@ -17 +16,0 @@ 2025/08/31 01:45:40 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:45:40 NOTICE: | @@ -19 +17,0 @@ 2025/08/31 01:45:40 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:45:40 NOTICE: | @@ -110 +107,0 @@ 2025/08/31 01:45:40 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:45:40 NOTICE: | @@ -145 +141,0 @@ 2025/08/31 01:45:40 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:45:40 NOTICE: | @@ -162 +157,0 @@ 2025/08/31 01:45:40 NOTICE: | -INFO : There was nothing to transfer 2025/08/31 01:45:40 NOTICE: ---------------------------------------------------------- 2025/08/31 01:45:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1: purge [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path1] 2025/08/31 01:45:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2: purge [/rclone-test-qasofaq0pisu/014414fa/rclone_args/path2] bisync_test.go:597: TEST rclone_args FAILED - 1 MISCOMPARED FILES 2025/08/31 01:45:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu: Purge remote 2025/08/31 01:45:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-qasofaq0pisu: purge [/rclone-test-qasofaq0pisu] --- FAIL: TestBisyncRemoteRemote (86.03s) --- FAIL: TestBisyncRemoteRemote/all_changed (16.99s) --- FAIL: TestBisyncRemoteRemote/compare_all (9.26s) --- FAIL: TestBisyncRemoteRemote/createemptysrcdirs (29.23s) --- FAIL: TestBisyncRemoteRemote/nomodtime (0.96s) --- FAIL: TestBisyncRemoteRemote/rclone_args (29.58s) FAIL 2025/08/31 01:45:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-poyoxul6wihu: Purge remote 2025/08/31 01:45:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-poyoxul6wihu: purge [/rclone-test-poyoxul6wihu] 2025/08/31 01:45:40 NOTICE: purge failed: directory not found "./bisync.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose -test.run '^TestBisyncLocalRemote$/^(all_changed|compare_all|createemptysrcdirs|nomodtime|rclone_args)$|^TestBisyncRemoteLocal$/^(all_changed|compare_all|createemptysrcdirs|nomodtime|rclone_args)$|^TestBisyncRemoteRemote$/^(all_changed|compare_all|createemptysrcdirs|nomodtime|rclone_args)$'" - Finished ERROR in 2m54.454429636s (try 4/5): exit status 1: Failed [TestBisyncRemoteLocal/all_changed TestBisyncRemoteLocal/compare_all TestBisyncRemoteLocal/createemptysrcdirs TestBisyncRemoteLocal/nomodtime TestBisyncRemoteLocal/rclone_args TestBisyncLocalRemote/all_changed TestBisyncLocalRemote/compare_all TestBisyncLocalRemote/createemptysrcdirs TestBisyncLocalRemote/nomodtime TestBisyncLocalRemote/rclone_args TestBisyncRemoteRemote/all_changed TestBisyncRemoteRemote/compare_all TestBisyncRemoteRemote/createemptysrcdirs TestBisyncRemoteRemote/nomodtime TestBisyncRemoteRemote/rclone_args]