"./bisync.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose" - Starting (try 1/5) 2024/04/26 03:27:28 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kagekuv4suwitix4qisubul7" 2024/04/26 03:27:28 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/04/26 03:27:28 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:28 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:28 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:28 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:28 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:28 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:28 DEBUG : Creating backend with remote "/tmp/rclone3438885916" === RUN TestBisyncRemoteLocal 2024/04/26 03:27:28 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0" 2024/04/26 03:27:28 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:28 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:28 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:28 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:28 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:28 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:28 remote: TestHdfs:rclone-test-cucitan6cidobus7hereqoc0 === RUN TestBisyncRemoteLocal/all_changed 2024/04/26 03:27:28 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:28 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/04/26 03:27:28 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:28 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:28 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:28 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:28 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:28 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:28 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:28 DEBUG : path1: Making directory 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:28 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1" 2024/04/26 03:27:28 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:28 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:28 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:28 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:28 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:28 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:28 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1" 2024/04/26 03:27:28 DEBUG : Creating backend with remote "/tmp/032728we" 2024/04/26 03:27:28 DEBUG : Creating backend with remote "/tmp/032728we/all_changed/path2" 2024/04/26 03:27:28 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_all_changed/initial" 2024/04/26 03:27:28 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_all_changed-voxejad8" 2024/04/26 03:27:28 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:28 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:28 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:28 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : file1.copy1.txt.xirifiz4.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:28 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : file1.copy3.txt.kutogox2.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:28 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : Local file system at /tmp/032728we/initdir/test_all_changed-voxejad8: Waiting for checks to finish 2024/04/26 03:27:28 DEBUG : Local file system at /tmp/032728we/initdir/test_all_changed-voxejad8: Waiting for transfers to finish 2024/04/26 03:27:28 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:28 DEBUG : file1.copy2.txt.jikicev4.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:28 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : RCLONE_TEST.tufocip4.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:28 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:28 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : file1.copy5.txt.hajotez7.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:28 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : file1.copy4.txt.yohowir9.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:28 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : file1.txt.zebocuf5.partial: renamed to: file1.txt 2024/04/26 03:27:28 INFO : file1.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : subdir/file20.txt.tahupuv2.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:28 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:28 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1] 2024/04/26 03:27:28 ERROR : : error listing: directory not found 2024/04/26 03:27:28 ERROR : : error listing: directory not found 2024/04/26 03:27:28 checking initFs Local file system at /tmp/032728we/initdir/test_all_changed-voxejad8 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1] 2024/04/26 03:27:28 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : subdir: Making directory 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/RCLONE_TEST] 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/subdir] 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/file1.copy2.txt] 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/file1.copy1.txt] 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/file1.copy3.txt] 2024/04/26 03:27:28 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: Waiting for checks to finish 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: Waiting for transfers to finish 2024/04/26 03:27:28 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/file1.copy4.txt] 2024/04/26 03:27:28 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/file1.copy5.txt] 2024/04/26 03:27:28 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/file1.txt] 2024/04/26 03:27:28 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/subdir/file20.txt] 2024/04/26 03:27:28 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:28 INFO : file1.txt: Copied (new) 2024/04/26 03:27:28 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/RCLONE_TEST: replication in progress) 2024/04/26 03:27:28 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/04/26 03:27:28 DEBUG : pacer: low level retry 2/10 (error create /rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/RCLONE_TEST: replication in progress) 2024/04/26 03:27:28 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2024/04/26 03:27:28 DEBUG : pacer: Reducing sleep to 60ms 2024/04/26 03:27:28 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:28 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1] 2024/04/26 03:27:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/subdir] 2024/04/26 03:27:28 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:28 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:28 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:28 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:28 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : file1.copy1.txt.wuxukup5.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:28 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : Local file system at /tmp/032728we/all_changed/path2: Waiting for checks to finish 2024/04/26 03:27:28 DEBUG : Local file system at /tmp/032728we/all_changed/path2: Waiting for transfers to finish 2024/04/26 03:27:28 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : file1.copy3.txt.sobocol4.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:28 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : file1.copy2.txt.xucesan6.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:28 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : file1.copy5.txt.luseqor4.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:28 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : file1.txt.ferizex6.partial: renamed to: file1.txt 2024/04/26 03:27:28 INFO : file1.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : subdir/file20.txt.disatuh5.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:28 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:28 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:28 DEBUG : RCLONE_TEST.buvenan2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:28 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:28 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:28 DEBUG : file1.copy4.txt.mobosin1.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:28 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:28 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:28 checking path2 Local file system at /tmp/032728we/all_changed/path2 2024/04/26 03:27:28 (01) : test all-changed 2024/04/26 03:27:28 (02) : test initial bisync 2024/04/26 03:27:28 (03) : bisync resync 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:29 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:29 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/" with Path2 "/tmp/032728we/all_changed/path2/" 2024/04/26 03:27:29 INFO : Copying Path2 files to Path1 2024/04/26 03:27:29 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:29 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : Resync updating listings 2024/04/26 03:27:29 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/" vs Path2 "/tmp/032728we/all_changed/path2/" 2024/04/26 03:27:29 INFO : Bisync successful 2024/04/26 03:27:29 (04) : test change timestamp on all files except RCLONE_TEST 2024/04/26 03:27:29 (05) : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/ file* 2024/04/26 03:27:29 (06) : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/subdir file* 2024/04/26 03:27:29 (07) : test sync should pass 2024/04/26 03:27:29 (08) : bisync 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:29 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:29 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/" with Path2 "/tmp/032728we/all_changed/path2/" 2024/04/26 03:27:29 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:29 INFO : Path1 checking for diffs 2024/04/26 03:27:29 INFO : - Path1 File changed: time (newer) - file1.copy1.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (newer) - file1.copy2.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (newer) - file1.copy3.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (newer) - file1.copy4.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (newer) - file1.copy5.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (newer) - file1.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2024/04/26 03:27:29 INFO : Path1: 7 changes:  0 new,  7 modified,  0 deleted 2024/04/26 03:27:29 INFO : (Modified:  7 newer,  0 older) 2024/04/26 03:27:29 INFO : Path2 checking for diffs 2024/04/26 03:27:29 INFO : Applying changes 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/file1.copy1.txt 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/file1.copy2.txt 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/file1.copy3.txt 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/file1.copy4.txt 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/file1.copy5.txt 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/file1.txt 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/subdir/file20.txt 2024/04/26 03:27:29 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : file1.copy1.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : file1.copy2.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : file1.copy3.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : file1.copy4.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : file1.copy5.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : Updating listings 2024/04/26 03:27:29 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/" vs Path2 "/tmp/032728we/all_changed/path2/" 2024/04/26 03:27:29 INFO : Bisync successful 2024/04/26 03:27:29 (09) : test change timestamp on all files including RCLONE_TEST 2024/04/26 03:27:29 (10) : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/ * 2024/04/26 03:27:29 (11) : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/subdir * 2024/04/26 03:27:29 (12) : test sync should fail 2024/04/26 03:27:29 (13) : bisync 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:29 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:29 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/" with Path2 "/tmp/032728we/all_changed/path2/" 2024/04/26 03:27:29 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:29 INFO : Path1 checking for diffs 2024/04/26 03:27:29 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - file1.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2024/04/26 03:27:29 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2024/04/26 03:27:29 INFO : (Modified:  1 newer,  7 older) 2024/04/26 03:27:29 INFO : Path2 checking for diffs 2024/04/26 03:27:29 ERROR : Safety abort: all files were changed on Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/". Run with --force if desired. 2024/04/26 03:27:29 NOTICE: Bisync aborted. Please try again. 2024/04/26 03:27:29 Bisync error: all files were changed 2024/04/26 03:27:29 (14) : test sync with force should pass 2024/04/26 03:27:29 (15) : bisync force 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:29 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:29 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/" with Path2 "/tmp/032728we/all_changed/path2/" 2024/04/26 03:27:29 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:29 INFO : Path1 checking for diffs 2024/04/26 03:27:29 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - file1.txt 2024/04/26 03:27:29 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2024/04/26 03:27:29 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2024/04/26 03:27:29 INFO : (Modified:  1 newer,  7 older) 2024/04/26 03:27:29 INFO : Path2 checking for diffs 2024/04/26 03:27:29 INFO : Applying changes 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/RCLONE_TEST 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/file1.copy1.txt 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/file1.copy2.txt 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/file1.copy3.txt 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/file1.copy4.txt 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/file1.copy5.txt 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/file1.txt 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/all_changed/path2/subdir/file20.txt 2024/04/26 03:27:29 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : file1.copy2.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : file1.copy3.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : file1.copy4.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : file1.copy5.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : file1.copy1.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : RCLONE_TEST: Copied (replaced existing) 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : Updating listings 2024/04/26 03:27:29 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/all_changed/path1/" vs Path2 "/tmp/032728we/all_changed/path2/" 2024/04/26 03:27:29 INFO : Bisync successful bisync_test.go:553: TEST all_changed PASSED === RUN TestBisyncRemoteLocal/backupdir 2024/04/26 03:27:29 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:29 DEBUG : path1: Making directory 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:29 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1" 2024/04/26 03:27:29 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:29 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:29 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:29 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:29 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:29 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:29 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1" 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/tmp/032728we/backupdir/path2" 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_backupdir/initial" 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_backupdir-kubalij8" 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/initdir/test_backupdir-kubalij8: Waiting for checks to finish 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/initdir/test_backupdir-kubalij8: Waiting for transfers to finish 2024/04/26 03:27:29 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file1.txt.yurehum8.partial: renamed to: file1.txt 2024/04/26 03:27:29 INFO : file1.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file2.txt.taxuqet7.partial: renamed to: file2.txt 2024/04/26 03:27:29 INFO : file2.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file4.txt.xokicon3.partial: renamed to: file4.txt 2024/04/26 03:27:29 INFO : file4.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file3.txt.maqilij4.partial: renamed to: file3.txt 2024/04/26 03:27:29 INFO : file3.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file5.txt.yivigac9.partial: renamed to: file5.txt 2024/04/26 03:27:29 INFO : file5.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file6.txt.jiqecem5.partial: renamed to: file6.txt 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:29 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 INFO : file6.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file7.txt.peyidat1.partial: renamed to: file7.txt 2024/04/26 03:27:29 INFO : file7.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file8.txt.boyosov0.partial: renamed to: file8.txt 2024/04/26 03:27:29 INFO : file8.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : RCLONE_TEST.fiponel1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:29 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_backupdir/modfiles" 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_backupdir-muqecer2" 2024/04/26 03:27:29 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/datadir/test_backupdir-muqecer2: Waiting for checks to finish 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/datadir/test_backupdir-muqecer2: Waiting for transfers to finish 2024/04/26 03:27:29 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:29 DEBUG : file2.txt.ritapoh6.partial: renamed to: file2.txt 2024/04/26 03:27:29 INFO : file2.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:29 DEBUG : file10.txt.kovufuy6.partial: renamed to: file10.txt 2024/04/26 03:27:29 INFO : file10.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:29 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:29 DEBUG : file1.txt.wogayif4.partial: renamed to: file1.txt 2024/04/26 03:27:29 INFO : file1.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file11.txt.vofocay5.partial: renamed to: file11.txt 2024/04/26 03:27:29 INFO : file11.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:29 DEBUG : file5L.txt.honuqap1.partial: renamed to: file5L.txt 2024/04/26 03:27:29 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:29 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:29 DEBUG : file5R.txt.taqokuv0.partial: renamed to: file5R.txt 2024/04/26 03:27:29 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file6.txt.woketun1.partial: renamed to: file6.txt 2024/04/26 03:27:29 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:29 INFO : file6.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file7.txt.mukegiw5.partial: renamed to: file7.txt 2024/04/26 03:27:29 INFO : file7.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1] 2024/04/26 03:27:29 ERROR : : error listing: directory not found 2024/04/26 03:27:29 ERROR : : error listing: directory not found 2024/04/26 03:27:29 checking initFs Local file system at /tmp/032728we/initdir/test_backupdir-kubalij8 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1] 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1/RCLONE_TEST] 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1/file1.txt] 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: Waiting for checks to finish 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: Waiting for transfers to finish 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1/file2.txt] 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1/file3.txt] 2024/04/26 03:27:29 INFO : file1.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1/file4.txt] 2024/04/26 03:27:29 INFO : file2.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1/file5.txt] 2024/04/26 03:27:29 INFO : file3.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1/file6.txt] 2024/04/26 03:27:29 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1/file7.txt] 2024/04/26 03:27:29 INFO : file4.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1/file8.txt] 2024/04/26 03:27:29 INFO : file5.txt: Copied (new) 2024/04/26 03:27:29 INFO : file6.txt: Copied (new) 2024/04/26 03:27:29 INFO : file7.txt: Copied (new) 2024/04/26 03:27:29 INFO : file8.txt: Copied (new) 2024/04/26 03:27:29 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/backupdir/path1] 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/backupdir/path2: Waiting for checks to finish 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/backupdir/path2: Waiting for transfers to finish 2024/04/26 03:27:29 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file3.txt.tuyegug9.partial: renamed to: file3.txt 2024/04/26 03:27:29 INFO : file3.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:29 DEBUG : file2.txt.sonosek3.partial: renamed to: file2.txt 2024/04/26 03:27:29 INFO : file2.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file4.txt.gokukin1.partial: renamed to: file4.txt 2024/04/26 03:27:29 INFO : file4.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : RCLONE_TEST.sogezot1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:29 DEBUG : file1.txt.yowujil5.partial: renamed to: file1.txt 2024/04/26 03:27:29 INFO : file1.txt: Copied (new) 2024/04/26 03:27:29 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:29 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file6.txt.qinujif2.partial: renamed to: file6.txt 2024/04/26 03:27:29 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 INFO : file6.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file8.txt.kajezil4.partial: renamed to: file8.txt 2024/04/26 03:27:29 INFO : file8.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file5.txt.qakopad7.partial: renamed to: file5.txt 2024/04/26 03:27:29 INFO : file5.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file7.txt.digelil6.partial: renamed to: file7.txt 2024/04/26 03:27:29 INFO : file7.txt: Copied (new) 2024/04/26 03:27:29 checking path2 Local file system at /tmp/032728we/backupdir/path2 2024/04/26 03:27:29 (01) : test backupdir 2024/04/26 03:27:29 (02) : test initial bisync 2024/04/26 03:27:29 (03) : bisync resync backupdir1=/tmp/032728we/workdir/backupdirs/backupdir1 backupdir2=/tmp/032728we/workdir/backupdirs/backupdir2 bisync_test.go:918: backupdir test currently only works on local (it uses the workdir) === RUN TestBisyncRemoteLocal/basic 2024/04/26 03:27:29 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:29 DEBUG : path1: Making directory 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:29 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1" 2024/04/26 03:27:29 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:29 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:29 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:29 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:29 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:29 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:29 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1" 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/tmp/032728we/basic/path2" 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_basic/initial" 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_basic-cobuvox9" 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:29 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:29 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:29 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file1.copy2.txt.lozayef8.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:29 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file1.copy3.txt.lirasow7.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:29 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.copy1.txt.wozopec4.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:29 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file1.copy5.txt.jifakuh8.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:29 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file1.txt.kafizil5.partial: renamed to: file1.txt 2024/04/26 03:27:29 INFO : file1.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/initdir/test_basic-cobuvox9: Waiting for checks to finish 2024/04/26 03:27:29 DEBUG : RCLONE_TEST.sixesug7.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:29 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:29 DEBUG : subdir/file20.txt.hududov5.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/initdir/test_basic-cobuvox9: Waiting for transfers to finish 2024/04/26 03:27:29 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.copy4.txt.sevesat3.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:29 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_basic/modfiles" 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_basic-rezuvem2" 2024/04/26 03:27:29 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/datadir/test_basic-rezuvem2: Waiting for checks to finish 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/datadir/test_basic-rezuvem2: Waiting for transfers to finish 2024/04/26 03:27:29 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:29 DEBUG : file1.txt.kagajuw3.partial: renamed to: file1.txt 2024/04/26 03:27:29 INFO : file1.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1] 2024/04/26 03:27:29 ERROR : : error listing: directory not found 2024/04/26 03:27:29 ERROR : : error listing: directory not found 2024/04/26 03:27:29 checking initFs Local file system at /tmp/032728we/initdir/test_basic-cobuvox9 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1] 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : subdir: Making directory 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/subdir] 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/RCLONE_TEST] 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/file1.copy1.txt] 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/file1.copy2.txt] 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/file1.copy3.txt] 2024/04/26 03:27:29 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: Waiting for checks to finish 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: Waiting for transfers to finish 2024/04/26 03:27:29 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/file1.copy4.txt] 2024/04/26 03:27:29 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/file1.copy5.txt] 2024/04/26 03:27:29 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/file1.txt] 2024/04/26 03:27:29 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/subdir/file20.txt] 2024/04/26 03:27:29 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:29 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:29 INFO : file1.txt: Copied (new) 2024/04/26 03:27:29 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:29 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1] 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/subdir] 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:29 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:29 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:29 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/basic/path2: Waiting for checks to finish 2024/04/26 03:27:29 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/basic/path2: Waiting for transfers to finish 2024/04/26 03:27:29 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file1.copy3.txt.mibudox5.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:29 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.copy1.txt.gurolus0.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:29 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file1.copy4.txt.gifedas9.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:29 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:29 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : RCLONE_TEST.zetajez1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:29 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.txt.kusadey0.partial: renamed to: file1.txt 2024/04/26 03:27:29 INFO : file1.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file1.copy2.txt.vebacow6.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:29 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : subdir/file20.txt.sularel7.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:29 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.copy5.txt.sufosur4.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:29 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 checking path2 Local file system at /tmp/032728we/basic/path2 2024/04/26 03:27:29 (01) : test basic 2024/04/26 03:27:29 (02) : test initial bisync 2024/04/26 03:27:29 (03) : bisync resync 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:29 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:29 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/" with Path2 "/tmp/032728we/basic/path2/" 2024/04/26 03:27:29 INFO : Copying Path2 files to Path1 2024/04/26 03:27:29 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:29 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : Resync updating listings 2024/04/26 03:27:29 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/" vs Path2 "/tmp/032728we/basic/path2/" 2024/04/26 03:27:29 INFO : Bisync successful 2024/04/26 03:27:29 (04) : test place newer files on both paths 2024/04/26 03:27:29 (05) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_basic-rezuvem2/file1.txt /tmp/032728we/basic/path2/ 2024/04/26 03:27:29 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:29 (06) : copy-as /tmp/032728we/datadir/test_basic-rezuvem2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/subdir file20.txt 2024/04/26 03:27:29 INFO : file1.txt: Copied (replaced existing) to: file20.txt 2024/04/26 03:27:29 (07) : test bisync run 2024/04/26 03:27:29 (08) : bisync 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:29 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:29 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/" with Path2 "/tmp/032728we/basic/path2/" 2024/04/26 03:27:29 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:29 INFO : Path1 checking for diffs 2024/04/26 03:27:29 INFO : - Path1 File changed: size (larger), time (newer) - subdir/file20.txt 2024/04/26 03:27:29 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:29 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:29 INFO : Path2 checking for diffs 2024/04/26 03:27:29 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:29 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:29 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:29 INFO : Applying changes 2024/04/26 03:27:29 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/basic/path2/subdir/file20.txt 2024/04/26 03:27:29 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/file1.txt 2024/04/26 03:27:29 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:29 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:29 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:29 INFO : Updating listings 2024/04/26 03:27:29 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/basic/path1/" vs Path2 "/tmp/032728we/basic/path2/" 2024/04/26 03:27:29 INFO : Bisync successful bisync_test.go:553: TEST basic PASSED === RUN TestBisyncRemoteLocal/changes 2024/04/26 03:27:29 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:29 DEBUG : path1: Making directory 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:29 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1" 2024/04/26 03:27:29 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:29 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:29 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:29 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:29 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:29 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:29 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1" 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/tmp/032728we/changes/path2" 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_changes/initial" 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_changes-xazuzeg8" 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file2.txt.civenas0.partial: renamed to: file2.txt 2024/04/26 03:27:29 INFO : file2.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/initdir/test_changes-xazuzeg8: Waiting for checks to finish 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/initdir/test_changes-xazuzeg8: Waiting for transfers to finish 2024/04/26 03:27:29 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file4.txt.qejulav8.partial: renamed to: file4.txt 2024/04/26 03:27:29 INFO : file4.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file3.txt.fanuhan2.partial: renamed to: file3.txt 2024/04/26 03:27:29 INFO : file3.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:29 DEBUG : RCLONE_TEST.qisibap7.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:29 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:29 DEBUG : file5.txt.locofaf4.partial: renamed to: file5.txt 2024/04/26 03:27:29 INFO : file5.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:29 DEBUG : file7.txt.jihawum7.partial: renamed to: file7.txt 2024/04/26 03:27:29 INFO : file7.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file6.txt.qiromez7.partial: renamed to: file6.txt 2024/04/26 03:27:29 INFO : file6.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file8.txt.pecojuk1.partial: renamed to: file8.txt 2024/04/26 03:27:29 INFO : file8.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file1.txt.ququvul7.partial: renamed to: file1.txt 2024/04/26 03:27:29 INFO : file1.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_changes/modfiles" 2024/04/26 03:27:29 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_changes-voxinad9" 2024/04/26 03:27:29 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/datadir/test_changes-voxinad9: Waiting for checks to finish 2024/04/26 03:27:29 DEBUG : Local file system at /tmp/032728we/datadir/test_changes-voxinad9: Waiting for transfers to finish 2024/04/26 03:27:29 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:29 DEBUG : file1.txt.lovujoz5.partial: renamed to: file1.txt 2024/04/26 03:27:29 INFO : file1.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:29 DEBUG : file10.txt.vejogum4.partial: renamed to: file10.txt 2024/04/26 03:27:29 INFO : file10.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:29 DEBUG : file2.txt.cobexiq6.partial: renamed to: file2.txt 2024/04/26 03:27:29 INFO : file2.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:29 DEBUG : file5L.txt.nixohef2.partial: renamed to: file5L.txt 2024/04/26 03:27:29 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:29 DEBUG : file11.txt.panagel0.partial: renamed to: file11.txt 2024/04/26 03:27:29 INFO : file11.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:29 DEBUG : file5R.txt.wuciqov0.partial: renamed to: file5R.txt 2024/04/26 03:27:29 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:29 DEBUG : file6.txt.zobucet1.partial: renamed to: file6.txt 2024/04/26 03:27:29 INFO : file6.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:29 DEBUG : file7.txt.zobafon8.partial: renamed to: file7.txt 2024/04/26 03:27:29 INFO : file7.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1] 2024/04/26 03:27:29 ERROR : : error listing: directory not found 2024/04/26 03:27:29 ERROR : : error listing: directory not found 2024/04/26 03:27:29 checking initFs Local file system at /tmp/032728we/initdir/test_changes-xazuzeg8 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1] 2024/04/26 03:27:29 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: Waiting for checks to finish 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file1.txt] 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/RCLONE_TEST] 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: Waiting for transfers to finish 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file3.txt] 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file2.txt] 2024/04/26 03:27:29 INFO : file1.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file4.txt] 2024/04/26 03:27:29 INFO : file3.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file5.txt] 2024/04/26 03:27:29 INFO : file2.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file6.txt] 2024/04/26 03:27:29 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file7.txt] 2024/04/26 03:27:29 INFO : file4.txt: Copied (new) 2024/04/26 03:27:29 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file8.txt] 2024/04/26 03:27:29 INFO : file5.txt: Copied (new) 2024/04/26 03:27:30 INFO : file6.txt: Copied (new) 2024/04/26 03:27:30 INFO : file7.txt: Copied (new) 2024/04/26 03:27:30 INFO : file8.txt: Copied (new) 2024/04/26 03:27:30 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1] 2024/04/26 03:27:30 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : Local file system at /tmp/032728we/changes/path2: Waiting for checks to finish 2024/04/26 03:27:30 DEBUG : Local file system at /tmp/032728we/changes/path2: Waiting for transfers to finish 2024/04/26 03:27:30 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file1.txt.befijuv9.partial: renamed to: file1.txt 2024/04/26 03:27:30 INFO : file1.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : file3.txt.ragehem9.partial: renamed to: file3.txt 2024/04/26 03:27:30 DEBUG : RCLONE_TEST.dahufat3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:30 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 INFO : file3.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file2.txt.witozih5.partial: renamed to: file2.txt 2024/04/26 03:27:30 INFO : file2.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : file6.txt.ribipoz4.partial: renamed to: file6.txt 2024/04/26 03:27:30 INFO : file6.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file5.txt.goqiyap4.partial: renamed to: file5.txt 2024/04/26 03:27:30 INFO : file5.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : file8.txt.huvozaj4.partial: renamed to: file8.txt 2024/04/26 03:27:30 INFO : file8.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file4.txt.pesulew2.partial: renamed to: file4.txt 2024/04/26 03:27:30 INFO : file4.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : file7.txt.xaxuvaj2.partial: renamed to: file7.txt 2024/04/26 03:27:30 INFO : file7.txt: Copied (new) 2024/04/26 03:27:30 checking path2 Local file system at /tmp/032728we/changes/path2 2024/04/26 03:27:30 (01) : test changes 2024/04/26 03:27:30 (02) : test initial bisync 2024/04/26 03:27:30 (03) : bisync resync 2024/04/26 03:27:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/" with Path2 "/tmp/032728we/changes/path2/" 2024/04/26 03:27:30 INFO : Copying Path2 files to Path1 2024/04/26 03:27:30 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:30 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:30 INFO : Resync updating listings 2024/04/26 03:27:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/" vs Path2 "/tmp/032728we/changes/path2/" 2024/04/26 03:27:30 INFO : Bisync successful 2024/04/26 03:27:30 (04) : test make modifications on both paths 2024/04/26 03:27:30 (05) : test new on path2 - file10 2024/04/26 03:27:30 (06) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_changes-voxinad9/file10.txt /tmp/032728we/changes/path2/ 2024/04/26 03:27:30 INFO : file10.txt: Copied (new) 2024/04/26 03:27:30 (07) : test newer on path2 - file1 2024/04/26 03:27:30 (08) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_changes-voxinad9/file1.txt /tmp/032728we/changes/path2/ 2024/04/26 03:27:30 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:30 (09) : test new on path1 - file11 2024/04/26 03:27:30 (10) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_changes-voxinad9/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/ 2024/04/26 03:27:30 INFO : file11.txt: Copied (new) 2024/04/26 03:27:30 (11) : test newer on path1 - file2 2024/04/26 03:27:30 (12) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_changes-voxinad9/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/ 2024/04/26 03:27:30 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:30 (13) : test deleted on path2 - file3 2024/04/26 03:27:30 (14) : delete-file /tmp/032728we/changes/path2/file3.txt 2024/04/26 03:27:30 INFO : file3.txt: Deleted 2024/04/26 03:27:30 (15) : test deleted on path1 - file4 2024/04/26 03:27:30 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file4.txt 2024/04/26 03:27:30 INFO : file4.txt: Deleted 2024/04/26 03:27:30 (17) : test deleted on both paths - file8 2024/04/26 03:27:30 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file8.txt 2024/04/26 03:27:30 INFO : file8.txt: Deleted 2024/04/26 03:27:30 (19) : delete-file /tmp/032728we/changes/path2/file8.txt 2024/04/26 03:27:30 INFO : file8.txt: Deleted 2024/04/26 03:27:30 (20) : test changed on both paths - file5 (file5R, file5L) 2024/04/26 03:27:30 (21) : touch-glob 2001-01-02 /tmp/032728we/datadir/test_changes-voxinad9/ file5R.txt 2024/04/26 03:27:30 (22) : copy-as /tmp/032728we/datadir/test_changes-voxinad9/file5R.txt /tmp/032728we/changes/path2/ file5.txt 2024/04/26 03:27:30 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:30 (23) : touch-glob 2001-03-04 /tmp/032728we/datadir/test_changes-voxinad9/ file5L.txt 2024/04/26 03:27:30 (24) : copy-as /tmp/032728we/datadir/test_changes-voxinad9/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/ file5.txt 2024/04/26 03:27:30 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:30 (25) : test newer on path2 and deleted on path1 - file6 2024/04/26 03:27:30 (26) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_changes-voxinad9/file6.txt /tmp/032728we/changes/path2/ 2024/04/26 03:27:30 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:27:30 (27) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file6.txt 2024/04/26 03:27:30 INFO : file6.txt: Deleted 2024/04/26 03:27:30 (28) : test newer on path1 and deleted on path2 - file7 2024/04/26 03:27:30 (29) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_changes-voxinad9/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/ 2024/04/26 03:27:30 INFO : file7.txt: Copied (replaced existing) 2024/04/26 03:27:30 (30) : delete-file /tmp/032728we/changes/path2/file7.txt 2024/04/26 03:27:30 INFO : file7.txt: Deleted 2024/04/26 03:27:30 (31) : test bisync run 2024/04/26 03:27:30 (32) : bisync 2024/04/26 03:27:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/" with Path2 "/tmp/032728we/changes/path2/" 2024/04/26 03:27:30 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:30 INFO : Path1 checking for diffs 2024/04/26 03:27:30 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:30 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:30 INFO : - Path1 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:30 INFO : - Path1 File was deleted - file6.txt 2024/04/26 03:27:30 INFO : - Path1 File changed: size (larger), time (newer) - file7.txt 2024/04/26 03:27:30 INFO : - Path1 File was deleted - file8.txt 2024/04/26 03:27:30 INFO : - Path1 File is new - file11.txt 2024/04/26 03:27:30 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:30 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:30 INFO : Path2 checking for diffs 2024/04/26 03:27:30 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:30 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:30 INFO : - Path2 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:30 INFO : - Path2 File changed: size (larger), time (newer) - file6.txt 2024/04/26 03:27:30 INFO : - Path2 File was deleted - file7.txt 2024/04/26 03:27:30 INFO : - Path2 File was deleted - file8.txt 2024/04/26 03:27:30 INFO : - Path2 File is new - file10.txt 2024/04/26 03:27:30 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:30 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:30 INFO : Applying changes 2024/04/26 03:27:30 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:30 INFO : Checking potential conflicts... 2024/04/26 03:27:30 NOTICE: Local file system at /tmp/032728we/changes/path2: 1 differences found 2024/04/26 03:27:30 NOTICE: Local file system at /tmp/032728we/changes/path2: 1 errors while checking 2024/04/26 03:27:30 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:30 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/changes/path2/file11.txt 2024/04/26 03:27:30 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/changes/path2/file2.txt 2024/04/26 03:27:30 INFO : - Path2 Queue delete - /tmp/032728we/changes/path2/file4.txt 2024/04/26 03:27:30 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:27:30 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file5.txt.conflict1 2024/04/26 03:27:30 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/04/26 03:27:30 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/changes/path2/file5.txt.conflict1 2024/04/26 03:27:30 NOTICE: - Path2 Renaming Path2 copy - /tmp/032728we/changes/path2/file5.txt.conflict2 2024/04/26 03:27:30 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/04/26 03:27:30 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file5.txt.conflict2 2024/04/26 03:27:30 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file6.txt 2024/04/26 03:27:30 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/changes/path2/file7.txt 2024/04/26 03:27:30 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file1.txt 2024/04/26 03:27:30 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file10.txt 2024/04/26 03:27:30 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/file3.txt 2024/04/26 03:27:30 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:30 INFO : file10.txt: Copied (new) 2024/04/26 03:27:30 INFO : file5.txt.conflict2: Copied (new) 2024/04/26 03:27:30 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:30 INFO : file6.txt: Copied (new) 2024/04/26 03:27:30 INFO : file3.txt: Deleted 2024/04/26 03:27:30 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:30 INFO : file11.txt: Copied (new) 2024/04/26 03:27:30 INFO : file5.txt.conflict1: Copied (new) 2024/04/26 03:27:30 INFO : file7.txt: Copied (new) 2024/04/26 03:27:30 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:30 INFO : file4.txt: Deleted 2024/04/26 03:27:30 INFO : Updating listings 2024/04/26 03:27:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/changes/path1/" vs Path2 "/tmp/032728we/changes/path2/" 2024/04/26 03:27:30 INFO : Bisync successful bisync_test.go:553: TEST changes PASSED === RUN TestBisyncRemoteLocal/check_access 2024/04/26 03:27:30 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:30 DEBUG : path1: Making directory 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:30 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1" 2024/04/26 03:27:30 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:30 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:30 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1" 2024/04/26 03:27:30 DEBUG : Creating backend with remote "/tmp/032728we/check_access/path2" 2024/04/26 03:27:30 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access/initial" 2024/04/26 03:27:30 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_check_access-milefez4" 2024/04/26 03:27:30 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:30 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:30 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:30 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : RCLONE_TEST.kanuqex2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:30 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 DEBUG : file1.txt.qiwubiv6.partial: renamed to: file1.txt 2024/04/26 03:27:30 INFO : file1.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file4.txt.fudaliz1.partial: renamed to: file4.txt 2024/04/26 03:27:30 DEBUG : Local file system at /tmp/032728we/initdir/test_check_access-milefez4: Waiting for checks to finish 2024/04/26 03:27:30 INFO : file4.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : Local file system at /tmp/032728we/initdir/test_check_access-milefez4: Waiting for transfers to finish 2024/04/26 03:27:30 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file3.txt.korecel0.partial: renamed to: file3.txt 2024/04/26 03:27:30 INFO : file3.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file2.txt.giwidov7.partial: renamed to: file2.txt 2024/04/26 03:27:30 INFO : file2.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir/file20.txt.fusabor9.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:30 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : subdir/RCLONE_TEST.hopuyef2.partial: renamed to: subdir/RCLONE_TEST 2024/04/26 03:27:30 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access/modfiles" 2024/04/26 03:27:30 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_check_access-luzaqeq7" 2024/04/26 03:27:30 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : Local file system at /tmp/032728we/datadir/test_check_access-luzaqeq7: Waiting for checks to finish 2024/04/26 03:27:30 DEBUG : Local file system at /tmp/032728we/datadir/test_check_access-luzaqeq7: Waiting for transfers to finish 2024/04/26 03:27:30 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:27:30 DEBUG : hold.txt.kelazeg7.partial: renamed to: hold.txt 2024/04/26 03:27:30 INFO : hold.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1] 2024/04/26 03:27:30 ERROR : : error listing: directory not found 2024/04/26 03:27:30 ERROR : : error listing: directory not found 2024/04/26 03:27:30 checking initFs Local file system at /tmp/032728we/initdir/test_check_access-milefez4 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1] 2024/04/26 03:27:30 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir: Making directory 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/subdir] 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/file2.txt] 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/RCLONE_TEST] 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/file3.txt] 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/file1.txt] 2024/04/26 03:27:30 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: Waiting for checks to finish 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: Waiting for transfers to finish 2024/04/26 03:27:30 INFO : file2.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/file4.txt] 2024/04/26 03:27:30 INFO : file3.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/subdir/RCLONE_TEST] 2024/04/26 03:27:30 INFO : file1.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/subdir/file20.txt] 2024/04/26 03:27:30 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 INFO : file4.txt: Copied (new) 2024/04/26 03:27:30 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:30 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1] 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/subdir] 2024/04/26 03:27:30 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:30 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:30 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:30 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : Local file system at /tmp/032728we/check_access/path2: Waiting for checks to finish 2024/04/26 03:27:30 DEBUG : file1.txt.xujibew0.partial: renamed to: file1.txt 2024/04/26 03:27:30 INFO : file1.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : Local file system at /tmp/032728we/check_access/path2: Waiting for transfers to finish 2024/04/26 03:27:30 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : file2.txt.zuforit9.partial: renamed to: file2.txt 2024/04/26 03:27:30 INFO : file2.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : RCLONE_TEST.yisosoq2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:30 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file4.txt.qotegar4.partial: renamed to: file4.txt 2024/04/26 03:27:30 INFO : file4.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : file3.txt.mohavub0.partial: renamed to: file3.txt 2024/04/26 03:27:30 INFO : file3.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : subdir/RCLONE_TEST.bawuyet3.partial: renamed to: subdir/RCLONE_TEST 2024/04/26 03:27:30 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : subdir/file20.txt.jeladog0.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:30 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 checking path2 Local file system at /tmp/032728we/check_access/path2 2024/04/26 03:27:30 (01) : test check-access 2024/04/26 03:27:30 (02) : test initial bisync 2024/04/26 03:27:30 (03) : bisync resync 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" with Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Copying Path2 files to Path1 2024/04/26 03:27:30 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:30 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : Resync updating listings 2024/04/26 03:27:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" vs Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Bisync successful 2024/04/26 03:27:30 (04) : test 1. see that check-access passes with the initial setup 2024/04/26 03:27:30 (05) : bisync check-access 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" with Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:30 INFO : Path1 checking for diffs 2024/04/26 03:27:30 INFO : Path2 checking for diffs 2024/04/26 03:27:30 INFO : Checking access health 2024/04/26 03:27:30 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:30 INFO : No changes found 2024/04/26 03:27:30 INFO : Updating listings 2024/04/26 03:27:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" vs Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Bisync successful 2024/04/26 03:27:30 (06) : test 2. delete the path2 subdir RCLONE_TEST and run sync. should fail critical. 2024/04/26 03:27:30 (07) : delete-file /tmp/032728we/check_access/path2/subdir/RCLONE_TEST 2024/04/26 03:27:30 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:30 (08) : bisync check-access 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" with Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:30 INFO : Path1 checking for diffs 2024/04/26 03:27:30 INFO : Path2 checking for diffs 2024/04/26 03:27:30 INFO : - Path2 File was deleted - subdir/RCLONE_TEST 2024/04/26 03:27:30 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:30 INFO : Checking access health 2024/04/26 03:27:30 ERROR : Access test failed: Path1 count 2, Path2 count 1 - RCLONE_TEST 2024/04/26 03:27:30 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/RCLONE_TEST 2024/04/26 03:27:30 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:30 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:30 Bisync error: bisync aborted 2024/04/26 03:27:30 (09) : copy-listings path2-missing 2024/04/26 03:27:30 (10) : test 3. put the path2 subdir RCLONE_TEST back, resync. 2024/04/26 03:27:30 (11) : copy-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/subdir/RCLONE_TEST /tmp/032728we/check_access/path2/ 2024/04/26 03:27:30 (12) : bisync resync 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" with Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Copying Path2 files to Path1 2024/04/26 03:27:30 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:30 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : Resync updating listings 2024/04/26 03:27:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" vs Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Bisync successful 2024/04/26 03:27:30 (13) : test 4. run sync with check-access. should pass. 2024/04/26 03:27:30 (14) : bisync check-access 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" with Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:30 INFO : Path1 checking for diffs 2024/04/26 03:27:30 INFO : Path2 checking for diffs 2024/04/26 03:27:30 INFO : Checking access health 2024/04/26 03:27:30 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:30 INFO : No changes found 2024/04/26 03:27:30 INFO : Updating listings 2024/04/26 03:27:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" vs Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Bisync successful 2024/04/26 03:27:30 (15) : test 5. delete path1 top level RCLONE_TEST, run sync. should fail critical. 2024/04/26 03:27:30 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/RCLONE_TEST 2024/04/26 03:27:30 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:30 (17) : bisync check-access 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" with Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:30 INFO : Path1 checking for diffs 2024/04/26 03:27:30 INFO : - Path1 File was deleted - RCLONE_TEST 2024/04/26 03:27:30 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:30 INFO : Path2 checking for diffs 2024/04/26 03:27:30 INFO : Checking access health 2024/04/26 03:27:30 ERROR : Access test failed: Path1 count 1, Path2 count 2 - RCLONE_TEST 2024/04/26 03:27:30 ERROR : -  Access test failed: Path2 file not found in Path1 - RCLONE_TEST 2024/04/26 03:27:30 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:30 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:30 Bisync error: bisync aborted 2024/04/26 03:27:30 (18) : copy-listings path1-missing 2024/04/26 03:27:30 (19) : test 6. run again. should fail critical due to missing listings. 2024/04/26 03:27:30 (20) : bisync check-access 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" with Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/032728we/workdir/TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_check_access_path1..tmp_032728we_check_access_path2.path1.lst Path2: /tmp/032728we/workdir/TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_check_access_path1..tmp_032728we_check_access_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/032728we/workdir" 2024/04/26 03:27:30 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:30 Bisync error: bisync aborted 2024/04/26 03:27:30 (21) : move-listings missing-listings 2024/04/26 03:27:30 (22) : test 7. run resync, which will copy the path2 top level back to path1. 2024/04/26 03:27:30 (23) : bisync resync 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" with Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Copying Path2 files to Path1 2024/04/26 03:27:30 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:30 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : Resync updating listings 2024/04/26 03:27:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" vs Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Bisync successful 2024/04/26 03:27:30 (24) : test 8. run sync with --check-access. should pass. 2024/04/26 03:27:30 (25) : bisync check-access 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" with Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:30 INFO : Path1 checking for diffs 2024/04/26 03:27:30 INFO : Path2 checking for diffs 2024/04/26 03:27:30 INFO : Checking access health 2024/04/26 03:27:30 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:30 INFO : No changes found 2024/04/26 03:27:30 INFO : Updating listings 2024/04/26 03:27:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access/path1/" vs Path2 "/tmp/032728we/check_access/path2/" 2024/04/26 03:27:30 INFO : Bisync successful bisync_test.go:553: TEST check_access PASSED === RUN TestBisyncRemoteLocal/check_access_filters 2024/04/26 03:27:30 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:30 DEBUG : path1: Making directory 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:30 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1" 2024/04/26 03:27:30 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:30 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:30 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1" 2024/04/26 03:27:30 DEBUG : Creating backend with remote "/tmp/032728we/check_access_filters/path2" 2024/04/26 03:27:30 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/initial" 2024/04/26 03:27:30 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_check_access_filters-danorob2" 2024/04/26 03:27:30 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:30 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:30 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:30 DEBUG : subdir-not: Making directory with metadata 2024/04/26 03:27:30 INFO : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:30 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not 2024/04/26 03:27:30 DEBUG : subdirX: Making directory with metadata 2024/04/26 03:27:30 INFO : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:30 DEBUG : Added delayed dir = "subdirX", newDst=subdirX 2024/04/26 03:27:30 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdirX/subdirX1: Making directory with metadata 2024/04/26 03:27:30 INFO : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:30 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1 2024/04/26 03:27:30 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : file1.txt.vopeziq0.partial: renamed to: file1.txt 2024/04/26 03:27:30 INFO : file1.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : RCLONE_TEST.beviwup4.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:30 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file4.txt.gobipos6.partial: renamed to: file4.txt 2024/04/26 03:27:30 INFO : file4.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir-not/subdir-not2: Making directory with metadata 2024/04/26 03:27:30 INFO : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:30 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2 2024/04/26 03:27:30 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir/subdirA: Making directory with metadata 2024/04/26 03:27:30 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : file2.txt.rebewos0.partial: renamed to: file2.txt 2024/04/26 03:27:30 INFO : file2.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : subdirX/RCLONE_TEST.jocopux3.partial: renamed to: subdirX/RCLONE_TEST 2024/04/26 03:27:30 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 INFO : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:30 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA 2024/04/26 03:27:30 DEBUG : subdir/subdirB: Making directory with metadata 2024/04/26 03:27:30 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : subdirX/subdirX1/file30.txt.qonezap7.partial: renamed to: subdirX/subdirX1/file30.txt 2024/04/26 03:27:30 INFO : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:30 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB 2024/04/26 03:27:30 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : file3.txt.qoqilav5.partial: renamed to: file3.txt 2024/04/26 03:27:30 INFO : file3.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : subdirX/subdirX1/RCLONE_TEST.rebabog7.partial: renamed to: subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:30 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdirX/file20.txt.lelebuv2.partial: renamed to: subdirX/file20.txt 2024/04/26 03:27:30 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : subdir-not/file20.txt.fotabit7.partial: renamed to: subdir-not/file20.txt 2024/04/26 03:27:30 INFO : subdirX/file20.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir-not/RCLONE_TEST.vuyebaq8.partial: renamed to: subdir-not/RCLONE_TEST 2024/04/26 03:27:30 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 DEBUG : Local file system at /tmp/032728we/initdir/test_check_access_filters-danorob2: Waiting for checks to finish 2024/04/26 03:27:30 DEBUG : Local file system at /tmp/032728we/initdir/test_check_access_filters-danorob2: Waiting for transfers to finish 2024/04/26 03:27:30 INFO : subdir-not/file20.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir/file20.txt.cegoveq4.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:30 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : subdir/RCLONE_TEST.zujuhed2.partial: renamed to: subdir/RCLONE_TEST 2024/04/26 03:27:30 DEBUG : subdir/subdirB/file30.txt.garawol8.partial: renamed to: subdir/subdirB/file30.txt 2024/04/26 03:27:30 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : subdir/subdirB/RCLONE_TEST.busijuy2.partial: renamed to: subdir/subdirB/RCLONE_TEST 2024/04/26 03:27:30 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.ribajeg8.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST 2024/04/26 03:27:30 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : subdir-not/subdir-not2/file30.txt.miqerig2.partial: renamed to: subdir-not/subdir-not2/file30.txt 2024/04/26 03:27:30 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:30 DEBUG : subdir/subdirA/RCLONE_TEST.qocivaf6.partial: renamed to: subdir/subdirA/RCLONE_TEST 2024/04/26 03:27:30 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/04/26 03:27:30 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:30 DEBUG : subdir/subdirA/file30.txt.zocokoz1.partial: renamed to: subdir/subdirA/file30.txt 2024/04/26 03:27:30 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/04/26 03:27:30 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:30 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/modfiles" 2024/04/26 03:27:30 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_check_access_filters-xicosah3" 2024/04/26 03:27:30 DEBUG : exclude-other-filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : include-other-filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : Local file system at /tmp/032728we/datadir/test_check_access_filters-xicosah3: Waiting for checks to finish 2024/04/26 03:27:30 DEBUG : Local file system at /tmp/032728we/datadir/test_check_access_filters-xicosah3: Waiting for transfers to finish 2024/04/26 03:27:30 DEBUG : exclude-other-filtersfile.txt: md5 = 5fcc6205d7df1c2e9ed3a15a1356b345 OK 2024/04/26 03:27:30 DEBUG : exclude-other-filtersfile.txt.jinufuv5.partial: renamed to: exclude-other-filtersfile.txt 2024/04/26 03:27:30 INFO : exclude-other-filtersfile.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : include-other-filtersfile.txt: md5 = 2ec13b2813141ed088e5978ef5a47b0e OK 2024/04/26 03:27:30 DEBUG : include-other-filtersfile.txt.hakimev8.partial: renamed to: include-other-filtersfile.txt 2024/04/26 03:27:30 INFO : include-other-filtersfile.txt: Copied (new) 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1] 2024/04/26 03:27:30 ERROR : : error listing: directory not found 2024/04/26 03:27:30 ERROR : : error listing: directory not found 2024/04/26 03:27:30 checking initFs Local file system at /tmp/032728we/initdir/test_check_access_filters-danorob2 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1] 2024/04/26 03:27:30 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir: Making directory 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir] 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/file1.txt] 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/RCLONE_TEST] 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/file2.txt] 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/file3.txt] 2024/04/26 03:27:30 DEBUG : subdir-not: Making directory 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir-not] 2024/04/26 03:27:30 DEBUG : subdirX: Making directory 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdirX] 2024/04/26 03:27:30 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdirX/subdirX1: Making directory 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdirX/subdirX1] 2024/04/26 03:27:30 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir-not/subdir-not2: Making directory 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir-not/subdir-not2] 2024/04/26 03:27:30 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:30 DEBUG : subdir/subdirA: Making directory 2024/04/26 03:27:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir/subdirA] 2024/04/26 03:27:31 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir/subdirB: Making directory 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir/subdirB] 2024/04/26 03:27:31 INFO : file1.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/file4.txt] 2024/04/26 03:27:31 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: Waiting for checks to finish 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: Waiting for transfers to finish 2024/04/26 03:27:31 INFO : file2.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdirX/RCLONE_TEST] 2024/04/26 03:27:31 INFO : file3.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdirX/file20.txt] 2024/04/26 03:27:31 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir/RCLONE_TEST] 2024/04/26 03:27:31 INFO : file4.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir-not/RCLONE_TEST] 2024/04/26 03:27:31 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir-not/file20.txt] 2024/04/26 03:27:31 INFO : subdirX/file20.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir/file20.txt] 2024/04/26 03:27:31 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST] 2024/04/26 03:27:31 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdirX/subdirX1/file30.txt] 2024/04/26 03:27:31 INFO : subdir-not/file20.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir-not/subdir-not2/RCLONE_TEST] 2024/04/26 03:27:31 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir-not/subdir-not2/file30.txt] 2024/04/26 03:27:31 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir/subdirA/RCLONE_TEST] 2024/04/26 03:27:31 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir/subdirA/file30.txt] 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir/subdirB/RCLONE_TEST] 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir/subdirB/file30.txt] 2024/04/26 03:27:31 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/04/26 03:27:31 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/04/26 03:27:31 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1] 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdirX] 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir] 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir-not] 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdirX/subdirX1] 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir/subdirB] 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir/subdirA] 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir-not/subdir-not2] 2024/04/26 03:27:31 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:31 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:31 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:31 DEBUG : subdir-not: Making directory with metadata 2024/04/26 03:27:31 INFO : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:31 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not 2024/04/26 03:27:31 DEBUG : subdirX: Making directory with metadata 2024/04/26 03:27:31 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : file2.txt.giwarur6.partial: renamed to: file2.txt 2024/04/26 03:27:31 INFO : file2.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 INFO : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:31 DEBUG : Added delayed dir = "subdirX", newDst=subdirX 2024/04/26 03:27:31 DEBUG : file1.txt.fadojof7.partial: renamed to: file1.txt 2024/04/26 03:27:31 INFO : file1.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file4.txt.yuneden1.partial: renamed to: file4.txt 2024/04/26 03:27:31 INFO : file4.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : subdirX/subdirX1: Making directory with metadata 2024/04/26 03:27:31 INFO : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:31 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1 2024/04/26 03:27:31 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir/subdirA: Making directory with metadata 2024/04/26 03:27:31 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 INFO : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:31 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA 2024/04/26 03:27:31 DEBUG : subdir/subdirB: Making directory with metadata 2024/04/26 03:27:31 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir-not/subdir-not2: Making directory with metadata 2024/04/26 03:27:31 DEBUG : file3.txt.qixifok4.partial: renamed to: file3.txt 2024/04/26 03:27:31 INFO : file3.txt: Copied (new) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:31 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2 2024/04/26 03:27:31 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : subdirX/file20.txt.nemicex1.partial: renamed to: subdirX/file20.txt 2024/04/26 03:27:31 INFO : subdirX/file20.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:31 DEBUG : subdirX/RCLONE_TEST.hufocez8.partial: renamed to: subdirX/RCLONE_TEST 2024/04/26 03:27:31 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 INFO : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:31 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB 2024/04/26 03:27:31 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : subdir/file20.txt.pezetiv5.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:31 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:31 DEBUG : subdir/RCLONE_TEST.hafiwab7.partial: renamed to: subdir/RCLONE_TEST 2024/04/26 03:27:31 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : subdirX/subdirX1/file30.txt.jitokuk4.partial: renamed to: subdirX/subdirX1/file30.txt 2024/04/26 03:27:31 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : Local file system at /tmp/032728we/check_access_filters/path2: Waiting for checks to finish 2024/04/26 03:27:31 DEBUG : subdir-not/file20.txt.yegodas3.partial: renamed to: subdir-not/file20.txt 2024/04/26 03:27:31 INFO : subdir-not/file20.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : Local file system at /tmp/032728we/check_access_filters/path2: Waiting for transfers to finish 2024/04/26 03:27:31 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:31 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:31 DEBUG : subdirX/subdirX1/RCLONE_TEST.dabicew5.partial: renamed to: subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:31 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 DEBUG : subdir-not/RCLONE_TEST.wudukex4.partial: renamed to: subdir-not/RCLONE_TEST 2024/04/26 03:27:31 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:31 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:31 DEBUG : subdir/subdirB/RCLONE_TEST.kadakiv5.partial: renamed to: subdir/subdirB/RCLONE_TEST 2024/04/26 03:27:31 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 DEBUG : subdir-not/subdir-not2/file30.txt.dufojex6.partial: renamed to: subdir-not/subdir-not2/file30.txt 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.dicuyuf4.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST 2024/04/26 03:27:31 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 DEBUG : subdir/subdirB/file30.txt.fuboxas1.partial: renamed to: subdir/subdirB/file30.txt 2024/04/26 03:27:31 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : subdir/subdirA/file30.txt.debodok2.partial: renamed to: subdir/subdirA/file30.txt 2024/04/26 03:27:31 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:31 DEBUG : subdir/subdirA/RCLONE_TEST.bulupan3.partial: renamed to: subdir/subdirA/RCLONE_TEST 2024/04/26 03:27:31 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:31 DEBUG : RCLONE_TEST.mosizax7.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 checking path2 Local file system at /tmp/032728we/check_access_filters/path2 2024/04/26 03:27:31 (01) : test check-access-filters 2024/04/26 03:27:31 (02) : test EXCLUDE - OTHER TESTS 2024/04/26 03:27:31 (03) : copy-file /tmp/032728we/datadir/test_check_access_filters-xicosah3/exclude-other-filtersfile.txt /tmp/032728we/workdir/ 2024/04/26 03:27:31 INFO : exclude-other-filtersfile.txt: Copied (new) 2024/04/26 03:27:31 (04) : test resync to get the filters file md5 built. 2024/04/26 03:27:31 (05) : bisync resync filters-file=/tmp/032728we/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" with Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Using filters file /tmp/032728we/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:31 INFO : Storing filters file hash to /tmp/032728we/workdir/exclude-other-filtersfile.txt.md5 2024/04/26 03:27:31 INFO : Copying Path2 files to Path1 2024/04/26 03:27:31 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:31 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : Resync updating listings 2024/04/26 03:27:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" vs Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Bisync successful 2024/04/26 03:27:31 (06) : test EXCLUDE - test filters for check access 2024/04/26 03:27:31 (07) : bisync check-access filters-file=/tmp/032728we/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" with Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Using filters file /tmp/032728we/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:31 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:31 INFO : Path1 checking for diffs 2024/04/26 03:27:31 INFO : Path2 checking for diffs 2024/04/26 03:27:31 INFO : Checking access health 2024/04/26 03:27:31 INFO : Found 3 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:31 INFO : No changes found 2024/04/26 03:27:31 INFO : Updating listings 2024/04/26 03:27:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" vs Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Bisync successful 2024/04/26 03:27:31 (08) : copy-listings exclude-initial 2024/04/26 03:27:31 (09) : test EXCLUDE - delete RCLONE_TEST files in excluded directories 2024/04/26 03:27:31 (10) : delete-file /tmp/032728we/check_access_filters/path2/subdir/subdirA/RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:31 (11) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir-not/RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:31 (12) : delete-file /tmp/032728we/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:31 (13) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdirX/RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:31 (14) : test EXCLUDE - test should PASS 2024/04/26 03:27:31 (15) : bisync check-access filters-file=/tmp/032728we/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" with Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Using filters file /tmp/032728we/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:31 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:31 INFO : Path1 checking for diffs 2024/04/26 03:27:31 INFO : Path2 checking for diffs 2024/04/26 03:27:31 INFO : Checking access health 2024/04/26 03:27:31 INFO : Found 3 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:31 INFO : No changes found 2024/04/26 03:27:31 INFO : Updating listings 2024/04/26 03:27:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" vs Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Bisync successful 2024/04/26 03:27:31 (16) : copy-listings exclude-pass-run 2024/04/26 03:27:31 (17) : test EXCLUDE - delete RCLONE_TEST files in included directories 2024/04/26 03:27:31 (18) : delete-file /tmp/032728we/check_access_filters/path2/RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:31 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir/RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:31 (20) : test EXCLUDE - test should ABORT 2024/04/26 03:27:31 (21) : bisync check-access filters-file=/tmp/032728we/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" with Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Using filters file /tmp/032728we/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:31 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:31 INFO : Path1 checking for diffs 2024/04/26 03:27:31 INFO : - Path1 File was deleted - subdir/RCLONE_TEST 2024/04/26 03:27:31 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:31 INFO : Path2 checking for diffs 2024/04/26 03:27:31 INFO : - Path2 File was deleted - RCLONE_TEST 2024/04/26 03:27:31 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:31 INFO : Checking access health 2024/04/26 03:27:31 ERROR : -  Access test failed: Path1 file not found in Path2 - RCLONE_TEST 2024/04/26 03:27:31 ERROR : -  Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST 2024/04/26 03:27:31 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:31 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:31 Bisync error: bisync aborted 2024/04/26 03:27:31 (22) : move-listings exclude-error-run 2024/04/26 03:27:31 (23) : test INCLUDE - OTHER TESTS 2024/04/26 03:27:31 (24) : test reset to the initial state 2024/04/26 03:27:31 (25) : copy-dir /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/initial TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/ 2024/04/26 03:27:31 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 (26) : sync-dir TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/ /tmp/032728we/check_access_filters/path2/ 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/04/26 03:27:31 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 (27) : copy-file /tmp/032728we/datadir/test_check_access_filters-xicosah3/include-other-filtersfile.txt /tmp/032728we/workdir/ 2024/04/26 03:27:31 INFO : include-other-filtersfile.txt: Copied (new) 2024/04/26 03:27:31 (28) : bisync resync filters-file=/tmp/032728we/workdir/include-other-filtersfile.txt 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" with Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Using filters file /tmp/032728we/workdir/include-other-filtersfile.txt 2024/04/26 03:27:31 INFO : Storing filters file hash to /tmp/032728we/workdir/include-other-filtersfile.txt.md5 2024/04/26 03:27:31 INFO : Copying Path2 files to Path1 2024/04/26 03:27:31 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:31 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : Resync updating listings 2024/04/26 03:27:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" vs Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Bisync successful 2024/04/26 03:27:31 (29) : test INCLUDE - test include/exclude filters for check access 2024/04/26 03:27:31 (30) : bisync check-access filters-file=/tmp/032728we/workdir/include-other-filtersfile.txt 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" with Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Using filters file /tmp/032728we/workdir/include-other-filtersfile.txt 2024/04/26 03:27:31 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:31 INFO : Path1 checking for diffs 2024/04/26 03:27:31 INFO : Path2 checking for diffs 2024/04/26 03:27:31 INFO : Checking access health 2024/04/26 03:27:31 INFO : Found 5 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:31 INFO : No changes found 2024/04/26 03:27:31 INFO : Updating listings 2024/04/26 03:27:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" vs Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Bisync successful 2024/04/26 03:27:31 (31) : copy-listings include-initial 2024/04/26 03:27:31 (32) : test INCLUDE - delete RCLONE_TEST files in excluded directories 2024/04/26 03:27:31 (33) : delete-file /tmp/032728we/check_access_filters/path2/subdir/subdirA/RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:31 (34) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir-not/RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:31 (35) : delete-file /tmp/032728we/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:31 (36) : test INCLUDE - test should PASS 2024/04/26 03:27:31 (37) : bisync check-access filters-file=/tmp/032728we/workdir/include-other-filtersfile.txt 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" with Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Using filters file /tmp/032728we/workdir/include-other-filtersfile.txt 2024/04/26 03:27:31 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:31 INFO : Path1 checking for diffs 2024/04/26 03:27:31 INFO : Path2 checking for diffs 2024/04/26 03:27:31 INFO : Checking access health 2024/04/26 03:27:31 INFO : Found 5 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:31 INFO : No changes found 2024/04/26 03:27:31 INFO : Updating listings 2024/04/26 03:27:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" vs Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Bisync successful 2024/04/26 03:27:31 (38) : copy-listings include-pass-run 2024/04/26 03:27:31 (39) : test INCLUDE - delete RCLONE_TEST files in included directories 2024/04/26 03:27:31 (40) : delete-file /tmp/032728we/check_access_filters/path2/RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:31 (41) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdir/RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:31 (42) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:31 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:31 (43) : test INCLUDE - test should ABORT 2024/04/26 03:27:31 (44) : bisync check-access filters-file=/tmp/032728we/workdir/include-other-filtersfile.txt 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_access_filters/path1/" with Path2 "/tmp/032728we/check_access_filters/path2/" 2024/04/26 03:27:31 INFO : Using filters file /tmp/032728we/workdir/include-other-filtersfile.txt 2024/04/26 03:27:31 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:31 INFO : Path1 checking for diffs 2024/04/26 03:27:31 INFO : - Path1 File was deleted - subdir/RCLONE_TEST 2024/04/26 03:27:31 INFO : - Path1 File was deleted - subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:31 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2024/04/26 03:27:31 INFO : Path2 checking for diffs 2024/04/26 03:27:31 INFO : - Path2 File was deleted - RCLONE_TEST 2024/04/26 03:27:31 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:31 INFO : Checking access health 2024/04/26 03:27:31 ERROR : Access test failed: Path1 count 3, Path2 count 4 - RCLONE_TEST 2024/04/26 03:27:31 ERROR : -  Access test failed: Path1 file not found in Path2 - RCLONE_TEST 2024/04/26 03:27:31 ERROR : -  Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST 2024/04/26 03:27:31 ERROR : -  Access test failed: Path2 file not found in Path1 - subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:31 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:31 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:31 Bisync error: bisync aborted 2024/04/26 03:27:31 (45) : move-listings include-error-run bisync_test.go:553: TEST check_access_filters PASSED === RUN TestBisyncRemoteLocal/check_filename 2024/04/26 03:27:31 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:31 DEBUG : path1: Making directory 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:31 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1" 2024/04/26 03:27:31 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:31 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:31 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1" 2024/04/26 03:27:31 DEBUG : Creating backend with remote "/tmp/032728we/check_filename/path2" 2024/04/26 03:27:31 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_filename/initial" 2024/04/26 03:27:31 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_check_filename-cifejuk4" 2024/04/26 03:27:31 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:31 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:31 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:31 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : Local file system at /tmp/032728we/initdir/test_check_filename-cifejuk4: Waiting for checks to finish 2024/04/26 03:27:31 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : Local file system at /tmp/032728we/initdir/test_check_filename-cifejuk4: Waiting for transfers to finish 2024/04/26 03:27:31 DEBUG : file1.txt.mesiyic5.partial: renamed to: file1.txt 2024/04/26 03:27:31 INFO : file1.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : file3.txt.gatakew9.partial: renamed to: file3.txt 2024/04/26 03:27:31 DEBUG : file2.txt.hihagaf7.partial: renamed to: file2.txt 2024/04/26 03:27:31 INFO : file3.txt: Copied (new) 2024/04/26 03:27:31 INFO : file2.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : file4.txt.puluxey0.partial: renamed to: file4.txt 2024/04/26 03:27:31 INFO : file4.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:31 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:31 DEBUG : .chk_file.pogulev2.partial: renamed to: .chk_file 2024/04/26 03:27:31 INFO : .chk_file: Copied (new) 2024/04/26 03:27:31 DEBUG : subdir/file20.txt.yulimaz8.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:31 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:31 DEBUG : subdir/.chk_file.joqolum0.partial: renamed to: subdir/.chk_file 2024/04/26 03:27:31 INFO : subdir/.chk_file: Copied (new) 2024/04/26 03:27:31 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:31 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_filename/modfiles" 2024/04/26 03:27:31 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_check_filename-zakoriz8" 2024/04/26 03:27:31 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : Local file system at /tmp/032728we/datadir/test_check_filename-zakoriz8: Waiting for checks to finish 2024/04/26 03:27:31 DEBUG : Local file system at /tmp/032728we/datadir/test_check_filename-zakoriz8: Waiting for transfers to finish 2024/04/26 03:27:31 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:27:31 DEBUG : hold.txt.sipexom1.partial: renamed to: hold.txt 2024/04/26 03:27:31 INFO : hold.txt: Copied (new) 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1] 2024/04/26 03:27:31 ERROR : : error listing: directory not found 2024/04/26 03:27:31 ERROR : : error listing: directory not found 2024/04/26 03:27:31 checking initFs Local file system at /tmp/032728we/initdir/test_check_filename-cifejuk4 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1] 2024/04/26 03:27:31 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir: Making directory 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/subdir] 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/file1.txt] 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/.chk_file] 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/file3.txt] 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/file2.txt] 2024/04/26 03:27:31 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: Waiting for checks to finish 2024/04/26 03:27:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: Waiting for transfers to finish 2024/04/26 03:27:32 INFO : file1.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/file4.txt] 2024/04/26 03:27:32 INFO : file3.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/subdir/.chk_file] 2024/04/26 03:27:32 INFO : file2.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/subdir/file20.txt] 2024/04/26 03:27:32 INFO : .chk_file: Copied (new) 2024/04/26 03:27:32 INFO : file4.txt: Copied (new) 2024/04/26 03:27:32 INFO : subdir/.chk_file: Copied (new) 2024/04/26 03:27:32 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:32 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1] 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/subdir] 2024/04/26 03:27:32 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:32 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:32 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:32 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file1.txt.ceqeluf3.partial: renamed to: file1.txt 2024/04/26 03:27:32 INFO : file1.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/check_filename/path2: Waiting for checks to finish 2024/04/26 03:27:32 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/check_filename/path2: Waiting for transfers to finish 2024/04/26 03:27:32 DEBUG : file3.txt.gorujay2.partial: renamed to: file3.txt 2024/04/26 03:27:32 INFO : file3.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:32 DEBUG : .chk_file.macazeg1.partial: renamed to: .chk_file 2024/04/26 03:27:32 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 INFO : .chk_file: Copied (new) 2024/04/26 03:27:32 DEBUG : file4.txt.lukeqit3.partial: renamed to: file4.txt 2024/04/26 03:27:32 INFO : file4.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:32 DEBUG : subdir/file20.txt.mitigir0.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:32 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : subdir/.chk_file.forozer1.partial: renamed to: subdir/.chk_file 2024/04/26 03:27:32 INFO : subdir/.chk_file: Copied (new) 2024/04/26 03:27:32 DEBUG : file2.txt.lulitoz6.partial: renamed to: file2.txt 2024/04/26 03:27:32 INFO : file2.txt: Copied (new) 2024/04/26 03:27:32 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:32 checking path2 Local file system at /tmp/032728we/check_filename/path2 2024/04/26 03:27:32 (01) : test check-filename 2024/04/26 03:27:32 (02) : test initial bisync 2024/04/26 03:27:32 (03) : bisync resync 2024/04/26 03:27:32 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/" with Path2 "/tmp/032728we/check_filename/path2/" 2024/04/26 03:27:32 INFO : Copying Path2 files to Path1 2024/04/26 03:27:32 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:32 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:32 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:32 INFO : Resync updating listings 2024/04/26 03:27:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/" vs Path2 "/tmp/032728we/check_filename/path2/" 2024/04/26 03:27:32 INFO : Bisync successful 2024/04/26 03:27:32 (04) : test 1. see that check-access passes with the initial setup 2024/04/26 03:27:32 (05) : bisync check-access check-filename=.chk_file 2024/04/26 03:27:32 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/" with Path2 "/tmp/032728we/check_filename/path2/" 2024/04/26 03:27:32 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:32 INFO : Path1 checking for diffs 2024/04/26 03:27:32 INFO : Path2 checking for diffs 2024/04/26 03:27:32 INFO : Checking access health 2024/04/26 03:27:32 INFO : Found 2 matching ".chk_file" files on both paths 2024/04/26 03:27:32 INFO : No changes found 2024/04/26 03:27:32 INFO : Updating listings 2024/04/26 03:27:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/" vs Path2 "/tmp/032728we/check_filename/path2/" 2024/04/26 03:27:32 INFO : Bisync successful 2024/04/26 03:27:32 (06) : copy-listings initial-pass 2024/04/26 03:27:32 (07) : test 2. delete the remote subdir .chk_file, run sync. should fail critical. 2024/04/26 03:27:32 (08) : delete-file /tmp/032728we/check_filename/path2/subdir/.chk_file 2024/04/26 03:27:32 INFO : .chk_file: Deleted 2024/04/26 03:27:32 (09) : bisync check-access check-filename=.chk_file 2024/04/26 03:27:32 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/" with Path2 "/tmp/032728we/check_filename/path2/" 2024/04/26 03:27:32 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:32 INFO : Path1 checking for diffs 2024/04/26 03:27:32 INFO : Path2 checking for diffs 2024/04/26 03:27:32 INFO : - Path2 File was deleted - subdir/.chk_file 2024/04/26 03:27:32 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:32 INFO : Checking access health 2024/04/26 03:27:32 ERROR : Access test failed: Path1 count 2, Path2 count 1 - .chk_file 2024/04/26 03:27:32 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/.chk_file 2024/04/26 03:27:32 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:32 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:32 Bisync error: bisync aborted 2024/04/26 03:27:32 (10) : move-listings path2-missing 2024/04/26 03:27:32 (11) : test 3. put the remote subdir .chk_file back, run resync. 2024/04/26 03:27:32 (12) : copy-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/subdir/.chk_file /tmp/032728we/check_filename/path2/subdir/ 2024/04/26 03:27:32 INFO : .chk_file: Copied (new) 2024/04/26 03:27:32 (13) : bisync check-access resync check-filename=.chk_file 2024/04/26 03:27:32 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/" with Path2 "/tmp/032728we/check_filename/path2/" 2024/04/26 03:27:32 INFO : Copying Path2 files to Path1 2024/04/26 03:27:32 INFO : Checking access health 2024/04/26 03:27:32 INFO : Found 2 matching ".chk_file" files on both paths 2024/04/26 03:27:32 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:32 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:32 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:32 INFO : Resync updating listings 2024/04/26 03:27:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/" vs Path2 "/tmp/032728we/check_filename/path2/" 2024/04/26 03:27:32 INFO : Bisync successful 2024/04/26 03:27:32 (14) : test 4. run sync with check-access. should pass. 2024/04/26 03:27:32 (15) : bisync check-access check-filename=.chk_file 2024/04/26 03:27:32 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/" with Path2 "/tmp/032728we/check_filename/path2/" 2024/04/26 03:27:32 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:32 INFO : Path1 checking for diffs 2024/04/26 03:27:32 INFO : Path2 checking for diffs 2024/04/26 03:27:32 INFO : Checking access health 2024/04/26 03:27:32 INFO : Found 2 matching ".chk_file" files on both paths 2024/04/26 03:27:32 INFO : No changes found 2024/04/26 03:27:32 INFO : Updating listings 2024/04/26 03:27:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_filename/path1/" vs Path2 "/tmp/032728we/check_filename/path2/" 2024/04/26 03:27:32 INFO : Bisync successful bisync_test.go:553: TEST check_filename PASSED === RUN TestBisyncRemoteLocal/check_sync 2024/04/26 03:27:32 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:32 DEBUG : path1: Making directory 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:32 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1" 2024/04/26 03:27:32 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:32 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:32 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:32 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:32 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:32 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:32 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1" 2024/04/26 03:27:32 DEBUG : Creating backend with remote "/tmp/032728we/check_sync/path2" 2024/04/26 03:27:32 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_sync/initial" 2024/04/26 03:27:32 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_check_sync-wacugus9" 2024/04/26 03:27:32 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file1.txt.qomudit5.partial: renamed to: file1.txt 2024/04/26 03:27:32 INFO : file1.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/initdir/test_check_sync-wacugus9: Waiting for checks to finish 2024/04/26 03:27:32 DEBUG : file3.txt.jinised3.partial: renamed to: file3.txt 2024/04/26 03:27:32 INFO : file3.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file2.txt.wuviboj5.partial: renamed to: file2.txt 2024/04/26 03:27:32 INFO : file2.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/initdir/test_check_sync-wacugus9: Waiting for transfers to finish 2024/04/26 03:27:32 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file4.txt.haqopim0.partial: renamed to: file4.txt 2024/04/26 03:27:32 INFO : file4.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file5.txt.qoluzag7.partial: renamed to: file5.txt 2024/04/26 03:27:32 DEBUG : file6.txt.dubeleq7.partial: renamed to: file6.txt 2024/04/26 03:27:32 INFO : file5.txt: Copied (new) 2024/04/26 03:27:32 INFO : file6.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file8.txt.xikusil1.partial: renamed to: file8.txt 2024/04/26 03:27:32 INFO : file8.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:32 DEBUG : file7.txt.komefap3.partial: renamed to: file7.txt 2024/04/26 03:27:32 DEBUG : RCLONE_TEST.bogikob9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:32 INFO : file7.txt: Copied (new) 2024/04/26 03:27:32 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:32 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_sync/modfiles" 2024/04/26 03:27:32 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_check_sync-wucegug5" 2024/04/26 03:27:32 DEBUG : _testdir_path1.._testdir_path2.path1.lst: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : _testdir_path1.._testdir_path2.path2.lst: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/datadir/test_check_sync-wucegug5: Waiting for checks to finish 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/datadir/test_check_sync-wucegug5: Waiting for transfers to finish 2024/04/26 03:27:32 DEBUG : _testdir_path1.._testdir_path2.path1.lst: md5 = fdb18e0dff6961813e12c57227d2e854 OK 2024/04/26 03:27:32 DEBUG : _testdir_path1.._testdir_path2.path1.lst.cofumol5.partial: renamed to: _testdir_path1.._testdir_path2.path1.lst 2024/04/26 03:27:32 INFO : _testdir_path1.._testdir_path2.path1.lst: Copied (new) 2024/04/26 03:27:32 DEBUG : _testdir_path1.._testdir_path2.path2.lst: md5 = d6ce44a26af9c2110b1750fe88dc4b69 OK 2024/04/26 03:27:32 DEBUG : _testdir_path1.._testdir_path2.path2.lst.quginar6.partial: renamed to: _testdir_path1.._testdir_path2.path2.lst 2024/04/26 03:27:32 INFO : _testdir_path1.._testdir_path2.path2.lst: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1] 2024/04/26 03:27:32 ERROR : : error listing: directory not found 2024/04/26 03:27:32 ERROR : : error listing: directory not found 2024/04/26 03:27:32 checking initFs Local file system at /tmp/032728we/initdir/test_check_sync-wacugus9 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1] 2024/04/26 03:27:32 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/RCLONE_TEST] 2024/04/26 03:27:32 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: Waiting for checks to finish 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: Waiting for transfers to finish 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/file1.txt] 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/file3.txt] 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/file2.txt] 2024/04/26 03:27:32 INFO : file1.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/file4.txt] 2024/04/26 03:27:32 INFO : file3.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/file5.txt] 2024/04/26 03:27:32 INFO : file2.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/file6.txt] 2024/04/26 03:27:32 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/file7.txt] 2024/04/26 03:27:32 INFO : file4.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/file8.txt] 2024/04/26 03:27:32 INFO : file5.txt: Copied (new) 2024/04/26 03:27:32 INFO : file6.txt: Copied (new) 2024/04/26 03:27:32 INFO : file7.txt: Copied (new) 2024/04/26 03:27:32 INFO : file8.txt: Copied (new) 2024/04/26 03:27:32 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1] 2024/04/26 03:27:32 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/check_sync/path2: Waiting for checks to finish 2024/04/26 03:27:32 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file1.txt.semonuc8.partial: renamed to: file1.txt 2024/04/26 03:27:32 INFO : file1.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file4.txt.nisinaf2.partial: renamed to: file4.txt 2024/04/26 03:27:32 INFO : file4.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file3.txt.diboqig3.partial: renamed to: file3.txt 2024/04/26 03:27:32 INFO : file3.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/check_sync/path2: Waiting for transfers to finish 2024/04/26 03:27:32 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:32 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : RCLONE_TEST.qureziw2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:32 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:32 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file2.txt.bidegec1.partial: renamed to: file2.txt 2024/04/26 03:27:32 INFO : file2.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file5.txt.kumidek9.partial: renamed to: file5.txt 2024/04/26 03:27:32 INFO : file5.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file7.txt.fugaxaf9.partial: renamed to: file7.txt 2024/04/26 03:27:32 INFO : file7.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file6.txt.sikiviy9.partial: renamed to: file6.txt 2024/04/26 03:27:32 INFO : file6.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file8.txt.rojurik1.partial: renamed to: file8.txt 2024/04/26 03:27:32 INFO : file8.txt: Copied (new) 2024/04/26 03:27:32 checking path2 Local file system at /tmp/032728we/check_sync/path2 2024/04/26 03:27:32 (01) : test check-sync 2024/04/26 03:27:32 (02) : test initial bisync 2024/04/26 03:27:32 (03) : bisync resync 2024/04/26 03:27:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/" with Path2 "/tmp/032728we/check_sync/path2/" 2024/04/26 03:27:32 INFO : Copying Path2 files to Path1 2024/04/26 03:27:32 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:32 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:32 INFO : Resync updating listings 2024/04/26 03:27:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/" vs Path2 "/tmp/032728we/check_sync/path2/" 2024/04/26 03:27:32 INFO : Bisync successful 2024/04/26 03:27:32 (04) : test 1. run check-sync-only on a clean sync 2024/04/26 03:27:32 (05) : bisync check-sync-only 2024/04/26 03:27:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/" vs Path2 "/tmp/032728we/check_sync/path2/" 2024/04/26 03:27:32 INFO : Bisync successful 2024/04/26 03:27:32 (06) : test 2. inject modified listings into the workdir 2024/04/26 03:27:32 (07) : copy-as /tmp/032728we/datadir/test_check_sync-wucegug5/_testdir_path1.._testdir_path2.path1.lst /tmp/032728we/workdir/ TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_check_sync_path1..tmp_032728we_check_sync_path2.path1.lst 2024/04/26 03:27:32 INFO : _testdir_path1.._testdir_path2.path1.lst: Copied (replaced existing) to: TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_check_sync_path1..tmp_032728we_check_sync_path2.path1.lst 2024/04/26 03:27:32 (08) : copy-as /tmp/032728we/datadir/test_check_sync-wucegug5/_testdir_path1.._testdir_path2.path2.lst /tmp/032728we/workdir/ TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_check_sync_path1..tmp_032728we_check_sync_path2.path2.lst 2024/04/26 03:27:32 INFO : _testdir_path1.._testdir_path2.path2.lst: Copied (replaced existing) to: TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_check_sync_path1..tmp_032728we_check_sync_path2.path2.lst 2024/04/26 03:27:32 (09) : test 3. run check-sync-only on modified listings 2024/04/26 03:27:32 (10) : bisync check-sync-only 2024/04/26 03:27:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/" vs Path2 "/tmp/032728we/check_sync/path2/" 2024/04/26 03:27:32 ERROR : -  Path1 file not found in Path2 - file2.txt 2024/04/26 03:27:32 ERROR : -  Path2 file not found in Path1 - file1.txt 2024/04/26 03:27:32 ERROR : Bisync critical error: path1 and path2 are out of sync, run --resync to recover 2024/04/26 03:27:32 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:32 Bisync error: bisync aborted 2024/04/26 03:27:32 (11) : copy-listings check-sync-only 2024/04/26 03:27:32 (12) : test 4. run normal sync to check that it aborts 2024/04/26 03:27:32 (13) : bisync 2024/04/26 03:27:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/" with Path2 "/tmp/032728we/check_sync/path2/" 2024/04/26 03:27:32 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/032728we/workdir/TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_check_sync_path1..tmp_032728we_check_sync_path2.path1.lst Path2: /tmp/032728we/workdir/TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_check_sync_path1..tmp_032728we_check_sync_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/032728we/workdir" 2024/04/26 03:27:32 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:32 Bisync error: bisync aborted 2024/04/26 03:27:32 (14) : test 5. prune failure listings after critical abort 2024/04/26 03:27:32 (15) : delete-glob /tmp/032728we/workdir/ *.lst 2024/04/26 03:27:32 (16) : delete-glob /tmp/032728we/workdir/ *.lst-err 2024/04/26 03:27:32 INFO : TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_check_sync_path1..tmp_032728we_check_sync_path2.path1.lst-err: Deleted 2024/04/26 03:27:32 INFO : TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_check_sync_path1..tmp_032728we_check_sync_path2.path2.lst-err: Deleted 2024/04/26 03:27:32 (17) : delete-glob /tmp/032728we/workdir/ *.lst-new 2024/04/26 03:27:32 INFO : TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_check_sync_path1..tmp_032728we_check_sync_path2.path1.lst-new: Deleted 2024/04/26 03:27:32 INFO : TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_check_sync_path1..tmp_032728we_check_sync_path2.path2.lst-new: Deleted 2024/04/26 03:27:32 (18) : test 6. run resync 2024/04/26 03:27:32 (19) : bisync resync 2024/04/26 03:27:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/" with Path2 "/tmp/032728we/check_sync/path2/" 2024/04/26 03:27:32 INFO : Copying Path2 files to Path1 2024/04/26 03:27:32 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:32 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:32 INFO : Resync updating listings 2024/04/26 03:27:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/" vs Path2 "/tmp/032728we/check_sync/path2/" 2024/04/26 03:27:32 INFO : Bisync successful 2024/04/26 03:27:32 (20) : test 7. run normal sync with check-sync enabled (default) 2024/04/26 03:27:32 (21) : bisync 2024/04/26 03:27:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/" with Path2 "/tmp/032728we/check_sync/path2/" 2024/04/26 03:27:32 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:32 INFO : Path1 checking for diffs 2024/04/26 03:27:32 INFO : Path2 checking for diffs 2024/04/26 03:27:32 INFO : No changes found 2024/04/26 03:27:32 INFO : Updating listings 2024/04/26 03:27:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/" vs Path2 "/tmp/032728we/check_sync/path2/" 2024/04/26 03:27:32 INFO : Bisync successful 2024/04/26 03:27:32 (22) : test 8. run normal sync with no-check-sync 2024/04/26 03:27:32 (23) : bisync no-check-sync 2024/04/26 03:27:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/check_sync/path1/" with Path2 "/tmp/032728we/check_sync/path2/" 2024/04/26 03:27:32 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:32 INFO : Path1 checking for diffs 2024/04/26 03:27:32 INFO : Path2 checking for diffs 2024/04/26 03:27:32 INFO : No changes found 2024/04/26 03:27:32 INFO : Updating listings 2024/04/26 03:27:32 INFO : Bisync successful bisync_test.go:553: TEST check_sync PASSED === RUN TestBisyncRemoteLocal/compare_all 2024/04/26 03:27:32 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:32 DEBUG : path1: Making directory 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:32 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1" 2024/04/26 03:27:32 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:32 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:32 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:32 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:32 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:32 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:32 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1" 2024/04/26 03:27:32 DEBUG : Creating backend with remote "/tmp/032728we/compare_all/path2" 2024/04/26 03:27:32 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_compare_all/initial" 2024/04/26 03:27:32 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_compare_all-goziwuq0" 2024/04/26 03:27:32 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/initdir/test_compare_all-goziwuq0: Waiting for checks to finish 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/initdir/test_compare_all-goziwuq0: Waiting for transfers to finish 2024/04/26 03:27:32 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file2.txt.hifupul9.partial: renamed to: file2.txt 2024/04/26 03:27:32 INFO : file2.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file1.txt.texuwad0.partial: renamed to: file1.txt 2024/04/26 03:27:32 INFO : file1.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file4.txt.pojaget6.partial: renamed to: file4.txt 2024/04/26 03:27:32 DEBUG : file5.txt.vajahuw6.partial: renamed to: file5.txt 2024/04/26 03:27:32 INFO : file4.txt: Copied (new) 2024/04/26 03:27:32 INFO : file5.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file3.txt.vaxugis9.partial: renamed to: file3.txt 2024/04/26 03:27:32 INFO : file3.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:32 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : RCLONE_TEST.cufadec7.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:32 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:32 DEBUG : file6.txt.qujofak3.partial: renamed to: file6.txt 2024/04/26 03:27:32 DEBUG : file7.txt.mewuxup6.partial: renamed to: file7.txt 2024/04/26 03:27:32 INFO : file6.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file8.txt.difisuh0.partial: renamed to: file8.txt 2024/04/26 03:27:32 INFO : file8.txt: Copied (new) 2024/04/26 03:27:32 INFO : file7.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_compare_all/modfiles" 2024/04/26 03:27:32 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_compare_all-cizepek3" 2024/04/26 03:27:32 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/datadir/test_compare_all-cizepek3: Waiting for checks to finish 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/datadir/test_compare_all-cizepek3: Waiting for transfers to finish 2024/04/26 03:27:32 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:32 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:32 DEBUG : file10.txt.tobosag5.partial: renamed to: file10.txt 2024/04/26 03:27:32 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:32 INFO : file10.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file11.txt.morejas8.partial: renamed to: file11.txt 2024/04/26 03:27:32 INFO : file11.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file1.txt.ceqadib6.partial: renamed to: file1.txt 2024/04/26 03:27:32 INFO : file1.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:32 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:32 DEBUG : file5R.txt.pijeseq9.partial: renamed to: file5R.txt 2024/04/26 03:27:32 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file5L.txt.fixamoz5.partial: renamed to: file5L.txt 2024/04/26 03:27:32 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:32 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:32 DEBUG : file2.txt.keguguq1.partial: renamed to: file2.txt 2024/04/26 03:27:32 DEBUG : file6.txt.hamepew1.partial: renamed to: file6.txt 2024/04/26 03:27:32 INFO : file2.txt: Copied (new) 2024/04/26 03:27:32 INFO : file6.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:32 DEBUG : file7.txt.dawexeq8.partial: renamed to: file7.txt 2024/04/26 03:27:32 INFO : file7.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1] 2024/04/26 03:27:32 ERROR : : error listing: directory not found 2024/04/26 03:27:32 ERROR : : error listing: directory not found 2024/04/26 03:27:32 checking initFs Local file system at /tmp/032728we/initdir/test_compare_all-goziwuq0 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1] 2024/04/26 03:27:32 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/RCLONE_TEST] 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file1.txt] 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file2.txt] 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file3.txt] 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: Waiting for checks to finish 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: Waiting for transfers to finish 2024/04/26 03:27:32 INFO : file1.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file4.txt] 2024/04/26 03:27:32 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file5.txt] 2024/04/26 03:27:32 INFO : file2.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file6.txt] 2024/04/26 03:27:32 INFO : file3.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file7.txt] 2024/04/26 03:27:32 INFO : file4.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file8.txt] 2024/04/26 03:27:32 INFO : file5.txt: Copied (new) 2024/04/26 03:27:32 INFO : file6.txt: Copied (new) 2024/04/26 03:27:32 INFO : file7.txt: Copied (new) 2024/04/26 03:27:32 INFO : file8.txt: Copied (new) 2024/04/26 03:27:32 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1 2024/04/26 03:27:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1] 2024/04/26 03:27:32 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/compare_all/path2: Waiting for checks to finish 2024/04/26 03:27:32 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file1.txt.hoyuzay1.partial: renamed to: file1.txt 2024/04/26 03:27:32 INFO : file1.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file2.txt.vujizev0.partial: renamed to: file2.txt 2024/04/26 03:27:32 INFO : file2.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : Local file system at /tmp/032728we/compare_all/path2: Waiting for transfers to finish 2024/04/26 03:27:32 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:32 DEBUG : RCLONE_TEST.bicoded7.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:32 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:32 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file3.txt.qofeqah0.partial: renamed to: file3.txt 2024/04/26 03:27:32 INFO : file3.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file5.txt.hikunih4.partial: renamed to: file5.txt 2024/04/26 03:27:32 INFO : file5.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file8.txt.xujagic4.partial: renamed to: file8.txt 2024/04/26 03:27:32 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file6.txt.diyufif7.partial: renamed to: file6.txt 2024/04/26 03:27:32 DEBUG : file7.txt.tadoboq8.partial: renamed to: file7.txt 2024/04/26 03:27:32 INFO : file7.txt: Copied (new) 2024/04/26 03:27:32 INFO : file8.txt: Copied (new) 2024/04/26 03:27:32 INFO : file6.txt: Copied (new) 2024/04/26 03:27:32 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:32 DEBUG : file4.txt.remacav4.partial: renamed to: file4.txt 2024/04/26 03:27:32 INFO : file4.txt: Copied (new) 2024/04/26 03:27:32 checking path2 Local file system at /tmp/032728we/compare_all/path2 2024/04/26 03:27:33 (01) : test changes compare-all 2024/04/26 03:27:33 (02) : test initial bisync 2024/04/26 03:27:33 (03) : bisync resync compare-all 2024/04/26 03:27:33 NOTICE: Local file system at /tmp/032728we/compare_all/path2: will use md5 for same-side diffs on Path2 only 2024/04/26 03:27:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/" with Path2 "/tmp/032728we/compare_all/path2/" 2024/04/26 03:27:33 INFO : Copying Path2 files to Path1 2024/04/26 03:27:33 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:33 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:33 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:33 INFO : Resync updating listings 2024/04/26 03:27:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/" vs Path2 "/tmp/032728we/compare_all/path2/" 2024/04/26 03:27:33 INFO : Bisync successful 2024/04/26 03:27:33 (04) : test make modifications on both paths 2024/04/26 03:27:33 (05) : test new on path2 - file10 2024/04/26 03:27:33 (06) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_compare_all-cizepek3/file10.txt /tmp/032728we/compare_all/path2/ 2024/04/26 03:27:33 INFO : file10.txt: Copied (new) 2024/04/26 03:27:33 (07) : test newer on path2 - file1 2024/04/26 03:27:33 (08) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_compare_all-cizepek3/file1.txt /tmp/032728we/compare_all/path2/ 2024/04/26 03:27:33 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:33 (09) : test new on path1 - file11 2024/04/26 03:27:33 (10) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_compare_all-cizepek3/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/ 2024/04/26 03:27:33 INFO : file11.txt: Copied (new) 2024/04/26 03:27:33 (11) : test newer on path1 - file2 2024/04/26 03:27:33 (12) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_compare_all-cizepek3/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/ 2024/04/26 03:27:33 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:33 (13) : test deleted on path2 - file3 2024/04/26 03:27:33 (14) : delete-file /tmp/032728we/compare_all/path2/file3.txt 2024/04/26 03:27:33 INFO : file3.txt: Deleted 2024/04/26 03:27:33 (15) : test deleted on path1 - file4 2024/04/26 03:27:33 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file4.txt 2024/04/26 03:27:33 INFO : file4.txt: Deleted 2024/04/26 03:27:33 (17) : test deleted on both paths - file8 2024/04/26 03:27:33 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file8.txt 2024/04/26 03:27:33 INFO : file8.txt: Deleted 2024/04/26 03:27:33 (19) : delete-file /tmp/032728we/compare_all/path2/file8.txt 2024/04/26 03:27:33 INFO : file8.txt: Deleted 2024/04/26 03:27:33 (20) : test changed on both paths - file5 (file5R, file5L) 2024/04/26 03:27:33 (21) : touch-glob 2001-01-02 /tmp/032728we/datadir/test_compare_all-cizepek3/ file5R.txt 2024/04/26 03:27:33 (22) : copy-as /tmp/032728we/datadir/test_compare_all-cizepek3/file5R.txt /tmp/032728we/compare_all/path2/ file5.txt 2024/04/26 03:27:33 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:33 (23) : touch-glob 2001-03-04 /tmp/032728we/datadir/test_compare_all-cizepek3/ file5L.txt 2024/04/26 03:27:33 (24) : copy-as /tmp/032728we/datadir/test_compare_all-cizepek3/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/ file5.txt 2024/04/26 03:27:33 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:33 (25) : test newer on path2 and deleted on path1 - file6 2024/04/26 03:27:33 (26) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_compare_all-cizepek3/file6.txt /tmp/032728we/compare_all/path2/ 2024/04/26 03:27:33 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:27:33 (27) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file6.txt 2024/04/26 03:27:33 INFO : file6.txt: Deleted 2024/04/26 03:27:33 (28) : test newer on path1 and deleted on path2 - file7 2024/04/26 03:27:33 (29) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_compare_all-cizepek3/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/ 2024/04/26 03:27:33 INFO : file7.txt: Copied (replaced existing) 2024/04/26 03:27:33 (30) : delete-file /tmp/032728we/compare_all/path2/file7.txt 2024/04/26 03:27:33 INFO : file7.txt: Deleted 2024/04/26 03:27:33 (31) : test bisync run 2024/04/26 03:27:33 (32) : bisync compare-all 2024/04/26 03:27:33 NOTICE: Local file system at /tmp/032728we/compare_all/path2: will use md5 for same-side diffs on Path2 only 2024/04/26 03:27:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/" with Path2 "/tmp/032728we/compare_all/path2/" 2024/04/26 03:27:33 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:33 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:33 INFO : Path1 checking for diffs 2024/04/26 03:27:33 INFO : - Path1 File changed: size (larger), time (newer), hash - file2.txt 2024/04/26 03:27:33 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:33 INFO : - Path1 File changed: size (larger), time (newer), hash - file5.txt 2024/04/26 03:27:33 INFO : - Path1 File was deleted - file6.txt 2024/04/26 03:27:33 INFO : - Path1 File changed: size (larger), time (newer), hash - file7.txt 2024/04/26 03:27:33 INFO : - Path1 File was deleted - file8.txt 2024/04/26 03:27:33 INFO : - Path1 File is new - file11.txt 2024/04/26 03:27:33 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:33 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2024/04/26 03:27:33 INFO : Path2 checking for diffs 2024/04/26 03:27:33 INFO : - Path2 File changed: size (larger), time (newer), hash - file1.txt 2024/04/26 03:27:33 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:33 INFO : - Path2 File changed: size (larger), time (newer), hash - file5.txt 2024/04/26 03:27:33 INFO : - Path2 File changed: size (larger), time (newer), hash - file6.txt 2024/04/26 03:27:33 INFO : - Path2 File was deleted - file7.txt 2024/04/26 03:27:33 INFO : - Path2 File was deleted - file8.txt 2024/04/26 03:27:33 INFO : - Path2 File is new - file10.txt 2024/04/26 03:27:33 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:33 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2024/04/26 03:27:33 INFO : Applying changes 2024/04/26 03:27:33 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/compare_all/path2/file11.txt 2024/04/26 03:27:33 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/compare_all/path2/file2.txt 2024/04/26 03:27:33 INFO : - Path2 Queue delete - /tmp/032728we/compare_all/path2/file4.txt 2024/04/26 03:27:33 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:27:33 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file5.txt.conflict1 2024/04/26 03:27:33 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/04/26 03:27:33 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/compare_all/path2/file5.txt.conflict1 2024/04/26 03:27:33 NOTICE: - Path2 Renaming Path2 copy - /tmp/032728we/compare_all/path2/file5.txt.conflict2 2024/04/26 03:27:33 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/04/26 03:27:33 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file5.txt.conflict2 2024/04/26 03:27:33 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file6.txt 2024/04/26 03:27:33 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/compare_all/path2/file7.txt 2024/04/26 03:27:33 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file1.txt 2024/04/26 03:27:33 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file10.txt 2024/04/26 03:27:33 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/file3.txt 2024/04/26 03:27:33 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:33 INFO : file10.txt: Copied (new) 2024/04/26 03:27:33 INFO : file5.txt.conflict2: Copied (new) 2024/04/26 03:27:33 INFO : file6.txt: Copied (new) 2024/04/26 03:27:33 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:33 INFO : file3.txt: Deleted 2024/04/26 03:27:33 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:33 INFO : file11.txt: Copied (new) 2024/04/26 03:27:33 INFO : file5.txt.conflict1: Copied (new) 2024/04/26 03:27:33 INFO : file7.txt: Copied (new) 2024/04/26 03:27:33 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:33 INFO : file4.txt: Deleted 2024/04/26 03:27:33 INFO : Updating listings 2024/04/26 03:27:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/compare_all/path1/" vs Path2 "/tmp/032728we/compare_all/path2/" 2024/04/26 03:27:33 INFO : Bisync successful bisync_test.go:553: TEST compare_all PASSED === RUN TestBisyncRemoteLocal/createemptysrcdirs 2024/04/26 03:27:33 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:33 DEBUG : path1: Making directory 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:33 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1" 2024/04/26 03:27:33 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:33 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:33 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:33 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:33 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:33 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:33 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1" 2024/04/26 03:27:33 DEBUG : Creating backend with remote "/tmp/032728we/createemptysrcdirs/path2" 2024/04/26 03:27:33 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_createemptysrcdirs/initial" 2024/04/26 03:27:33 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_createemptysrcdirs-carepiw0" 2024/04/26 03:27:33 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : Local file system at /tmp/032728we/initdir/test_createemptysrcdirs-carepiw0: Waiting for checks to finish 2024/04/26 03:27:33 DEBUG : Local file system at /tmp/032728we/initdir/test_createemptysrcdirs-carepiw0: Waiting for transfers to finish 2024/04/26 03:27:33 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file1.copy1.txt.foridit6.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:33 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:33 DEBUG : file1.copy2.txt.covafoh1.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:33 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file1.copy3.txt.jedasap6.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:33 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : RCLONE_TEST.beronah2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:33 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:33 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file1.copy4.txt.furawer4.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:33 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file1.copy5.txt.yijulew3.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:33 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file1.txt.zotodep3.partial: renamed to: file1.txt 2024/04/26 03:27:33 INFO : file1.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_createemptysrcdirs/modfiles" 2024/04/26 03:27:33 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1" 2024/04/26 03:27:33 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : Local file system at /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1: Waiting for checks to finish 2024/04/26 03:27:33 DEBUG : Local file system at /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1: Waiting for transfers to finish 2024/04/26 03:27:33 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : placeholder.txt.cefoyar1.partial: renamed to: placeholder.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1] 2024/04/26 03:27:33 ERROR : : error listing: directory not found 2024/04/26 03:27:33 ERROR : : error listing: directory not found 2024/04/26 03:27:33 checking initFs Local file system at /tmp/032728we/initdir/test_createemptysrcdirs-carepiw0 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1] 2024/04/26 03:27:33 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/file1.copy1.txt] 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/file1.copy2.txt] 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/file1.copy3.txt] 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1: Waiting for checks to finish 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/RCLONE_TEST] 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1: Waiting for transfers to finish 2024/04/26 03:27:33 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/file1.copy4.txt] 2024/04/26 03:27:33 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/file1.copy5.txt] 2024/04/26 03:27:33 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/file1.txt] 2024/04/26 03:27:33 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:33 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:33 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:33 INFO : file1.txt: Copied (new) 2024/04/26 03:27:33 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1] 2024/04/26 03:27:33 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file1.copy1.txt.bokufoq4.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:33 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : Local file system at /tmp/032728we/createemptysrcdirs/path2: Waiting for checks to finish 2024/04/26 03:27:33 DEBUG : Local file system at /tmp/032728we/createemptysrcdirs/path2: Waiting for transfers to finish 2024/04/26 03:27:33 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file1.copy4.txt.nowaqop3.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:33 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file1.copy2.txt.hitosak8.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:33 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:33 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : RCLONE_TEST.xosexek5.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:33 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:33 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file1.copy3.txt.fanupax6.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:33 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file1.copy5.txt.ruvafeg0.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:33 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file1.txt.bizugeb1.partial: renamed to: file1.txt 2024/04/26 03:27:33 INFO : file1.txt: Copied (new) 2024/04/26 03:27:33 checking path2 Local file system at /tmp/032728we/createemptysrcdirs/path2 2024/04/26 03:27:33 (01) : test createemptysrcdirs 2024/04/26 03:27:33 (02) : test initial bisync 2024/04/26 03:27:33 (03) : touch-glob 2001-01-02 /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/ placeholder.txt 2024/04/26 03:27:33 (04) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:33 (05) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy1.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy1.txt 2024/04/26 03:27:33 (06) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy2.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy2.txt 2024/04/26 03:27:33 (07) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy3.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy3.txt 2024/04/26 03:27:33 (08) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy4.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy4.txt 2024/04/26 03:27:33 (09) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy5.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy5.txt 2024/04/26 03:27:33 (10) : bisync resync 2024/04/26 03:27:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" with Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Copying Path2 files to Path1 2024/04/26 03:27:33 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:33 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:33 INFO : file1.copy3.txt: Copied (replaced existing) 2024/04/26 03:27:33 INFO : file1.copy1.txt: Copied (replaced existing) 2024/04/26 03:27:33 INFO : file1.copy2.txt: Copied (replaced existing) 2024/04/26 03:27:33 INFO : file1.copy4.txt: Copied (replaced existing) 2024/04/26 03:27:33 INFO : file1.copy5.txt: Copied (replaced existing) 2024/04/26 03:27:33 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:33 INFO : Resync updating listings 2024/04/26 03:27:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" vs Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Bisync successful 2024/04/26 03:27:33 (11) : test 1. Create an empty dir on Path1 by creating subdir/placeholder.txt and then deleting the placeholder 2024/04/26 03:27:33 (12) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ subdir/placeholder.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: subdir/placeholder.txt 2024/04/26 03:27:33 (13) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ subdir 2024/04/26 03:27:33 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/subdir/placeholder.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Deleted 2024/04/26 03:27:33 (15) : test 2. Run bisync without --create-empty-src-dirs 2024/04/26 03:27:33 (16) : bisync 2024/04/26 03:27:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" with Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:33 INFO : Path1 checking for diffs 2024/04/26 03:27:33 INFO : Path2 checking for diffs 2024/04/26 03:27:33 INFO : No changes found 2024/04/26 03:27:33 INFO : Updating listings 2024/04/26 03:27:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" vs Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Bisync successful 2024/04/26 03:27:33 (17) : test 3. Confirm the subdir exists only on Path1 and not Path2 2024/04/26 03:27:33 (18) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ 2024/04/26 03:27:33 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:33 (19) : list-dirs /tmp/032728we/createemptysrcdirs/path2/ 2024/04/26 03:27:33 (20) : test 4.Run bisync WITH --create-empty-src-dirs 2024/04/26 03:27:33 (21) : bisync create-empty-src-dirs 2024/04/26 03:27:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" with Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:33 INFO : Path1 checking for diffs 2024/04/26 03:27:33 INFO : - Path1 File is new - subdir 2024/04/26 03:27:33 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:33 INFO : Path2 checking for diffs 2024/04/26 03:27:33 INFO : Applying changes 2024/04/26 03:27:33 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/createemptysrcdirs/path2/subdir 2024/04/26 03:27:33 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:33 INFO : Updating listings 2024/04/26 03:27:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" vs Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Bisync successful 2024/04/26 03:27:33 (22) : test 5. Confirm the subdir exists on both paths 2024/04/26 03:27:33 (23) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ 2024/04/26 03:27:33 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:33 (24) : list-dirs /tmp/032728we/createemptysrcdirs/path2/ 2024/04/26 03:27:33 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:33 (25) : test 6. Delete the empty dir on Path1 using purge-children (and also add files so the path isn't empty) 2024/04/26 03:27:33 (26) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ 2024/04/26 03:27:33 (27) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: file1.txt 2024/04/26 03:27:33 (28) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy1.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2024/04/26 03:27:33 (29) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy2.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2024/04/26 03:27:33 (30) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy3.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2024/04/26 03:27:33 (31) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy4.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2024/04/26 03:27:33 (32) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy5.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2024/04/26 03:27:33 (33) : test 7. Run bisync without --create-empty-src-dirs 2024/04/26 03:27:33 (34) : bisync 2024/04/26 03:27:33 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" with Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:33 INFO : Path1 checking for diffs 2024/04/26 03:27:33 INFO : - Path1 File was deleted - RCLONE_TEST 2024/04/26 03:27:33 INFO : - Path1 File was deleted - subdir 2024/04/26 03:27:33 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2024/04/26 03:27:33 INFO : Path2 checking for diffs 2024/04/26 03:27:33 INFO : - Path2 File was deleted - subdir 2024/04/26 03:27:33 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:33 INFO : Applying changes 2024/04/26 03:27:33 INFO : - Path2 Queue delete - /tmp/032728we/createemptysrcdirs/path2/RCLONE_TEST 2024/04/26 03:27:33 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:33 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:33 INFO : Updating listings 2024/04/26 03:27:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" vs Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Bisync successful 2024/04/26 03:27:33 (35) : test 8. Confirm the subdir exists only on Path2 and not Path1 2024/04/26 03:27:33 (36) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ 2024/04/26 03:27:33 (37) : list-dirs /tmp/032728we/createemptysrcdirs/path2/ 2024/04/26 03:27:33 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:33 (38) : test 9. Reset, do the delete again, and run bisync WITH --create-empty-src-dirs 2024/04/26 03:27:33 (39) : bisync resync create-empty-src-dirs 2024/04/26 03:27:33 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" with Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Copying Path2 files to Path1 2024/04/26 03:27:33 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:33 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:33 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:33 INFO : Resync updating listings 2024/04/26 03:27:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" vs Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Bisync successful 2024/04/26 03:27:33 (40) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ 2024/04/26 03:27:33 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:33 (41) : list-dirs /tmp/032728we/createemptysrcdirs/path2/ 2024/04/26 03:27:33 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:33 (42) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ 2024/04/26 03:27:33 (43) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: file1.txt 2024/04/26 03:27:33 (44) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy1.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2024/04/26 03:27:33 (45) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy2.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2024/04/26 03:27:33 (46) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy3.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2024/04/26 03:27:33 (47) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy4.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2024/04/26 03:27:33 (48) : copy-as /tmp/032728we/datadir/test_createemptysrcdirs-tedocaf1/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ file1.copy5.txt 2024/04/26 03:27:33 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2024/04/26 03:27:33 (49) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ 2024/04/26 03:27:33 (50) : list-dirs /tmp/032728we/createemptysrcdirs/path2/ 2024/04/26 03:27:33 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:33 (51) : bisync create-empty-src-dirs 2024/04/26 03:27:33 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" with Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:33 INFO : Path1 checking for diffs 2024/04/26 03:27:33 INFO : - Path1 File was deleted - subdir 2024/04/26 03:27:33 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:33 INFO : Path2 checking for diffs 2024/04/26 03:27:33 INFO : Applying changes 2024/04/26 03:27:33 INFO : - Path2 Queue delete - /tmp/032728we/createemptysrcdirs/path2/subdir 2024/04/26 03:27:33 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:33 INFO : subdir: Removing directory 2024/04/26 03:27:33 INFO : Updating listings 2024/04/26 03:27:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" vs Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Bisync successful 2024/04/26 03:27:33 (52) : test 10. Confirm the subdir has been removed on both paths 2024/04/26 03:27:33 (53) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/ 2024/04/26 03:27:33 (54) : list-dirs /tmp/032728we/createemptysrcdirs/path2/ 2024/04/26 03:27:33 (55) : test 11. bisync again (because if we leave subdir in listings, test will fail due to mismatched modtime) 2024/04/26 03:27:33 (56) : bisync create-empty-src-dirs 2024/04/26 03:27:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" with Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:33 INFO : Path1 checking for diffs 2024/04/26 03:27:33 INFO : Path2 checking for diffs 2024/04/26 03:27:33 INFO : No changes found 2024/04/26 03:27:33 INFO : Updating listings 2024/04/26 03:27:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/createemptysrcdirs/path1/" vs Path2 "/tmp/032728we/createemptysrcdirs/path2/" 2024/04/26 03:27:33 INFO : Bisync successful bisync_test.go:553: TEST createemptysrcdirs PASSED === RUN TestBisyncRemoteLocal/dry_run 2024/04/26 03:27:33 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:33 DEBUG : path1: Making directory 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:33 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1" 2024/04/26 03:27:33 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:33 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:33 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:33 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:33 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:33 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:33 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1" 2024/04/26 03:27:33 DEBUG : Creating backend with remote "/tmp/032728we/dry_run/path2" 2024/04/26 03:27:33 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_dry_run/initial" 2024/04/26 03:27:33 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_dry_run-colotiw1" 2024/04/26 03:27:33 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : Local file system at /tmp/032728we/initdir/test_dry_run-colotiw1: Waiting for checks to finish 2024/04/26 03:27:33 DEBUG : Local file system at /tmp/032728we/initdir/test_dry_run-colotiw1: Waiting for transfers to finish 2024/04/26 03:27:33 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:33 DEBUG : RCLONE_TEST.raluyuz3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:33 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:33 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file4.txt.xecetap2.partial: renamed to: file4.txt 2024/04/26 03:27:33 INFO : file4.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file5.txt.keyelog2.partial: renamed to: file5.txt 2024/04/26 03:27:33 INFO : file5.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file6.txt.fanopad5.partial: renamed to: file6.txt 2024/04/26 03:27:33 INFO : file6.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file7.txt.zudanow8.partial: renamed to: file7.txt 2024/04/26 03:27:33 INFO : file7.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 DEBUG : file3.txt.wemivoc3.partial: renamed to: file3.txt 2024/04/26 03:27:33 INFO : file3.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file2.txt.mipohef1.partial: renamed to: file2.txt 2024/04/26 03:27:33 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:33 INFO : file2.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file1.txt.hebepot4.partial: renamed to: file1.txt 2024/04/26 03:27:33 INFO : file1.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_dry_run/modfiles" 2024/04/26 03:27:33 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_dry_run-woyadov4" 2024/04/26 03:27:33 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : Local file system at /tmp/032728we/datadir/test_dry_run-woyadov4: Waiting for checks to finish 2024/04/26 03:27:33 DEBUG : Local file system at /tmp/032728we/datadir/test_dry_run-woyadov4: Waiting for transfers to finish 2024/04/26 03:27:33 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:33 DEBUG : file1.txt.pazefum2.partial: renamed to: file1.txt 2024/04/26 03:27:33 INFO : file1.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:33 DEBUG : file2.txt.xivilix2.partial: renamed to: file2.txt 2024/04/26 03:27:33 INFO : file2.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:33 DEBUG : file10.txt.qubalex9.partial: renamed to: file10.txt 2024/04/26 03:27:33 INFO : file10.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:33 DEBUG : file11.txt.japuxiv5.partial: renamed to: file11.txt 2024/04/26 03:27:33 INFO : file11.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:33 DEBUG : file5L.txt.vexebos3.partial: renamed to: file5L.txt 2024/04/26 03:27:33 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:33 DEBUG : file5R.txt.sacakit1.partial: renamed to: file5R.txt 2024/04/26 03:27:33 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:33 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:33 DEBUG : file7.txt.yelitar9.partial: renamed to: file7.txt 2024/04/26 03:27:33 INFO : file7.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : file6.txt.xutoruh0.partial: renamed to: file6.txt 2024/04/26 03:27:33 INFO : file6.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1] 2024/04/26 03:27:33 ERROR : : error listing: directory not found 2024/04/26 03:27:33 ERROR : : error listing: directory not found 2024/04/26 03:27:33 checking initFs Local file system at /tmp/032728we/initdir/test_dry_run-colotiw1 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1] 2024/04/26 03:27:33 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: Waiting for checks to finish 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/RCLONE_TEST] 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file1.txt] 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file2.txt] 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: Waiting for transfers to finish 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file3.txt] 2024/04/26 03:27:33 INFO : file1.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file4.txt] 2024/04/26 03:27:33 INFO : file2.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file5.txt] 2024/04/26 03:27:33 INFO : file3.txt: Copied (new) 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file6.txt] 2024/04/26 03:27:33 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file7.txt] 2024/04/26 03:27:34 INFO : file4.txt: Copied (new) 2024/04/26 03:27:34 INFO : file5.txt: Copied (new) 2024/04/26 03:27:34 INFO : file6.txt: Copied (new) 2024/04/26 03:27:34 INFO : file7.txt: Copied (new) 2024/04/26 03:27:34 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1] 2024/04/26 03:27:34 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:34 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : RCLONE_TEST.dadezeh8.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:34 DEBUG : file1.txt.nurogah8.partial: renamed to: file1.txt 2024/04/26 03:27:34 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:34 INFO : file1.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : Local file system at /tmp/032728we/dry_run/path2: Waiting for checks to finish 2024/04/26 03:27:34 DEBUG : Local file system at /tmp/032728we/dry_run/path2: Waiting for transfers to finish 2024/04/26 03:27:34 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : file2.txt.weqapon7.partial: renamed to: file2.txt 2024/04/26 03:27:34 INFO : file2.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : file3.txt.lukudek4.partial: renamed to: file3.txt 2024/04/26 03:27:34 INFO : file3.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : file4.txt.bicusoz0.partial: renamed to: file4.txt 2024/04/26 03:27:34 INFO : file4.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : file5.txt.suwoway0.partial: renamed to: file5.txt 2024/04/26 03:27:34 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 INFO : file5.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : file6.txt.nagewef2.partial: renamed to: file6.txt 2024/04/26 03:27:34 INFO : file6.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : file7.txt.hihunum5.partial: renamed to: file7.txt 2024/04/26 03:27:34 INFO : file7.txt: Copied (new) 2024/04/26 03:27:34 checking path2 Local file system at /tmp/032728we/dry_run/path2 2024/04/26 03:27:34 (01) : test dry-run 2024/04/26 03:27:34 (02) : test initial bisync 2024/04/26 03:27:34 (03) : bisync resync 2024/04/26 03:27:34 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:34 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:34 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/" with Path2 "/tmp/032728we/dry_run/path2/" 2024/04/26 03:27:34 INFO : Copying Path2 files to Path1 2024/04/26 03:27:34 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:34 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:34 INFO : Resync updating listings 2024/04/26 03:27:34 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/" vs Path2 "/tmp/032728we/dry_run/path2/" 2024/04/26 03:27:34 INFO : Bisync successful 2024/04/26 03:27:34 (04) : test new on path2 - file10 2024/04/26 03:27:34 (05) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_dry_run-woyadov4/file10.txt /tmp/032728we/dry_run/path2/ 2024/04/26 03:27:34 INFO : file10.txt: Copied (new) 2024/04/26 03:27:34 (06) : test newer on path2 - file1 2024/04/26 03:27:34 (07) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_dry_run-woyadov4/file1.txt /tmp/032728we/dry_run/path2/ 2024/04/26 03:27:34 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:34 (08) : test new on path1 - file11 2024/04/26 03:27:34 (09) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_dry_run-woyadov4/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/ 2024/04/26 03:27:34 INFO : file11.txt: Copied (new) 2024/04/26 03:27:34 (10) : test newer on path1 - file2 2024/04/26 03:27:34 (11) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_dry_run-woyadov4/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/ 2024/04/26 03:27:34 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:34 (12) : test deleted on path2 - file3 2024/04/26 03:27:34 (13) : delete-file /tmp/032728we/dry_run/path2/file3.txt 2024/04/26 03:27:34 INFO : file3.txt: Deleted 2024/04/26 03:27:34 (14) : test deleted on path1 - file4 2024/04/26 03:27:34 (15) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file4.txt 2024/04/26 03:27:34 INFO : file4.txt: Deleted 2024/04/26 03:27:34 (16) : test changed on path2 and on path1 - file5 (file5R, file5L) 2024/04/26 03:27:34 (17) : touch-glob 2001-01-02 /tmp/032728we/datadir/test_dry_run-woyadov4/ file5R.txt 2024/04/26 03:27:34 (18) : copy-as /tmp/032728we/datadir/test_dry_run-woyadov4/file5R.txt /tmp/032728we/dry_run/path2/ file5.txt 2024/04/26 03:27:34 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:34 (19) : touch-glob 2001-03-04 /tmp/032728we/datadir/test_dry_run-woyadov4/ file5L.txt 2024/04/26 03:27:34 (20) : copy-as /tmp/032728we/datadir/test_dry_run-woyadov4/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/ file5.txt 2024/04/26 03:27:34 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:34 (21) : test newer on path2 and deleted on path1 - file6 2024/04/26 03:27:34 (22) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_dry_run-woyadov4/file6.txt /tmp/032728we/dry_run/path2/ 2024/04/26 03:27:34 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:27:34 (23) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file6.txt 2024/04/26 03:27:34 INFO : file6.txt: Deleted 2024/04/26 03:27:34 (24) : test newer on path1 and deleted on path2 - file7 2024/04/26 03:27:34 (25) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_dry_run-woyadov4/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/ 2024/04/26 03:27:34 INFO : file7.txt: Copied (replaced existing) 2024/04/26 03:27:34 (26) : delete-file /tmp/032728we/dry_run/path2/file7.txt 2024/04/26 03:27:34 INFO : file7.txt: Deleted 2024/04/26 03:27:34 (27) : test sync with dry-run and resync 2024/04/26 03:27:34 (28) : bisync dry-run resync 2024/04/26 03:27:34 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:34 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:34 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/" with Path2 "/tmp/032728we/dry_run/path2/" 2024/04/26 03:27:34 INFO : Copying Path2 files to Path1 2024/04/26 03:27:34 NOTICE: - Path2 Resync is copying files to - Path1 2024/04/26 03:27:34 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:34 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:34 NOTICE: file4.txt: Skipped copy as --dry-run is set (size 0) 2024/04/26 03:27:34 NOTICE: - Path1 Resync is copying files to - Path2 2024/04/26 03:27:34 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:34 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:34 NOTICE: file3.txt: Skipped copy as --dry-run is set (size 0) 2024/04/26 03:27:34 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 0) 2024/04/26 03:27:34 NOTICE: file5.txt: Skipped copy as --dry-run is set (size 39) 2024/04/26 03:27:34 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13) 2024/04/26 03:27:34 INFO : Resync updating listings 2024/04/26 03:27:34 INFO : Bisync successful 2024/04/26 03:27:34 (29) : copy-listings dryrun-resync 2024/04/26 03:27:34 (30) : test sync with dry-run 2024/04/26 03:27:34 (31) : bisync dry-run 2024/04/26 03:27:34 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:34 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:34 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/" with Path2 "/tmp/032728we/dry_run/path2/" 2024/04/26 03:27:34 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:34 INFO : Path1 checking for diffs 2024/04/26 03:27:34 NOTICE: - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:34 NOTICE: - Path1 File was deleted - file4.txt 2024/04/26 03:27:34 NOTICE: - Path1 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:34 NOTICE: - Path1 File was deleted - file6.txt 2024/04/26 03:27:34 NOTICE: - Path1 File changed: size (larger), time (newer) - file7.txt 2024/04/26 03:27:34 NOTICE: - Path1 File is new - file11.txt 2024/04/26 03:27:34 INFO : Path1: 6 changes:  1 new,  3 modified,  2 deleted 2024/04/26 03:27:34 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:34 INFO : Path2 checking for diffs 2024/04/26 03:27:34 NOTICE: - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:34 NOTICE: - Path2 File was deleted - file3.txt 2024/04/26 03:27:34 NOTICE: - Path2 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:34 NOTICE: - Path2 File changed: size (larger), time (newer) - file6.txt 2024/04/26 03:27:34 NOTICE: - Path2 File was deleted - file7.txt 2024/04/26 03:27:34 NOTICE: - Path2 File is new - file10.txt 2024/04/26 03:27:34 INFO : Path2: 6 changes:  1 new,  3 modified,  2 deleted 2024/04/26 03:27:34 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:34 INFO : Applying changes 2024/04/26 03:27:34 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:34 INFO : Checking potential conflicts... 2024/04/26 03:27:34 NOTICE: Local file system at /tmp/032728we/dry_run/path2: 1 differences found 2024/04/26 03:27:34 NOTICE: Local file system at /tmp/032728we/dry_run/path2: 1 errors while checking 2024/04/26 03:27:34 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:34 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/dry_run/path2/file11.txt 2024/04/26 03:27:34 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/dry_run/path2/file2.txt 2024/04/26 03:27:34 NOTICE: - Path2 Queue delete - /tmp/032728we/dry_run/path2/file4.txt 2024/04/26 03:27:34 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:27:34 NOTICE: file5.txt: Skipped rename as --dry-run is set 2024/04/26 03:27:34 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/dry_run/path2/file5.txt.conflict1 2024/04/26 03:27:34 NOTICE: file5.txt: Skipped rename as --dry-run is set 2024/04/26 03:27:34 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file5.txt.conflict2 2024/04/26 03:27:34 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file6.txt 2024/04/26 03:27:34 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/dry_run/path2/file7.txt 2024/04/26 03:27:34 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file1.txt 2024/04/26 03:27:34 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file10.txt 2024/04/26 03:27:34 NOTICE: - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file3.txt 2024/04/26 03:27:34 NOTICE: - Path2 Do queued copies to - Path1 2024/04/26 03:27:34 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:34 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:34 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:34 NOTICE: file3.txt: Skipped delete as --dry-run is set (size 0) 2024/04/26 03:27:34 NOTICE: - Path1 Do queued copies to - Path2 2024/04/26 03:27:34 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:34 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:34 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13) 2024/04/26 03:27:34 NOTICE: file4.txt: Skipped delete as --dry-run is set (size 0) 2024/04/26 03:27:34 INFO : Updating listings 2024/04/26 03:27:34 INFO : Bisync successful 2024/04/26 03:27:34 (32) : copy-listings dryrun 2024/04/26 03:27:34 (33) : test sync without dry-run 2024/04/26 03:27:34 (34) : bisync 2024/04/26 03:27:34 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:34 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:34 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/" with Path2 "/tmp/032728we/dry_run/path2/" 2024/04/26 03:27:34 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:34 INFO : Path1 checking for diffs 2024/04/26 03:27:34 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:34 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:34 INFO : - Path1 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:34 INFO : - Path1 File was deleted - file6.txt 2024/04/26 03:27:34 INFO : - Path1 File changed: size (larger), time (newer) - file7.txt 2024/04/26 03:27:34 INFO : - Path1 File is new - file11.txt 2024/04/26 03:27:34 INFO : Path1: 6 changes:  1 new,  3 modified,  2 deleted 2024/04/26 03:27:34 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:34 INFO : Path2 checking for diffs 2024/04/26 03:27:34 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:34 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:34 INFO : - Path2 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:34 INFO : - Path2 File changed: size (larger), time (newer) - file6.txt 2024/04/26 03:27:34 INFO : - Path2 File was deleted - file7.txt 2024/04/26 03:27:34 INFO : - Path2 File is new - file10.txt 2024/04/26 03:27:34 INFO : Path2: 6 changes:  1 new,  3 modified,  2 deleted 2024/04/26 03:27:34 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:34 INFO : Applying changes 2024/04/26 03:27:34 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:34 INFO : Checking potential conflicts... 2024/04/26 03:27:34 NOTICE: Local file system at /tmp/032728we/dry_run/path2: 1 differences found 2024/04/26 03:27:34 NOTICE: Local file system at /tmp/032728we/dry_run/path2: 1 errors while checking 2024/04/26 03:27:34 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:34 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/dry_run/path2/file11.txt 2024/04/26 03:27:34 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/dry_run/path2/file2.txt 2024/04/26 03:27:34 INFO : - Path2 Queue delete - /tmp/032728we/dry_run/path2/file4.txt 2024/04/26 03:27:34 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:27:34 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file5.txt.conflict1 2024/04/26 03:27:34 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/04/26 03:27:34 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/dry_run/path2/file5.txt.conflict1 2024/04/26 03:27:34 NOTICE: - Path2 Renaming Path2 copy - /tmp/032728we/dry_run/path2/file5.txt.conflict2 2024/04/26 03:27:34 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/04/26 03:27:34 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file5.txt.conflict2 2024/04/26 03:27:34 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file6.txt 2024/04/26 03:27:34 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/dry_run/path2/file7.txt 2024/04/26 03:27:34 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file1.txt 2024/04/26 03:27:34 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file10.txt 2024/04/26 03:27:34 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/file3.txt 2024/04/26 03:27:34 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:34 INFO : file10.txt: Copied (new) 2024/04/26 03:27:34 INFO : file5.txt.conflict2: Copied (new) 2024/04/26 03:27:34 INFO : file6.txt: Copied (new) 2024/04/26 03:27:34 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:34 INFO : file3.txt: Deleted 2024/04/26 03:27:34 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:34 INFO : file11.txt: Copied (new) 2024/04/26 03:27:34 INFO : file7.txt: Copied (new) 2024/04/26 03:27:34 INFO : file5.txt.conflict1: Copied (new) 2024/04/26 03:27:34 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:34 INFO : file4.txt: Deleted 2024/04/26 03:27:34 INFO : Updating listings 2024/04/26 03:27:34 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/dry_run/path1/" vs Path2 "/tmp/032728we/dry_run/path2/" 2024/04/26 03:27:34 INFO : Bisync successful bisync_test.go:553: TEST dry_run PASSED === RUN TestBisyncRemoteLocal/equal 2024/04/26 03:27:34 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:34 DEBUG : path1: Making directory 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:34 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1" 2024/04/26 03:27:34 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:34 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:34 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:34 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:34 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:34 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:34 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1" 2024/04/26 03:27:34 DEBUG : Creating backend with remote "/tmp/032728we/equal/path2" 2024/04/26 03:27:34 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_equal/initial" 2024/04/26 03:27:34 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_equal-dixirun5" 2024/04/26 03:27:34 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : Local file system at /tmp/032728we/initdir/test_equal-dixirun5: Waiting for checks to finish 2024/04/26 03:27:34 DEBUG : Local file system at /tmp/032728we/initdir/test_equal-dixirun5: Waiting for transfers to finish 2024/04/26 03:27:34 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : file1.txt.cifaqog1.partial: renamed to: file1.txt 2024/04/26 03:27:34 INFO : file1.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:34 DEBUG : RCLONE_TEST.qorebet8.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:34 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:34 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : file2.txt.bayexaf6.partial: renamed to: file2.txt 2024/04/26 03:27:34 INFO : file2.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_equal/modfiles" 2024/04/26 03:27:34 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_equal-zemisay8" 2024/04/26 03:27:34 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : Local file system at /tmp/032728we/datadir/test_equal-zemisay8: Waiting for checks to finish 2024/04/26 03:27:34 DEBUG : Local file system at /tmp/032728we/datadir/test_equal-zemisay8: Waiting for transfers to finish 2024/04/26 03:27:34 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/04/26 03:27:34 DEBUG : file2.txt.gukejid0.partial: renamed to: file2.txt 2024/04/26 03:27:34 INFO : file2.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/04/26 03:27:34 DEBUG : file1L.txt.koquwew1.partial: renamed to: file1L.txt 2024/04/26 03:27:34 INFO : file1L.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK 2024/04/26 03:27:34 DEBUG : file1R.txt.zozanub4.partial: renamed to: file1R.txt 2024/04/26 03:27:34 INFO : file1R.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1] 2024/04/26 03:27:34 ERROR : : error listing: directory not found 2024/04/26 03:27:34 ERROR : : error listing: directory not found 2024/04/26 03:27:34 checking initFs Local file system at /tmp/032728we/initdir/test_equal-dixirun5 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1] 2024/04/26 03:27:34 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1/RCLONE_TEST] 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1/file1.txt] 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1/file2.txt] 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1: Waiting for checks to finish 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1: Waiting for transfers to finish 2024/04/26 03:27:34 INFO : file1.txt: Copied (new) 2024/04/26 03:27:34 INFO : file2.txt: Copied (new) 2024/04/26 03:27:34 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:34 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1] 2024/04/26 03:27:34 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : Local file system at /tmp/032728we/equal/path2: Waiting for checks to finish 2024/04/26 03:27:34 DEBUG : Local file system at /tmp/032728we/equal/path2: Waiting for transfers to finish 2024/04/26 03:27:34 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : file1.txt.xafalub3.partial: renamed to: file1.txt 2024/04/26 03:27:34 INFO : file1.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : file2.txt.qulimuv5.partial: renamed to: file2.txt 2024/04/26 03:27:34 INFO : file2.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:34 DEBUG : RCLONE_TEST.xadafap0.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:34 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:34 checking path2 Local file system at /tmp/032728we/equal/path2 2024/04/26 03:27:34 (01) : test equal 2024/04/26 03:27:34 (02) : test initial bisync 2024/04/26 03:27:34 (03) : bisync resync 2024/04/26 03:27:34 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:34 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:34 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1/" with Path2 "/tmp/032728we/equal/path2/" 2024/04/26 03:27:34 INFO : Copying Path2 files to Path1 2024/04/26 03:27:34 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:34 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:34 INFO : Resync updating listings 2024/04/26 03:27:34 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1/" vs Path2 "/tmp/032728we/equal/path2/" 2024/04/26 03:27:34 INFO : Bisync successful 2024/04/26 03:27:34 (04) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:34 (05) : touch-glob 2001-01-02 /tmp/032728we/datadir/test_equal-zemisay8/ file1R.txt 2024/04/26 03:27:34 (06) : copy-as /tmp/032728we/datadir/test_equal-zemisay8/file1R.txt /tmp/032728we/equal/path2/ file1.txt 2024/04/26 03:27:34 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:34 (07) : touch-glob 2001-03-04 /tmp/032728we/datadir/test_equal-zemisay8/ file1L.txt 2024/04/26 03:27:34 (08) : copy-as /tmp/032728we/datadir/test_equal-zemisay8/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1/ file1.txt 2024/04/26 03:27:34 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:34 (09) : test changed on both paths and identical - file2 2024/04/26 03:27:34 (10) : touch-glob 2001-01-02 /tmp/032728we/datadir/test_equal-zemisay8/ file2.txt 2024/04/26 03:27:34 (11) : copy-as /tmp/032728we/datadir/test_equal-zemisay8/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1/ file2.txt 2024/04/26 03:27:34 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:34 (12) : copy-as /tmp/032728we/datadir/test_equal-zemisay8/file2.txt /tmp/032728we/equal/path2/ file2.txt 2024/04/26 03:27:34 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:34 (13) : test bisync run 2024/04/26 03:27:34 (14) : bisync 2024/04/26 03:27:34 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:34 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:34 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1/" with Path2 "/tmp/032728we/equal/path2/" 2024/04/26 03:27:34 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:34 INFO : Path1 checking for diffs 2024/04/26 03:27:34 INFO : - Path1 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:34 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:34 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:27:34 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/04/26 03:27:34 INFO : Path2 checking for diffs 2024/04/26 03:27:34 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:34 INFO : - Path2 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:34 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:27:34 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/04/26 03:27:34 INFO : Applying changes 2024/04/26 03:27:34 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:34 INFO : Checking potential conflicts... 2024/04/26 03:27:34 NOTICE: Local file system at /tmp/032728we/equal/path2: 1 differences found 2024/04/26 03:27:34 NOTICE: Local file system at /tmp/032728we/equal/path2: 1 errors while checking 2024/04/26 03:27:34 NOTICE: Local file system at /tmp/032728we/equal/path2: 1 matching files 2024/04/26 03:27:34 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:34 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:34 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1/file1.txt.conflict1 2024/04/26 03:27:34 INFO : file1.txt: Moved (server-side) to: file1.txt.conflict1 2024/04/26 03:27:34 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/equal/path2/file1.txt.conflict1 2024/04/26 03:27:34 NOTICE: - Path2 Renaming Path2 copy - /tmp/032728we/equal/path2/file1.txt.conflict2 2024/04/26 03:27:34 INFO : file1.txt: Moved (server-side) to: file1.txt.conflict2 2024/04/26 03:27:34 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1/file1.txt.conflict2 2024/04/26 03:27:34 NOTICE: - WARNING New or changed in both paths - file2.txt 2024/04/26 03:27:34 INFO : Files are equal! Skipping: file2.txt 2024/04/26 03:27:34 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:34 INFO : file1.txt.conflict2: Copied (new) 2024/04/26 03:27:34 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:34 INFO : file1.txt.conflict1: Copied (new) 2024/04/26 03:27:34 INFO : Updating listings 2024/04/26 03:27:34 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:34 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:34 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/equal/path1/" vs Path2 "/tmp/032728we/equal/path2/" 2024/04/26 03:27:34 INFO : Bisync successful bisync_test.go:553: TEST equal PASSED === RUN TestBisyncRemoteLocal/ext_paths 2024/04/26 03:27:34 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:34 DEBUG : path1: Making directory 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:34 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1" 2024/04/26 03:27:34 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:34 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:34 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:34 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:34 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:34 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:34 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1" 2024/04/26 03:27:34 DEBUG : Creating backend with remote "/tmp/032728we/ext_paths/path2" 2024/04/26 03:27:34 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_ext_paths/initial" 2024/04/26 03:27:34 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_ext_paths-jivogav0" 2024/04/26 03:27:34 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ: Making directory with metadata 2024/04/26 03:27:34 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : file1.txt.gepujob4.partial: renamed to: file1.txt 2024/04/26 03:27:34 INFO : file1.txt: Copied (new) 2024/04/26 03:27:34 INFO : 測試РуÑÑкий ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z) 2024/04/26 03:27:34 DEBUG : Added delayed dir = "測試РуÑÑкий ěáñ", newDst=測試РуÑÑкий ěáñ 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : Local file system at /tmp/032728we/initdir/test_ext_paths-jivogav0: Waiting for checks to finish 2024/04/26 03:27:34 DEBUG : Local file system at /tmp/032728we/initdir/test_ext_paths-jivogav0: Waiting for transfers to finish 2024/04/26 03:27:34 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:34 DEBUG : RCLONE_TEST.yefaxom9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:34 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:34 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:34 DEBUG : file_enconde_mañana_funcionará.txt.riqegah1.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/04/26 03:27:34 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : filename_contains_Ä›_.txt.putorim4.partial: renamed to: filename_contains_Ä›_.txt 2024/04/26 03:27:34 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : РуÑÑкий.txt.liwadil3.partial: renamed to: РуÑÑкий.txt 2024/04/26 03:27:34 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:34 DEBUG : filename_contains_ࢺ_.txt.gusujel1.partial: renamed to: filename_contains_ࢺ_.txt 2024/04/26 03:27:34 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : 測試_check file.vamafab6.partial: renamed to: 測試_check file 2024/04/26 03:27:34 INFO : 測試_check file: Copied (new) 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ/測試_check file.wuqodah5.partial: renamed to: 測試РуÑÑкий ěáñ/測試_check file 2024/04/26 03:27:34 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt.bovetac3.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt.zumegim2.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt 2024/04/26 03:27:34 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:34 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:34 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:34 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_ext_paths/modfiles" 2024/04/26 03:27:34 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_ext_paths-cejipuz7" 2024/04/26 03:27:34 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : Local file system at /tmp/032728we/datadir/test_ext_paths-cejipuz7: Waiting for checks to finish 2024/04/26 03:27:34 DEBUG : Local file system at /tmp/032728we/datadir/test_ext_paths-cejipuz7: Waiting for transfers to finish 2024/04/26 03:27:34 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/04/26 03:27:34 DEBUG : 測試_filtersfile.txt.dizohof7.partial: renamed to: 測試_filtersfile.txt 2024/04/26 03:27:34 INFO : 測試_filtersfile.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:34 DEBUG : file1.txt.pevotey1.partial: renamed to: file1.txt 2024/04/26 03:27:34 INFO : file1.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1] 2024/04/26 03:27:34 ERROR : : error listing: directory not found 2024/04/26 03:27:34 ERROR : : error listing: directory not found 2024/04/26 03:27:34 checking initFs Local file system at /tmp/032728we/initdir/test_ext_paths-jivogav0 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1] 2024/04/26 03:27:34 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ: Making directory 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ] 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/RCLONE_TEST] 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/file1.txt] 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/file_enconde_mañana_funcionará.txt] 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/filename_contains_Ä›_.txt] 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: Waiting for checks to finish 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: Waiting for transfers to finish 2024/04/26 03:27:34 INFO : file1.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/filename_contains_ࢺ_.txt] 2024/04/26 03:27:34 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/РуÑÑкий.txt] 2024/04/26 03:27:34 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試_check file] 2024/04/26 03:27:34 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt] 2024/04/26 03:27:34 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/filename_contains_ࢺ_.txt: replication in progress) 2024/04/26 03:27:34 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/04/26 03:27:34 DEBUG : pacer: Reducing sleep to 30ms 2024/04/26 03:27:34 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt] 2024/04/26 03:27:34 DEBUG : pacer: Reducing sleep to 22.5ms 2024/04/26 03:27:34 INFO : 測試_check file: Copied (new) 2024/04/26 03:27:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ/測試_check file] 2024/04/26 03:27:35 DEBUG : pacer: Reducing sleep to 20ms 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:35 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/04/26 03:27:35 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1] 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ] 2024/04/26 03:27:35 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : 測試РуÑÑкий ěáñ: Making directory with metadata 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z) 2024/04/26 03:27:35 DEBUG : Added delayed dir = "測試РуÑÑкий ěáñ", newDst=測試РуÑÑкий ěáñ 2024/04/26 03:27:35 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : file1.txt.jirumoh3.partial: renamed to: file1.txt 2024/04/26 03:27:35 INFO : file1.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : file_enconde_mañana_funcionará.txt.yigopor5.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/04/26 03:27:35 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:35 DEBUG : РуÑÑкий.txt.lowexog2.partial: renamed to: РуÑÑкий.txt 2024/04/26 03:27:35 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : RCLONE_TEST.pofupad3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:35 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:35 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : Local file system at /tmp/032728we/ext_paths/path2: Waiting for checks to finish 2024/04/26 03:27:35 DEBUG : Local file system at /tmp/032728we/ext_paths/path2: Waiting for transfers to finish 2024/04/26 03:27:35 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:35 DEBUG : filename_contains_Ä›_.txt.nefawiy3.partial: renamed to: filename_contains_Ä›_.txt 2024/04/26 03:27:35 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : 測試_check file.bimewin8.partial: renamed to: 測試_check file 2024/04/26 03:27:35 INFO : 測試_check file: Copied (new) 2024/04/26 03:27:35 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:35 DEBUG : filename_contains_ࢺ_.txt.jazamuy2.partial: renamed to: filename_contains_ࢺ_.txt 2024/04/26 03:27:35 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : 測試РуÑÑкий ěáñ/測試_check file.jijurak9.partial: renamed to: 測試РуÑÑкий ěáñ/測試_check file 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/04/26 03:27:35 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:35 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt.memuyob3.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:35 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt.widicos0.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 checking path2 Local file system at /tmp/032728we/ext_paths/path2 2024/04/26 03:27:35 (01) : test extended-char-paths 2024/04/26 03:27:35 (02) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/ 2024/04/26 03:27:35 ERROR : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-poqugob4: Server side directory move failed: rename /rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий eÌŒaÌñ: file does not exist 2024/04/26 03:27:35 INFO : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ/: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2024/04/26 03:27:35 ERROR : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-poqugob4: error reading source root directory: directory not found 2024/04/26 03:27:35 (03) : fix-names /tmp/032728we/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/ 2024/04/26 03:27:35 ERROR : Local file system at /tmp/032728we/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-lenulap6: Server side directory move failed: rename /tmp/032728we/ext_paths/path2/測試РуÑÑкий eÌŒaÌñ /tmp/032728we/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-lenulap6: no such file or directory 2024/04/26 03:27:35 INFO : Local file system at /tmp/032728we/ext_paths/path2/測試РуÑÑкий ěáñ: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2024/04/26 03:27:35 ERROR : Local file system at /tmp/032728we/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-lenulap6: error reading source root directory: directory not found 2024/04/26 03:27:35 (04) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:27:35 (05) : fix-names /tmp/032728we/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:27:35 (06) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/filename_contains_Ä›_.txt 2024/04/26 03:27:35 (07) : fix-names /tmp/032728we/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/filename_contains_Ä›_.txt 2024/04/26 03:27:35 (08) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試_check{spc}file 2024/04/26 03:27:35 (09) : fix-names /tmp/032728we/ext_paths/path2/測試_check{spc}file 2024/04/26 03:27:35 (10) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:27:35 (11) : fix-names /tmp/032728we/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:27:35 (12) : test resync subdirs with extended chars 2024/04/26 03:27:35 (13) : bisync subdir=測試РуÑÑкий{spc}{spc}ěáñ resync 2024/04/26 03:27:35 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:35 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:35 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ/" with Path2 "/tmp/032728we/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/04/26 03:27:35 INFO : Copying Path2 files to Path1 2024/04/26 03:27:35 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:35 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:35 INFO : Resync updating listings 2024/04/26 03:27:35 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ/" vs Path2 "/tmp/032728we/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/04/26 03:27:35 INFO : Bisync successful 2024/04/26 03:27:35 (14) : copy-listings resync 2024/04/26 03:27:35 (15) : test place new files with extended chars on each side 2024/04/26 03:27:35 (16) : touch-glob 2001-01-02 /tmp/032728we/datadir/test_ext_paths-cejipuz7/ file1.txt 2024/04/26 03:27:35 (17) : copy-as /tmp/032728we/datadir/test_ext_paths-cejipuz7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ 測試_file1p1 2024/04/26 03:27:35 INFO : file1.txt: Copied (new) to: 測試_file1p1 2024/04/26 03:27:35 (18) : copy-as /tmp/032728we/datadir/test_ext_paths-cejipuz7/file1.txt /tmp/032728we/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ 測試_file1p2 2024/04/26 03:27:35 INFO : file1.txt: Copied (new) to: 測試_file1p2 2024/04/26 03:27:35 (19) : test normal sync of subdirs with extended chars 2024/04/26 03:27:35 (20) : bisync subdir=測試РуÑÑкий{spc}{spc}ěáñ 2024/04/26 03:27:35 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:35 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:35 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ/" with Path2 "/tmp/032728we/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/04/26 03:27:35 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:35 INFO : Path1 checking for diffs 2024/04/26 03:27:35 INFO : - Path1 File is new - 測試_file1p1 2024/04/26 03:27:35 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:35 INFO : Path2 checking for diffs 2024/04/26 03:27:35 INFO : - Path2 File is new - 測試_file1p2 2024/04/26 03:27:35 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:35 INFO : Applying changes 2024/04/26 03:27:35 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/ext_paths/path2/測試РуÑÑкий ěáñ/測試_file1p1 2024/04/26 03:27:35 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ/測試_file1p2 2024/04/26 03:27:35 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:35 INFO : 測試_file1p2: Copied (new) 2024/04/26 03:27:35 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:35 INFO : 測試_file1p1: Copied (new) 2024/04/26 03:27:35 INFO : Updating listings 2024/04/26 03:27:35 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий ěáñ/" vs Path2 "/tmp/032728we/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/04/26 03:27:35 INFO : Bisync successful 2024/04/26 03:27:35 (21) : move-listings normal-sync 2024/04/26 03:27:35 (22) : test check-filename with extended chars. check should fail. 2024/04/26 03:27:35 (23) : bisync resync 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:35 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:35 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/" with Path2 "/tmp/032728we/ext_paths/path2/" 2024/04/26 03:27:35 INFO : Copying Path2 files to Path1 2024/04/26 03:27:35 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:35 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 INFO : Resync updating listings 2024/04/26 03:27:35 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/" vs Path2 "/tmp/032728we/ext_paths/path2/" 2024/04/26 03:27:35 INFO : Bisync successful 2024/04/26 03:27:35 (24) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:27:35 INFO : 測試_check file: Deleted 2024/04/26 03:27:35 (25) : bisync check-access check-filename=測試_check{spc}file 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:35 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:35 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/" with Path2 "/tmp/032728we/ext_paths/path2/" 2024/04/26 03:27:35 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:35 INFO : Path1 checking for diffs 2024/04/26 03:27:35 INFO : - Path1 File was deleted - 測試РуÑÑкий ěáñ/測試_check file 2024/04/26 03:27:35 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:35 INFO : Path2 checking for diffs 2024/04/26 03:27:35 INFO : Checking access health 2024/04/26 03:27:35 ERROR : Access test failed: Path1 count 1, Path2 count 2 - 測試_check file 2024/04/26 03:27:35 ERROR : -  Access test failed: Path2 file not found in Path1 - 測試РуÑÑкий ěáñ/測試_check file 2024/04/26 03:27:35 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:35 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:35 Bisync error: bisync aborted 2024/04/26 03:27:35 (26) : copy-listings check-access-fail 2024/04/26 03:27:35 (27) : test check-filename with extended chars. check should pass. 2024/04/26 03:27:35 (28) : bisync resync 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:35 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:35 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/" with Path2 "/tmp/032728we/ext_paths/path2/" 2024/04/26 03:27:35 INFO : Copying Path2 files to Path1 2024/04/26 03:27:35 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/04/26 03:27:35 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 INFO : Resync updating listings 2024/04/26 03:27:35 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/" vs Path2 "/tmp/032728we/ext_paths/path2/" 2024/04/26 03:27:35 INFO : Bisync successful 2024/04/26 03:27:35 (29) : bisync check-access check-filename=測試_check{spc}file 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:35 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:35 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/" with Path2 "/tmp/032728we/ext_paths/path2/" 2024/04/26 03:27:35 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:35 INFO : Path1 checking for diffs 2024/04/26 03:27:35 INFO : Path2 checking for diffs 2024/04/26 03:27:35 INFO : Checking access health 2024/04/26 03:27:35 INFO : Found 2 matching "測試_check file" files on both paths 2024/04/26 03:27:35 INFO : No changes found 2024/04/26 03:27:35 INFO : Updating listings 2024/04/26 03:27:35 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/" vs Path2 "/tmp/032728we/ext_paths/path2/" 2024/04/26 03:27:35 INFO : Bisync successful 2024/04/26 03:27:35 (30) : move-listings check-access-pass 2024/04/26 03:27:35 (31) : test filters-file path with extended chars - masks /fileZ.txt 2024/04/26 03:27:35 (32) : copy-file /tmp/032728we/datadir/test_ext_paths-cejipuz7/測試_filtersfile.txt /tmp/032728we/workdir/ 2024/04/26 03:27:35 INFO : 測試_filtersfile.txt: Copied (new) 2024/04/26 03:27:35 (33) : bisync filters-file=/tmp/032728we/workdir/測試_filtersfile.txt resync 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:35 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:35 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/" with Path2 "/tmp/032728we/ext_paths/path2/" 2024/04/26 03:27:35 INFO : Using filters file /tmp/032728we/workdir/測試_filtersfile.txt 2024/04/26 03:27:35 INFO : Storing filters file hash to /tmp/032728we/workdir/測試_filtersfile.txt.md5 2024/04/26 03:27:35 INFO : Copying Path2 files to Path1 2024/04/26 03:27:35 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:35 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 INFO : Resync updating listings 2024/04/26 03:27:35 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/" vs Path2 "/tmp/032728we/ext_paths/path2/" 2024/04/26 03:27:35 INFO : Bisync successful 2024/04/26 03:27:35 (34) : copy-as /tmp/032728we/datadir/test_ext_paths-cejipuz7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/ fileZ.txt 2024/04/26 03:27:35 INFO : file1.txt: Copied (new) to: fileZ.txt 2024/04/26 03:27:35 (35) : bisync filters-file=/tmp/032728we/workdir/測試_filtersfile.txt 2024/04/26 03:27:35 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:35 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:35 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/" with Path2 "/tmp/032728we/ext_paths/path2/" 2024/04/26 03:27:35 INFO : Using filters file /tmp/032728we/workdir/測試_filtersfile.txt 2024/04/26 03:27:35 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:35 INFO : Path1 checking for diffs 2024/04/26 03:27:35 INFO : Path2 checking for diffs 2024/04/26 03:27:35 INFO : No changes found 2024/04/26 03:27:35 INFO : Updating listings 2024/04/26 03:27:35 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ext_paths/path1/" vs Path2 "/tmp/032728we/ext_paths/path2/" 2024/04/26 03:27:35 INFO : Bisync successful bisync_test.go:553: TEST ext_paths PASSED === RUN TestBisyncRemoteLocal/extended_filenames 2024/04/26 03:27:35 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:35 DEBUG : path1: Making directory 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:35 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1" 2024/04/26 03:27:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:35 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:35 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:35 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:35 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:35 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1" 2024/04/26 03:27:35 DEBUG : Creating backend with remote "/tmp/032728we/extended_filenames/path2" 2024/04/26 03:27:35 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_extended_filenames/initial" 2024/04/26 03:27:35 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_extended_filenames-zutecib4" 2024/04/26 03:27:35 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_: Making directory with metadata 2024/04/26 03:27:35 INFO : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:35 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_ 2024/04/26 03:27:35 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : file1 - Copy.txt.qerocen1.partial: renamed to: file1 - Copy.txt 2024/04/26 03:27:35 INFO : file1 - Copy.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : Local file system at /tmp/032728we/initdir/test_extended_filenames-zutecib4: Waiting for checks to finish 2024/04/26 03:27:35 DEBUG : Local file system at /tmp/032728we/initdir/test_extended_filenames-zutecib4: Waiting for transfers to finish 2024/04/26 03:27:35 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:35 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : file1 - Copy (2).txt.jonulef1.partial: renamed to: file1 - Copy (2).txt 2024/04/26 03:27:35 INFO : file1 - Copy (2).txt: Copied (new) 2024/04/26 03:27:35 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : RCLONE_TEST.pigamaf1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:35 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:35 DEBUG : file_enconde_mañana_funcionará.txt.becoyem8.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/04/26 03:27:35 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : РуÑÑкий.txt.yonuwac2.partial: renamed to: РуÑÑкий.txt 2024/04/26 03:27:35 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:35 DEBUG : filename_contains_Ä›_.txt.davurap2.partial: renamed to: filename_contains_Ä›_.txt 2024/04/26 03:27:35 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:35 DEBUG : filename_contains_ࢺ_.txt.gibocoh8.partial: renamed to: filename_contains_ࢺ_.txt 2024/04/26 03:27:35 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt.puyosim9.partial: renamed to: subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:27:35 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:35 DEBUG : file1.txt.wocamor2.partial: renamed to: file1.txt 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.yuwowuh4.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt 2024/04/26 03:27:35 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:35 INFO : file1.txt: Copied (new) 2024/04/26 03:27:35 INFO : subdir_with_ࢺ_: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_extended_filenames/modfiles" 2024/04/26 03:27:35 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_extended_filenames-yuhogos8" 2024/04/26 03:27:35 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : Local file system at /tmp/032728we/datadir/test_extended_filenames-yuhogos8: Waiting for checks to finish 2024/04/26 03:27:35 DEBUG : Local file system at /tmp/032728we/datadir/test_extended_filenames-yuhogos8: Waiting for transfers to finish 2024/04/26 03:27:35 DEBUG : file2.txt: md5 = 40b811fb5009223b6da573f169619d8e OK 2024/04/26 03:27:35 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:35 DEBUG : file2.txt.sitigad5.partial: renamed to: file2.txt 2024/04/26 03:27:35 INFO : file2.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : file1.txt.yozudod6.partial: renamed to: file1.txt 2024/04/26 03:27:35 INFO : file1.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1] 2024/04/26 03:27:35 ERROR : : error listing: directory not found 2024/04/26 03:27:35 ERROR : : error listing: directory not found 2024/04/26 03:27:35 checking initFs Local file system at /tmp/032728we/initdir/test_extended_filenames-zutecib4 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1] 2024/04/26 03:27:35 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/RCLONE_TEST] 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/file1 - Copy (2).txt] 2024/04/26 03:27:35 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_: Making directory 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/subdir_with_ࢺ_] 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/file1 - Copy.txt] 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/file1.txt] 2024/04/26 03:27:35 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: Waiting for checks to finish 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: Waiting for transfers to finish 2024/04/26 03:27:35 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/file_enconde_mañana_funcionará.txt] 2024/04/26 03:27:35 INFO : file1 - Copy (2).txt: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/filename_contains_Ä›_.txt] 2024/04/26 03:27:35 INFO : file1 - Copy.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/filename_contains_ࢺ_.txt] 2024/04/26 03:27:35 INFO : file1.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/РуÑÑкий.txt] 2024/04/26 03:27:35 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_Ä›_.txt] 2024/04/26 03:27:35 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ࢺ_.txt] 2024/04/26 03:27:35 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:35 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:27:35 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:35 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:35 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1] 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/subdir_with_ࢺ_] 2024/04/26 03:27:35 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_: Making directory with metadata 2024/04/26 03:27:35 INFO : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:35 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_ 2024/04/26 03:27:35 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : Local file system at /tmp/032728we/extended_filenames/path2: Waiting for checks to finish 2024/04/26 03:27:35 DEBUG : Local file system at /tmp/032728we/extended_filenames/path2: Waiting for transfers to finish 2024/04/26 03:27:35 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:35 DEBUG : RCLONE_TEST.yemufog2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:35 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:35 DEBUG : file1 - Copy (2).txt.muxavil1.partial: renamed to: file1 - Copy (2).txt 2024/04/26 03:27:35 INFO : file1 - Copy (2).txt: Copied (new) 2024/04/26 03:27:35 DEBUG : file1.txt.fehagup5.partial: renamed to: file1.txt 2024/04/26 03:27:35 INFO : file1.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : file_enconde_mañana_funcionará.txt.tujehub9.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/04/26 03:27:35 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : РуÑÑкий.txt.xekiqez1.partial: renamed to: РуÑÑкий.txt 2024/04/26 03:27:35 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:35 DEBUG : filename_contains_ࢺ_.txt.xepupal2.partial: renamed to: filename_contains_ࢺ_.txt 2024/04/26 03:27:35 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt.dusitos4.partial: renamed to: subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:27:35 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : filename_contains_Ä›_.txt.renitol3.partial: renamed to: filename_contains_Ä›_.txt 2024/04/26 03:27:35 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:35 DEBUG : file1 - Copy.txt.yonahaw1.partial: renamed to: file1 - Copy.txt 2024/04/26 03:27:35 INFO : file1 - Copy.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.qadonub4.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt 2024/04/26 03:27:35 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:35 INFO : subdir_with_ࢺ_: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 checking path2 Local file system at /tmp/032728we/extended_filenames/path2 2024/04/26 03:27:35 (01) : test extended-filenames 2024/04/26 03:27:35 (02) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/subdir_with_ࢺ_/ 2024/04/26 03:27:35 (03) : fix-names /tmp/032728we/extended_filenames/path2/subdir_with_ࢺ_/ 2024/04/26 03:27:35 (04) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:27:35 (05) : fix-names /tmp/032728we/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:27:35 (06) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/РуÑÑкий.txt 2024/04/26 03:27:35 (07) : fix-names /tmp/032728we/extended_filenames/path2/РуÑÑкий.txt 2024/04/26 03:27:35 (08) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1/file_enconde_mañana_funcionará.txt 2024/04/26 03:27:35 (09) : fix-names /tmp/032728we/extended_filenames/path2/file_enconde_mañana_funcionará.txt 2024/04/26 03:27:35 (10) : test initial bisync 2024/04/26 03:27:35 (11) : bisync resync 2024/04/26 03:27:35 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:27:35 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/04/26 03:27:35 NOTICE: Local file system at /tmp/032728we/extended_filenames/path2: Replacing invalid UTF-8 characters in "eÌŒ\x81\xfe aÌñhࢺ_測試РуÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬eÌö" 2024/04/26 03:27:35 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:27:35 NOTICE: Local file system at /tmp/032728we/extended_filenames/path2: Replacing invalid UTF-8 characters in "Ä›\x81\xfe áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö" 2024/04/26 03:27:35 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) bisync_test.go:1012: Fs is incapable of running test as the paths produce different results, skipping: extended_filenames (path1: РуÑÑкий.txtÄ›þ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶ (NFC) path2: file1 - Copy (2).txtfile1 - Copy (2).txt (file1 - Copy (2).txtfile1 - Copy (2).txt)) (fs1: hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/extended_filenames/path1 fs2: Local file system at /tmp/032728we/extended_filenames/path2) @@ -1 +1 @@ -РуÑÑкий.txtÄ›þ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶+file1 - Copy (2).txtfile1 - Copy (2).txt === RUN TestBisyncRemoteLocal/filters 2024/04/26 03:27:35 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:35 DEBUG : path1: Making directory 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:35 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1" 2024/04/26 03:27:35 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:35 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:35 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:35 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:35 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:35 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:35 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1" 2024/04/26 03:27:35 DEBUG : Creating backend with remote "/tmp/032728we/filters/path2" 2024/04/26 03:27:35 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filters/initial" 2024/04/26 03:27:35 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_filters-jaxefax0" 2024/04/26 03:27:35 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:35 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:35 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:35 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : Local file system at /tmp/032728we/initdir/test_filters-jaxefax0: Waiting for checks to finish 2024/04/26 03:27:35 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : Local file system at /tmp/032728we/initdir/test_filters-jaxefax0: Waiting for transfers to finish 2024/04/26 03:27:35 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : file1.txt.lixujoy9.partial: renamed to: file1.txt 2024/04/26 03:27:35 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : file2.txt.mepaqud0.partial: renamed to: file2.txt 2024/04/26 03:27:35 INFO : file2.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : file3.txt.qekiruw0.partial: renamed to: file3.txt 2024/04/26 03:27:35 INFO : file3.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:35 INFO : file1.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : RCLONE_TEST.jowuguh6.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:35 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:35 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : file5.txt.vakeqov0.partial: renamed to: file5.txt 2024/04/26 03:27:35 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 INFO : file5.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : file4.txt.boteceg6.partial: renamed to: file4.txt 2024/04/26 03:27:35 INFO : file4.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : file6.txt.tudanig0.partial: renamed to: file6.txt 2024/04/26 03:27:35 INFO : file6.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:35 DEBUG : file7.txt.solezim7.partial: renamed to: file7.txt 2024/04/26 03:27:35 INFO : file7.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : subdir/file20.txt.xuduzal1.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:35 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:35 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:35 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filters/modfiles" 2024/04/26 03:27:35 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_filters-kurigob5" 2024/04/26 03:27:35 DEBUG : fileZ.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : filtersfile.flt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : Local file system at /tmp/032728we/datadir/test_filters-kurigob5: Waiting for checks to finish 2024/04/26 03:27:35 DEBUG : Local file system at /tmp/032728we/datadir/test_filters-kurigob5: Waiting for transfers to finish 2024/04/26 03:27:35 DEBUG : fileZ.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:35 DEBUG : fileZ.txt.zigafej5.partial: renamed to: fileZ.txt 2024/04/26 03:27:35 INFO : fileZ.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : filtersfile.flt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/04/26 03:27:35 DEBUG : filtersfile.flt.texegof7.partial: renamed to: filtersfile.flt 2024/04/26 03:27:35 INFO : filtersfile.flt: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1] 2024/04/26 03:27:35 ERROR : : error listing: directory not found 2024/04/26 03:27:35 ERROR : : error listing: directory not found 2024/04/26 03:27:35 checking initFs Local file system at /tmp/032728we/initdir/test_filters-jaxefax0 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1] 2024/04/26 03:27:35 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : subdir: Making directory 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/subdir] 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/RCLONE_TEST] 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/file2.txt] 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/file1.txt] 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/file3.txt] 2024/04/26 03:27:35 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: Waiting for checks to finish 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: Waiting for transfers to finish 2024/04/26 03:27:35 INFO : file2.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/file4.txt] 2024/04/26 03:27:35 INFO : file1.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/file5.txt] 2024/04/26 03:27:35 INFO : file3.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/file6.txt] 2024/04/26 03:27:35 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/file7.txt] 2024/04/26 03:27:35 INFO : file4.txt: Copied (new) 2024/04/26 03:27:35 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/subdir/file20.txt] 2024/04/26 03:27:35 INFO : file5.txt: Copied (new) 2024/04/26 03:27:35 INFO : file6.txt: Copied (new) 2024/04/26 03:27:35 INFO : file7.txt: Copied (new) 2024/04/26 03:27:36 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:36 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/subdir] 2024/04/26 03:27:36 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:36 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:36 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:36 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/filters/path2: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/filters/path2: Waiting for transfers to finish 2024/04/26 03:27:36 DEBUG : file2.txt.dicokow0.partial: renamed to: file2.txt 2024/04/26 03:27:36 INFO : file2.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file4.txt.xidewup5.partial: renamed to: file4.txt 2024/04/26 03:27:36 INFO : file4.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file5.txt.dukubat7.partial: renamed to: file5.txt 2024/04/26 03:27:36 INFO : file5.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file6.txt.tamodad0.partial: renamed to: file6.txt 2024/04/26 03:27:36 INFO : file6.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file7.txt.hotuxun2.partial: renamed to: file7.txt 2024/04/26 03:27:36 INFO : file7.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file3.txt.jizazaj8.partial: renamed to: file3.txt 2024/04/26 03:27:36 INFO : file3.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.txt.sumukat1.partial: renamed to: file1.txt 2024/04/26 03:27:36 INFO : file1.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : subdir/file20.txt.bebunen0.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:36 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:36 DEBUG : RCLONE_TEST.wuwedey0.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:36 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 checking path2 Local file system at /tmp/032728we/filters/path2 2024/04/26 03:27:36 (01) : test filters 2024/04/26 03:27:36 (02) : copy-file /tmp/032728we/datadir/test_filters-kurigob5/filtersfile.flt /tmp/032728we/workdir/ 2024/04/26 03:27:36 INFO : filtersfile.flt: Copied (new) 2024/04/26 03:27:36 (03) : test resync to force building of the filters md5 hash 2024/04/26 03:27:36 (04) : bisync filters-file=/tmp/032728we/workdir/filtersfile.flt resync 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/" with Path2 "/tmp/032728we/filters/path2/" 2024/04/26 03:27:36 INFO : Using filters file /tmp/032728we/workdir/filtersfile.flt 2024/04/26 03:27:36 INFO : Storing filters file hash to /tmp/032728we/workdir/filtersfile.flt.md5 2024/04/26 03:27:36 INFO : Copying Path2 files to Path1 2024/04/26 03:27:36 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:36 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Resync updating listings 2024/04/26 03:27:36 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/" vs Path2 "/tmp/032728we/filters/path2/" 2024/04/26 03:27:36 INFO : Bisync successful 2024/04/26 03:27:36 (05) : copy-listings resync 2024/04/26 03:27:36 (06) : test place new files on the remote 2024/04/26 03:27:36 (07) : touch-glob 2001-01-02 /tmp/032728we/datadir/test_filters-kurigob5/ fileZ.txt 2024/04/26 03:27:36 (08) : copy-as /tmp/032728we/datadir/test_filters-kurigob5/fileZ.txt /tmp/032728we/filters/path2/ fileZ.txt 2024/04/26 03:27:36 INFO : fileZ.txt: Copied (new) 2024/04/26 03:27:36 (09) : copy-as /tmp/032728we/datadir/test_filters-kurigob5/fileZ.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/subdir fileZ.txt 2024/04/26 03:27:36 INFO : fileZ.txt: Copied (new) 2024/04/26 03:27:36 (10) : test bisync with filters-file. path2-side fileZ.txt will be filtered. 2024/04/26 03:27:36 (11) : bisync filters-file=/tmp/032728we/workdir/filtersfile.flt 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/" with Path2 "/tmp/032728we/filters/path2/" 2024/04/26 03:27:36 INFO : Using filters file /tmp/032728we/workdir/filtersfile.flt 2024/04/26 03:27:36 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:36 INFO : Path1 checking for diffs 2024/04/26 03:27:36 INFO : - Path1 File is new - subdir/fileZ.txt 2024/04/26 03:27:36 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:36 INFO : Path2 checking for diffs 2024/04/26 03:27:36 INFO : Applying changes 2024/04/26 03:27:36 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/filters/path2/subdir/fileZ.txt 2024/04/26 03:27:36 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : subdir/fileZ.txt: Copied (new) 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Updating listings 2024/04/26 03:27:36 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filters/path1/" vs Path2 "/tmp/032728we/filters/path2/" 2024/04/26 03:27:36 INFO : Bisync successful bisync_test.go:553: TEST filters PASSED === RUN TestBisyncRemoteLocal/filtersfile_checks 2024/04/26 03:27:36 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:36 DEBUG : path1: Making directory 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:36 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1" 2024/04/26 03:27:36 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:36 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:36 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1" 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/tmp/032728we/filtersfile_checks/path2" 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filtersfile_checks/initial" 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_filtersfile_checks-qemoqil5" 2024/04/26 03:27:36 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:36 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:36 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:36 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/initdir/test_filtersfile_checks-qemoqil5: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : subdir/file20.txt.kesedop3.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:36 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/initdir/test_filtersfile_checks-qemoqil5: Waiting for transfers to finish 2024/04/26 03:27:36 DEBUG : file1.txt.bogetoh7.partial: renamed to: file1.txt 2024/04/26 03:27:36 INFO : file1.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:36 DEBUG : file2.txt.tedewox0.partial: renamed to: file2.txt 2024/04/26 03:27:36 INFO : file2.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : RCLONE_TEST.lowufij2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:36 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filtersfile_checks/modfiles" 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_filtersfile_checks-hasoduq5" 2024/04/26 03:27:36 DEBUG : filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : filtersfile2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/datadir/test_filtersfile_checks-hasoduq5: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/datadir/test_filtersfile_checks-hasoduq5: Waiting for transfers to finish 2024/04/26 03:27:36 DEBUG : filtersfile.txt: md5 = cbf4389cb34d9e160689d1578eb5707f OK 2024/04/26 03:27:36 DEBUG : filtersfile2.txt: md5 = 95acc1e3b5beda465d9b2cb32808588c OK 2024/04/26 03:27:36 DEBUG : filtersfile.txt.mesuhib3.partial: renamed to: filtersfile.txt 2024/04/26 03:27:36 INFO : filtersfile.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : filtersfile2.txt.guburoq4.partial: renamed to: filtersfile2.txt 2024/04/26 03:27:36 INFO : filtersfile2.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:27:36 DEBUG : hold.txt.toboyam3.partial: renamed to: hold.txt 2024/04/26 03:27:36 INFO : hold.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1] 2024/04/26 03:27:36 ERROR : : error listing: directory not found 2024/04/26 03:27:36 ERROR : : error listing: directory not found 2024/04/26 03:27:36 checking initFs Local file system at /tmp/032728we/initdir/test_filtersfile_checks-qemoqil5 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1] 2024/04/26 03:27:36 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : subdir: Making directory 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/subdir] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/RCLONE_TEST] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/file2.txt] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/file1.txt] 2024/04/26 03:27:36 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1: Waiting for transfers to finish 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/subdir/file20.txt] 2024/04/26 03:27:36 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:36 INFO : file2.txt: Copied (new) 2024/04/26 03:27:36 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:36 INFO : file1.txt: Copied (new) 2024/04/26 03:27:36 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/subdir] 2024/04/26 03:27:36 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:36 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:36 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:36 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/filtersfile_checks/path2: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/filtersfile_checks/path2: Waiting for transfers to finish 2024/04/26 03:27:36 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : subdir/file20.txt.darahap7.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:36 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:36 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file2.txt.duraxac1.partial: renamed to: file2.txt 2024/04/26 03:27:36 INFO : file2.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.txt.humewul5.partial: renamed to: file1.txt 2024/04/26 03:27:36 INFO : file1.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : RCLONE_TEST.zahokoc1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:36 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 checking path2 Local file system at /tmp/032728we/filtersfile_checks/path2 2024/04/26 03:27:36 (01) : test filtersfile-checks 2024/04/26 03:27:36 (02) : test initial bisync 2024/04/26 03:27:36 (03) : bisync resync 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/" with Path2 "/tmp/032728we/filtersfile_checks/path2/" 2024/04/26 03:27:36 INFO : Copying Path2 files to Path1 2024/04/26 03:27:36 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:36 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Resync updating listings 2024/04/26 03:27:36 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/" vs Path2 "/tmp/032728we/filtersfile_checks/path2/" 2024/04/26 03:27:36 INFO : Bisync successful 2024/04/26 03:27:36 (04) : test 1. inject filters file in workdir. 2024/04/26 03:27:36 (05) : copy-file /tmp/032728we/datadir/test_filtersfile_checks-hasoduq5/filtersfile.txt /tmp/032728we/workdir/ 2024/04/26 03:27:36 INFO : filtersfile.txt: Copied (new) 2024/04/26 03:27:36 (06) : test 2. run with filters-file but without md5. should abort. 2024/04/26 03:27:36 (07) : bisync filters-file=/tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/" with Path2 "/tmp/032728we/filtersfile_checks/path2/" 2024/04/26 03:27:36 INFO : Using filters file /tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 ERROR : Bisync critical error: filters file md5 hash not found (must run --resync): /tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:36 Bisync error: bisync aborted 2024/04/26 03:27:36 (08) : test 3. run without filters-file. should be blocked due to prior abort. 2024/04/26 03:27:36 (09) : bisync 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/" with Path2 "/tmp/032728we/filtersfile_checks/path2/" 2024/04/26 03:27:36 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/032728we/workdir/TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_filtersfile_checks_path1..tmp_032728we_filtersfile_checks_path2.path1.lst Path2: /tmp/032728we/workdir/TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_filtersfile_checks_path1..tmp_032728we_filtersfile_checks_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/032728we/workdir" 2024/04/26 03:27:36 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:36 Bisync error: bisync aborted 2024/04/26 03:27:36 (10) : test 4. run with filters-file and resync. 2024/04/26 03:27:36 (11) : bisync filters-file=/tmp/032728we/workdir/filtersfile.txt resync 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/" with Path2 "/tmp/032728we/filtersfile_checks/path2/" 2024/04/26 03:27:36 INFO : Using filters file /tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 INFO : Storing filters file hash to /tmp/032728we/workdir/filtersfile.txt.md5 2024/04/26 03:27:36 INFO : Copying Path2 files to Path1 2024/04/26 03:27:36 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:36 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Resync updating listings 2024/04/26 03:27:36 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/" vs Path2 "/tmp/032728we/filtersfile_checks/path2/" 2024/04/26 03:27:36 INFO : Bisync successful 2024/04/26 03:27:36 (12) : test 5. run with filters-file alone. should run. 2024/04/26 03:27:36 (13) : bisync filters-file=/tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/" with Path2 "/tmp/032728we/filtersfile_checks/path2/" 2024/04/26 03:27:36 INFO : Using filters file /tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:36 INFO : Path1 checking for diffs 2024/04/26 03:27:36 INFO : Path2 checking for diffs 2024/04/26 03:27:36 INFO : No changes found 2024/04/26 03:27:36 INFO : Updating listings 2024/04/26 03:27:36 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/" vs Path2 "/tmp/032728we/filtersfile_checks/path2/" 2024/04/26 03:27:36 INFO : Bisync successful 2024/04/26 03:27:36 (14) : test 6. push changed filters-file to workdir. 2024/04/26 03:27:36 (15) : copy-as /tmp/032728we/datadir/test_filtersfile_checks-hasoduq5/filtersfile2.txt /tmp/032728we/workdir/ filtersfile.txt 2024/04/26 03:27:36 INFO : filtersfile2.txt: Copied (replaced existing) to: filtersfile.txt 2024/04/26 03:27:36 (16) : test 7. run with filters-file alone. should abort. 2024/04/26 03:27:36 (17) : bisync filters-file=/tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/" with Path2 "/tmp/032728we/filtersfile_checks/path2/" 2024/04/26 03:27:36 INFO : Using filters file /tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:36 Bisync error: bisync aborted 2024/04/26 03:27:36 (18) : test 8. run with filters-file and resync and dry-run. should do the dry-run but still cause next non-resync run to abort. 2024/04/26 03:27:36 (19) : bisync filters-file=/tmp/032728we/workdir/filtersfile.txt resync dry-run 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/" with Path2 "/tmp/032728we/filtersfile_checks/path2/" 2024/04/26 03:27:36 INFO : Using filters file /tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 INFO : Skipped storing filters file hash to /tmp/032728we/workdir/filtersfile.txt.md5 as --dry-run is set 2024/04/26 03:27:36 INFO : Copying Path2 files to Path1 2024/04/26 03:27:36 NOTICE: - Path2 Resync is copying files to - Path1 2024/04/26 03:27:36 NOTICE: - Path1 Resync is copying files to - Path2 2024/04/26 03:27:36 NOTICE: subdir: Skipped set directory modification time as --dry-run is set (size 4Ki) 2024/04/26 03:27:36 INFO : Resync updating listings 2024/04/26 03:27:36 INFO : Bisync successful 2024/04/26 03:27:36 (20) : test 9. run with filters-file alone. should abort. 2024/04/26 03:27:36 (21) : bisync filters-file=/tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/filtersfile_checks/path1/" with Path2 "/tmp/032728we/filtersfile_checks/path2/" 2024/04/26 03:27:36 INFO : Using filters file /tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/032728we/workdir/filtersfile.txt 2024/04/26 03:27:36 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:36 Bisync error: bisync aborted bisync_test.go:553: TEST filtersfile_checks PASSED === RUN TestBisyncRemoteLocal/ignorelistingchecksum 2024/04/26 03:27:36 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:36 DEBUG : path1: Making directory 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:36 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1" 2024/04/26 03:27:36 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:36 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:36 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1" 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/tmp/032728we/ignorelistingchecksum/path2" 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_ignorelistingchecksum/initial" 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_ignorelistingchecksum-xodudej8" 2024/04/26 03:27:36 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:36 INFO : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/04/26 03:27:36 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:36 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/initdir/test_ignorelistingchecksum-xodudej8: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/initdir/test_ignorelistingchecksum-xodudej8: Waiting for transfers to finish 2024/04/26 03:27:36 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.copy2.txt.vituqah1.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:36 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:36 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : RCLONE_TEST.weluvef9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:36 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:36 DEBUG : file1.copy3.txt.tuzebak6.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:36 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file1.copy4.txt.kovobus2.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:36 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.copy5.txt.joyijiv4.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:36 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : subdir/file20.txt.tuboniv8.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:36 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.copy1.txt.lutavic6.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:36 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file1.txt.lexaton7.partial: renamed to: file1.txt 2024/04/26 03:27:36 INFO : file1.txt: Copied (new) 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_ignorelistingchecksum/modfiles" 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_ignorelistingchecksum-wifanow8" 2024/04/26 03:27:36 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/datadir/test_ignorelistingchecksum-wifanow8: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/datadir/test_ignorelistingchecksum-wifanow8: Waiting for transfers to finish 2024/04/26 03:27:36 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:36 DEBUG : file1.txt.butozil6.partial: renamed to: file1.txt 2024/04/26 03:27:36 INFO : file1.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1] 2024/04/26 03:27:36 ERROR : : error listing: directory not found 2024/04/26 03:27:36 ERROR : : error listing: directory not found 2024/04/26 03:27:36 checking initFs Local file system at /tmp/032728we/initdir/test_ignorelistingchecksum-xodudej8 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1] 2024/04/26 03:27:36 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : subdir: Making directory 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/subdir] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/file1.copy1.txt] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/file1.copy2.txt] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/RCLONE_TEST] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/file1.copy3.txt] 2024/04/26 03:27:36 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: Waiting for transfers to finish 2024/04/26 03:27:36 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/file1.copy4.txt] 2024/04/26 03:27:36 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/file1.copy5.txt] 2024/04/26 03:27:36 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/file1.txt] 2024/04/26 03:27:36 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/subdir/file20.txt] 2024/04/26 03:27:36 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:36 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:36 INFO : file1.txt: Copied (new) 2024/04/26 03:27:36 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:36 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/subdir] 2024/04/26 03:27:36 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:36 INFO : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/04/26 03:27:36 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:36 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/ignorelistingchecksum/path2: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : file1.copy1.txt.puzajut1.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:36 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/ignorelistingchecksum/path2: Waiting for transfers to finish 2024/04/26 03:27:36 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.copy2.txt.civurod7.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:36 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.copy3.txt.yediwih5.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:36 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.copy4.txt.koritot0.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:36 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file1.copy5.txt.sobideq8.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:36 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : subdir/file20.txt.dokohaw3.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:36 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.txt.verewop4.partial: renamed to: file1.txt 2024/04/26 03:27:36 INFO : file1.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:36 DEBUG : RCLONE_TEST.jepiroy1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:36 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 checking path2 Local file system at /tmp/032728we/ignorelistingchecksum/path2 2024/04/26 03:27:36 (01) : test basic 2024/04/26 03:27:36 (02) : test initial bisync 2024/04/26 03:27:36 (03) : bisync resync 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/" with Path2 "/tmp/032728we/ignorelistingchecksum/path2/" 2024/04/26 03:27:36 INFO : Copying Path2 files to Path1 2024/04/26 03:27:36 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:36 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Resync updating listings 2024/04/26 03:27:36 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/" vs Path2 "/tmp/032728we/ignorelistingchecksum/path2/" 2024/04/26 03:27:36 INFO : Bisync successful 2024/04/26 03:27:36 (04) : bisync resync ignore-listing-checksum 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/" with Path2 "/tmp/032728we/ignorelistingchecksum/path2/" 2024/04/26 03:27:36 INFO : Copying Path2 files to Path1 2024/04/26 03:27:36 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:36 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Resync updating listings 2024/04/26 03:27:36 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/" vs Path2 "/tmp/032728we/ignorelistingchecksum/path2/" 2024/04/26 03:27:36 INFO : Bisync successful 2024/04/26 03:27:36 (05) : test place newer files on both paths 2024/04/26 03:27:36 (06) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_ignorelistingchecksum-wifanow8/file1.txt /tmp/032728we/ignorelistingchecksum/path2/ 2024/04/26 03:27:36 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:36 (07) : copy-as /tmp/032728we/datadir/test_ignorelistingchecksum-wifanow8/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/subdir file20.txt 2024/04/26 03:27:36 INFO : file1.txt: Copied (replaced existing) to: file20.txt 2024/04/26 03:27:36 (08) : test bisync run 2024/04/26 03:27:36 (09) : bisync ignore-listing-checksum 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/" with Path2 "/tmp/032728we/ignorelistingchecksum/path2/" 2024/04/26 03:27:36 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:36 INFO : Path1 checking for diffs 2024/04/26 03:27:36 INFO : - Path1 File changed: size (larger), time (newer) - subdir/file20.txt 2024/04/26 03:27:36 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:36 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:36 INFO : Path2 checking for diffs 2024/04/26 03:27:36 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:36 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:36 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:36 INFO : Applying changes 2024/04/26 03:27:36 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/ignorelistingchecksum/path2/subdir/file20.txt 2024/04/26 03:27:36 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/file1.txt 2024/04/26 03:27:36 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:36 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:36 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:36 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:36 INFO : Updating listings 2024/04/26 03:27:36 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/ignorelistingchecksum/path1/" vs Path2 "/tmp/032728we/ignorelistingchecksum/path2/" 2024/04/26 03:27:36 INFO : Bisync successful bisync_test.go:553: TEST ignorelistingchecksum PASSED === RUN TestBisyncRemoteLocal/max_delete_path1 2024/04/26 03:27:36 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:36 DEBUG : path1: Making directory 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:36 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1" 2024/04/26 03:27:36 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:36 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:36 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1" 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/tmp/032728we/max_delete_path1/path2" 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_max_delete_path1/initial" 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_max_delete_path1-hivufeq4" 2024/04/26 03:27:36 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/initdir/test_max_delete_path1-hivufeq4: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/initdir/test_max_delete_path1-hivufeq4: Waiting for transfers to finish 2024/04/26 03:27:36 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file3.txt.yuzumax2.partial: renamed to: file3.txt 2024/04/26 03:27:36 INFO : file3.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.txt.kidosob4.partial: renamed to: file1.txt 2024/04/26 03:27:36 INFO : file1.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file2.txt.nihedid2.partial: renamed to: file2.txt 2024/04/26 03:27:36 INFO : file2.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file5.txt.sadikoy0.partial: renamed to: file5.txt 2024/04/26 03:27:36 INFO : file5.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file6.txt.zidenop5.partial: renamed to: file6.txt 2024/04/26 03:27:36 INFO : file6.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file8.txt.tidacan4.partial: renamed to: file8.txt 2024/04/26 03:27:36 INFO : file8.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file7.txt.mohokox0.partial: renamed to: file7.txt 2024/04/26 03:27:36 INFO : file7.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file4.txt.befolaz3.partial: renamed to: file4.txt 2024/04/26 03:27:36 INFO : file4.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:36 DEBUG : file9.txt.wicowiq1.partial: renamed to: file9.txt 2024/04/26 03:27:36 INFO : file9.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_max_delete_path1/modfiles" 2024/04/26 03:27:36 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_max_delete_path1-lujudas2" 2024/04/26 03:27:36 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/datadir/test_max_delete_path1-lujudas2: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/datadir/test_max_delete_path1-lujudas2: Waiting for transfers to finish 2024/04/26 03:27:36 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:27:36 DEBUG : hold.txt.zecumic4.partial: renamed to: hold.txt 2024/04/26 03:27:36 INFO : hold.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1] 2024/04/26 03:27:36 ERROR : : error listing: directory not found 2024/04/26 03:27:36 ERROR : : error listing: directory not found 2024/04/26 03:27:36 checking initFs Local file system at /tmp/032728we/initdir/test_max_delete_path1-hivufeq4 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1] 2024/04/26 03:27:36 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file2.txt] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file1.txt] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file4.txt] 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: Waiting for transfers to finish 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file3.txt] 2024/04/26 03:27:36 INFO : file2.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file5.txt] 2024/04/26 03:27:36 INFO : file5.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file6.txt] 2024/04/26 03:27:36 INFO : file1.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file7.txt] 2024/04/26 03:27:36 INFO : file4.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file8.txt] 2024/04/26 03:27:36 INFO : file3.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file9.txt] 2024/04/26 03:27:36 INFO : file6.txt: Copied (new) 2024/04/26 03:27:36 INFO : file7.txt: Copied (new) 2024/04/26 03:27:36 INFO : file8.txt: Copied (new) 2024/04/26 03:27:36 INFO : file9.txt: Copied (new) 2024/04/26 03:27:36 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1 2024/04/26 03:27:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1] 2024/04/26 03:27:36 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:36 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file1.txt.dekabon4.partial: renamed to: file1.txt 2024/04/26 03:27:36 INFO : file1.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file3.txt.yuvubab5.partial: renamed to: file3.txt 2024/04/26 03:27:36 INFO : file3.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/max_delete_path1/path2: Waiting for checks to finish 2024/04/26 03:27:36 DEBUG : file2.txt.jutufin3.partial: renamed to: file2.txt 2024/04/26 03:27:36 DEBUG : Local file system at /tmp/032728we/max_delete_path1/path2: Waiting for transfers to finish 2024/04/26 03:27:36 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 INFO : file2.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file6.txt.xolerif6.partial: renamed to: file6.txt 2024/04/26 03:27:36 INFO : file6.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file5.txt.royuwoq9.partial: renamed to: file5.txt 2024/04/26 03:27:36 INFO : file5.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file4.txt.rerupac5.partial: renamed to: file4.txt 2024/04/26 03:27:36 INFO : file4.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:36 DEBUG : file8.txt.rijutoh2.partial: renamed to: file8.txt 2024/04/26 03:27:36 INFO : file8.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file7.txt.yuxeciq3.partial: renamed to: file7.txt 2024/04/26 03:27:36 INFO : file7.txt: Copied (new) 2024/04/26 03:27:36 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:36 DEBUG : file9.txt.gulelaf2.partial: renamed to: file9.txt 2024/04/26 03:27:36 INFO : file9.txt: Copied (new) 2024/04/26 03:27:36 checking path2 Local file system at /tmp/032728we/max_delete_path1/path2 2024/04/26 03:27:36 (01) : test max-delete-path1 2024/04/26 03:27:36 (02) : test initial bisync 2024/04/26 03:27:36 (03) : bisync resync 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/" with Path2 "/tmp/032728we/max_delete_path1/path2/" 2024/04/26 03:27:36 INFO : Copying Path2 files to Path1 2024/04/26 03:27:36 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:36 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:36 INFO : Resync updating listings 2024/04/26 03:27:36 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/" vs Path2 "/tmp/032728we/max_delete_path1/path2/" 2024/04/26 03:27:36 INFO : Bisync successful 2024/04/26 03:27:36 (04) : test delete >50% of local files 2024/04/26 03:27:36 (05) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file1.txt 2024/04/26 03:27:36 INFO : file1.txt: Deleted 2024/04/26 03:27:36 (06) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file2.txt 2024/04/26 03:27:36 INFO : file2.txt: Deleted 2024/04/26 03:27:36 (07) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file3.txt 2024/04/26 03:27:36 INFO : file3.txt: Deleted 2024/04/26 03:27:36 (08) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file4.txt 2024/04/26 03:27:36 INFO : file4.txt: Deleted 2024/04/26 03:27:36 (09) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/file5.txt 2024/04/26 03:27:36 INFO : file5.txt: Deleted 2024/04/26 03:27:36 (10) : test sync should fail due to too many local deletes 2024/04/26 03:27:36 (11) : bisync 2024/04/26 03:27:36 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:36 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:36 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/" with Path2 "/tmp/032728we/max_delete_path1/path2/" 2024/04/26 03:27:36 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:36 INFO : Path1 checking for diffs 2024/04/26 03:27:36 INFO : - Path1 File was deleted - file1.txt 2024/04/26 03:27:36 INFO : - Path1 File was deleted - file2.txt 2024/04/26 03:27:36 INFO : - Path1 File was deleted - file3.txt 2024/04/26 03:27:36 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:36 INFO : - Path1 File was deleted - file5.txt 2024/04/26 03:27:36 INFO : Path1: 5 changes:  0 new,  0 modified,  5 deleted 2024/04/26 03:27:36 INFO : Path2 checking for diffs 2024/04/26 03:27:36 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/". Run with --force if desired. 2024/04/26 03:27:36 NOTICE: Bisync aborted. Please try again. 2024/04/26 03:27:36 Bisync error: too many deletes 2024/04/26 03:27:36 (12) : copy-listings initial-fail 2024/04/26 03:27:36 (13) : test change max-delete limit to 60%. sync should run. 2024/04/26 03:27:36 (14) : bisync max-delete=60 2024/04/26 03:27:37 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:37 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:37 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/" with Path2 "/tmp/032728we/max_delete_path1/path2/" 2024/04/26 03:27:37 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:37 INFO : Path1 checking for diffs 2024/04/26 03:27:37 INFO : - Path1 File was deleted - file1.txt 2024/04/26 03:27:37 INFO : - Path1 File was deleted - file2.txt 2024/04/26 03:27:37 INFO : - Path1 File was deleted - file3.txt 2024/04/26 03:27:37 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:37 INFO : - Path1 File was deleted - file5.txt 2024/04/26 03:27:37 INFO : Path1: 5 changes:  0 new,  0 modified,  5 deleted 2024/04/26 03:27:37 INFO : Path2 checking for diffs 2024/04/26 03:27:37 INFO : Applying changes 2024/04/26 03:27:37 INFO : - Path2 Queue delete - /tmp/032728we/max_delete_path1/path2/file1.txt 2024/04/26 03:27:37 INFO : - Path2 Queue delete - /tmp/032728we/max_delete_path1/path2/file2.txt 2024/04/26 03:27:37 INFO : - Path2 Queue delete - /tmp/032728we/max_delete_path1/path2/file3.txt 2024/04/26 03:27:37 INFO : - Path2 Queue delete - /tmp/032728we/max_delete_path1/path2/file4.txt 2024/04/26 03:27:37 INFO : - Path2 Queue delete - /tmp/032728we/max_delete_path1/path2/file5.txt 2024/04/26 03:27:37 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:37 INFO : file1.txt: Deleted 2024/04/26 03:27:37 INFO : file2.txt: Deleted 2024/04/26 03:27:37 INFO : file3.txt: Deleted 2024/04/26 03:27:37 INFO : file4.txt: Deleted 2024/04/26 03:27:37 INFO : file5.txt: Deleted 2024/04/26 03:27:37 INFO : Updating listings 2024/04/26 03:27:37 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path1/path1/" vs Path2 "/tmp/032728we/max_delete_path1/path2/" 2024/04/26 03:27:37 INFO : Bisync successful bisync_test.go:553: TEST max_delete_path1 PASSED === RUN TestBisyncRemoteLocal/max_delete_path2_force 2024/04/26 03:27:37 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:37 DEBUG : path1: Making directory 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:37 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1" 2024/04/26 03:27:37 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:37 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:37 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:37 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:37 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:37 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:37 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1" 2024/04/26 03:27:37 DEBUG : Creating backend with remote "/tmp/032728we/max_delete_path2_force/path2" 2024/04/26 03:27:37 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_max_delete_path2_force/initial" 2024/04/26 03:27:37 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_max_delete_path2_force-hejevup7" 2024/04/26 03:27:37 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : Local file system at /tmp/032728we/initdir/test_max_delete_path2_force-hejevup7: Waiting for checks to finish 2024/04/26 03:27:37 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file1.txt.botivec2.partial: renamed to: file1.txt 2024/04/26 03:27:37 INFO : file1.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : Local file system at /tmp/032728we/initdir/test_max_delete_path2_force-hejevup7: Waiting for transfers to finish 2024/04/26 03:27:37 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file3.txt.saqajuv8.partial: renamed to: file3.txt 2024/04/26 03:27:37 INFO : file3.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file4.txt.luvezay6.partial: renamed to: file4.txt 2024/04/26 03:27:37 INFO : file4.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file5.txt.vasajit5.partial: renamed to: file5.txt 2024/04/26 03:27:37 INFO : file5.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file6.txt.liguyiz7.partial: renamed to: file6.txt 2024/04/26 03:27:37 INFO : file6.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file7.txt.xureqir0.partial: renamed to: file7.txt 2024/04/26 03:27:37 INFO : file7.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file2.txt.zereqix5.partial: renamed to: file2.txt 2024/04/26 03:27:37 INFO : file2.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file8.txt.perunob1.partial: renamed to: file8.txt 2024/04/26 03:27:37 INFO : file8.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:37 DEBUG : file9.txt.muxoloh7.partial: renamed to: file9.txt 2024/04/26 03:27:37 INFO : file9.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_max_delete_path2_force/modfiles" 2024/04/26 03:27:37 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_max_delete_path2_force-zufaliv1" 2024/04/26 03:27:37 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : Local file system at /tmp/032728we/datadir/test_max_delete_path2_force-zufaliv1: Waiting for checks to finish 2024/04/26 03:27:37 DEBUG : Local file system at /tmp/032728we/datadir/test_max_delete_path2_force-zufaliv1: Waiting for transfers to finish 2024/04/26 03:27:37 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:27:37 DEBUG : hold.txt.mulufut3.partial: renamed to: hold.txt 2024/04/26 03:27:37 INFO : hold.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1] 2024/04/26 03:27:37 ERROR : : error listing: directory not found 2024/04/26 03:27:37 ERROR : : error listing: directory not found 2024/04/26 03:27:37 checking initFs Local file system at /tmp/032728we/initdir/test_max_delete_path2_force-hejevup7 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1] 2024/04/26 03:27:37 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: Waiting for checks to finish 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file1.txt] 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: Waiting for transfers to finish 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file2.txt] 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file4.txt] 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file3.txt] 2024/04/26 03:27:37 INFO : file1.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file5.txt] 2024/04/26 03:27:37 INFO : file2.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file6.txt] 2024/04/26 03:27:37 INFO : file4.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file7.txt] 2024/04/26 03:27:37 INFO : file3.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file8.txt] 2024/04/26 03:27:37 INFO : file5.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file9.txt] 2024/04/26 03:27:37 INFO : file6.txt: Copied (new) 2024/04/26 03:27:37 INFO : file7.txt: Copied (new) 2024/04/26 03:27:37 INFO : file8.txt: Copied (new) 2024/04/26 03:27:37 INFO : file9.txt: Copied (new) 2024/04/26 03:27:37 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1] 2024/04/26 03:27:37 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : Local file system at /tmp/032728we/max_delete_path2_force/path2: Waiting for checks to finish 2024/04/26 03:27:37 DEBUG : Local file system at /tmp/032728we/max_delete_path2_force/path2: Waiting for transfers to finish 2024/04/26 03:27:37 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file3.txt.kadicib5.partial: renamed to: file3.txt 2024/04/26 03:27:37 INFO : file3.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file2.txt.kaqofel6.partial: renamed to: file2.txt 2024/04/26 03:27:37 INFO : file2.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file1.txt.riyewen9.partial: renamed to: file1.txt 2024/04/26 03:27:37 DEBUG : file5.txt.wawesat5.partial: renamed to: file5.txt 2024/04/26 03:27:37 INFO : file5.txt: Copied (new) 2024/04/26 03:27:37 INFO : file1.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file4.txt.dapukaf8.partial: renamed to: file4.txt 2024/04/26 03:27:37 INFO : file4.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file7.txt.cosogev8.partial: renamed to: file7.txt 2024/04/26 03:27:37 INFO : file7.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file6.txt.gehaxif1.partial: renamed to: file6.txt 2024/04/26 03:27:37 INFO : file6.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file8.txt.woqacuf4.partial: renamed to: file8.txt 2024/04/26 03:27:37 INFO : file8.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:37 DEBUG : file9.txt.voxajor2.partial: renamed to: file9.txt 2024/04/26 03:27:37 INFO : file9.txt: Copied (new) 2024/04/26 03:27:37 checking path2 Local file system at /tmp/032728we/max_delete_path2_force/path2 2024/04/26 03:27:37 (01) : test max-delete-path2-force 2024/04/26 03:27:37 (02) : test initial bisync 2024/04/26 03:27:37 (03) : bisync resync 2024/04/26 03:27:37 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:37 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:37 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/" with Path2 "/tmp/032728we/max_delete_path2_force/path2/" 2024/04/26 03:27:37 INFO : Copying Path2 files to Path1 2024/04/26 03:27:37 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:37 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:37 INFO : Resync updating listings 2024/04/26 03:27:37 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/" vs Path2 "/tmp/032728we/max_delete_path2_force/path2/" 2024/04/26 03:27:37 INFO : Bisync successful 2024/04/26 03:27:37 (04) : test delete >50% of remote files 2024/04/26 03:27:37 (05) : delete-file /tmp/032728we/max_delete_path2_force/path2/file1.txt 2024/04/26 03:27:37 INFO : file1.txt: Deleted 2024/04/26 03:27:37 (06) : delete-file /tmp/032728we/max_delete_path2_force/path2/file2.txt 2024/04/26 03:27:37 INFO : file2.txt: Deleted 2024/04/26 03:27:37 (07) : delete-file /tmp/032728we/max_delete_path2_force/path2/file3.txt 2024/04/26 03:27:37 INFO : file3.txt: Deleted 2024/04/26 03:27:37 (08) : delete-file /tmp/032728we/max_delete_path2_force/path2/file4.txt 2024/04/26 03:27:37 INFO : file4.txt: Deleted 2024/04/26 03:27:37 (09) : delete-file /tmp/032728we/max_delete_path2_force/path2/file5.txt 2024/04/26 03:27:37 INFO : file5.txt: Deleted 2024/04/26 03:27:37 (10) : test sync should fail due to too many path2 deletes 2024/04/26 03:27:37 (11) : bisync 2024/04/26 03:27:37 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:37 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:37 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/" with Path2 "/tmp/032728we/max_delete_path2_force/path2/" 2024/04/26 03:27:37 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:37 INFO : Path1 checking for diffs 2024/04/26 03:27:37 INFO : Path2 checking for diffs 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file1.txt 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file2.txt 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file4.txt 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file5.txt 2024/04/26 03:27:37 INFO : Path2: 5 changes:  0 new,  0 modified,  5 deleted 2024/04/26 03:27:37 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path2 "/tmp/032728we/max_delete_path2_force/path2/". Run with --force if desired. 2024/04/26 03:27:37 NOTICE: Bisync aborted. Please try again. 2024/04/26 03:27:37 Bisync error: too many deletes 2024/04/26 03:27:37 (12) : copy-listings initial-fail 2024/04/26 03:27:37 (13) : test apply force option. sync should run. 2024/04/26 03:27:37 (14) : bisync force 2024/04/26 03:27:37 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:37 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:37 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/" with Path2 "/tmp/032728we/max_delete_path2_force/path2/" 2024/04/26 03:27:37 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:37 INFO : Path1 checking for diffs 2024/04/26 03:27:37 INFO : Path2 checking for diffs 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file1.txt 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file2.txt 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file4.txt 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file5.txt 2024/04/26 03:27:37 INFO : Path2: 5 changes:  0 new,  0 modified,  5 deleted 2024/04/26 03:27:37 INFO : Applying changes 2024/04/26 03:27:37 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file1.txt 2024/04/26 03:27:37 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file2.txt 2024/04/26 03:27:37 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file3.txt 2024/04/26 03:27:37 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file4.txt 2024/04/26 03:27:37 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/file5.txt 2024/04/26 03:27:37 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:37 INFO : file1.txt: Deleted 2024/04/26 03:27:37 INFO : file5.txt: Deleted 2024/04/26 03:27:37 INFO : file2.txt: Deleted 2024/04/26 03:27:37 INFO : file4.txt: Deleted 2024/04/26 03:27:37 INFO : file3.txt: Deleted 2024/04/26 03:27:37 INFO : Updating listings 2024/04/26 03:27:37 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/max_delete_path2_force/path1/" vs Path2 "/tmp/032728we/max_delete_path2_force/path2/" 2024/04/26 03:27:37 INFO : Bisync successful bisync_test.go:553: TEST max_delete_path2_force PASSED === RUN TestBisyncRemoteLocal/nomodtime 2024/04/26 03:27:37 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:37 DEBUG : path1: Making directory 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:37 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1" 2024/04/26 03:27:37 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:37 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:37 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:37 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:37 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:37 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:37 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1" 2024/04/26 03:27:37 DEBUG : Creating backend with remote "/tmp/032728we/nomodtime/path2" 2024/04/26 03:27:37 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_nomodtime/initial" 2024/04/26 03:27:37 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_nomodtime-baxomuh9" 2024/04/26 03:27:37 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file1.txt.nijonad7.partial: renamed to: file1.txt 2024/04/26 03:27:37 INFO : file1.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : Local file system at /tmp/032728we/initdir/test_nomodtime-baxomuh9: Waiting for checks to finish 2024/04/26 03:27:37 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : Local file system at /tmp/032728we/initdir/test_nomodtime-baxomuh9: Waiting for transfers to finish 2024/04/26 03:27:37 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file3.txt.quyenaw2.partial: renamed to: file3.txt 2024/04/26 03:27:37 INFO : file3.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file2.txt.joseduv7.partial: renamed to: file2.txt 2024/04/26 03:27:37 INFO : file2.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file5.txt.bazifam2.partial: renamed to: file5.txt 2024/04/26 03:27:37 INFO : file5.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file6.txt.feyixin9.partial: renamed to: file6.txt 2024/04/26 03:27:37 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 INFO : file6.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file7.txt.hitifun4.partial: renamed to: file7.txt 2024/04/26 03:27:37 INFO : file7.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file8.txt.quxumuy1.partial: renamed to: file8.txt 2024/04/26 03:27:37 INFO : file8.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:37 DEBUG : RCLONE_TEST.guqitak5.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:37 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:37 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file4.txt.suzerup3.partial: renamed to: file4.txt 2024/04/26 03:27:37 INFO : file4.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_nomodtime/modfiles" 2024/04/26 03:27:37 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_nomodtime-fucuwul7" 2024/04/26 03:27:37 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:37 DEBUG : file11.txt.rapugur9.partial: renamed to: file11.txt 2024/04/26 03:27:37 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:37 INFO : file11.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file1.txt.xanajup8.partial: renamed to: file1.txt 2024/04/26 03:27:37 INFO : file1.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:37 DEBUG : file2.txt.vunijab2.partial: renamed to: file2.txt 2024/04/26 03:27:37 INFO : file2.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:37 DEBUG : file5L.txt.vevesix7.partial: renamed to: file5L.txt 2024/04/26 03:27:37 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : Local file system at /tmp/032728we/datadir/test_nomodtime-fucuwul7: Waiting for checks to finish 2024/04/26 03:27:37 DEBUG : Local file system at /tmp/032728we/datadir/test_nomodtime-fucuwul7: Waiting for transfers to finish 2024/04/26 03:27:37 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:37 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:37 DEBUG : file10.txt.jifisiy7.partial: renamed to: file10.txt 2024/04/26 03:27:37 INFO : file10.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file5R.txt.hufajih0.partial: renamed to: file5R.txt 2024/04/26 03:27:37 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:37 DEBUG : file6.txt.gikidet9.partial: renamed to: file6.txt 2024/04/26 03:27:37 INFO : file6.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:37 DEBUG : file7.txt.jideguh1.partial: renamed to: file7.txt 2024/04/26 03:27:37 INFO : file7.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1] 2024/04/26 03:27:37 ERROR : : error listing: directory not found 2024/04/26 03:27:37 ERROR : : error listing: directory not found 2024/04/26 03:27:37 checking initFs Local file system at /tmp/032728we/initdir/test_nomodtime-baxomuh9 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1] 2024/04/26 03:27:37 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file1.txt] 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/RCLONE_TEST] 2024/04/26 03:27:37 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file2.txt] 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file3.txt] 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: Waiting for checks to finish 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: Waiting for transfers to finish 2024/04/26 03:27:37 INFO : file1.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file4.txt] 2024/04/26 03:27:37 INFO : file2.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file5.txt] 2024/04/26 03:27:37 INFO : file3.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file6.txt] 2024/04/26 03:27:37 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file7.txt] 2024/04/26 03:27:37 INFO : file4.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file8.txt] 2024/04/26 03:27:37 INFO : file5.txt: Copied (new) 2024/04/26 03:27:37 INFO : file6.txt: Copied (new) 2024/04/26 03:27:37 INFO : file7.txt: Copied (new) 2024/04/26 03:27:37 INFO : file8.txt: Copied (new) 2024/04/26 03:27:37 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1 2024/04/26 03:27:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1] 2024/04/26 03:27:37 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file1.txt.ruvirux4.partial: renamed to: file1.txt 2024/04/26 03:27:37 INFO : file1.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:37 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : Local file system at /tmp/032728we/nomodtime/path2: Waiting for checks to finish 2024/04/26 03:27:37 DEBUG : file2.txt.kalesig7.partial: renamed to: file2.txt 2024/04/26 03:27:37 INFO : file2.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : Local file system at /tmp/032728we/nomodtime/path2: Waiting for transfers to finish 2024/04/26 03:27:37 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file4.txt.pivowor0.partial: renamed to: file4.txt 2024/04/26 03:27:37 INFO : file4.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file3.txt.bamikis0.partial: renamed to: file3.txt 2024/04/26 03:27:37 INFO : file3.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file6.txt.carelar2.partial: renamed to: file6.txt 2024/04/26 03:27:37 INFO : file6.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file5.txt.hoqezot1.partial: renamed to: file5.txt 2024/04/26 03:27:37 INFO : file5.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file7.txt.kurabuw0.partial: renamed to: file7.txt 2024/04/26 03:27:37 INFO : file7.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:37 DEBUG : file8.txt.gecojim5.partial: renamed to: file8.txt 2024/04/26 03:27:37 INFO : file8.txt: Copied (new) 2024/04/26 03:27:37 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:37 DEBUG : RCLONE_TEST.rusadeq9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:37 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:37 checking path2 Local file system at /tmp/032728we/nomodtime/path2 2024/04/26 03:27:37 (01) : test changes 2024/04/26 03:27:37 (02) : test initial bisync 2024/04/26 03:27:37 (03) : bisync resync nomodtime 2024/04/26 03:27:37 NOTICE: Local file system at /tmp/032728we/nomodtime/path2: will use md5 for same-side diffs on Path2 only 2024/04/26 03:27:37 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:37 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/" with Path2 "/tmp/032728we/nomodtime/path2/" 2024/04/26 03:27:37 INFO : Copying Path2 files to Path1 2024/04/26 03:27:37 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:37 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:37 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:37 INFO : Resync updating listings 2024/04/26 03:27:37 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/" vs Path2 "/tmp/032728we/nomodtime/path2/" 2024/04/26 03:27:37 INFO : Bisync successful 2024/04/26 03:27:37 (04) : test make modifications on both paths 2024/04/26 03:27:37 (05) : test new on path2 - file10 2024/04/26 03:27:37 (06) : copy-file /tmp/032728we/datadir/test_nomodtime-fucuwul7/file10.txt /tmp/032728we/nomodtime/path2/ 2024/04/26 03:27:37 INFO : file10.txt: Copied (new) 2024/04/26 03:27:37 (07) : test changed on path2 - file1 2024/04/26 03:27:37 (08) : copy-file /tmp/032728we/datadir/test_nomodtime-fucuwul7/file1.txt /tmp/032728we/nomodtime/path2/ 2024/04/26 03:27:37 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:37 (09) : test new on path1 - file11 2024/04/26 03:27:37 (10) : copy-file /tmp/032728we/datadir/test_nomodtime-fucuwul7/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/ 2024/04/26 03:27:37 INFO : file11.txt: Copied (new) 2024/04/26 03:27:37 (11) : test changed on path1 - file2 2024/04/26 03:27:37 (12) : copy-file /tmp/032728we/datadir/test_nomodtime-fucuwul7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/ 2024/04/26 03:27:37 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:37 (13) : test deleted on path2 - file3 2024/04/26 03:27:37 (14) : delete-file /tmp/032728we/nomodtime/path2/file3.txt 2024/04/26 03:27:37 INFO : file3.txt: Deleted 2024/04/26 03:27:37 (15) : test deleted on path1 - file4 2024/04/26 03:27:37 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file4.txt 2024/04/26 03:27:37 INFO : file4.txt: Deleted 2024/04/26 03:27:37 (17) : test deleted on both paths - file8 2024/04/26 03:27:37 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file8.txt 2024/04/26 03:27:37 INFO : file8.txt: Deleted 2024/04/26 03:27:37 (19) : delete-file /tmp/032728we/nomodtime/path2/file8.txt 2024/04/26 03:27:37 INFO : file8.txt: Deleted 2024/04/26 03:27:37 (20) : test changed on both paths - file5 (file5R, file5L) 2024/04/26 03:27:37 (21) : copy-as /tmp/032728we/datadir/test_nomodtime-fucuwul7/file5R.txt /tmp/032728we/nomodtime/path2/ file5.txt 2024/04/26 03:27:37 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:37 (22) : copy-as /tmp/032728we/datadir/test_nomodtime-fucuwul7/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/ file5.txt 2024/04/26 03:27:37 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:37 (23) : test changed on path2 and deleted on path1 - file6 2024/04/26 03:27:37 (24) : copy-file /tmp/032728we/datadir/test_nomodtime-fucuwul7/file6.txt /tmp/032728we/nomodtime/path2/ 2024/04/26 03:27:37 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:27:37 (25) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file6.txt 2024/04/26 03:27:37 INFO : file6.txt: Deleted 2024/04/26 03:27:37 (26) : test changed on path1 and deleted on path2 - file7 2024/04/26 03:27:37 (27) : copy-file /tmp/032728we/datadir/test_nomodtime-fucuwul7/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/ 2024/04/26 03:27:37 INFO : file7.txt: Copied (replaced existing) 2024/04/26 03:27:37 (28) : delete-file /tmp/032728we/nomodtime/path2/file7.txt 2024/04/26 03:27:37 INFO : file7.txt: Deleted 2024/04/26 03:27:37 (29) : test bisync run 2024/04/26 03:27:37 (30) : bisync nomodtime 2024/04/26 03:27:37 NOTICE: Local file system at /tmp/032728we/nomodtime/path2: will use md5 for same-side diffs on Path2 only 2024/04/26 03:27:37 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:37 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/" with Path2 "/tmp/032728we/nomodtime/path2/" 2024/04/26 03:27:37 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:37 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:37 INFO : Path1 checking for diffs 2024/04/26 03:27:37 INFO : - Path1 File changed: size (larger), hash - file2.txt 2024/04/26 03:27:37 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:37 INFO : - Path1 File changed: size (larger), hash - file5.txt 2024/04/26 03:27:37 INFO : - Path1 File was deleted - file6.txt 2024/04/26 03:27:37 INFO : - Path1 File changed: size (larger), hash - file7.txt 2024/04/26 03:27:37 INFO : - Path1 File was deleted - file8.txt 2024/04/26 03:27:37 INFO : - Path1 File is new - file11.txt 2024/04/26 03:27:37 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:37 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2024/04/26 03:27:37 INFO : Path2 checking for diffs 2024/04/26 03:27:37 INFO : - Path2 File changed: size (larger), hash - file1.txt 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:37 INFO : - Path2 File changed: size (larger), hash - file5.txt 2024/04/26 03:27:37 INFO : - Path2 File changed: size (larger), hash - file6.txt 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file7.txt 2024/04/26 03:27:37 INFO : - Path2 File was deleted - file8.txt 2024/04/26 03:27:37 INFO : - Path2 File is new - file10.txt 2024/04/26 03:27:37 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:37 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2024/04/26 03:27:37 INFO : Applying changes 2024/04/26 03:27:37 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/nomodtime/path2/file11.txt 2024/04/26 03:27:37 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/nomodtime/path2/file2.txt 2024/04/26 03:27:37 INFO : - Path2 Queue delete - /tmp/032728we/nomodtime/path2/file4.txt 2024/04/26 03:27:37 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:27:37 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file5.txt.conflict1 2024/04/26 03:27:37 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/04/26 03:27:37 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/nomodtime/path2/file5.txt.conflict1 2024/04/26 03:27:37 NOTICE: - Path2 Renaming Path2 copy - /tmp/032728we/nomodtime/path2/file5.txt.conflict2 2024/04/26 03:27:37 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/04/26 03:27:37 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file5.txt.conflict2 2024/04/26 03:27:37 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file6.txt 2024/04/26 03:27:37 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/nomodtime/path2/file7.txt 2024/04/26 03:27:37 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file1.txt 2024/04/26 03:27:37 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file10.txt 2024/04/26 03:27:37 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/file3.txt 2024/04/26 03:27:37 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:37 INFO : file10.txt: Copied (new) 2024/04/26 03:27:37 INFO : file6.txt: Copied (new) 2024/04/26 03:27:37 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:37 INFO : file5.txt.conflict2: Copied (new) 2024/04/26 03:27:37 INFO : file3.txt: Deleted 2024/04/26 03:27:37 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:37 INFO : file11.txt: Copied (new) 2024/04/26 03:27:37 INFO : file5.txt.conflict1: Copied (new) 2024/04/26 03:27:37 INFO : file7.txt: Copied (new) 2024/04/26 03:27:37 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:37 INFO : file4.txt: Deleted 2024/04/26 03:27:37 INFO : Updating listings 2024/04/26 03:27:37 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/nomodtime/path1/" vs Path2 "/tmp/032728we/nomodtime/path2/" 2024/04/26 03:27:37 INFO : Bisync successful bisync_test.go:553: TEST nomodtime PASSED === RUN TestBisyncRemoteLocal/normalization 2024/04/26 03:27:38 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:38 DEBUG : path1: Making directory 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:38 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1" 2024/04/26 03:27:38 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:38 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:38 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:38 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:38 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:38 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:38 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1" 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/tmp/032728we/normalization/path2" 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_normalization/initial" 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_normalization-raxayov9" 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory with metadata 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/04/26 03:27:38 DEBUG : Added delayed dir = "測試_РуÑÑкий_ _ _Ä›_áñ", newDst=測試_РуÑÑкий_ _ _Ä›_áñ 2024/04/26 03:27:38 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : file1.txt.reqilef6.partial: renamed to: file1.txt 2024/04/26 03:27:38 INFO : file1.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/initdir/test_normalization-raxayov9: Waiting for checks to finish 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/initdir/test_normalization-raxayov9: Waiting for transfers to finish 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:38 DEBUG : RCLONE_TEST.nokezoc0.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:38 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file.tamuvep1.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt.tejevec1.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt.logokiv5.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_normalization/modfiles" 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_normalization-bayoped9" 2024/04/26 03:27:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/datadir/test_normalization-bayoped9: Waiting for checks to finish 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/datadir/test_normalization-bayoped9: Waiting for transfers to finish 2024/04/26 03:27:38 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/04/26 03:27:38 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:38 DEBUG : 測試_filtersfile.txt.gizazuk5.partial: renamed to: 測試_filtersfile.txt 2024/04/26 03:27:38 INFO : 測試_filtersfile.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : file1.txt.gihibub2.partial: renamed to: file1.txt 2024/04/26 03:27:38 INFO : file1.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1] 2024/04/26 03:27:38 ERROR : : error listing: directory not found 2024/04/26 03:27:38 ERROR : : error listing: directory not found 2024/04/26 03:27:38 checking initFs Local file system at /tmp/032728we/initdir/test_normalization-raxayov9 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1] 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1/file1.txt] 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1/RCLONE_TEST] 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt] 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1: Waiting for checks to finish 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1: Waiting for transfers to finish 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt] 2024/04/26 03:27:38 INFO : file1.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file] 2024/04/26 03:27:38 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/04/26 03:27:38 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1] 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory with metadata 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/04/26 03:27:38 DEBUG : Added delayed dir = "測試_РуÑÑкий_ _ _Ä›_áñ", newDst=測試_РуÑÑкий_ _ _Ä›_áñ 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/normalization/path2: Waiting for checks to finish 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/normalization/path2: Waiting for transfers to finish 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:38 DEBUG : RCLONE_TEST.yasipox5.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:38 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt.woleset7.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file.guyaxeq8.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:38 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt.vakuhiq6.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : file1.txt.jadiquz5.partial: renamed to: file1.txt 2024/04/26 03:27:38 INFO : file1.txt: Copied (new) 2024/04/26 03:27:38 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 checking path2 Local file system at /tmp/032728we/normalization/path2 2024/04/26 03:27:38 (01) : test normalization 2024/04/26 03:27:38 (02) : touch-copy 2001-01-02 /tmp/032728we/datadir/test_normalization-bayoped9/file1.txt /tmp/032728we/normalization/path2/ 2024/04/26 03:27:38 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:38 (03) : test initial bisync 2024/04/26 03:27:38 (04) : bisync resync 2024/04/26 03:27:38 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:27:38 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/04/26 03:27:38 NOTICE: Local file system at /tmp/032728we/normalization/path2: Replacing invalid UTF-8 characters in "eÌŒ\x81\xfe aÌñhࢺ_測試РуÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬eÌö" 2024/04/26 03:27:38 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:27:38 NOTICE: Local file system at /tmp/032728we/normalization/path2: Replacing invalid UTF-8 characters in "Ä›\x81\xfe áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö" 2024/04/26 03:27:38 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) bisync_test.go:1012: Fs is incapable of running test as the paths produce different results, skipping: normalization (path1: 測試_РуÑÑкий_ _ _Ä›_áñěþ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶ (NFC) path2: 測試_РуÑÑкий_ _ _Ä›_áñ測試_РуÑÑкий_ _ _Ä›_áñ (測試_РуÑÑкий_ _ _Ä›_áñ測試_РуÑÑкий_ _ _Ä›_áñ)) (fs1: hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/normalization/path1 fs2: Local file system at /tmp/032728we/normalization/path2) @@ -1 +1 @@ -測試_РуÑÑкий_ _ _Ä›_áñěþ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶+測試_РуÑÑкий_ _ _Ä›_áñ測試_РуÑÑкий_ _ _Ä›_áñ === RUN TestBisyncRemoteLocal/rclone_args 2024/04/26 03:27:38 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:38 DEBUG : path1: Making directory 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:38 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1" 2024/04/26 03:27:38 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:38 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:38 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:38 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:38 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:38 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:38 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1" 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/tmp/032728we/rclone_args/path2" 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rclone_args/initial" 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_rclone_args-nevobac4" 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:38 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:38 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:38 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2024/04/26 03:27:38 DEBUG : file2.txt.vosimuz6.partial: renamed to: file2.txt 2024/04/26 03:27:38 INFO : file2.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : file1.txt.bocowip2.partial: renamed to: file1.txt 2024/04/26 03:27:38 INFO : file1.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:38 DEBUG : RCLONE_TEST.mitihuc5.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:38 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/initdir/test_rclone_args-nevobac4: Waiting for checks to finish 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/initdir/test_rclone_args-nevobac4: Waiting for transfers to finish 2024/04/26 03:27:38 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : subdir/file21.txt.balutey8.partial: renamed to: subdir/file21.txt 2024/04/26 03:27:38 INFO : subdir/file21.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : subdir/file20.txt.nejuwav5.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:38 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rclone_args/modfiles" 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_rclone_args-qoqaxig6" 2024/04/26 03:27:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file21.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/datadir/test_rclone_args-qoqaxig6: Waiting for checks to finish 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/datadir/test_rclone_args-qoqaxig6: Waiting for transfers to finish 2024/04/26 03:27:38 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : file21.txt.yunarak9.partial: renamed to: file21.txt 2024/04/26 03:27:38 INFO : file21.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : file20.txt.mecupod1.partial: renamed to: file20.txt 2024/04/26 03:27:38 INFO : file20.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:38 DEBUG : file1.txt.rarunic8.partial: renamed to: file1.txt 2024/04/26 03:27:38 INFO : file1.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:38 DEBUG : file2.txt.vecevez2.partial: renamed to: file2.txt 2024/04/26 03:27:38 INFO : file2.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1] 2024/04/26 03:27:38 ERROR : : error listing: directory not found 2024/04/26 03:27:38 ERROR : : error listing: directory not found 2024/04/26 03:27:38 checking initFs Local file system at /tmp/032728we/initdir/test_rclone_args-nevobac4 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1] 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : subdir: Making directory 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir] 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/RCLONE_TEST] 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/file1.txt] 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/file2.txt] 2024/04/26 03:27:38 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir/file20.txt] 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1: Waiting for checks to finish 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1: Waiting for transfers to finish 2024/04/26 03:27:38 INFO : file2.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir/file21.txt] 2024/04/26 03:27:38 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:38 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:38 INFO : file1.txt: Copied (new) 2024/04/26 03:27:38 INFO : subdir/file21.txt: Copied (new) 2024/04/26 03:27:38 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1] 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir] 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:38 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:38 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:38 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : file2.txt.horimiq4.partial: renamed to: file2.txt 2024/04/26 03:27:38 INFO : file2.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2024/04/26 03:27:38 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : subdir/file20.txt.rulezob4.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:38 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : file1.txt.hugubeq6.partial: renamed to: file1.txt 2024/04/26 03:27:38 INFO : file1.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : subdir/file21.txt.bawizuh0.partial: renamed to: subdir/file21.txt 2024/04/26 03:27:38 INFO : subdir/file21.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/rclone_args/path2: Waiting for checks to finish 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/rclone_args/path2: Waiting for transfers to finish 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:38 DEBUG : RCLONE_TEST.lekovif9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:38 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 checking path2 Local file system at /tmp/032728we/rclone_args/path2 2024/04/26 03:27:38 (01) : test rclone-args 2024/04/26 03:27:38 (02) : touch-glob 2001-01-02 /tmp/032728we/datadir/test_rclone_args-qoqaxig6/ * 2024/04/26 03:27:38 (03) : test initial bisync 2024/04/26 03:27:38 (04) : bisync resync checksum 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 NOTICE: Local file system at /tmp/032728we/rclone_args/path2: will use md5 for same-side diffs on Path2 only 2024/04/26 03:27:38 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:38 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" with Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Copying Path2 files to Path1 2024/04/26 03:27:38 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:38 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:38 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 INFO : Resync updating listings 2024/04/26 03:27:38 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" vs Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Bisync successful 2024/04/26 03:27:38 (05) : test place newer files on both paths 2024/04/26 03:27:38 (06) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/ 2024/04/26 03:27:38 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:38 (07) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file2.txt /tmp/032728we/rclone_args/path2/ 2024/04/26 03:27:38 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:38 (08) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir 2024/04/26 03:27:38 INFO : file20.txt: Copied (replaced existing) 2024/04/26 03:27:38 (09) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file21.txt /tmp/032728we/rclone_args/path2/subdir 2024/04/26 03:27:38 INFO : file21.txt: Updated modification time in destination 2024/04/26 03:27:38 (10) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/ file1.txt 2024/04/26 03:27:38 (11) : touch-glob 2001-01-02 /tmp/032728we/rclone_args/path2/ file2.txt 2024/04/26 03:27:38 (12) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir/ file20.txt 2024/04/26 03:27:38 (13) : touch-glob 2001-01-02 /tmp/032728we/rclone_args/path2/subdir/ file21.txt 2024/04/26 03:27:38 (14) : test run bisync with custom options 2024/04/26 03:27:38 (15) : bisync checksum 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 NOTICE: Local file system at /tmp/032728we/rclone_args/path2: will use md5 for same-side diffs on Path2 only 2024/04/26 03:27:38 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:38 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" with Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:38 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:38 INFO : Path1 checking for diffs 2024/04/26 03:27:38 INFO : - Path1 File changed: hash - file1.txt 2024/04/26 03:27:38 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:38 INFO : (Modified:  1 hash differs) 2024/04/26 03:27:38 INFO : Path2 checking for diffs 2024/04/26 03:27:38 INFO : - Path2 File changed: size (larger), hash - file2.txt 2024/04/26 03:27:38 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:38 INFO : (Modified:  1 larger,  0 smaller,  1 hash differs) 2024/04/26 03:27:38 INFO : Applying changes 2024/04/26 03:27:38 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/rclone_args/path2/file1.txt 2024/04/26 03:27:38 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/file2.txt 2024/04/26 03:27:38 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:38 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:38 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : Updating listings 2024/04/26 03:27:38 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" vs Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Bisync successful 2024/04/26 03:27:38 (16) : touch-glob 2007-07-23 /tmp/032728we/datadir/test_rclone_args-qoqaxig6/ * 2024/04/26 03:27:38 (17) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/ 2024/04/26 03:27:38 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:38 (18) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file2.txt /tmp/032728we/rclone_args/path2/ 2024/04/26 03:27:38 INFO : file2.txt: Updated modification time in destination 2024/04/26 03:27:38 (19) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir 2024/04/26 03:27:38 INFO : file20.txt: Copied (replaced existing) 2024/04/26 03:27:38 (20) : copy-as /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file21.txt /tmp/032728we/rclone_args/path2/ file1.txt 2024/04/26 03:27:38 INFO : file21.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:38 (21) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/ file1.txt 2024/04/26 03:27:38 (22) : touch-glob 2007-07-23 /tmp/032728we/rclone_args/path2/ file2.txt 2024/04/26 03:27:38 (23) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir/ file20.txt 2024/04/26 03:27:38 (24) : touch-glob 2007-07-23 /tmp/032728we/rclone_args/path2/subdir/ file21.txt 2024/04/26 03:27:38 (25) : bisync size-only 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:38 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:38 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" with Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:38 INFO : Path1 checking for diffs 2024/04/26 03:27:38 INFO : Path2 checking for diffs 2024/04/26 03:27:38 INFO : - Path2 File changed: size (smaller) - file1.txt 2024/04/26 03:27:38 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:38 INFO : (Modified:  0 larger,  1 smaller) 2024/04/26 03:27:38 INFO : Applying changes 2024/04/26 03:27:38 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/file1.txt 2024/04/26 03:27:38 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:38 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : Updating listings 2024/04/26 03:27:38 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" vs Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Bisync successful 2024/04/26 03:27:38 (26) : bisync resync 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:38 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:38 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" with Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Copying Path2 files to Path1 2024/04/26 03:27:38 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:38 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : subdir/file21.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 INFO : Resync updating listings 2024/04/26 03:27:38 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" vs Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Bisync successful 2024/04/26 03:27:38 (27) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/ 2024/04/26 03:27:38 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:38 (28) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file2.txt /tmp/032728we/rclone_args/path2/ 2024/04/26 03:27:38 INFO : file2.txt: Updated modification time in destination 2024/04/26 03:27:38 (29) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir 2024/04/26 03:27:38 (30) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file21.txt /tmp/032728we/rclone_args/path2/subdir 2024/04/26 03:27:38 INFO : file21.txt: Updated modification time in destination 2024/04/26 03:27:38 (31) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/ file1.txt 2024/04/26 03:27:38 (32) : touch-glob 2007-07-23 /tmp/032728we/rclone_args/path2/ file2.txt 2024/04/26 03:27:38 (33) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir/ file20.txt 2024/04/26 03:27:38 (34) : touch-glob 2007-07-23 /tmp/032728we/rclone_args/path2/subdir/ file21.txt 2024/04/26 03:27:38 (35) : bisync ignore-size 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:38 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": false, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:38 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" with Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:38 INFO : Path1 checking for diffs 2024/04/26 03:27:38 INFO : Path2 checking for diffs 2024/04/26 03:27:38 INFO : - Path2 File changed: time (newer) - file2.txt 2024/04/26 03:27:38 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2024/04/26 03:27:38 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:27:38 INFO : (Modified:  2 newer,  0 older) 2024/04/26 03:27:38 INFO : Applying changes 2024/04/26 03:27:38 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/file2.txt 2024/04/26 03:27:38 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir/file21.txt 2024/04/26 03:27:38 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:38 INFO : subdir/file21.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : Updating listings 2024/04/26 03:27:38 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" vs Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Bisync successful 2024/04/26 03:27:38 (36) : bisync resync compare-all 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 NOTICE: Local file system at /tmp/032728we/rclone_args/path2: will use md5 for same-side diffs on Path2 only 2024/04/26 03:27:38 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:38 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" with Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Copying Path2 files to Path1 2024/04/26 03:27:38 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:38 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:38 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : Resync updating listings 2024/04/26 03:27:38 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" vs Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Bisync successful 2024/04/26 03:27:38 (37) : copy-as /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file21.txt /tmp/032728we/rclone_args/path2/ file2.txt 2024/04/26 03:27:38 INFO : file21.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:38 (38) : touch-glob 2023-08-26 /tmp/032728we/datadir/test_rclone_args-qoqaxig6/ * 2024/04/26 03:27:38 (39) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/ 2024/04/26 03:27:38 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:38 (40) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir 2024/04/26 03:27:38 INFO : file20.txt: Copied (replaced existing) 2024/04/26 03:27:38 (41) : copy-file /tmp/032728we/datadir/test_rclone_args-qoqaxig6/file21.txt /tmp/032728we/rclone_args/path2/subdir 2024/04/26 03:27:38 INFO : file21.txt: Updated modification time in destination 2024/04/26 03:27:38 (42) : touch-glob 2007-07-23 /tmp/032728we/rclone_args/path2/ file2.txt 2024/04/26 03:27:38 (43) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/ file1.txt 2024/04/26 03:27:38 (44) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir/ file20.txt 2024/04/26 03:27:38 (45) : touch-glob 2023-08-26 /tmp/032728we/rclone_args/path2/subdir/ file21.txt 2024/04/26 03:27:38 (46) : bisync compare-all 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 NOTICE: Local file system at /tmp/032728we/rclone_args/path2: will use md5 for same-side diffs on Path2 only 2024/04/26 03:27:38 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:38 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" with Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:38 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:38 INFO : Path1 checking for diffs 2024/04/26 03:27:38 INFO : - Path1 File changed: time (newer) - file1.txt 2024/04/26 03:27:38 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2024/04/26 03:27:38 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:27:38 INFO : (Modified:  2 newer,  0 older) 2024/04/26 03:27:38 INFO : Path2 checking for diffs 2024/04/26 03:27:38 INFO : - Path2 File changed: size (smaller), hash - file2.txt 2024/04/26 03:27:38 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2024/04/26 03:27:38 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:27:38 INFO : (Modified:  1 newer,  0 older,  0 larger,  1 smaller,  1 hash differs) 2024/04/26 03:27:38 INFO : Applying changes 2024/04/26 03:27:38 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/rclone_args/path2/file1.txt 2024/04/26 03:27:38 INFO : - Path1 Queue copy to Path2 - /tmp/032728we/rclone_args/path2/subdir/file20.txt 2024/04/26 03:27:38 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/file2.txt 2024/04/26 03:27:38 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/subdir/file21.txt 2024/04/26 03:27:38 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:38 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : subdir/file21.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:38 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:38 INFO : Updating listings 2024/04/26 03:27:38 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rclone_args/path1/" vs Path2 "/tmp/032728we/rclone_args/path2/" 2024/04/26 03:27:38 INFO : Bisync successful bisync_test.go:553: TEST rclone_args PASSED === RUN TestBisyncRemoteLocal/resolve 2024/04/26 03:27:38 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:38 DEBUG : path1: Making directory 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:38 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1" 2024/04/26 03:27:38 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:38 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:38 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:38 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:38 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:38 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:38 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1" 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/tmp/032728we/resolve/path2" 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resolve/initial" 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_resolve-gudexub7" 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/initdir/test_resolve-gudexub7: Waiting for checks to finish 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/initdir/test_resolve-gudexub7: Waiting for transfers to finish 2024/04/26 03:27:38 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : file1.txt.puyokeb0.partial: renamed to: file1.txt 2024/04/26 03:27:38 INFO : file1.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : file2.txt.fapuhoc2.partial: renamed to: file2.txt 2024/04/26 03:27:38 INFO : file2.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:38 DEBUG : RCLONE_TEST.xumonay8.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:38 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resolve/modfiles" 2024/04/26 03:27:38 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_resolve-manebif2" 2024/04/26 03:27:38 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/datadir/test_resolve-manebif2: Waiting for checks to finish 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/datadir/test_resolve-manebif2: Waiting for transfers to finish 2024/04/26 03:27:38 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK 2024/04/26 03:27:38 DEBUG : file1R.txt.rimulay6.partial: renamed to: file1R.txt 2024/04/26 03:27:38 INFO : file1R.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/04/26 03:27:38 DEBUG : file1L.txt.yazepis0.partial: renamed to: file1L.txt 2024/04/26 03:27:38 INFO : file1L.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/04/26 03:27:38 DEBUG : file2.txt.bezisuq1.partial: renamed to: file2.txt 2024/04/26 03:27:38 INFO : file2.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1] 2024/04/26 03:27:38 ERROR : : error listing: directory not found 2024/04/26 03:27:38 ERROR : : error listing: directory not found 2024/04/26 03:27:38 checking initFs Local file system at /tmp/032728we/initdir/test_resolve-gudexub7 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1] 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1: Waiting for checks to finish 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/RCLONE_TEST] 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/file1.txt] 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1: Waiting for transfers to finish 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/file2.txt] 2024/04/26 03:27:38 INFO : file2.txt: Copied (new) 2024/04/26 03:27:38 INFO : file1.txt: Copied (new) 2024/04/26 03:27:38 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:38 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1 2024/04/26 03:27:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1] 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:38 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : file2.txt.vikakuy7.partial: renamed to: file2.txt 2024/04/26 03:27:38 INFO : file2.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/resolve/path2: Waiting for checks to finish 2024/04/26 03:27:38 DEBUG : Local file system at /tmp/032728we/resolve/path2: Waiting for transfers to finish 2024/04/26 03:27:38 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:38 DEBUG : file1.txt.musayab5.partial: renamed to: file1.txt 2024/04/26 03:27:38 INFO : file1.txt: Copied (new) 2024/04/26 03:27:38 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:38 DEBUG : RCLONE_TEST.koqedas5.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:38 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:38 checking path2 Local file system at /tmp/032728we/resolve/path2 2024/04/26 03:27:38 (01) : test resolve 2024/04/26 03:27:38 (02) : test initial bisync 2024/04/26 03:27:38 (03) : bisync resync 2024/04/26 03:27:39 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" with Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Copying Path2 files to Path1 2024/04/26 03:27:39 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:39 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:39 INFO : Resync updating listings 2024/04/26 03:27:39 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" vs Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Bisync successful 2024/04/26 03:27:39 (04) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:39 (05) : touch-glob 2001-01-02 /tmp/032728we/datadir/test_resolve-manebif2/ file1R.txt 2024/04/26 03:27:39 (06) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1R.txt /tmp/032728we/resolve/path2/ file1.txt 2024/04/26 03:27:39 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:39 (07) : touch-glob 2001-03-04 /tmp/032728we/datadir/test_resolve-manebif2/ file1L.txt 2024/04/26 03:27:39 (08) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/ file1.txt 2024/04/26 03:27:39 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:39 (09) : test bisync run with --conflict-resolve=newer --conflict-loser=delete --conflict-suffix=potato 2024/04/26 03:27:39 (10) : bisync conflict-resolve=newer conflict-loser=delete conflict-suffix=potato 2024/04/26 03:27:39 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" with Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:39 INFO : Path1 checking for diffs 2024/04/26 03:27:39 INFO : - Path1 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:39 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:39 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:39 INFO : Path2 checking for diffs 2024/04/26 03:27:39 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:39 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:39 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:39 INFO : Applying changes 2024/04/26 03:27:39 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:39 INFO : Checking potential conflicts... 2024/04/26 03:27:39 NOTICE: Local file system at /tmp/032728we/resolve/path2: 1 differences found 2024/04/26 03:27:39 NOTICE: Local file system at /tmp/032728we/resolve/path2: 1 errors while checking 2024/04/26 03:27:39 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:39 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:39 INFO : file1.txt: Path1 is newer. Path1: 2001-03-04 00:00:00 +0000 UTC, Path2: 2001-01-02 00:00:00 +0000 UTC, Difference: 1464h0m0s 2024/04/26 03:27:39 INFO : file1.txt: The winner is: Path1 2024/04/26 03:27:39 NOTICE: - Path2 Deleting Path2 copy - /tmp/032728we/resolve/path2/file1.txt 2024/04/26 03:27:39 INFO : file1.txt: Deleted 2024/04/26 03:27:39 INFO : - Path1 Queue copy to Path2 - file1.txt 2024/04/26 03:27:39 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:39 INFO : file1.txt: Copied (new) 2024/04/26 03:27:39 INFO : Updating listings 2024/04/26 03:27:39 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" vs Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Bisync successful 2024/04/26 03:27:39 (11) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:39 (12) : touch-glob 2001-07-23 /tmp/032728we/datadir/test_resolve-manebif2/ file1R.txt 2024/04/26 03:27:39 (13) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1R.txt /tmp/032728we/resolve/path2/ file1.txt 2024/04/26 03:27:39 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:39 (14) : touch-glob 2001-08-26 /tmp/032728we/datadir/test_resolve-manebif2/ file1L.txt 2024/04/26 03:27:39 (15) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/ file1.txt 2024/04/26 03:27:39 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:39 (16) : test bisync run with --conflict-resolve=path2 --conflict-loser=num --conflict-suffix=dinosaur 2024/04/26 03:27:39 (17) : bisync conflict-resolve=path2 conflict-loser=num conflict-suffix=dinosaur 2024/04/26 03:27:39 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" with Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:39 INFO : Path1 checking for diffs 2024/04/26 03:27:39 INFO : - Path1 File changed: time (newer) - file1.txt 2024/04/26 03:27:39 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:39 INFO : (Modified:  1 newer,  0 older) 2024/04/26 03:27:39 INFO : Path2 checking for diffs 2024/04/26 03:27:39 INFO : - Path2 File changed: time (newer) - file1.txt 2024/04/26 03:27:39 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:39 INFO : (Modified:  1 newer,  0 older) 2024/04/26 03:27:39 INFO : Applying changes 2024/04/26 03:27:39 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:39 INFO : Checking potential conflicts... 2024/04/26 03:27:39 NOTICE: Local file system at /tmp/032728we/resolve/path2: 1 differences found 2024/04/26 03:27:39 NOTICE: Local file system at /tmp/032728we/resolve/path2: 1 errors while checking 2024/04/26 03:27:39 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:39 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:39 INFO : file1.txt: The winner is: Path2 2024/04/26 03:27:39 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/file1.txt.dinosaur1 2024/04/26 03:27:39 INFO : file1.txt: Moved (server-side) to: file1.txt.dinosaur1 2024/04/26 03:27:39 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/resolve/path2/file1.txt.dinosaur1 2024/04/26 03:27:39 NOTICE: - Path2 Not renaming Path2 copy, as it was determined the winner - /tmp/032728we/resolve/path2/file1.txt 2024/04/26 03:27:39 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/file1.txt 2024/04/26 03:27:39 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:39 INFO : file1.txt: Copied (new) 2024/04/26 03:27:39 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:39 INFO : file1.txt.dinosaur1: Copied (new) 2024/04/26 03:27:39 INFO : Updating listings 2024/04/26 03:27:39 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" vs Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Bisync successful 2024/04/26 03:27:39 (18) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:39 (19) : touch-glob 2002-07-23 /tmp/032728we/datadir/test_resolve-manebif2/ file1R.txt 2024/04/26 03:27:39 (20) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1R.txt /tmp/032728we/resolve/path2/ file1.txt 2024/04/26 03:27:39 INFO : file1R.txt: Updated modification time in destination 2024/04/26 03:27:39 (21) : touch-glob 2002-08-26 /tmp/032728we/datadir/test_resolve-manebif2/ file1L.txt 2024/04/26 03:27:39 (22) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/ file1.txt 2024/04/26 03:27:39 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:39 (23) : test bisync run with --conflict-resolve=larger --conflict-loser=num --conflict-suffix=apple 2024/04/26 03:27:39 (24) : bisync conflict-resolve=larger conflict-loser=num conflict-suffix=apple 2024/04/26 03:27:39 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" with Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:39 INFO : Path1 checking for diffs 2024/04/26 03:27:39 INFO : - Path1 File is new - file1.txt 2024/04/26 03:27:39 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:39 INFO : Path2 checking for diffs 2024/04/26 03:27:39 INFO : - Path2 File is new - file1.txt 2024/04/26 03:27:39 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:39 INFO : Applying changes 2024/04/26 03:27:39 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:39 INFO : Checking potential conflicts... 2024/04/26 03:27:39 NOTICE: Local file system at /tmp/032728we/resolve/path2: 1 differences found 2024/04/26 03:27:39 NOTICE: Local file system at /tmp/032728we/resolve/path2: 1 errors while checking 2024/04/26 03:27:39 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:39 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:39 INFO : file1.txt: Winner cannot be determined as sizes are equal. Path1: 33, Path2: 33, Difference: 0 2024/04/26 03:27:39 INFO : file1.txt: A winner could not be determined. 2024/04/26 03:27:39 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/file1.txt.apple1 2024/04/26 03:27:39 INFO : file1.txt: Moved (server-side) to: file1.txt.apple1 2024/04/26 03:27:39 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/resolve/path2/file1.txt.apple1 2024/04/26 03:27:39 NOTICE: - Path2 Renaming Path2 copy - /tmp/032728we/resolve/path2/file1.txt.apple2 2024/04/26 03:27:39 INFO : file1.txt: Moved (server-side) to: file1.txt.apple2 2024/04/26 03:27:39 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/file1.txt.apple2 2024/04/26 03:27:39 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:39 INFO : file1.txt.apple2: Copied (new) 2024/04/26 03:27:39 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:39 INFO : file1.txt.apple1: Copied (new) 2024/04/26 03:27:39 INFO : Updating listings 2024/04/26 03:27:39 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" vs Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Bisync successful 2024/04/26 03:27:39 (25) : test different suffixes 2024/04/26 03:27:39 (26) : touch-glob 2003-07-23 /tmp/032728we/datadir/test_resolve-manebif2/ file1R.txt 2024/04/26 03:27:39 (27) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1R.txt /tmp/032728we/resolve/path2/ file1.txt 2024/04/26 03:27:39 INFO : file1R.txt: Copied (new) to: file1.txt 2024/04/26 03:27:39 (28) : touch-glob 2003-07-23 /tmp/032728we/datadir/test_resolve-manebif2/ file1L.txt 2024/04/26 03:27:39 (29) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/ file1.txt 2024/04/26 03:27:39 INFO : file1L.txt: Copied (new) to: file1.txt 2024/04/26 03:27:39 (30) : test bisync run with --conflict-resolve=older --conflict-loser=num --conflict-suffix=cloud,local 2024/04/26 03:27:39 (31) : bisync conflict-resolve=older conflict-loser=num conflict-suffix=cloud,local 2024/04/26 03:27:39 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" with Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:39 INFO : Path1 checking for diffs 2024/04/26 03:27:39 INFO : - Path1 File is new - file1.txt 2024/04/26 03:27:39 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:39 INFO : Path2 checking for diffs 2024/04/26 03:27:39 INFO : - Path2 File is new - file1.txt 2024/04/26 03:27:39 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:39 INFO : Applying changes 2024/04/26 03:27:39 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:39 INFO : Checking potential conflicts... 2024/04/26 03:27:39 NOTICE: Local file system at /tmp/032728we/resolve/path2: 1 differences found 2024/04/26 03:27:39 NOTICE: Local file system at /tmp/032728we/resolve/path2: 1 errors while checking 2024/04/26 03:27:39 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:39 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:39 INFO : file1.txt: Winner cannot be determined as times are equal. Path1: 2003-07-23 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 0s 2024/04/26 03:27:39 INFO : file1.txt: A winner could not be determined. 2024/04/26 03:27:39 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/file1.txt.cloud1 2024/04/26 03:27:39 INFO : file1.txt: Moved (server-side) to: file1.txt.cloud1 2024/04/26 03:27:39 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/resolve/path2/file1.txt.cloud1 2024/04/26 03:27:39 NOTICE: - Path2 Renaming Path2 copy - /tmp/032728we/resolve/path2/file1.txt.local1 2024/04/26 03:27:39 INFO : file1.txt: Moved (server-side) to: file1.txt.local1 2024/04/26 03:27:39 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/file1.txt.local1 2024/04/26 03:27:39 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:39 INFO : file1.txt.local1: Copied (new) 2024/04/26 03:27:39 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:39 INFO : file1.txt.cloud1: Copied (new) 2024/04/26 03:27:39 INFO : Updating listings 2024/04/26 03:27:39 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" vs Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Bisync successful 2024/04/26 03:27:39 (32) : test legacy 2024/04/26 03:27:39 (33) : touch-glob 2004-07-23 /tmp/032728we/datadir/test_resolve-manebif2/ file1R.txt 2024/04/26 03:27:39 (34) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1R.txt /tmp/032728we/resolve/path2/ file1.txt 2024/04/26 03:27:39 INFO : file1R.txt: Copied (new) to: file1.txt 2024/04/26 03:27:39 (35) : touch-glob 2004-07-23 /tmp/032728we/datadir/test_resolve-manebif2/ file1L.txt 2024/04/26 03:27:39 (36) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/ file1.txt 2024/04/26 03:27:39 INFO : file1L.txt: Copied (new) to: file1.txt 2024/04/26 03:27:39 (37) : test bisync run with --conflict-resolve=none --conflict-loser=pathname --conflict-suffix=.path 2024/04/26 03:27:39 (38) : bisync conflict-resolve=none conflict-loser=pathname conflict-suffix=.path 2024/04/26 03:27:39 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" with Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:39 INFO : Path1 checking for diffs 2024/04/26 03:27:39 INFO : - Path1 File is new - file1.txt 2024/04/26 03:27:39 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:39 INFO : Path2 checking for diffs 2024/04/26 03:27:39 INFO : - Path2 File is new - file1.txt 2024/04/26 03:27:39 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:39 INFO : Applying changes 2024/04/26 03:27:39 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:39 INFO : Checking potential conflicts... 2024/04/26 03:27:39 NOTICE: Local file system at /tmp/032728we/resolve/path2: 1 differences found 2024/04/26 03:27:39 NOTICE: Local file system at /tmp/032728we/resolve/path2: 1 errors while checking 2024/04/26 03:27:39 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:39 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:39 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/file1.txt..path1 2024/04/26 03:27:39 INFO : file1.txt: Moved (server-side) to: file1.txt..path1 2024/04/26 03:27:39 NOTICE: - Path1 Queue copy to Path2 - /tmp/032728we/resolve/path2/file1.txt..path1 2024/04/26 03:27:39 NOTICE: - Path2 Renaming Path2 copy - /tmp/032728we/resolve/path2/file1.txt..path2 2024/04/26 03:27:39 INFO : file1.txt: Moved (server-side) to: file1.txt..path2 2024/04/26 03:27:39 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/file1.txt..path2 2024/04/26 03:27:39 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:39 INFO : file1.txt..path2: Copied (new) 2024/04/26 03:27:39 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:39 INFO : file1.txt..path1: Copied (new) 2024/04/26 03:27:39 INFO : Updating listings 2024/04/26 03:27:39 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" vs Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Bisync successful 2024/04/26 03:27:39 (39) : test deletes on both sides with default suffix 2024/04/26 03:27:39 (40) : touch-glob 2005-01-02 /tmp/032728we/datadir/test_resolve-manebif2/ file1R.txt 2024/04/26 03:27:39 (41) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1R.txt /tmp/032728we/resolve/path2/ file1.txt 2024/04/26 03:27:39 INFO : file1R.txt: Copied (new) to: file1.txt 2024/04/26 03:27:39 (42) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/ file2.txt 2024/04/26 03:27:39 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:39 (43) : touch-glob 2006-03-04 /tmp/032728we/datadir/test_resolve-manebif2/ file1L.txt 2024/04/26 03:27:39 (44) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/ file1.txt 2024/04/26 03:27:39 INFO : file1L.txt: Copied (new) to: file1.txt 2024/04/26 03:27:39 (45) : copy-as /tmp/032728we/datadir/test_resolve-manebif2/file1L.txt /tmp/032728we/resolve/path2/ file2.txt 2024/04/26 03:27:39 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:39 (46) : test bisync run with --conflict-resolve=newer --conflict-loser=delete 2024/04/26 03:27:39 (47) : bisync conflict-resolve=newer conflict-loser=delete 2024/04/26 03:27:39 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" with Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:39 INFO : Path1 checking for diffs 2024/04/26 03:27:39 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:39 INFO : - Path1 File is new - file1.txt 2024/04/26 03:27:39 INFO : Path1: 2 changes:  1 new,  1 modified,  0 deleted 2024/04/26 03:27:39 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:39 INFO : Path2 checking for diffs 2024/04/26 03:27:39 INFO : - Path2 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:39 INFO : - Path2 File is new - file1.txt 2024/04/26 03:27:39 INFO : Path2: 2 changes:  1 new,  1 modified,  0 deleted 2024/04/26 03:27:39 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:39 INFO : Applying changes 2024/04/26 03:27:39 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:39 INFO : Checking potential conflicts... 2024/04/26 03:27:39 NOTICE: Local file system at /tmp/032728we/resolve/path2: 2 differences found 2024/04/26 03:27:39 NOTICE: Local file system at /tmp/032728we/resolve/path2: 2 errors while checking 2024/04/26 03:27:39 INFO : Finished checking the potential conflicts. 2 differences found 2024/04/26 03:27:39 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:39 INFO : file1.txt: Path1 is newer. Path1: 2006-03-04 00:00:00 +0000 UTC, Path2: 2005-01-02 00:00:00 +0000 UTC, Difference: 10224h0m0s 2024/04/26 03:27:39 INFO : file1.txt: The winner is: Path1 2024/04/26 03:27:39 NOTICE: - Path2 Deleting Path2 copy - /tmp/032728we/resolve/path2/file1.txt 2024/04/26 03:27:39 INFO : file1.txt: Deleted 2024/04/26 03:27:39 INFO : - Path1 Queue copy to Path2 - file1.txt 2024/04/26 03:27:39 NOTICE: - WARNING New or changed in both paths - file2.txt 2024/04/26 03:27:39 INFO : file2.txt: Path2 is newer. Path1: 2005-01-02 00:00:00 +0000 UTC, Path2: 2006-03-04 00:00:00 +0000 UTC, Difference: 10224h0m0s 2024/04/26 03:27:39 INFO : file2.txt: The winner is: Path2 2024/04/26 03:27:39 NOTICE: - Path1 Deleting Path1 copy - TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/file2.txt 2024/04/26 03:27:39 INFO : file2.txt: Deleted 2024/04/26 03:27:39 INFO : - Path2 Queue copy to Path1 - file2.txt 2024/04/26 03:27:39 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:39 INFO : file2.txt: Copied (new) 2024/04/26 03:27:39 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:39 INFO : file1.txt: Copied (new) 2024/04/26 03:27:39 INFO : Updating listings 2024/04/26 03:27:39 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:39 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resolve/path1/" vs Path2 "/tmp/032728we/resolve/path2/" 2024/04/26 03:27:39 INFO : Bisync successful bisync_test.go:553: TEST resolve PASSED === RUN TestBisyncRemoteLocal/resync 2024/04/26 03:27:39 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:39 DEBUG : path1: Making directory 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:39 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1" 2024/04/26 03:27:39 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:39 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:39 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:39 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:39 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:39 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:39 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1" 2024/04/26 03:27:39 DEBUG : Creating backend with remote "/tmp/032728we/resync/path2" 2024/04/26 03:27:39 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resync/initial" 2024/04/26 03:27:39 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_resync-decayek4" 2024/04/26 03:27:39 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : file2.txt.nohafeg9.partial: renamed to: file2.txt 2024/04/26 03:27:39 INFO : file2.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : file1.txt.kayipey6.partial: renamed to: file1.txt 2024/04/26 03:27:39 INFO : file1.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : Local file system at /tmp/032728we/initdir/test_resync-decayek4: Waiting for checks to finish 2024/04/26 03:27:39 DEBUG : Local file system at /tmp/032728we/initdir/test_resync-decayek4: Waiting for transfers to finish 2024/04/26 03:27:39 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : file4.txt.zexasix1.partial: renamed to: file4.txt 2024/04/26 03:27:39 INFO : file4.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : file3.txt.xeruzuh2.partial: renamed to: file3.txt 2024/04/26 03:27:39 INFO : file3.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : file5.txt.howonav7.partial: renamed to: file5.txt 2024/04/26 03:27:39 INFO : file5.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:39 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : RCLONE_TEST.sodulez9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:39 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:39 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : file7.txt.coronoj3.partial: renamed to: file7.txt 2024/04/26 03:27:39 INFO : file7.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : file6.txt.fidehum7.partial: renamed to: file6.txt 2024/04/26 03:27:39 INFO : file6.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resync/modfiles" 2024/04/26 03:27:39 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_resync-cufapak3" 2024/04/26 03:27:39 DEBUG : fileA.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : fileB.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : Local file system at /tmp/032728we/datadir/test_resync-cufapak3: Waiting for checks to finish 2024/04/26 03:27:39 DEBUG : Local file system at /tmp/032728we/datadir/test_resync-cufapak3: Waiting for transfers to finish 2024/04/26 03:27:39 DEBUG : fileB.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:39 DEBUG : fileA.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:39 DEBUG : fileB.txt.wepiduq4.partial: renamed to: fileB.txt 2024/04/26 03:27:39 INFO : fileB.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : fileA.txt.bisizuq1.partial: renamed to: fileA.txt 2024/04/26 03:27:39 INFO : fileA.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1] 2024/04/26 03:27:39 ERROR : : error listing: directory not found 2024/04/26 03:27:39 ERROR : : error listing: directory not found 2024/04/26 03:27:39 checking initFs Local file system at /tmp/032728we/initdir/test_resync-decayek4 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1] 2024/04/26 03:27:39 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/RCLONE_TEST] 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/file1.txt] 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/file2.txt] 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/file3.txt] 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: Waiting for checks to finish 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: Waiting for transfers to finish 2024/04/26 03:27:39 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/file4.txt] 2024/04/26 03:27:39 INFO : file1.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/file5.txt] 2024/04/26 03:27:39 INFO : file3.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/file6.txt] 2024/04/26 03:27:39 INFO : file2.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/file7.txt] 2024/04/26 03:27:39 INFO : file4.txt: Copied (new) 2024/04/26 03:27:39 INFO : file5.txt: Copied (new) 2024/04/26 03:27:39 INFO : file6.txt: Copied (new) 2024/04/26 03:27:39 INFO : file7.txt: Copied (new) 2024/04/26 03:27:39 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1 2024/04/26 03:27:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1] 2024/04/26 03:27:39 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:39 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : file1.txt.dijohir7.partial: renamed to: file1.txt 2024/04/26 03:27:39 INFO : file1.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : file4.txt.qikatol3.partial: renamed to: file4.txt 2024/04/26 03:27:39 INFO : file4.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : Local file system at /tmp/032728we/resync/path2: Waiting for checks to finish 2024/04/26 03:27:39 DEBUG : Local file system at /tmp/032728we/resync/path2: Waiting for transfers to finish 2024/04/26 03:27:39 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:39 DEBUG : file3.txt.ninogef0.partial: renamed to: file3.txt 2024/04/26 03:27:39 DEBUG : RCLONE_TEST.dihoses2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:39 INFO : file3.txt: Copied (new) 2024/04/26 03:27:39 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:39 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : file5.txt.mumerab8.partial: renamed to: file5.txt 2024/04/26 03:27:39 INFO : file5.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : file2.txt.xonoleq8.partial: renamed to: file2.txt 2024/04/26 03:27:39 INFO : file2.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:39 DEBUG : file7.txt.jedihot2.partial: renamed to: file7.txt 2024/04/26 03:27:39 INFO : file7.txt: Copied (new) 2024/04/26 03:27:39 DEBUG : file6.txt.duwoyer9.partial: renamed to: file6.txt 2024/04/26 03:27:39 INFO : file6.txt: Copied (new) 2024/04/26 03:27:39 checking path2 Local file system at /tmp/032728we/resync/path2 2024/04/26 03:27:39 (01) : test resync 2024/04/26 03:27:39 (02) : test 1. resync with empty path1, resulting in copying all content from path2. 2024/04/26 03:27:39 (03) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/ 2024/04/26 03:27:39 (04) : bisync resync 2024/04/26 03:27:39 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/" with Path2 "/tmp/032728we/resync/path2/" 2024/04/26 03:27:39 INFO : Copying Path2 files to Path1 2024/04/26 03:27:39 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:39 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:39 INFO : file1.txt: Copied (new) 2024/04/26 03:27:39 INFO : file2.txt: Copied (new) 2024/04/26 03:27:39 INFO : file3.txt: Copied (new) 2024/04/26 03:27:39 INFO : file4.txt: Copied (new) 2024/04/26 03:27:39 INFO : file5.txt: Copied (new) 2024/04/26 03:27:39 INFO : file6.txt: Copied (new) 2024/04/26 03:27:39 INFO : file7.txt: Copied (new) 2024/04/26 03:27:39 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:39 INFO : Resync updating listings 2024/04/26 03:27:39 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/" vs Path2 "/tmp/032728we/resync/path2/" 2024/04/26 03:27:39 INFO : Bisync successful 2024/04/26 03:27:39 (05) : move-listings empty-path1 2024/04/26 03:27:39 (06) : test 2. resync with empty path2, resulting in synching all content to path2. 2024/04/26 03:27:39 (07) : purge-children /tmp/032728we/resync/path2/ 2024/04/26 03:27:39 (08) : bisync resync 2024/04/26 03:27:39 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/" with Path2 "/tmp/032728we/resync/path2/" 2024/04/26 03:27:39 INFO : Copying Path2 files to Path1 2024/04/26 03:27:39 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:39 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:39 INFO : file1.txt: Copied (new) 2024/04/26 03:27:39 INFO : file2.txt: Copied (new) 2024/04/26 03:27:39 INFO : file3.txt: Copied (new) 2024/04/26 03:27:39 INFO : file4.txt: Copied (new) 2024/04/26 03:27:39 INFO : file5.txt: Copied (new) 2024/04/26 03:27:39 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:39 INFO : file6.txt: Copied (new) 2024/04/26 03:27:39 INFO : file7.txt: Copied (new) 2024/04/26 03:27:39 INFO : Resync updating listings 2024/04/26 03:27:39 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/" vs Path2 "/tmp/032728we/resync/path2/" 2024/04/26 03:27:39 INFO : Bisync successful 2024/04/26 03:27:39 (09) : move-listings empty-path2 2024/04/26 03:27:39 (10) : test 3. exercise all of the various file difference scenarios during a resync. 2024/04/26 03:27:39 (11) : touch-glob 2002-02-02 /tmp/032728we/datadir/test_resync-cufapak3/ fileA.txt 2024/04/26 03:27:39 (12) : touch-glob 1999-09-09 /tmp/032728we/datadir/test_resync-cufapak3/ fileB.txt 2024/04/26 03:27:39 (13) : test = file - path1 - path2 - expected action - who wins 2024/04/26 03:27:39 (14) : test - file1.txt - exists - missing - sync path1 > path2 - path1 2024/04/26 03:27:39 (15) : delete-file /tmp/032728we/resync/path2/file1.txt 2024/04/26 03:27:39 INFO : file1.txt: Deleted 2024/04/26 03:27:39 (16) : test - file2.txt - missing - exists - copy path2 > path1 - path2 2024/04/26 03:27:39 (17) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/file2.txt 2024/04/26 03:27:39 INFO : file2.txt: Deleted 2024/04/26 03:27:39 (18) : test - file3.txt - exists - newer date - sync path1 > path2 - path1 2024/04/26 03:27:39 (19) : copy-as /tmp/032728we/datadir/test_resync-cufapak3/fileA.txt /tmp/032728we/resync/path2/ file3.txt 2024/04/26 03:27:39 INFO : fileA.txt: Copied (replaced existing) to: file3.txt 2024/04/26 03:27:39 (20) : test - file4.txt - missing - newer date - copy path2 > path1 - path2 2024/04/26 03:27:39 (21) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/file4.txt 2024/04/26 03:27:39 INFO : file4.txt: Deleted 2024/04/26 03:27:39 (22) : copy-as /tmp/032728we/datadir/test_resync-cufapak3/fileA.txt /tmp/032728we/resync/path2/ file4.txt 2024/04/26 03:27:39 INFO : fileA.txt: Copied (replaced existing) to: file4.txt 2024/04/26 03:27:39 (23) : test - file5.txt - exists - older date - sync path1 > path2 - path1 2024/04/26 03:27:39 (24) : copy-as /tmp/032728we/datadir/test_resync-cufapak3/fileB.txt /tmp/032728we/resync/path2/ file5.txt 2024/04/26 03:27:39 INFO : fileB.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:39 (25) : test - file6.txt - older date - newer date - sync path1 > path2 - path1 2024/04/26 03:27:39 (26) : copy-as /tmp/032728we/datadir/test_resync-cufapak3/fileB.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/ file6.txt 2024/04/26 03:27:39 INFO : fileB.txt: Copied (replaced existing) to: file6.txt 2024/04/26 03:27:39 (27) : copy-as /tmp/032728we/datadir/test_resync-cufapak3/fileA.txt /tmp/032728we/resync/path2/ file6.txt 2024/04/26 03:27:39 INFO : fileA.txt: Copied (replaced existing) to: file6.txt 2024/04/26 03:27:39 (28) : test - file7.txt - exists - exists (same) - none - same 2024/04/26 03:27:39 (29) : test run bisync with resync 2024/04/26 03:27:39 (30) : bisync resync 2024/04/26 03:27:39 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/" with Path2 "/tmp/032728we/resync/path2/" 2024/04/26 03:27:39 INFO : Copying Path2 files to Path1 2024/04/26 03:27:39 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:39 INFO : file2.txt: Copied (new) 2024/04/26 03:27:39 INFO : file4.txt: Copied (new) 2024/04/26 03:27:39 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:39 INFO : file1.txt: Copied (new) 2024/04/26 03:27:39 INFO : file3.txt: Copied (replaced existing) 2024/04/26 03:27:39 INFO : file5.txt: Copied (replaced existing) 2024/04/26 03:27:39 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:27:39 INFO : Resync updating listings 2024/04/26 03:27:39 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/" vs Path2 "/tmp/032728we/resync/path2/" 2024/04/26 03:27:39 INFO : Bisync successful 2024/04/26 03:27:39 (31) : copy-listings mixed-diffs 2024/04/26 03:27:39 (32) : test run normal bisync 2024/04/26 03:27:39 (33) : bisync 2024/04/26 03:27:39 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:39 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:39 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/" with Path2 "/tmp/032728we/resync/path2/" 2024/04/26 03:27:39 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:39 INFO : Path1 checking for diffs 2024/04/26 03:27:39 INFO : Path2 checking for diffs 2024/04/26 03:27:39 INFO : No changes found 2024/04/26 03:27:39 INFO : Updating listings 2024/04/26 03:27:39 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/" vs Path2 "/tmp/032728we/resync/path2/" 2024/04/26 03:27:39 INFO : Bisync successful 2024/04/26 03:27:40 (34) : test 4. confirm critical error on normal sync of empty path. 2024/04/26 03:27:40 (35) : purge-children /tmp/032728we/resync/path2/ 2024/04/26 03:27:40 (36) : bisync 2024/04/26 03:27:40 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:40 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:40 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync/path1/" with Path2 "/tmp/032728we/resync/path2/" 2024/04/26 03:27:40 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:40 INFO : Path1 checking for diffs 2024/04/26 03:27:40 INFO : Path2 checking for diffs 2024/04/26 03:27:40 ERROR : Empty current Path2 listing. Cannot sync to an empty directory: /tmp/032728we/workdir/TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_resync_path1..tmp_032728we_resync_path2.path2.lst-new 2024/04/26 03:27:40 ERROR : Bisync critical error: empty current Path2 listing: /tmp/032728we/workdir/TestHdfs_rclone-test-cucitan6cidobus7hereqoc0_032728we_resync_path1..tmp_032728we_resync_path2.path2.lst-new 2024/04/26 03:27:40 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:40 Bisync error: bisync aborted bisync_test.go:553: TEST resync PASSED === RUN TestBisyncRemoteLocal/resync_modes 2024/04/26 03:27:40 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:40 DEBUG : path1: Making directory 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:40 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1" 2024/04/26 03:27:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:40 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1" 2024/04/26 03:27:40 DEBUG : Creating backend with remote "/tmp/032728we/resync_modes/path2" 2024/04/26 03:27:40 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resync_modes/initial" 2024/04/26 03:27:40 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_resync_modes-ligadep6" 2024/04/26 03:27:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : Local file system at /tmp/032728we/initdir/test_resync_modes-ligadep6: Waiting for checks to finish 2024/04/26 03:27:40 DEBUG : Local file system at /tmp/032728we/initdir/test_resync_modes-ligadep6: Waiting for transfers to finish 2024/04/26 03:27:40 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:40 DEBUG : file2.txt.tapihih2.partial: renamed to: file2.txt 2024/04/26 03:27:40 INFO : file2.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:40 DEBUG : file1.txt.xofolep6.partial: renamed to: file1.txt 2024/04/26 03:27:40 INFO : file1.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:40 DEBUG : RCLONE_TEST.nacizil3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:40 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:40 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resync_modes/modfiles" 2024/04/26 03:27:40 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_resync_modes-biyatim7" 2024/04/26 03:27:40 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1R.txt: md5 = 705bb3c0ef02925739e834ca98c099c3 OK 2024/04/26 03:27:40 DEBUG : file1R.txt.xasokal5.partial: renamed to: file1R.txt 2024/04/26 03:27:40 INFO : file1R.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : Local file system at /tmp/032728we/datadir/test_resync_modes-biyatim7: Waiting for checks to finish 2024/04/26 03:27:40 DEBUG : Local file system at /tmp/032728we/datadir/test_resync_modes-biyatim7: Waiting for transfers to finish 2024/04/26 03:27:40 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/04/26 03:27:40 DEBUG : file2.txt.hanegeb8.partial: renamed to: file2.txt 2024/04/26 03:27:40 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/04/26 03:27:40 INFO : file2.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : file1L.txt.celacem6.partial: renamed to: file1L.txt 2024/04/26 03:27:40 INFO : file1L.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1] 2024/04/26 03:27:40 ERROR : : error listing: directory not found 2024/04/26 03:27:40 ERROR : : error listing: directory not found 2024/04/26 03:27:40 checking initFs Local file system at /tmp/032728we/initdir/test_resync_modes-ligadep6 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1] 2024/04/26 03:27:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/RCLONE_TEST] 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1: Waiting for checks to finish 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1: Waiting for transfers to finish 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/file2.txt] 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/file1.txt] 2024/04/26 03:27:40 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:40 INFO : file2.txt: Copied (new) 2024/04/26 03:27:40 INFO : file1.txt: Copied (new) 2024/04/26 03:27:40 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1] 2024/04/26 03:27:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : Local file system at /tmp/032728we/resync_modes/path2: Waiting for checks to finish 2024/04/26 03:27:40 DEBUG : Local file system at /tmp/032728we/resync_modes/path2: Waiting for transfers to finish 2024/04/26 03:27:40 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:40 DEBUG : file1.txt.pozisut1.partial: renamed to: file1.txt 2024/04/26 03:27:40 INFO : file1.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:40 DEBUG : file2.txt.vekebit8.partial: renamed to: file2.txt 2024/04/26 03:27:40 INFO : file2.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:40 DEBUG : RCLONE_TEST.serodej3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:40 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:40 checking path2 Local file system at /tmp/032728we/resync_modes/path2 2024/04/26 03:27:40 (01) : test resync-mode 2024/04/26 03:27:40 (02) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:40 (03) : touch-glob 2001-01-02 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1R.txt 2024/04/26 03:27:40 (04) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1R.txt /tmp/032728we/resync_modes/path2/ file1.txt 2024/04/26 03:27:40 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:40 (05) : touch-glob 2001-03-04 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1L.txt 2024/04/26 03:27:40 (06) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/ file1.txt 2024/04/26 03:27:40 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:40 (07) : test bisync run with --resync-mode=newer 2024/04/26 03:27:40 (08) : bisync resync resync-mode=newer 2024/04/26 03:27:40 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:40 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:40 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" with Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Copying Path2 files to Path1 2024/04/26 03:27:40 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:40 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:40 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:40 INFO : Resync updating listings 2024/04/26 03:27:40 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" vs Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Bisync successful 2024/04/26 03:27:40 (09) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:40 (10) : touch-glob 2001-07-23 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1R.txt 2024/04/26 03:27:40 (11) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1R.txt /tmp/032728we/resync_modes/path2/ file1.txt 2024/04/26 03:27:40 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:40 (12) : touch-glob 2001-08-26 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1L.txt 2024/04/26 03:27:40 (13) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/ file1.txt 2024/04/26 03:27:40 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:40 (14) : test bisync run with --resync-mode=path2 2024/04/26 03:27:40 (15) : bisync resync resync-mode=path2 2024/04/26 03:27:40 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:40 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:40 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" with Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Copying Path2 files to Path1 2024/04/26 03:27:40 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:40 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:40 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:40 INFO : Resync updating listings 2024/04/26 03:27:40 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" vs Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Bisync successful 2024/04/26 03:27:40 (16) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:40 (17) : touch-glob 2002-07-23 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1R.txt 2024/04/26 03:27:40 (18) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1R.txt /tmp/032728we/resync_modes/path2/ file1.txt 2024/04/26 03:27:40 INFO : file1R.txt: Updated modification time in destination 2024/04/26 03:27:40 (19) : touch-glob 2002-08-26 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1L.txt 2024/04/26 03:27:40 (20) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/ file1.txt 2024/04/26 03:27:40 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:40 (21) : test bisync run with --resync-mode=larger 2024/04/26 03:27:40 (22) : bisync resync resync-mode=larger 2024/04/26 03:27:40 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:40 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:40 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" with Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Copying Path2 files to Path1 2024/04/26 03:27:40 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:40 INFO : file1.txt: Path2 is larger. Path1: 33, Path2: 42, Difference: 9 2024/04/26 03:27:40 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:40 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:40 INFO : Resync updating listings 2024/04/26 03:27:40 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" vs Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Bisync successful 2024/04/26 03:27:40 (23) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:40 (24) : touch-glob 2003-07-23 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1R.txt 2024/04/26 03:27:40 (25) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1R.txt /tmp/032728we/resync_modes/path2/ file1.txt 2024/04/26 03:27:40 INFO : file1R.txt: Updated modification time in destination 2024/04/26 03:27:40 (26) : touch-glob 2003-09-04 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1L.txt 2024/04/26 03:27:40 (27) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/ file1.txt 2024/04/26 03:27:40 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:40 (28) : test bisync run with --resync-mode=older 2024/04/26 03:27:40 (29) : bisync resync resync-mode=older 2024/04/26 03:27:40 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:40 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:40 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" with Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Copying Path2 files to Path1 2024/04/26 03:27:40 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:40 INFO : file1.txt: Path2 is older. Path1: 2003-09-04 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 1032h0m0s 2024/04/26 03:27:40 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:40 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:40 INFO : Resync updating listings 2024/04/26 03:27:40 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" vs Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Bisync successful 2024/04/26 03:27:40 (30) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:40 (31) : touch-glob 2004-07-23 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1R.txt 2024/04/26 03:27:40 (32) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1R.txt /tmp/032728we/resync_modes/path2/ file1.txt 2024/04/26 03:27:40 INFO : file1R.txt: Updated modification time in destination 2024/04/26 03:27:40 (33) : touch-glob 2004-07-23 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1L.txt 2024/04/26 03:27:40 (34) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/ file1.txt 2024/04/26 03:27:40 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:40 (35) : test bisync run with --resync-mode=smaller 2024/04/26 03:27:40 (36) : bisync resync resync-mode=smaller 2024/04/26 03:27:40 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:40 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:40 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" with Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Copying Path2 files to Path1 2024/04/26 03:27:40 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:40 INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9 2024/04/26 03:27:40 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:40 INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9 2024/04/26 03:27:40 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:40 INFO : Resync updating listings 2024/04/26 03:27:40 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" vs Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Bisync successful 2024/04/26 03:27:40 (37) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:40 (38) : touch-glob 2005-01-02 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1R.txt 2024/04/26 03:27:40 (39) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1R.txt /tmp/032728we/resync_modes/path2/ file1.txt 2024/04/26 03:27:40 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:40 (40) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/ file2.txt 2024/04/26 03:27:40 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:40 (41) : touch-glob 2006-03-04 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1L.txt 2024/04/26 03:27:40 (42) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/ file1.txt 2024/04/26 03:27:40 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:40 (43) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1L.txt /tmp/032728we/resync_modes/path2/ file2.txt 2024/04/26 03:27:40 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:40 (44) : test bisync run with --resync-mode=path1 2024/04/26 03:27:40 (45) : bisync resync resync-mode=path1 2024/04/26 03:27:40 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:40 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:40 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" with Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Copying Path2 files to Path1 2024/04/26 03:27:40 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:40 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:40 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:40 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:40 INFO : Resync updating listings 2024/04/26 03:27:40 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" vs Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Bisync successful 2024/04/26 03:27:40 (46) : test no winner 2024/04/26 03:27:40 (47) : touch-glob 2022-02-22 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1R.txt 2024/04/26 03:27:40 (48) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1R.txt /tmp/032728we/resync_modes/path2/ file1.txt 2024/04/26 03:27:40 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:40 (49) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/ file2.txt 2024/04/26 03:27:40 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:40 (50) : touch-glob 2022-02-22 /tmp/032728we/datadir/test_resync_modes-biyatim7/ file1L.txt 2024/04/26 03:27:40 (51) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/ file1.txt 2024/04/26 03:27:40 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:40 (52) : copy-as /tmp/032728we/datadir/test_resync_modes-biyatim7/file1L.txt /tmp/032728we/resync_modes/path2/ file2.txt 2024/04/26 03:27:40 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:40 (53) : test bisync run with --resync-mode=newer 2024/04/26 03:27:40 (54) : bisync resync resync-mode=newer 2024/04/26 03:27:40 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:40 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:40 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" with Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Copying Path2 files to Path1 2024/04/26 03:27:40 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:40 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:40 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:40 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:40 INFO : Resync updating listings 2024/04/26 03:27:40 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/resync_modes/path1/" vs Path2 "/tmp/032728we/resync_modes/path2/" 2024/04/26 03:27:40 INFO : Bisync successful bisync_test.go:553: TEST resync_modes PASSED === RUN TestBisyncRemoteLocal/rmdirs 2024/04/26 03:27:40 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:40 DEBUG : path1: Making directory 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:40 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1" 2024/04/26 03:27:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:40 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1" 2024/04/26 03:27:40 DEBUG : Creating backend with remote "/tmp/032728we/rmdirs/path2" 2024/04/26 03:27:40 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rmdirs/initial" 2024/04/26 03:27:40 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_rmdirs-qiquqeh7" 2024/04/26 03:27:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:40 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:40 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:40 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : Local file system at /tmp/032728we/initdir/test_rmdirs-qiquqeh7: Waiting for checks to finish 2024/04/26 03:27:40 DEBUG : Local file system at /tmp/032728we/initdir/test_rmdirs-qiquqeh7: Waiting for transfers to finish 2024/04/26 03:27:40 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:40 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:40 DEBUG : file1.copy1.txt.mozoqav2.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:40 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : file1.copy3.txt.popaqos3.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:40 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:40 DEBUG : file1.copy2.txt.pubugeh7.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:40 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:40 DEBUG : file1.copy4.txt.fogukeq0.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:40 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:40 DEBUG : file1.txt.roqebiy6.partial: renamed to: file1.txt 2024/04/26 03:27:40 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:40 INFO : file1.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : file1.copy5.txt.zodivul0.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:40 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:40 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:40 DEBUG : RCLONE_TEST.podemek6.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:40 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:40 DEBUG : subdir/file20.txt.gucacag8.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:40 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:40 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:40 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rmdirs/modfiles" 2024/04/26 03:27:40 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_rmdirs-yedewag3" 2024/04/26 03:27:40 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : Local file system at /tmp/032728we/datadir/test_rmdirs-yedewag3: Waiting for checks to finish 2024/04/26 03:27:40 DEBUG : Local file system at /tmp/032728we/datadir/test_rmdirs-yedewag3: Waiting for transfers to finish 2024/04/26 03:27:40 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:40 DEBUG : file1.txt.riyarum9.partial: renamed to: file1.txt 2024/04/26 03:27:40 INFO : file1.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1] 2024/04/26 03:27:40 ERROR : : error listing: directory not found 2024/04/26 03:27:40 ERROR : : error listing: directory not found 2024/04/26 03:27:40 checking initFs Local file system at /tmp/032728we/initdir/test_rmdirs-qiquqeh7 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1] 2024/04/26 03:27:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : subdir: Making directory 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/subdir] 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/RCLONE_TEST] 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/file1.copy2.txt] 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/file1.copy1.txt] 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/file1.copy3.txt] 2024/04/26 03:27:40 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: Waiting for checks to finish 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: Waiting for transfers to finish 2024/04/26 03:27:40 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/file1.copy4.txt] 2024/04/26 03:27:40 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/file1.copy5.txt] 2024/04/26 03:27:40 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/file1.txt] 2024/04/26 03:27:40 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/subdir/file20.txt] 2024/04/26 03:27:40 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:41 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:41 INFO : file1.txt: Copied (new) 2024/04/26 03:27:41 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:41 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1] 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/subdir] 2024/04/26 03:27:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:41 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:41 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:41 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy1.txt.nosemiy8.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:41 DEBUG : Local file system at /tmp/032728we/rmdirs/path2: Waiting for checks to finish 2024/04/26 03:27:41 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : Local file system at /tmp/032728we/rmdirs/path2: Waiting for transfers to finish 2024/04/26 03:27:41 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy3.txt.tufopuz1.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:41 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:41 DEBUG : RCLONE_TEST.werapah7.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:41 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy5.txt.xaworer6.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:41 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.txt.folufey3.partial: renamed to: file1.txt 2024/04/26 03:27:41 INFO : file1.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.copy2.txt.kopunuj8.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:41 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy4.txt.davozoc0.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:41 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : subdir/file20.txt.ginowep2.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:41 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:41 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:41 checking path2 Local file system at /tmp/032728we/rmdirs/path2 2024/04/26 03:27:41 (01) : test rmdirs 2024/04/26 03:27:41 (02) : test initial bisync 2024/04/26 03:27:41 (03) : bisync resync 2024/04/26 03:27:41 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:41 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:41 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:41 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/" with Path2 "/tmp/032728we/rmdirs/path2/" 2024/04/26 03:27:41 INFO : Copying Path2 files to Path1 2024/04/26 03:27:41 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:41 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:41 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:41 INFO : Resync updating listings 2024/04/26 03:27:41 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/" vs Path2 "/tmp/032728we/rmdirs/path2/" 2024/04/26 03:27:41 INFO : Bisync successful 2024/04/26 03:27:41 (04) : test 1. delete path1 subdir file 2024/04/26 03:27:41 (05) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/subdir/file20.txt 2024/04/26 03:27:41 INFO : file20.txt: Deleted 2024/04/26 03:27:41 (06) : test 2. run bisync without remove-empty-dirs 2024/04/26 03:27:41 (07) : bisync 2024/04/26 03:27:41 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:41 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:41 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:41 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/" with Path2 "/tmp/032728we/rmdirs/path2/" 2024/04/26 03:27:41 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:41 INFO : Path1 checking for diffs 2024/04/26 03:27:41 INFO : - Path1 File was deleted - subdir/file20.txt 2024/04/26 03:27:41 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:41 INFO : Path2 checking for diffs 2024/04/26 03:27:41 INFO : Applying changes 2024/04/26 03:27:41 INFO : - Path2 Queue delete - /tmp/032728we/rmdirs/path2/subdir/file20.txt 2024/04/26 03:27:41 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:41 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:41 INFO : subdir/file20.txt: Deleted 2024/04/26 03:27:41 INFO : Updating listings 2024/04/26 03:27:41 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/" vs Path2 "/tmp/032728we/rmdirs/path2/" 2024/04/26 03:27:41 INFO : Bisync successful 2024/04/26 03:27:41 (08) : test 3. confirm the subdir still exists on both paths 2024/04/26 03:27:41 (09) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/ 2024/04/26 03:27:41 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:41 (10) : list-dirs /tmp/032728we/rmdirs/path2/ 2024/04/26 03:27:41 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:41 (11) : test 4. run bisync with remove-empty-dirs 2024/04/26 03:27:41 (12) : bisync remove-empty-dirs 2024/04/26 03:27:41 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:41 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:41 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:41 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/" with Path2 "/tmp/032728we/rmdirs/path2/" 2024/04/26 03:27:41 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:41 INFO : Path1 checking for diffs 2024/04/26 03:27:41 INFO : Path2 checking for diffs 2024/04/26 03:27:41 INFO : No changes found 2024/04/26 03:27:41 INFO : Updating listings 2024/04/26 03:27:41 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/" vs Path2 "/tmp/032728we/rmdirs/path2/" 2024/04/26 03:27:41 INFO : Removing empty directories 2024/04/26 03:27:41 INFO : subdir: Removing directory 2024/04/26 03:27:41 INFO : subdir: Removing directory 2024/04/26 03:27:41 INFO : Bisync successful 2024/04/26 03:27:41 (13) : test 5. confirm the subdir has been removed on both paths 2024/04/26 03:27:41 (14) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-cucitan6cidobus7hereqoc0/032728we/rmdirs/path1/ 2024/04/26 03:27:41 (15) : list-dirs /tmp/032728we/rmdirs/path2/ bisync_test.go:553: TEST rmdirs PASSED === RUN TestBisyncRemoteLocal/volatile 2024/04/26 03:27:41 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we" for canonical name "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we" 2024/04/26 03:27:41 DEBUG : path1: Making directory 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we: mkdir [/rclone-test-cucitan6cidobus7hereqoc0/032728we/path1] 2024/04/26 03:27:41 DEBUG : Creating backend with remote "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1" 2024/04/26 03:27:41 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:41 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:41 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:41 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:41 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:41 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:41 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1" 2024/04/26 03:27:41 DEBUG : Creating backend with remote "/tmp/032728we/volatile/path2" 2024/04/26 03:27:41 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_volatile/initial" 2024/04/26 03:27:41 DEBUG : Creating backend with remote "/tmp/032728we/initdir/test_volatile-novomik6" 2024/04/26 03:27:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.txt.sidajok0.partial: renamed to: file1.txt 2024/04/26 03:27:41 INFO : file1.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:41 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : Local file system at /tmp/032728we/initdir/test_volatile-novomik6: Waiting for checks to finish 2024/04/26 03:27:41 DEBUG : Local file system at /tmp/032728we/initdir/test_volatile-novomik6: Waiting for transfers to finish 2024/04/26 03:27:41 DEBUG : file2.txt.qifoper5.partial: renamed to: file2.txt 2024/04/26 03:27:41 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 INFO : file2.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file3.txt.qetuyuc6.partial: renamed to: file3.txt 2024/04/26 03:27:41 INFO : file3.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file4.txt.zuciruw0.partial: renamed to: file4.txt 2024/04/26 03:27:41 INFO : file4.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file6.txt.depuwic7.partial: renamed to: file6.txt 2024/04/26 03:27:41 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file5.txt.beyakuc7.partial: renamed to: file5.txt 2024/04/26 03:27:41 INFO : file6.txt: Copied (new) 2024/04/26 03:27:41 INFO : file5.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file7.txt.qoqadaf2.partial: renamed to: file7.txt 2024/04/26 03:27:41 INFO : file7.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : RCLONE_TEST.merodug9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:41 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:41 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file8.txt.qadezut1.partial: renamed to: file8.txt 2024/04/26 03:27:41 INFO : file8.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_volatile/modfiles" 2024/04/26 03:27:41 DEBUG : Creating backend with remote "/tmp/032728we/datadir/test_volatile-zesecod9" 2024/04/26 03:27:41 DEBUG : dummy.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : Local file system at /tmp/032728we/datadir/test_volatile-zesecod9: Waiting for checks to finish 2024/04/26 03:27:41 DEBUG : dummy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : dummy.txt.tudeler3.partial: renamed to: dummy.txt 2024/04/26 03:27:41 DEBUG : Local file system at /tmp/032728we/datadir/test_volatile-zesecod9: Waiting for transfers to finish 2024/04/26 03:27:41 INFO : dummy.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:41 DEBUG : file1.txt.jososis0.partial: renamed to: file1.txt 2024/04/26 03:27:41 INFO : file1.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:41 DEBUG : file10.txt.gufivoc0.partial: renamed to: file10.txt 2024/04/26 03:27:41 INFO : file10.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:41 DEBUG : file11.txt.pemihub7.partial: renamed to: file11.txt 2024/04/26 03:27:41 INFO : file11.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:41 DEBUG : file5L.txt.qalirok7.partial: renamed to: file5L.txt 2024/04/26 03:27:41 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:41 DEBUG : file2.txt.zunanoq3.partial: renamed to: file2.txt 2024/04/26 03:27:41 INFO : file2.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:41 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:41 DEBUG : file6.txt.digumey9.partial: renamed to: file6.txt 2024/04/26 03:27:41 INFO : file6.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file5R.txt.vakokuz2.partial: renamed to: file5R.txt 2024/04/26 03:27:41 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:41 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file7.txt.vuneyoj2.partial: renamed to: file7.txt 2024/04/26 03:27:41 INFO : file7.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1] 2024/04/26 03:27:41 ERROR : : error listing: directory not found 2024/04/26 03:27:41 ERROR : : error listing: directory not found 2024/04/26 03:27:41 checking initFs Local file system at /tmp/032728we/initdir/test_volatile-novomik6 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1] 2024/04/26 03:27:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1/RCLONE_TEST] 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1/file1.txt] 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1/file2.txt] 2024/04/26 03:27:41 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1/file3.txt] 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: Waiting for checks to finish 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: Waiting for transfers to finish 2024/04/26 03:27:41 INFO : file1.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1/file4.txt] 2024/04/26 03:27:41 INFO : file2.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1/file5.txt] 2024/04/26 03:27:41 INFO : file3.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1/file6.txt] 2024/04/26 03:27:41 INFO : file4.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1/file7.txt] 2024/04/26 03:27:41 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: update [/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1/file8.txt] 2024/04/26 03:27:41 INFO : file5.txt: Copied (new) 2024/04/26 03:27:41 INFO : file6.txt: Copied (new) 2024/04/26 03:27:41 INFO : file7.txt: Copied (new) 2024/04/26 03:27:41 INFO : file8.txt: Copied (new) 2024/04/26 03:27:41 checking Path1 hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1: list [/rclone-test-cucitan6cidobus7hereqoc0/032728we/volatile/path1] 2024/04/26 03:27:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.txt.wofecit8.partial: renamed to: file1.txt 2024/04/26 03:27:41 INFO : file1.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : Local file system at /tmp/032728we/volatile/path2: Waiting for checks to finish 2024/04/26 03:27:41 DEBUG : Local file system at /tmp/032728we/volatile/path2: Waiting for transfers to finish 2024/04/26 03:27:41 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file2.txt.fapekat6.partial: renamed to: file2.txt 2024/04/26 03:27:41 INFO : file2.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file4.txt.lopaloz6.partial: renamed to: file4.txt 2024/04/26 03:27:41 INFO : file4.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file3.txt.jajocof9.partial: renamed to: file3.txt 2024/04/26 03:27:41 INFO : file3.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file5.txt.zenanun8.partial: renamed to: file5.txt 2024/04/26 03:27:41 INFO : file5.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:41 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : RCLONE_TEST.pasuxep2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:41 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:41 DEBUG : file7.txt.kopopef6.partial: renamed to: file7.txt 2024/04/26 03:27:41 INFO : file7.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file6.txt.cicociv8.partial: renamed to: file6.txt 2024/04/26 03:27:41 INFO : file6.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file8.txt.bonoten4.partial: renamed to: file8.txt 2024/04/26 03:27:41 INFO : file8.txt: Copied (new) 2024/04/26 03:27:41 checking path2 Local file system at /tmp/032728we/volatile/path2 2024/04/26 03:27:41 (01) : test volatile 2024/04/26 03:27:41 (02) : test initial bisync 2024/04/26 03:27:41 (03) : bisync resync bisync_test.go:921: skipping 'volatile' test on non-local as it requires uploading 100 files 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0: Purge remote 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-cucitan6cidobus7hereqoc0: purge [/rclone-test-cucitan6cidobus7hereqoc0] --- PASS: TestBisyncRemoteLocal (12.77s) --- PASS: TestBisyncRemoteLocal/all_changed (0.66s) --- SKIP: TestBisyncRemoteLocal/backupdir (0.21s) --- PASS: TestBisyncRemoteLocal/basic (0.33s) --- PASS: TestBisyncRemoteLocal/changes (0.63s) --- PASS: TestBisyncRemoteLocal/check_access (0.48s) --- PASS: TestBisyncRemoteLocal/check_access_filters (1.04s) --- PASS: TestBisyncRemoteLocal/check_filename (0.39s) --- PASS: TestBisyncRemoteLocal/check_sync (0.44s) --- PASS: TestBisyncRemoteLocal/compare_all (0.48s) --- PASS: TestBisyncRemoteLocal/createemptysrcdirs (0.59s) --- PASS: TestBisyncRemoteLocal/dry_run (0.66s) --- PASS: TestBisyncRemoteLocal/equal (0.26s) --- PASS: TestBisyncRemoteLocal/ext_paths (0.63s) --- SKIP: TestBisyncRemoteLocal/extended_filenames (0.38s) --- PASS: TestBisyncRemoteLocal/filters (0.33s) --- PASS: TestBisyncRemoteLocal/filtersfile_checks (0.29s) --- PASS: TestBisyncRemoteLocal/ignorelistingchecksum (0.30s) --- PASS: TestBisyncRemoteLocal/max_delete_path1 (0.31s) --- PASS: TestBisyncRemoteLocal/max_delete_path2_force (0.33s) --- PASS: TestBisyncRemoteLocal/nomodtime (0.65s) --- SKIP: TestBisyncRemoteLocal/normalization (0.23s) --- PASS: TestBisyncRemoteLocal/rclone_args (0.68s) --- PASS: TestBisyncRemoteLocal/resolve (0.56s) --- PASS: TestBisyncRemoteLocal/resync (0.59s) --- PASS: TestBisyncRemoteLocal/resync_modes (0.79s) --- PASS: TestBisyncRemoteLocal/rmdirs (0.32s) --- SKIP: TestBisyncRemoteLocal/volatile (0.20s) === RUN TestBisyncLocalRemote 2024/04/26 03:27:41 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8" 2024/04/26 03:27:41 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:41 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:41 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:41 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:41 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:41 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:41 remote: TestHdfs:rclone-test-buqefin8mofibej2lakocub8 === RUN TestBisyncLocalRemote/all_changed 2024/04/26 03:27:41 DEBUG : Creating backend with remote "/tmp/032741ra" 2024/04/26 03:27:41 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/04/26 03:27:41 DEBUG : Creating backend with remote "/tmp/032741ra/all_changed/path1" 2024/04/26 03:27:41 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:41 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:41 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:41 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:41 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:41 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:41 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:41 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:41 DEBUG : path2: Making directory 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:41 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2" 2024/04/26 03:27:41 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:41 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:41 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:41 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:41 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:41 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:41 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2" 2024/04/26 03:27:41 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_all_changed-nokecoq5" 2024/04/26 03:27:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:41 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:41 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:41 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : Local file system at /tmp/032741ra/initdir/test_all_changed-nokecoq5: Waiting for checks to finish 2024/04/26 03:27:41 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : Local file system at /tmp/032741ra/initdir/test_all_changed-nokecoq5: Waiting for transfers to finish 2024/04/26 03:27:41 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy1.txt.jaforep8.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:41 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.copy2.txt.kuqipaf1.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:41 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy4.txt.juyizeh6.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:41 DEBUG : file1.copy3.txt.wuwogac4.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:41 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:41 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy5.txt.nuhiliy1.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:41 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.txt.zucavul9.partial: renamed to: file1.txt 2024/04/26 03:27:41 INFO : file1.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:41 DEBUG : RCLONE_TEST.qunuzab3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:41 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:41 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : subdir/file20.txt.noqepec3.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:41 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:41 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:41 ERROR : : error listing: directory not found 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2] 2024/04/26 03:27:41 ERROR : : error listing: directory not found 2024/04/26 03:27:41 checking initFs Local file system at /tmp/032741ra/initdir/test_all_changed-nokecoq5 2024/04/26 03:27:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:41 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:41 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:41 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : Local file system at /tmp/032741ra/all_changed/path1: Waiting for checks to finish 2024/04/26 03:27:41 DEBUG : Local file system at /tmp/032741ra/all_changed/path1: Waiting for transfers to finish 2024/04/26 03:27:41 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy2.txt.meketiq7.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:41 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.copy1.txt.caqiyat0.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:41 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.copy3.txt.xebecoq9.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:41 DEBUG : file1.copy5.txt.fojetov6.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:41 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:41 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:41 DEBUG : RCLONE_TEST.muwewol8.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:41 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.copy4.txt.vijahev5.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:41 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : subdir/file20.txt.sexuzob5.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:41 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:41 DEBUG : file1.txt.seqovaq3.partial: renamed to: file1.txt 2024/04/26 03:27:41 INFO : file1.txt: Copied (new) 2024/04/26 03:27:41 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:41 checking Path1 Local file system at /tmp/032741ra/all_changed/path1 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2] 2024/04/26 03:27:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : subdir: Making directory 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/subdir] 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/RCLONE_TEST] 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy1.txt] 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy2.txt] 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy3.txt] 2024/04/26 03:27:41 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: Waiting for checks to finish 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: Waiting for transfers to finish 2024/04/26 03:27:41 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy4.txt] 2024/04/26 03:27:41 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy5.txt] 2024/04/26 03:27:41 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.txt] 2024/04/26 03:27:41 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/subdir/file20.txt] 2024/04/26 03:27:41 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:41 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:41 INFO : file1.txt: Copied (new) 2024/04/26 03:27:41 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:41 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2] 2024/04/26 03:27:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/subdir] 2024/04/26 03:27:41 (01) : test all-changed 2024/04/26 03:27:41 (02) : test initial bisync 2024/04/26 03:27:41 (03) : bisync resync 2024/04/26 03:27:41 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:41 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:41 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:41 INFO : Synching Path1 "/tmp/032741ra/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/" 2024/04/26 03:27:41 INFO : Copying Path2 files to Path1 2024/04/26 03:27:41 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:41 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:41 INFO : Resync updating listings 2024/04/26 03:27:41 INFO : Validating listings for Path1 "/tmp/032741ra/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/" 2024/04/26 03:27:41 INFO : Bisync successful 2024/04/26 03:27:41 (04) : test change timestamp on all files except RCLONE_TEST 2024/04/26 03:27:41 (05) : touch-glob 2005-01-02 /tmp/032741ra/all_changed/path1/ file* 2024/04/26 03:27:41 (06) : touch-glob 2005-01-02 /tmp/032741ra/all_changed/path1/subdir file* 2024/04/26 03:27:41 (07) : test sync should pass 2024/04/26 03:27:41 (08) : bisync 2024/04/26 03:27:41 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:41 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:41 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:41 INFO : Synching Path1 "/tmp/032741ra/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/" 2024/04/26 03:27:41 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:41 INFO : Path1 checking for diffs 2024/04/26 03:27:41 INFO : - Path1 File changed: time (newer) - file1.copy1.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (newer) - file1.copy2.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (newer) - file1.copy3.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (newer) - file1.copy4.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (newer) - file1.copy5.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (newer) - file1.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2024/04/26 03:27:41 INFO : Path1: 7 changes:  0 new,  7 modified,  0 deleted 2024/04/26 03:27:41 INFO : (Modified:  7 newer,  0 older) 2024/04/26 03:27:41 INFO : Path2 checking for diffs 2024/04/26 03:27:41 INFO : Applying changes 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy1.txt 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy2.txt 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy3.txt 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy4.txt 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy5.txt 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.txt 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/subdir/file20.txt 2024/04/26 03:27:41 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:41 INFO : file1.copy4.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : file1.copy2.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : file1.copy5.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : file1.copy3.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : file1.copy1.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : Updating listings 2024/04/26 03:27:41 INFO : Validating listings for Path1 "/tmp/032741ra/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/" 2024/04/26 03:27:41 INFO : Bisync successful 2024/04/26 03:27:41 (09) : test change timestamp on all files including RCLONE_TEST 2024/04/26 03:27:41 (10) : touch-glob 2004-01-02 /tmp/032741ra/all_changed/path1/ * 2024/04/26 03:27:41 (11) : touch-glob 2004-01-02 /tmp/032741ra/all_changed/path1/subdir * 2024/04/26 03:27:41 (12) : test sync should fail 2024/04/26 03:27:41 (13) : bisync 2024/04/26 03:27:41 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:41 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:41 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:41 INFO : Synching Path1 "/tmp/032741ra/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/" 2024/04/26 03:27:41 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:41 INFO : Path1 checking for diffs 2024/04/26 03:27:41 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - file1.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2024/04/26 03:27:41 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2024/04/26 03:27:41 INFO : (Modified:  1 newer,  7 older) 2024/04/26 03:27:41 INFO : Path2 checking for diffs 2024/04/26 03:27:41 ERROR : Safety abort: all files were changed on Path1 "/tmp/032741ra/all_changed/path1/". Run with --force if desired. 2024/04/26 03:27:41 NOTICE: Bisync aborted. Please try again. 2024/04/26 03:27:41 Bisync error: all files were changed 2024/04/26 03:27:41 (14) : test sync with force should pass 2024/04/26 03:27:41 (15) : bisync force 2024/04/26 03:27:41 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:41 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:41 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:41 INFO : Synching Path1 "/tmp/032741ra/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/" 2024/04/26 03:27:41 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:41 INFO : Path1 checking for diffs 2024/04/26 03:27:41 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - file1.txt 2024/04/26 03:27:41 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2024/04/26 03:27:41 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2024/04/26 03:27:41 INFO : (Modified:  1 newer,  7 older) 2024/04/26 03:27:41 INFO : Path2 checking for diffs 2024/04/26 03:27:41 INFO : Applying changes 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/RCLONE_TEST 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy1.txt 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy2.txt 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy3.txt 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy4.txt 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.copy5.txt 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/file1.txt 2024/04/26 03:27:41 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/subdir/file20.txt 2024/04/26 03:27:41 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:41 INFO : file1.copy1.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : file1.copy2.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : file1.copy4.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : RCLONE_TEST: Copied (replaced existing) 2024/04/26 03:27:41 INFO : file1.copy3.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : file1.copy5.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:41 INFO : Updating listings 2024/04/26 03:27:41 INFO : Validating listings for Path1 "/tmp/032741ra/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/all_changed/path2/" 2024/04/26 03:27:41 INFO : Bisync successful bisync_test.go:553: TEST all_changed PASSED === RUN TestBisyncLocalRemote/backupdir 2024/04/26 03:27:42 DEBUG : Creating backend with remote "/tmp/032741ra/backupdir/path1" 2024/04/26 03:27:42 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:42 DEBUG : path2: Making directory 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:42 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2" 2024/04/26 03:27:42 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:42 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:42 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:42 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:42 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:42 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:42 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2" 2024/04/26 03:27:42 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_backupdir-fequmoq1" 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.txt.giharid6.partial: renamed to: file1.txt 2024/04/26 03:27:42 INFO : file1.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/initdir/test_backupdir-fequmoq1: Waiting for checks to finish 2024/04/26 03:27:42 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/initdir/test_backupdir-fequmoq1: Waiting for transfers to finish 2024/04/26 03:27:42 DEBUG : file4.txt.bogozic9.partial: renamed to: file4.txt 2024/04/26 03:27:42 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 INFO : file4.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file2.txt.vorodad6.partial: renamed to: file2.txt 2024/04/26 03:27:42 INFO : file2.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file5.txt.dayovoq2.partial: renamed to: file5.txt 2024/04/26 03:27:42 INFO : file5.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:42 DEBUG : file3.txt.wefuwiv6.partial: renamed to: file3.txt 2024/04/26 03:27:42 INFO : file3.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : RCLONE_TEST.cemafic1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:42 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:42 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file6.txt.havopey3.partial: renamed to: file6.txt 2024/04/26 03:27:42 INFO : file6.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file7.txt.tanaxaq4.partial: renamed to: file7.txt 2024/04/26 03:27:42 INFO : file7.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file8.txt.rozekic3.partial: renamed to: file8.txt 2024/04/26 03:27:42 INFO : file8.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_backupdir-wefajov9" 2024/04/26 03:27:42 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/datadir/test_backupdir-wefajov9: Waiting for checks to finish 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/datadir/test_backupdir-wefajov9: Waiting for transfers to finish 2024/04/26 03:27:42 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:42 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:42 DEBUG : file10.txt.casoleq2.partial: renamed to: file10.txt 2024/04/26 03:27:42 INFO : file10.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file1.txt.taviyes0.partial: renamed to: file1.txt 2024/04/26 03:27:42 INFO : file1.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:42 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:42 DEBUG : file2.txt.fimeqal4.partial: renamed to: file2.txt 2024/04/26 03:27:42 INFO : file2.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file11.txt.zileviv4.partial: renamed to: file11.txt 2024/04/26 03:27:42 INFO : file11.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:42 DEBUG : file5L.txt.sidutaf4.partial: renamed to: file5L.txt 2024/04/26 03:27:42 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:42 DEBUG : file5R.txt.jarahuc3.partial: renamed to: file5R.txt 2024/04/26 03:27:42 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:42 DEBUG : file6.txt.loyewig6.partial: renamed to: file6.txt 2024/04/26 03:27:42 INFO : file6.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:42 DEBUG : file7.txt.jahuwab5.partial: renamed to: file7.txt 2024/04/26 03:27:42 INFO : file7.txt: Copied (new) 2024/04/26 03:27:42 ERROR : : error listing: directory not found 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2] 2024/04/26 03:27:42 ERROR : : error listing: directory not found 2024/04/26 03:27:42 checking initFs Local file system at /tmp/032741ra/initdir/test_backupdir-fequmoq1 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.txt.pijucaq3.partial: renamed to: file1.txt 2024/04/26 03:27:42 INFO : file1.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/backupdir/path1: Waiting for checks to finish 2024/04/26 03:27:42 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file4.txt.danukiv5.partial: renamed to: file4.txt 2024/04/26 03:27:42 INFO : file4.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:42 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : RCLONE_TEST.xunuwik7.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:42 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:42 DEBUG : file5.txt.yubowoq4.partial: renamed to: file5.txt 2024/04/26 03:27:42 INFO : file5.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file3.txt.lonufil2.partial: renamed to: file3.txt 2024/04/26 03:27:42 INFO : file3.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file7.txt.sirokan4.partial: renamed to: file7.txt 2024/04/26 03:27:42 INFO : file7.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file2.txt.yocehih9.partial: renamed to: file2.txt 2024/04/26 03:27:42 INFO : file2.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file8.txt.hiwilib9.partial: renamed to: file8.txt 2024/04/26 03:27:42 INFO : file8.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/backupdir/path1: Waiting for transfers to finish 2024/04/26 03:27:42 DEBUG : file6.txt.socokaf5.partial: renamed to: file6.txt 2024/04/26 03:27:42 INFO : file6.txt: Copied (new) 2024/04/26 03:27:42 checking Path1 Local file system at /tmp/032741ra/backupdir/path1 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2] 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2/RCLONE_TEST] 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2/file1.txt] 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2/file2.txt] 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2/file3.txt] 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: Waiting for checks to finish 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: Waiting for transfers to finish 2024/04/26 03:27:42 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2/file4.txt] 2024/04/26 03:27:42 INFO : file1.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2/file5.txt] 2024/04/26 03:27:42 INFO : file3.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2/file6.txt] 2024/04/26 03:27:42 INFO : file2.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2/file7.txt] 2024/04/26 03:27:42 INFO : file4.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2/file8.txt] 2024/04/26 03:27:42 INFO : file5.txt: Copied (new) 2024/04/26 03:27:42 INFO : file6.txt: Copied (new) 2024/04/26 03:27:42 INFO : file7.txt: Copied (new) 2024/04/26 03:27:42 INFO : file8.txt: Copied (new) 2024/04/26 03:27:42 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/backupdir/path2] 2024/04/26 03:27:42 (01) : test backupdir 2024/04/26 03:27:42 (02) : test initial bisync 2024/04/26 03:27:42 (03) : bisync resync backupdir1=/tmp/032741ra/workdir/backupdirs/backupdir1 backupdir2=/tmp/032741ra/workdir/backupdirs/backupdir2 bisync_test.go:918: backupdir test currently only works on local (it uses the workdir) === RUN TestBisyncLocalRemote/basic 2024/04/26 03:27:42 DEBUG : Creating backend with remote "/tmp/032741ra/basic/path1" 2024/04/26 03:27:42 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:42 DEBUG : path2: Making directory 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:42 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2" 2024/04/26 03:27:42 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:42 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:42 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:42 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:42 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:42 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:42 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2" 2024/04/26 03:27:42 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_basic-cegorad6" 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.copy1.txt.yeloguc7.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:42 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.copy2.txt.devadup6.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:42 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file1.copy3.txt.kijasak5.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:42 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:42 DEBUG : file1.copy4.txt.pewimif9.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:42 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:42 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:42 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:42 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : RCLONE_TEST.xedutiv1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:42 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:42 DEBUG : file1.txt.vuxihur8.partial: renamed to: file1.txt 2024/04/26 03:27:42 INFO : file1.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/initdir/test_basic-cegorad6: Waiting for checks to finish 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/initdir/test_basic-cegorad6: Waiting for transfers to finish 2024/04/26 03:27:42 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : subdir/file20.txt.lonatoh5.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:42 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.copy5.txt.kitirog6.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:42 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:42 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:42 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_basic-gejezux9" 2024/04/26 03:27:42 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/datadir/test_basic-gejezux9: Waiting for checks to finish 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/datadir/test_basic-gejezux9: Waiting for transfers to finish 2024/04/26 03:27:42 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:42 DEBUG : file1.txt.mequxey7.partial: renamed to: file1.txt 2024/04/26 03:27:42 INFO : file1.txt: Copied (new) 2024/04/26 03:27:42 ERROR : : error listing: directory not found 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2] 2024/04/26 03:27:42 ERROR : : error listing: directory not found 2024/04/26 03:27:42 checking initFs Local file system at /tmp/032741ra/initdir/test_basic-cegorad6 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:42 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:42 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:42 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/basic/path1: Waiting for checks to finish 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/basic/path1: Waiting for transfers to finish 2024/04/26 03:27:42 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.copy1.txt.cuceroz5.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:42 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : RCLONE_TEST.tukequj6.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:42 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:42 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.copy2.txt.luwunup1.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:42 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.copy3.txt.nuzokux3.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:42 DEBUG : file1.copy4.txt.vuqixog7.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:42 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file1.copy5.txt.romixup1.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:42 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:42 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : subdir/file20.txt.vapuwaq9.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:42 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file1.txt.mitadap8.partial: renamed to: file1.txt 2024/04/26 03:27:42 INFO : file1.txt: Copied (new) 2024/04/26 03:27:42 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:42 checking Path1 Local file system at /tmp/032741ra/basic/path1 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2] 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : subdir: Making directory 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/subdir] 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/RCLONE_TEST] 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/file1.copy1.txt] 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/file1.copy2.txt] 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/file1.copy3.txt] 2024/04/26 03:27:42 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: Waiting for checks to finish 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: Waiting for transfers to finish 2024/04/26 03:27:42 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/file1.copy4.txt] 2024/04/26 03:27:42 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/file1.copy5.txt] 2024/04/26 03:27:42 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/file1.txt] 2024/04/26 03:27:42 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/subdir/file20.txt] 2024/04/26 03:27:42 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:42 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:42 INFO : file1.txt: Copied (new) 2024/04/26 03:27:42 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:42 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2] 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/subdir] 2024/04/26 03:27:42 (01) : test basic 2024/04/26 03:27:42 (02) : test initial bisync 2024/04/26 03:27:42 (03) : bisync resync 2024/04/26 03:27:42 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:42 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:42 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:42 INFO : Synching Path1 "/tmp/032741ra/basic/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/" 2024/04/26 03:27:42 INFO : Copying Path2 files to Path1 2024/04/26 03:27:42 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:42 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:42 INFO : Resync updating listings 2024/04/26 03:27:42 INFO : Validating listings for Path1 "/tmp/032741ra/basic/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/" 2024/04/26 03:27:42 INFO : Bisync successful 2024/04/26 03:27:42 (04) : test place newer files on both paths 2024/04/26 03:27:42 (05) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_basic-gejezux9/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/ 2024/04/26 03:27:42 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:42 (06) : copy-as /tmp/032741ra/datadir/test_basic-gejezux9/file1.txt /tmp/032741ra/basic/path1/subdir file20.txt 2024/04/26 03:27:42 INFO : file1.txt: Copied (replaced existing) to: file20.txt 2024/04/26 03:27:42 (07) : test bisync run 2024/04/26 03:27:42 (08) : bisync 2024/04/26 03:27:42 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:42 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:42 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:42 INFO : Synching Path1 "/tmp/032741ra/basic/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/" 2024/04/26 03:27:42 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:42 INFO : Path1 checking for diffs 2024/04/26 03:27:42 INFO : - Path1 File changed: size (larger), time (newer) - subdir/file20.txt 2024/04/26 03:27:42 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:42 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:42 INFO : Path2 checking for diffs 2024/04/26 03:27:42 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:42 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:42 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:42 INFO : Applying changes 2024/04/26 03:27:42 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/subdir/file20.txt 2024/04/26 03:27:42 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/basic/path1/file1.txt 2024/04/26 03:27:42 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:42 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:42 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:42 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:42 INFO : Updating listings 2024/04/26 03:27:42 INFO : Validating listings for Path1 "/tmp/032741ra/basic/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/basic/path2/" 2024/04/26 03:27:42 INFO : Bisync successful bisync_test.go:553: TEST basic PASSED === RUN TestBisyncLocalRemote/changes 2024/04/26 03:27:42 DEBUG : Creating backend with remote "/tmp/032741ra/changes/path1" 2024/04/26 03:27:42 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:42 DEBUG : path2: Making directory 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:42 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2" 2024/04/26 03:27:42 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:42 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:42 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:42 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:42 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:42 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:42 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2" 2024/04/26 03:27:42 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_changes-buvozen5" 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/initdir/test_changes-buvozen5: Waiting for checks to finish 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/initdir/test_changes-buvozen5: Waiting for transfers to finish 2024/04/26 03:27:42 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file3.txt.musofep7.partial: renamed to: file3.txt 2024/04/26 03:27:42 INFO : file3.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file2.txt.vowefas1.partial: renamed to: file2.txt 2024/04/26 03:27:42 INFO : file2.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:42 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file4.txt.netidov6.partial: renamed to: file4.txt 2024/04/26 03:27:42 INFO : file4.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file6.txt.lixabed5.partial: renamed to: file6.txt 2024/04/26 03:27:42 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 INFO : file6.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file5.txt.nosumoy9.partial: renamed to: file5.txt 2024/04/26 03:27:42 INFO : file5.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file7.txt.tovayog3.partial: renamed to: file7.txt 2024/04/26 03:27:42 INFO : file7.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : RCLONE_TEST.roloxix2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:42 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:42 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.txt.jigeway2.partial: renamed to: file1.txt 2024/04/26 03:27:42 INFO : file1.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file8.txt.foloyiz5.partial: renamed to: file8.txt 2024/04/26 03:27:42 INFO : file8.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_changes-bilenat8" 2024/04/26 03:27:42 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/datadir/test_changes-bilenat8: Waiting for checks to finish 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/datadir/test_changes-bilenat8: Waiting for transfers to finish 2024/04/26 03:27:42 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:42 DEBUG : file1.txt.sayumoc0.partial: renamed to: file1.txt 2024/04/26 03:27:42 INFO : file1.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:42 DEBUG : file10.txt.jagoteh0.partial: renamed to: file10.txt 2024/04/26 03:27:42 INFO : file10.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:42 DEBUG : file2.txt.lejeceb7.partial: renamed to: file2.txt 2024/04/26 03:27:42 INFO : file2.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:42 DEBUG : file5L.txt.yeqefij5.partial: renamed to: file5L.txt 2024/04/26 03:27:42 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:42 DEBUG : file5R.txt.todiyor2.partial: renamed to: file5R.txt 2024/04/26 03:27:42 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:42 DEBUG : file6.txt.ponihem0.partial: renamed to: file6.txt 2024/04/26 03:27:42 INFO : file6.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:42 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:42 DEBUG : file11.txt.yesalan1.partial: renamed to: file11.txt 2024/04/26 03:27:42 INFO : file11.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file7.txt.xabidis0.partial: renamed to: file7.txt 2024/04/26 03:27:42 INFO : file7.txt: Copied (new) 2024/04/26 03:27:42 ERROR : : error listing: directory not found 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2] 2024/04/26 03:27:42 ERROR : : error listing: directory not found 2024/04/26 03:27:42 checking initFs Local file system at /tmp/032741ra/initdir/test_changes-buvozen5 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/changes/path1: Waiting for checks to finish 2024/04/26 03:27:42 DEBUG : Local file system at /tmp/032741ra/changes/path1: Waiting for transfers to finish 2024/04/26 03:27:42 DEBUG : file2.txt.dupexoj1.partial: renamed to: file2.txt 2024/04/26 03:27:42 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 INFO : file2.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file1.txt.zewomeb7.partial: renamed to: file1.txt 2024/04/26 03:27:42 INFO : file1.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file3.txt.radebas2.partial: renamed to: file3.txt 2024/04/26 03:27:42 INFO : file3.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:42 DEBUG : RCLONE_TEST.puqorif0.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:42 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:42 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file5.txt.mabujav6.partial: renamed to: file5.txt 2024/04/26 03:27:42 INFO : file5.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file6.txt.luyetaf3.partial: renamed to: file6.txt 2024/04/26 03:27:42 INFO : file6.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file4.txt.xareviz7.partial: renamed to: file4.txt 2024/04/26 03:27:42 INFO : file4.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file8.txt.xaxezuh3.partial: renamed to: file8.txt 2024/04/26 03:27:42 INFO : file8.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:42 DEBUG : file7.txt.cehezoy2.partial: renamed to: file7.txt 2024/04/26 03:27:42 INFO : file7.txt: Copied (new) 2024/04/26 03:27:42 checking Path1 Local file system at /tmp/032741ra/changes/path1 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2] 2024/04/26 03:27:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/RCLONE_TEST] 2024/04/26 03:27:42 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file2.txt] 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file1.txt] 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file3.txt] 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: Waiting for checks to finish 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: Waiting for transfers to finish 2024/04/26 03:27:42 INFO : file2.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file4.txt] 2024/04/26 03:27:42 INFO : file1.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file5.txt] 2024/04/26 03:27:42 INFO : file3.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file6.txt] 2024/04/26 03:27:42 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file7.txt] 2024/04/26 03:27:42 INFO : file4.txt: Copied (new) 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file8.txt] 2024/04/26 03:27:42 INFO : file5.txt: Copied (new) 2024/04/26 03:27:42 INFO : file6.txt: Copied (new) 2024/04/26 03:27:42 INFO : file7.txt: Copied (new) 2024/04/26 03:27:42 INFO : file8.txt: Copied (new) 2024/04/26 03:27:42 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2 2024/04/26 03:27:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2] 2024/04/26 03:27:42 (01) : test changes 2024/04/26 03:27:42 (02) : test initial bisync 2024/04/26 03:27:42 (03) : bisync resync 2024/04/26 03:27:42 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:42 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:42 INFO : Synching Path1 "/tmp/032741ra/changes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/" 2024/04/26 03:27:42 INFO : Copying Path2 files to Path1 2024/04/26 03:27:42 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:42 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:42 INFO : Resync updating listings 2024/04/26 03:27:42 INFO : Validating listings for Path1 "/tmp/032741ra/changes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/" 2024/04/26 03:27:42 INFO : Bisync successful 2024/04/26 03:27:42 (04) : test make modifications on both paths 2024/04/26 03:27:42 (05) : test new on path2 - file10 2024/04/26 03:27:42 (06) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_changes-bilenat8/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/ 2024/04/26 03:27:42 INFO : file10.txt: Copied (new) 2024/04/26 03:27:42 (07) : test newer on path2 - file1 2024/04/26 03:27:42 (08) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_changes-bilenat8/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/ 2024/04/26 03:27:42 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:42 (09) : test new on path1 - file11 2024/04/26 03:27:42 (10) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_changes-bilenat8/file11.txt /tmp/032741ra/changes/path1/ 2024/04/26 03:27:42 INFO : file11.txt: Copied (new) 2024/04/26 03:27:42 (11) : test newer on path1 - file2 2024/04/26 03:27:42 (12) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_changes-bilenat8/file2.txt /tmp/032741ra/changes/path1/ 2024/04/26 03:27:42 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:42 (13) : test deleted on path2 - file3 2024/04/26 03:27:42 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file3.txt 2024/04/26 03:27:42 INFO : file3.txt: Deleted 2024/04/26 03:27:42 (15) : test deleted on path1 - file4 2024/04/26 03:27:42 (16) : delete-file /tmp/032741ra/changes/path1/file4.txt 2024/04/26 03:27:42 INFO : file4.txt: Deleted 2024/04/26 03:27:42 (17) : test deleted on both paths - file8 2024/04/26 03:27:42 (18) : delete-file /tmp/032741ra/changes/path1/file8.txt 2024/04/26 03:27:42 INFO : file8.txt: Deleted 2024/04/26 03:27:42 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file8.txt 2024/04/26 03:27:42 INFO : file8.txt: Deleted 2024/04/26 03:27:42 (20) : test changed on both paths - file5 (file5R, file5L) 2024/04/26 03:27:42 (21) : touch-glob 2001-01-02 /tmp/032741ra/datadir/test_changes-bilenat8/ file5R.txt 2024/04/26 03:27:42 (22) : copy-as /tmp/032741ra/datadir/test_changes-bilenat8/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/ file5.txt 2024/04/26 03:27:42 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:42 (23) : touch-glob 2001-03-04 /tmp/032741ra/datadir/test_changes-bilenat8/ file5L.txt 2024/04/26 03:27:42 (24) : copy-as /tmp/032741ra/datadir/test_changes-bilenat8/file5L.txt /tmp/032741ra/changes/path1/ file5.txt 2024/04/26 03:27:42 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:42 (25) : test newer on path2 and deleted on path1 - file6 2024/04/26 03:27:42 (26) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_changes-bilenat8/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/ 2024/04/26 03:27:42 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:27:42 (27) : delete-file /tmp/032741ra/changes/path1/file6.txt 2024/04/26 03:27:42 INFO : file6.txt: Deleted 2024/04/26 03:27:42 (28) : test newer on path1 and deleted on path2 - file7 2024/04/26 03:27:42 (29) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_changes-bilenat8/file7.txt /tmp/032741ra/changes/path1/ 2024/04/26 03:27:42 INFO : file7.txt: Copied (replaced existing) 2024/04/26 03:27:42 (30) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file7.txt 2024/04/26 03:27:42 INFO : file7.txt: Deleted 2024/04/26 03:27:42 (31) : test bisync run 2024/04/26 03:27:42 (32) : bisync 2024/04/26 03:27:42 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:42 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:42 INFO : Synching Path1 "/tmp/032741ra/changes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/" 2024/04/26 03:27:42 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:42 INFO : Path1 checking for diffs 2024/04/26 03:27:42 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:42 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:42 INFO : - Path1 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:42 INFO : - Path1 File was deleted - file6.txt 2024/04/26 03:27:42 INFO : - Path1 File changed: size (larger), time (newer) - file7.txt 2024/04/26 03:27:42 INFO : - Path1 File was deleted - file8.txt 2024/04/26 03:27:42 INFO : - Path1 File is new - file11.txt 2024/04/26 03:27:42 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:42 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:42 INFO : Path2 checking for diffs 2024/04/26 03:27:42 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:42 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:42 INFO : - Path2 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:42 INFO : - Path2 File changed: size (larger), time (newer) - file6.txt 2024/04/26 03:27:42 INFO : - Path2 File was deleted - file7.txt 2024/04/26 03:27:42 INFO : - Path2 File was deleted - file8.txt 2024/04/26 03:27:42 INFO : - Path2 File is new - file10.txt 2024/04/26 03:27:42 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:42 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:42 INFO : Applying changes 2024/04/26 03:27:42 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:42 INFO : Checking potential conflicts... 2024/04/26 03:27:42 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: 1 differences found 2024/04/26 03:27:42 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2: 1 errors while checking 2024/04/26 03:27:42 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:42 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file11.txt 2024/04/26 03:27:42 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file2.txt 2024/04/26 03:27:42 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file4.txt 2024/04/26 03:27:42 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:27:42 NOTICE: - Path1 Renaming Path1 copy - /tmp/032741ra/changes/path1/file5.txt.conflict1 2024/04/26 03:27:42 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/04/26 03:27:42 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file5.txt.conflict1 2024/04/26 03:27:42 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file5.txt.conflict2 2024/04/26 03:27:42 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/04/26 03:27:42 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/changes/path1/file5.txt.conflict2 2024/04/26 03:27:42 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/changes/path1/file6.txt 2024/04/26 03:27:42 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/file7.txt 2024/04/26 03:27:42 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/changes/path1/file1.txt 2024/04/26 03:27:42 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/changes/path1/file10.txt 2024/04/26 03:27:42 INFO : - Path1 Queue delete - /tmp/032741ra/changes/path1/file3.txt 2024/04/26 03:27:42 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:42 INFO : file10.txt: Copied (new) 2024/04/26 03:27:42 INFO : file6.txt: Copied (new) 2024/04/26 03:27:42 INFO : file5.txt.conflict2: Copied (new) 2024/04/26 03:27:42 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:42 INFO : file3.txt: Deleted 2024/04/26 03:27:42 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:42 INFO : file5.txt.conflict1: Copied (new) 2024/04/26 03:27:42 INFO : file11.txt: Copied (new) 2024/04/26 03:27:43 INFO : file7.txt: Copied (new) 2024/04/26 03:27:43 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:43 INFO : file4.txt: Deleted 2024/04/26 03:27:43 INFO : Updating listings 2024/04/26 03:27:43 INFO : Validating listings for Path1 "/tmp/032741ra/changes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/changes/path2/" 2024/04/26 03:27:43 INFO : Bisync successful bisync_test.go:553: TEST changes PASSED === RUN TestBisyncLocalRemote/check_access 2024/04/26 03:27:43 DEBUG : Creating backend with remote "/tmp/032741ra/check_access/path1" 2024/04/26 03:27:43 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:43 DEBUG : path2: Making directory 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:43 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2" 2024/04/26 03:27:43 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:43 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:43 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:43 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:43 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:43 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:43 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2" 2024/04/26 03:27:43 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_check_access-kozemac3" 2024/04/26 03:27:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:43 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : file2.txt.punuvik5.partial: renamed to: file2.txt 2024/04/26 03:27:43 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 INFO : file2.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : RCLONE_TEST.wohitek0.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:43 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:43 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : file1.txt.cibuxos1.partial: renamed to: file1.txt 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 INFO : file1.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : Local file system at /tmp/032741ra/initdir/test_check_access-kozemac3: Waiting for checks to finish 2024/04/26 03:27:43 DEBUG : Local file system at /tmp/032741ra/initdir/test_check_access-kozemac3: Waiting for transfers to finish 2024/04/26 03:27:43 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : file4.txt.paqocug5.partial: renamed to: file4.txt 2024/04/26 03:27:43 INFO : file4.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : file3.txt.zujovez2.partial: renamed to: file3.txt 2024/04/26 03:27:43 INFO : file3.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir/file20.txt.niwegub8.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:43 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST.kiwalif3.partial: renamed to: subdir/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_check_access-pedozam2" 2024/04/26 03:27:43 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : Local file system at /tmp/032741ra/datadir/test_check_access-pedozam2: Waiting for checks to finish 2024/04/26 03:27:43 DEBUG : Local file system at /tmp/032741ra/datadir/test_check_access-pedozam2: Waiting for transfers to finish 2024/04/26 03:27:43 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:27:43 DEBUG : hold.txt.wofanid6.partial: renamed to: hold.txt 2024/04/26 03:27:43 INFO : hold.txt: Copied (new) 2024/04/26 03:27:43 ERROR : : error listing: directory not found 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2] 2024/04/26 03:27:43 ERROR : : error listing: directory not found 2024/04/26 03:27:43 checking initFs Local file system at /tmp/032741ra/initdir/test_check_access-kozemac3 2024/04/26 03:27:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:43 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : file1.txt.sizipad1.partial: renamed to: file1.txt 2024/04/26 03:27:43 INFO : file1.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : file2.txt.waxilun3.partial: renamed to: file2.txt 2024/04/26 03:27:43 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 INFO : file2.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : file3.txt.cokibuq3.partial: renamed to: file3.txt 2024/04/26 03:27:43 INFO : file3.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : file4.txt.jayejev1.partial: renamed to: file4.txt 2024/04/26 03:27:43 INFO : file4.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : RCLONE_TEST.jatohuf4.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:43 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : Local file system at /tmp/032741ra/check_access/path1: Waiting for checks to finish 2024/04/26 03:27:43 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : Local file system at /tmp/032741ra/check_access/path1: Waiting for transfers to finish 2024/04/26 03:27:43 DEBUG : subdir/file20.txt.cogovah6.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:43 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST.cepaciq6.partial: renamed to: subdir/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 checking Path1 Local file system at /tmp/032741ra/check_access/path1 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2] 2024/04/26 03:27:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir: Making directory 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/subdir] 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/file1.txt] 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/RCLONE_TEST] 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/file2.txt] 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/file3.txt] 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: Waiting for checks to finish 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: Waiting for transfers to finish 2024/04/26 03:27:43 INFO : file2.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/file4.txt] 2024/04/26 03:27:43 INFO : file1.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/subdir/RCLONE_TEST] 2024/04/26 03:27:43 INFO : file3.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/subdir/file20.txt] 2024/04/26 03:27:43 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 INFO : file4.txt: Copied (new) 2024/04/26 03:27:43 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:43 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2] 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/subdir] 2024/04/26 03:27:43 (01) : test check-access 2024/04/26 03:27:43 (02) : test initial bisync 2024/04/26 03:27:43 (03) : bisync resync 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:43 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:43 INFO : Synching Path1 "/tmp/032741ra/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Copying Path2 files to Path1 2024/04/26 03:27:43 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:43 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:43 INFO : Resync updating listings 2024/04/26 03:27:43 INFO : Validating listings for Path1 "/tmp/032741ra/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Bisync successful 2024/04/26 03:27:43 (04) : test 1. see that check-access passes with the initial setup 2024/04/26 03:27:43 (05) : bisync check-access 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:43 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:43 INFO : Synching Path1 "/tmp/032741ra/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:43 INFO : Path1 checking for diffs 2024/04/26 03:27:43 INFO : Path2 checking for diffs 2024/04/26 03:27:43 INFO : Checking access health 2024/04/26 03:27:43 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:43 INFO : No changes found 2024/04/26 03:27:43 INFO : Updating listings 2024/04/26 03:27:43 INFO : Validating listings for Path1 "/tmp/032741ra/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Bisync successful 2024/04/26 03:27:43 (06) : test 2. delete the path2 subdir RCLONE_TEST and run sync. should fail critical. 2024/04/26 03:27:43 (07) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/subdir/RCLONE_TEST 2024/04/26 03:27:43 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:43 (08) : bisync check-access 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:43 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:43 INFO : Synching Path1 "/tmp/032741ra/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:43 INFO : Path1 checking for diffs 2024/04/26 03:27:43 INFO : Path2 checking for diffs 2024/04/26 03:27:43 INFO : - Path2 File was deleted - subdir/RCLONE_TEST 2024/04/26 03:27:43 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:43 INFO : Checking access health 2024/04/26 03:27:43 ERROR : Access test failed: Path1 count 2, Path2 count 1 - RCLONE_TEST 2024/04/26 03:27:43 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/RCLONE_TEST 2024/04/26 03:27:43 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:43 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:43 Bisync error: bisync aborted 2024/04/26 03:27:43 (09) : copy-listings path2-missing 2024/04/26 03:27:43 (10) : test 3. put the path2 subdir RCLONE_TEST back, resync. 2024/04/26 03:27:43 (11) : copy-file /tmp/032741ra/check_access/path1/subdir/RCLONE_TEST TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/ 2024/04/26 03:27:43 (12) : bisync resync 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:43 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:43 INFO : Synching Path1 "/tmp/032741ra/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Copying Path2 files to Path1 2024/04/26 03:27:43 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:43 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:43 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 INFO : Resync updating listings 2024/04/26 03:27:43 INFO : Validating listings for Path1 "/tmp/032741ra/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Bisync successful 2024/04/26 03:27:43 (13) : test 4. run sync with check-access. should pass. 2024/04/26 03:27:43 (14) : bisync check-access 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:43 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:43 INFO : Synching Path1 "/tmp/032741ra/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:43 INFO : Path1 checking for diffs 2024/04/26 03:27:43 INFO : Path2 checking for diffs 2024/04/26 03:27:43 INFO : Checking access health 2024/04/26 03:27:43 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:43 INFO : No changes found 2024/04/26 03:27:43 INFO : Updating listings 2024/04/26 03:27:43 INFO : Validating listings for Path1 "/tmp/032741ra/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Bisync successful 2024/04/26 03:27:43 (15) : test 5. delete path1 top level RCLONE_TEST, run sync. should fail critical. 2024/04/26 03:27:43 (16) : delete-file /tmp/032741ra/check_access/path1/RCLONE_TEST 2024/04/26 03:27:43 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:43 (17) : bisync check-access 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:43 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:43 INFO : Synching Path1 "/tmp/032741ra/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:43 INFO : Path1 checking for diffs 2024/04/26 03:27:43 INFO : - Path1 File was deleted - RCLONE_TEST 2024/04/26 03:27:43 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:43 INFO : Path2 checking for diffs 2024/04/26 03:27:43 INFO : Checking access health 2024/04/26 03:27:43 ERROR : Access test failed: Path1 count 1, Path2 count 2 - RCLONE_TEST 2024/04/26 03:27:43 ERROR : -  Access test failed: Path2 file not found in Path1 - RCLONE_TEST 2024/04/26 03:27:43 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:43 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:43 Bisync error: bisync aborted 2024/04/26 03:27:43 (18) : copy-listings path1-missing 2024/04/26 03:27:43 (19) : test 6. run again. should fail critical due to missing listings. 2024/04/26 03:27:43 (20) : bisync check-access 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:43 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:43 INFO : Synching Path1 "/tmp/032741ra/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/032741ra/workdir/tmp_032741ra_check_access_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_check_access_path2.path1.lst Path2: /tmp/032741ra/workdir/tmp_032741ra_check_access_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_check_access_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/032741ra/workdir" 2024/04/26 03:27:43 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:43 Bisync error: bisync aborted 2024/04/26 03:27:43 (21) : move-listings missing-listings 2024/04/26 03:27:43 (22) : test 7. run resync, which will copy the path2 top level back to path1. 2024/04/26 03:27:43 (23) : bisync resync 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:43 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:43 INFO : Synching Path1 "/tmp/032741ra/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Copying Path2 files to Path1 2024/04/26 03:27:43 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:43 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:43 INFO : Resync updating listings 2024/04/26 03:27:43 INFO : Validating listings for Path1 "/tmp/032741ra/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Bisync successful 2024/04/26 03:27:43 (24) : test 8. run sync with --check-access. should pass. 2024/04/26 03:27:43 (25) : bisync check-access 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:43 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:43 INFO : Synching Path1 "/tmp/032741ra/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:43 INFO : Path1 checking for diffs 2024/04/26 03:27:43 INFO : Path2 checking for diffs 2024/04/26 03:27:43 INFO : Checking access health 2024/04/26 03:27:43 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:43 INFO : No changes found 2024/04/26 03:27:43 INFO : Updating listings 2024/04/26 03:27:43 INFO : Validating listings for Path1 "/tmp/032741ra/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access/path2/" 2024/04/26 03:27:43 INFO : Bisync successful bisync_test.go:553: TEST check_access PASSED === RUN TestBisyncLocalRemote/check_access_filters 2024/04/26 03:27:43 DEBUG : Creating backend with remote "/tmp/032741ra/check_access_filters/path1" 2024/04/26 03:27:43 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:43 DEBUG : path2: Making directory 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:43 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2" 2024/04/26 03:27:43 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:43 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:43 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:43 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:43 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:43 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:43 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2" 2024/04/26 03:27:43 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_check_access_filters-yezedeb6" 2024/04/26 03:27:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:43 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:43 DEBUG : subdir-not: Making directory with metadata 2024/04/26 03:27:43 INFO : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not 2024/04/26 03:27:43 DEBUG : subdirX: Making directory with metadata 2024/04/26 03:27:43 INFO : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdirX", newDst=subdirX 2024/04/26 03:27:43 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1: Making directory with metadata 2024/04/26 03:27:43 INFO : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1 2024/04/26 03:27:43 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : file2.txt.jukoyev7.partial: renamed to: file2.txt 2024/04/26 03:27:43 INFO : file2.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : RCLONE_TEST.gocobic5.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:43 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirA: Making directory with metadata 2024/04/26 03:27:43 INFO : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA 2024/04/26 03:27:43 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : file3.txt.kuqeput1.partial: renamed to: file3.txt 2024/04/26 03:27:43 INFO : file3.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2: Making directory with metadata 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 INFO : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2 2024/04/26 03:27:43 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : file4.txt.vozarej2.partial: renamed to: file4.txt 2024/04/26 03:27:43 INFO : file4.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirB: Making directory with metadata 2024/04/26 03:27:43 DEBUG : file1.txt.xolafaj8.partial: renamed to: file1.txt 2024/04/26 03:27:43 INFO : file1.txt: Copied (new) 2024/04/26 03:27:43 INFO : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB 2024/04/26 03:27:43 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdirX/file20.txt.jiwirep8.partial: renamed to: subdirX/file20.txt 2024/04/26 03:27:43 INFO : subdirX/file20.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST.jovacil6.partial: renamed to: subdir/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/file20.txt.berogeb9.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:43 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir-not/file20.txt.locekoy6.partial: renamed to: subdir-not/file20.txt 2024/04/26 03:27:43 INFO : subdir-not/file20.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdirX/RCLONE_TEST.jewepev1.partial: renamed to: subdirX/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir-not/RCLONE_TEST.luxatom7.partial: renamed to: subdir-not/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : Local file system at /tmp/032741ra/initdir/test_check_access_filters-yezedeb6: Waiting for checks to finish 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/file30.txt.figihuc6.partial: renamed to: subdirX/subdirX1/file30.txt 2024/04/26 03:27:43 DEBUG : Local file system at /tmp/032741ra/initdir/test_check_access_filters-yezedeb6: Waiting for transfers to finish 2024/04/26 03:27:43 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.xijogac7.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/RCLONE_TEST.pinajoh7.partial: renamed to: subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir/subdirA/file30.txt.dowikaz4.partial: renamed to: subdir/subdirA/file30.txt 2024/04/26 03:27:43 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdir/subdirA/RCLONE_TEST.mozuzok6.partial: renamed to: subdir/subdirA/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir/subdirB/file30.txt.hezodaj4.partial: renamed to: subdir/subdirB/file30.txt 2024/04/26 03:27:43 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/file30.txt.xetakum5.partial: renamed to: subdir-not/subdir-not2/file30.txt 2024/04/26 03:27:43 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdir/subdirB/RCLONE_TEST.kiyewuf7.partial: renamed to: subdir/subdirB/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_check_access_filters-mazagaq5" 2024/04/26 03:27:43 DEBUG : exclude-other-filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : include-other-filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : Local file system at /tmp/032741ra/datadir/test_check_access_filters-mazagaq5: Waiting for checks to finish 2024/04/26 03:27:43 DEBUG : Local file system at /tmp/032741ra/datadir/test_check_access_filters-mazagaq5: Waiting for transfers to finish 2024/04/26 03:27:43 DEBUG : include-other-filtersfile.txt: md5 = 2ec13b2813141ed088e5978ef5a47b0e OK 2024/04/26 03:27:43 DEBUG : include-other-filtersfile.txt.feravuf0.partial: renamed to: include-other-filtersfile.txt 2024/04/26 03:27:43 INFO : include-other-filtersfile.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : exclude-other-filtersfile.txt: md5 = 5fcc6205d7df1c2e9ed3a15a1356b345 OK 2024/04/26 03:27:43 DEBUG : exclude-other-filtersfile.txt.wimigux2.partial: renamed to: exclude-other-filtersfile.txt 2024/04/26 03:27:43 INFO : exclude-other-filtersfile.txt: Copied (new) 2024/04/26 03:27:43 ERROR : : error listing: directory not found 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2] 2024/04/26 03:27:43 ERROR : : error listing: directory not found 2024/04/26 03:27:43 checking initFs Local file system at /tmp/032741ra/initdir/test_check_access_filters-yezedeb6 2024/04/26 03:27:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:43 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:43 DEBUG : subdir-not: Making directory with metadata 2024/04/26 03:27:43 INFO : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not 2024/04/26 03:27:43 DEBUG : subdirX: Making directory with metadata 2024/04/26 03:27:43 INFO : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdirX", newDst=subdirX 2024/04/26 03:27:43 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1: Making directory with metadata 2024/04/26 03:27:43 INFO : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1 2024/04/26 03:27:43 DEBUG : file1.txt.layavib5.partial: renamed to: file1.txt 2024/04/26 03:27:43 INFO : file1.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : RCLONE_TEST.wuletuy5.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:43 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2: Making directory with metadata 2024/04/26 03:27:43 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : file2.txt.biwijiy0.partial: renamed to: file2.txt 2024/04/26 03:27:43 INFO : file2.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirA: Making directory with metadata 2024/04/26 03:27:43 INFO : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA 2024/04/26 03:27:43 DEBUG : file4.txt.rirunef0.partial: renamed to: file4.txt 2024/04/26 03:27:43 DEBUG : subdir/subdirB: Making directory with metadata 2024/04/26 03:27:43 INFO : file4.txt: Copied (new) 2024/04/26 03:27:43 INFO : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB 2024/04/26 03:27:43 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdirX/file20.txt.kitujid5.partial: renamed to: subdirX/file20.txt 2024/04/26 03:27:43 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 INFO : subdirX/file20.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : file3.txt.fekaciq9.partial: renamed to: file3.txt 2024/04/26 03:27:43 INFO : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:43 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2 2024/04/26 03:27:43 DEBUG : subdirX/RCLONE_TEST.ganijon0.partial: renamed to: subdirX/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/RCLONE_TEST.quxojec7.partial: renamed to: subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 INFO : file3.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir-not/file20.txt.numigim0.partial: renamed to: subdir-not/file20.txt 2024/04/26 03:27:43 INFO : subdir-not/file20.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir/file20.txt.rarekuh0.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:43 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/file30.txt.hizomat3.partial: renamed to: subdirX/subdirX1/file30.txt 2024/04/26 03:27:43 DEBUG : subdir-not/RCLONE_TEST.diquqiw3.partial: renamed to: subdir-not/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/04/26 03:27:43 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdir/subdirA/RCLONE_TEST.legaraj6.partial: renamed to: subdir/subdirA/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/subdirA/file30.txt.hurudot0.partial: renamed to: subdir/subdirA/file30.txt 2024/04/26 03:27:43 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST.nowujaz6.partial: renamed to: subdir/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : subdir/subdirB/RCLONE_TEST.canafog3.partial: renamed to: subdir/subdirB/RCLONE_TEST 2024/04/26 03:27:43 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:43 DEBUG : subdir/subdirB/file30.txt.nowuset4.partial: renamed to: subdir/subdirB/file30.txt 2024/04/26 03:27:43 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/04/26 03:27:43 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/file30.txt.hupofac6.partial: renamed to: subdir-not/subdir-not2/file30.txt 2024/04/26 03:27:43 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:43 DEBUG : Local file system at /tmp/032741ra/check_access_filters/path1: Waiting for checks to finish 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.peyulut7.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST 2024/04/26 03:27:43 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : Local file system at /tmp/032741ra/check_access_filters/path1: Waiting for transfers to finish 2024/04/26 03:27:43 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:43 checking Path1 Local file system at /tmp/032741ra/check_access_filters/path1 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2] 2024/04/26 03:27:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir: Making directory 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir] 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/file1.txt] 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/RCLONE_TEST] 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/file2.txt] 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/file3.txt] 2024/04/26 03:27:43 DEBUG : subdir-not: Making directory 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir-not] 2024/04/26 03:27:43 DEBUG : subdirX: Making directory 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdirX] 2024/04/26 03:27:43 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1: Making directory 2024/04/26 03:27:43 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirA: Making directory 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir/subdirA] 2024/04/26 03:27:43 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2: Making directory 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir-not/subdir-not2] 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdirX/subdirX1] 2024/04/26 03:27:43 DEBUG : subdir/subdirB: Making directory 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir/subdirB] 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: Waiting for checks to finish 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: Waiting for transfers to finish 2024/04/26 03:27:43 INFO : file1.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/file4.txt] 2024/04/26 03:27:43 INFO : file2.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdirX/RCLONE_TEST] 2024/04/26 03:27:43 INFO : file3.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdirX/file20.txt] 2024/04/26 03:27:43 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir/RCLONE_TEST] 2024/04/26 03:27:43 INFO : file4.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir/file20.txt] 2024/04/26 03:27:43 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir-not/RCLONE_TEST] 2024/04/26 03:27:43 INFO : subdirX/file20.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir-not/file20.txt] 2024/04/26 03:27:43 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST] 2024/04/26 03:27:43 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir-not/subdir-not2/file30.txt] 2024/04/26 03:27:43 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir-not/RCLONE_TEST: replication in progress) 2024/04/26 03:27:43 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/04/26 03:27:43 DEBUG : pacer: Reducing sleep to 30ms 2024/04/26 03:27:43 INFO : subdir-not/file20.txt: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdirX/subdirX1/RCLONE_TEST] 2024/04/26 03:27:43 DEBUG : pacer: Reducing sleep to 22.5ms 2024/04/26 03:27:43 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/04/26 03:27:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdirX/subdirX1/file30.txt] 2024/04/26 03:27:44 DEBUG : pacer: Reducing sleep to 20ms 2024/04/26 03:27:44 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir/subdirB/RCLONE_TEST] 2024/04/26 03:27:44 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir/subdirB/file30.txt] 2024/04/26 03:27:44 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir/subdirA/RCLONE_TEST] 2024/04/26 03:27:44 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir/subdirA/file30.txt] 2024/04/26 03:27:44 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/04/26 03:27:44 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/04/26 03:27:44 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir-not] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdirX] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir/subdirB] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir/subdirA] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir-not/subdir-not2] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdirX/subdirX1] 2024/04/26 03:27:44 (01) : test check-access-filters 2024/04/26 03:27:44 (02) : test EXCLUDE - OTHER TESTS 2024/04/26 03:27:44 (03) : copy-file /tmp/032741ra/datadir/test_check_access_filters-mazagaq5/exclude-other-filtersfile.txt /tmp/032741ra/workdir/ 2024/04/26 03:27:44 INFO : exclude-other-filtersfile.txt: Copied (new) 2024/04/26 03:27:44 (04) : test resync to get the filters file md5 built. 2024/04/26 03:27:44 (05) : bisync resync filters-file=/tmp/032741ra/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Using filters file /tmp/032741ra/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:44 INFO : Storing filters file hash to /tmp/032741ra/workdir/exclude-other-filtersfile.txt.md5 2024/04/26 03:27:44 INFO : Copying Path2 files to Path1 2024/04/26 03:27:44 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:44 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:44 INFO : Resync updating listings 2024/04/26 03:27:44 INFO : Validating listings for Path1 "/tmp/032741ra/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Bisync successful 2024/04/26 03:27:44 (06) : test EXCLUDE - test filters for check access 2024/04/26 03:27:44 (07) : bisync check-access filters-file=/tmp/032741ra/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Using filters file /tmp/032741ra/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:44 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:44 INFO : Path1 checking for diffs 2024/04/26 03:27:44 INFO : Path2 checking for diffs 2024/04/26 03:27:44 INFO : Checking access health 2024/04/26 03:27:44 INFO : Found 3 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:44 INFO : No changes found 2024/04/26 03:27:44 INFO : Updating listings 2024/04/26 03:27:44 INFO : Validating listings for Path1 "/tmp/032741ra/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Bisync successful 2024/04/26 03:27:44 (08) : copy-listings exclude-initial 2024/04/26 03:27:44 (09) : test EXCLUDE - delete RCLONE_TEST files in excluded directories 2024/04/26 03:27:44 (10) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir/subdirA/RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:44 (11) : delete-file /tmp/032741ra/check_access_filters/path1/subdir-not/RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:44 (12) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:44 (13) : delete-file /tmp/032741ra/check_access_filters/path1/subdirX/RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:44 (14) : test EXCLUDE - test should PASS 2024/04/26 03:27:44 (15) : bisync check-access filters-file=/tmp/032741ra/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Using filters file /tmp/032741ra/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:44 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:44 INFO : Path1 checking for diffs 2024/04/26 03:27:44 INFO : Path2 checking for diffs 2024/04/26 03:27:44 INFO : Checking access health 2024/04/26 03:27:44 INFO : Found 3 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:44 INFO : No changes found 2024/04/26 03:27:44 INFO : Updating listings 2024/04/26 03:27:44 INFO : Validating listings for Path1 "/tmp/032741ra/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Bisync successful 2024/04/26 03:27:44 (16) : copy-listings exclude-pass-run 2024/04/26 03:27:44 (17) : test EXCLUDE - delete RCLONE_TEST files in included directories 2024/04/26 03:27:44 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:44 (19) : delete-file /tmp/032741ra/check_access_filters/path1/subdir/RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:44 (20) : test EXCLUDE - test should ABORT 2024/04/26 03:27:44 (21) : bisync check-access filters-file=/tmp/032741ra/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Using filters file /tmp/032741ra/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:44 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:44 INFO : Path1 checking for diffs 2024/04/26 03:27:44 INFO : - Path1 File was deleted - subdir/RCLONE_TEST 2024/04/26 03:27:44 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:44 INFO : Path2 checking for diffs 2024/04/26 03:27:44 INFO : - Path2 File was deleted - RCLONE_TEST 2024/04/26 03:27:44 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:44 INFO : Checking access health 2024/04/26 03:27:44 ERROR : -  Access test failed: Path1 file not found in Path2 - RCLONE_TEST 2024/04/26 03:27:44 ERROR : -  Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST 2024/04/26 03:27:44 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:44 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:44 Bisync error: bisync aborted 2024/04/26 03:27:44 (22) : move-listings exclude-error-run 2024/04/26 03:27:44 (23) : test INCLUDE - OTHER TESTS 2024/04/26 03:27:44 (24) : test reset to the initial state 2024/04/26 03:27:44 (25) : copy-dir /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/initial /tmp/032741ra/check_access_filters/path1/ 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 (26) : sync-dir /tmp/032741ra/check_access_filters/path1/ TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/ 2024/04/26 03:27:44 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 (27) : copy-file /tmp/032741ra/datadir/test_check_access_filters-mazagaq5/include-other-filtersfile.txt /tmp/032741ra/workdir/ 2024/04/26 03:27:44 INFO : include-other-filtersfile.txt: Copied (new) 2024/04/26 03:27:44 (28) : bisync resync filters-file=/tmp/032741ra/workdir/include-other-filtersfile.txt 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Using filters file /tmp/032741ra/workdir/include-other-filtersfile.txt 2024/04/26 03:27:44 INFO : Storing filters file hash to /tmp/032741ra/workdir/include-other-filtersfile.txt.md5 2024/04/26 03:27:44 INFO : Copying Path2 files to Path1 2024/04/26 03:27:44 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:44 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:44 INFO : Resync updating listings 2024/04/26 03:27:44 INFO : Validating listings for Path1 "/tmp/032741ra/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Bisync successful 2024/04/26 03:27:44 (29) : test INCLUDE - test include/exclude filters for check access 2024/04/26 03:27:44 (30) : bisync check-access filters-file=/tmp/032741ra/workdir/include-other-filtersfile.txt 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Using filters file /tmp/032741ra/workdir/include-other-filtersfile.txt 2024/04/26 03:27:44 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:44 INFO : Path1 checking for diffs 2024/04/26 03:27:44 INFO : Path2 checking for diffs 2024/04/26 03:27:44 INFO : Checking access health 2024/04/26 03:27:44 INFO : Found 5 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:44 INFO : No changes found 2024/04/26 03:27:44 INFO : Updating listings 2024/04/26 03:27:44 INFO : Validating listings for Path1 "/tmp/032741ra/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Bisync successful 2024/04/26 03:27:44 (31) : copy-listings include-initial 2024/04/26 03:27:44 (32) : test INCLUDE - delete RCLONE_TEST files in excluded directories 2024/04/26 03:27:44 (33) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir/subdirA/RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:44 (34) : delete-file /tmp/032741ra/check_access_filters/path1/subdir-not/RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:44 (35) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:44 (36) : test INCLUDE - test should PASS 2024/04/26 03:27:44 (37) : bisync check-access filters-file=/tmp/032741ra/workdir/include-other-filtersfile.txt 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Using filters file /tmp/032741ra/workdir/include-other-filtersfile.txt 2024/04/26 03:27:44 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:44 INFO : Path1 checking for diffs 2024/04/26 03:27:44 INFO : Path2 checking for diffs 2024/04/26 03:27:44 INFO : Checking access health 2024/04/26 03:27:44 INFO : Found 5 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:44 INFO : No changes found 2024/04/26 03:27:44 INFO : Updating listings 2024/04/26 03:27:44 INFO : Validating listings for Path1 "/tmp/032741ra/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Bisync successful 2024/04/26 03:27:44 (38) : copy-listings include-pass-run 2024/04/26 03:27:44 (39) : test INCLUDE - delete RCLONE_TEST files in included directories 2024/04/26 03:27:44 (40) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:44 (41) : delete-file /tmp/032741ra/check_access_filters/path1/subdir/RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:44 (42) : delete-file /tmp/032741ra/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:44 (43) : test INCLUDE - test should ABORT 2024/04/26 03:27:44 (44) : bisync check-access filters-file=/tmp/032741ra/workdir/include-other-filtersfile.txt 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_access_filters/path2/" 2024/04/26 03:27:44 INFO : Using filters file /tmp/032741ra/workdir/include-other-filtersfile.txt 2024/04/26 03:27:44 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:44 INFO : Path1 checking for diffs 2024/04/26 03:27:44 INFO : - Path1 File was deleted - subdir/RCLONE_TEST 2024/04/26 03:27:44 INFO : - Path1 File was deleted - subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:44 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2024/04/26 03:27:44 INFO : Path2 checking for diffs 2024/04/26 03:27:44 INFO : - Path2 File was deleted - RCLONE_TEST 2024/04/26 03:27:44 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:44 INFO : Checking access health 2024/04/26 03:27:44 ERROR : Access test failed: Path1 count 3, Path2 count 4 - RCLONE_TEST 2024/04/26 03:27:44 ERROR : -  Access test failed: Path1 file not found in Path2 - RCLONE_TEST 2024/04/26 03:27:44 ERROR : -  Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST 2024/04/26 03:27:44 ERROR : -  Access test failed: Path2 file not found in Path1 - subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:44 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:44 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:44 Bisync error: bisync aborted 2024/04/26 03:27:44 (45) : move-listings include-error-run bisync_test.go:553: TEST check_access_filters PASSED === RUN TestBisyncLocalRemote/check_filename 2024/04/26 03:27:44 DEBUG : Creating backend with remote "/tmp/032741ra/check_filename/path1" 2024/04/26 03:27:44 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:44 DEBUG : path2: Making directory 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:44 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2" 2024/04/26 03:27:44 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:44 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:44 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:44 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:44 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:44 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:44 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2" 2024/04/26 03:27:44 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_check_filename-hubupah9" 2024/04/26 03:27:44 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:44 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:44 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:44 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file1.txt.xeyumik3.partial: renamed to: file1.txt 2024/04/26 03:27:44 INFO : file1.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file2.txt.nucepir3.partial: renamed to: file2.txt 2024/04/26 03:27:44 INFO : file2.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file4.txt.kahaxud8.partial: renamed to: file4.txt 2024/04/26 03:27:44 INFO : file4.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : subdir/file20.txt.fayozew2.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:44 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : Local file system at /tmp/032741ra/initdir/test_check_filename-hubupah9: Waiting for checks to finish 2024/04/26 03:27:44 DEBUG : Local file system at /tmp/032741ra/initdir/test_check_filename-hubupah9: Waiting for transfers to finish 2024/04/26 03:27:44 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:44 DEBUG : .chk_file.puduxoy5.partial: renamed to: .chk_file 2024/04/26 03:27:44 INFO : .chk_file: Copied (new) 2024/04/26 03:27:44 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file3.txt.mimefoc3.partial: renamed to: file3.txt 2024/04/26 03:27:44 INFO : file3.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:44 DEBUG : subdir/.chk_file.zocetep9.partial: renamed to: subdir/.chk_file 2024/04/26 03:27:44 INFO : subdir/.chk_file: Copied (new) 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_check_filename-wavunic3" 2024/04/26 03:27:44 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : Local file system at /tmp/032741ra/datadir/test_check_filename-wavunic3: Waiting for checks to finish 2024/04/26 03:27:44 DEBUG : Local file system at /tmp/032741ra/datadir/test_check_filename-wavunic3: Waiting for transfers to finish 2024/04/26 03:27:44 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:27:44 DEBUG : hold.txt.jesozup5.partial: renamed to: hold.txt 2024/04/26 03:27:44 INFO : hold.txt: Copied (new) 2024/04/26 03:27:44 ERROR : : error listing: directory not found 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2] 2024/04/26 03:27:44 ERROR : : error listing: directory not found 2024/04/26 03:27:44 checking initFs Local file system at /tmp/032741ra/initdir/test_check_filename-hubupah9 2024/04/26 03:27:44 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:44 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:44 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:44 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file1.txt.feqokix0.partial: renamed to: file1.txt 2024/04/26 03:27:44 INFO : file1.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : Local file system at /tmp/032741ra/check_filename/path1: Waiting for checks to finish 2024/04/26 03:27:44 DEBUG : Local file system at /tmp/032741ra/check_filename/path1: Waiting for transfers to finish 2024/04/26 03:27:44 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file3.txt.momenag8.partial: renamed to: file3.txt 2024/04/26 03:27:44 INFO : file3.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file2.txt.lobukas5.partial: renamed to: file2.txt 2024/04/26 03:27:44 INFO : file2.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file4.txt.wuweraj1.partial: renamed to: file4.txt 2024/04/26 03:27:44 INFO : file4.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:44 DEBUG : subdir/.chk_file.rusemar1.partial: renamed to: subdir/.chk_file 2024/04/26 03:27:44 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:44 INFO : subdir/.chk_file: Copied (new) 2024/04/26 03:27:44 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : subdir/file20.txt.tagedij2.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:44 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : .chk_file.musises2.partial: renamed to: .chk_file 2024/04/26 03:27:44 INFO : .chk_file: Copied (new) 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 checking Path1 Local file system at /tmp/032741ra/check_filename/path1 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2] 2024/04/26 03:27:44 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : subdir: Making directory 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/subdir] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/.chk_file] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/file2.txt] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/file3.txt] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/file1.txt] 2024/04/26 03:27:44 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: Waiting for checks to finish 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: Waiting for transfers to finish 2024/04/26 03:27:44 INFO : file3.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/file4.txt] 2024/04/26 03:27:44 INFO : file2.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/subdir/.chk_file] 2024/04/26 03:27:44 INFO : file1.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/subdir/file20.txt] 2024/04/26 03:27:44 INFO : .chk_file: Copied (new) 2024/04/26 03:27:44 INFO : file4.txt: Copied (new) 2024/04/26 03:27:44 INFO : subdir/.chk_file: Copied (new) 2024/04/26 03:27:44 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:44 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/subdir] 2024/04/26 03:27:44 (01) : test check-filename 2024/04/26 03:27:44 (02) : test initial bisync 2024/04/26 03:27:44 (03) : bisync resync 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/" 2024/04/26 03:27:44 INFO : Copying Path2 files to Path1 2024/04/26 03:27:44 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:44 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:44 INFO : Resync updating listings 2024/04/26 03:27:44 INFO : Validating listings for Path1 "/tmp/032741ra/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/" 2024/04/26 03:27:44 INFO : Bisync successful 2024/04/26 03:27:44 (04) : test 1. see that check-access passes with the initial setup 2024/04/26 03:27:44 (05) : bisync check-access check-filename=.chk_file 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/" 2024/04/26 03:27:44 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:44 INFO : Path1 checking for diffs 2024/04/26 03:27:44 INFO : Path2 checking for diffs 2024/04/26 03:27:44 INFO : Checking access health 2024/04/26 03:27:44 INFO : Found 2 matching ".chk_file" files on both paths 2024/04/26 03:27:44 INFO : No changes found 2024/04/26 03:27:44 INFO : Updating listings 2024/04/26 03:27:44 INFO : Validating listings for Path1 "/tmp/032741ra/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/" 2024/04/26 03:27:44 INFO : Bisync successful 2024/04/26 03:27:44 (06) : copy-listings initial-pass 2024/04/26 03:27:44 (07) : test 2. delete the remote subdir .chk_file, run sync. should fail critical. 2024/04/26 03:27:44 (08) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/subdir/.chk_file 2024/04/26 03:27:44 INFO : .chk_file: Deleted 2024/04/26 03:27:44 (09) : bisync check-access check-filename=.chk_file 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/" 2024/04/26 03:27:44 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:44 INFO : Path1 checking for diffs 2024/04/26 03:27:44 INFO : Path2 checking for diffs 2024/04/26 03:27:44 INFO : - Path2 File was deleted - subdir/.chk_file 2024/04/26 03:27:44 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:44 INFO : Checking access health 2024/04/26 03:27:44 ERROR : Access test failed: Path1 count 2, Path2 count 1 - .chk_file 2024/04/26 03:27:44 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/.chk_file 2024/04/26 03:27:44 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:44 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:44 Bisync error: bisync aborted 2024/04/26 03:27:44 (10) : move-listings path2-missing 2024/04/26 03:27:44 (11) : test 3. put the remote subdir .chk_file back, run resync. 2024/04/26 03:27:44 (12) : copy-file /tmp/032741ra/check_filename/path1/subdir/.chk_file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/subdir/ 2024/04/26 03:27:44 INFO : .chk_file: Copied (new) 2024/04/26 03:27:44 (13) : bisync check-access resync check-filename=.chk_file 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/" 2024/04/26 03:27:44 INFO : Copying Path2 files to Path1 2024/04/26 03:27:44 INFO : Checking access health 2024/04/26 03:27:44 INFO : Found 2 matching ".chk_file" files on both paths 2024/04/26 03:27:44 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:44 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:44 INFO : Resync updating listings 2024/04/26 03:27:44 INFO : Validating listings for Path1 "/tmp/032741ra/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/" 2024/04/26 03:27:44 INFO : Bisync successful 2024/04/26 03:27:44 (14) : test 4. run sync with check-access. should pass. 2024/04/26 03:27:44 (15) : bisync check-access check-filename=.chk_file 2024/04/26 03:27:44 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:44 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:44 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:44 INFO : Synching Path1 "/tmp/032741ra/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/" 2024/04/26 03:27:44 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:44 INFO : Path1 checking for diffs 2024/04/26 03:27:44 INFO : Path2 checking for diffs 2024/04/26 03:27:44 INFO : Checking access health 2024/04/26 03:27:44 INFO : Found 2 matching ".chk_file" files on both paths 2024/04/26 03:27:44 INFO : No changes found 2024/04/26 03:27:44 INFO : Updating listings 2024/04/26 03:27:44 INFO : Validating listings for Path1 "/tmp/032741ra/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_filename/path2/" 2024/04/26 03:27:44 INFO : Bisync successful bisync_test.go:553: TEST check_filename PASSED === RUN TestBisyncLocalRemote/check_sync 2024/04/26 03:27:44 DEBUG : Creating backend with remote "/tmp/032741ra/check_sync/path1" 2024/04/26 03:27:44 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:44 DEBUG : path2: Making directory 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:44 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2" 2024/04/26 03:27:44 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:44 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:44 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:44 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:44 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:44 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:44 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2" 2024/04/26 03:27:44 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_check_sync-kociceg6" 2024/04/26 03:27:44 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : Local file system at /tmp/032741ra/initdir/test_check_sync-kociceg6: Waiting for checks to finish 2024/04/26 03:27:44 DEBUG : Local file system at /tmp/032741ra/initdir/test_check_sync-kociceg6: Waiting for transfers to finish 2024/04/26 03:27:44 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file1.txt.tehipep6.partial: renamed to: file1.txt 2024/04/26 03:27:44 INFO : file1.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:44 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : RCLONE_TEST.wedepay4.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:44 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file4.txt.kexoruw7.partial: renamed to: file4.txt 2024/04/26 03:27:44 INFO : file4.txt: Copied (new) 2024/04/26 03:27:44 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file2.txt.ganuxiv9.partial: renamed to: file2.txt 2024/04/26 03:27:44 INFO : file2.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file3.txt.docupef3.partial: renamed to: file3.txt 2024/04/26 03:27:44 INFO : file3.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file6.txt.fecobuj3.partial: renamed to: file6.txt 2024/04/26 03:27:44 INFO : file6.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file5.txt.zixocon1.partial: renamed to: file5.txt 2024/04/26 03:27:44 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 INFO : file5.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file7.txt.vogelax6.partial: renamed to: file7.txt 2024/04/26 03:27:44 INFO : file7.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file8.txt.dikuhar1.partial: renamed to: file8.txt 2024/04/26 03:27:44 INFO : file8.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_check_sync-sisufud5" 2024/04/26 03:27:44 DEBUG : _testdir_path1.._testdir_path2.path1.lst: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : _testdir_path1.._testdir_path2.path2.lst: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : Local file system at /tmp/032741ra/datadir/test_check_sync-sisufud5: Waiting for checks to finish 2024/04/26 03:27:44 DEBUG : Local file system at /tmp/032741ra/datadir/test_check_sync-sisufud5: Waiting for transfers to finish 2024/04/26 03:27:44 DEBUG : _testdir_path1.._testdir_path2.path2.lst: md5 = d6ce44a26af9c2110b1750fe88dc4b69 OK 2024/04/26 03:27:44 DEBUG : _testdir_path1.._testdir_path2.path1.lst: md5 = fdb18e0dff6961813e12c57227d2e854 OK 2024/04/26 03:27:44 DEBUG : _testdir_path1.._testdir_path2.path2.lst.vosanor5.partial: renamed to: _testdir_path1.._testdir_path2.path2.lst 2024/04/26 03:27:44 INFO : _testdir_path1.._testdir_path2.path2.lst: Copied (new) 2024/04/26 03:27:44 DEBUG : _testdir_path1.._testdir_path2.path1.lst.helelew1.partial: renamed to: _testdir_path1.._testdir_path2.path1.lst 2024/04/26 03:27:44 INFO : _testdir_path1.._testdir_path2.path1.lst: Copied (new) 2024/04/26 03:27:44 ERROR : : error listing: directory not found 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2] 2024/04/26 03:27:44 ERROR : : error listing: directory not found 2024/04/26 03:27:44 checking initFs Local file system at /tmp/032741ra/initdir/test_check_sync-kociceg6 2024/04/26 03:27:44 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : Local file system at /tmp/032741ra/check_sync/path1: Waiting for checks to finish 2024/04/26 03:27:44 DEBUG : Local file system at /tmp/032741ra/check_sync/path1: Waiting for transfers to finish 2024/04/26 03:27:44 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file1.txt.lehefir4.partial: renamed to: file1.txt 2024/04/26 03:27:44 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 INFO : file1.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file3.txt.xefejoq8.partial: renamed to: file3.txt 2024/04/26 03:27:44 INFO : file3.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file2.txt.qupapuz6.partial: renamed to: file2.txt 2024/04/26 03:27:44 INFO : file2.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:44 DEBUG : RCLONE_TEST.xitezas7.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:44 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file4.txt.qeduqur8.partial: renamed to: file4.txt 2024/04/26 03:27:44 INFO : file4.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file7.txt.welibor4.partial: renamed to: file7.txt 2024/04/26 03:27:44 INFO : file7.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file8.txt.caleyob9.partial: renamed to: file8.txt 2024/04/26 03:27:44 INFO : file8.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:44 DEBUG : file5.txt.ciyekac2.partial: renamed to: file5.txt 2024/04/26 03:27:44 INFO : file5.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : file6.txt.xaxuzax5.partial: renamed to: file6.txt 2024/04/26 03:27:44 INFO : file6.txt: Copied (new) 2024/04/26 03:27:44 checking Path1 Local file system at /tmp/032741ra/check_sync/path1 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2] 2024/04/26 03:27:44 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/RCLONE_TEST] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/file2.txt] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/file1.txt] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/file3.txt] 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: Waiting for checks to finish 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: Waiting for transfers to finish 2024/04/26 03:27:44 INFO : file2.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/file4.txt] 2024/04/26 03:27:44 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/file5.txt] 2024/04/26 03:27:44 INFO : file1.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/file6.txt] 2024/04/26 03:27:44 INFO : file3.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/file7.txt] 2024/04/26 03:27:44 INFO : file4.txt: Copied (new) 2024/04/26 03:27:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/file8.txt] 2024/04/26 03:27:44 INFO : file5.txt: Copied (new) 2024/04/26 03:27:45 INFO : file6.txt: Copied (new) 2024/04/26 03:27:45 INFO : file7.txt: Copied (new) 2024/04/26 03:27:45 INFO : file8.txt: Copied (new) 2024/04/26 03:27:45 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2] 2024/04/26 03:27:45 (01) : test check-sync 2024/04/26 03:27:45 (02) : test initial bisync 2024/04/26 03:27:45 (03) : bisync resync 2024/04/26 03:27:45 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:45 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:45 INFO : Synching Path1 "/tmp/032741ra/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/" 2024/04/26 03:27:45 INFO : Copying Path2 files to Path1 2024/04/26 03:27:45 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:45 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:45 INFO : Resync updating listings 2024/04/26 03:27:45 INFO : Validating listings for Path1 "/tmp/032741ra/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/" 2024/04/26 03:27:45 INFO : Bisync successful 2024/04/26 03:27:45 (04) : test 1. run check-sync-only on a clean sync 2024/04/26 03:27:45 (05) : bisync check-sync-only 2024/04/26 03:27:45 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:45 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:45 INFO : Validating listings for Path1 "/tmp/032741ra/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/" 2024/04/26 03:27:45 INFO : Bisync successful 2024/04/26 03:27:45 (06) : test 2. inject modified listings into the workdir 2024/04/26 03:27:45 (07) : copy-as /tmp/032741ra/datadir/test_check_sync-sisufud5/_testdir_path1.._testdir_path2.path1.lst /tmp/032741ra/workdir/ tmp_032741ra_check_sync_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_check_sync_path2.path1.lst 2024/04/26 03:27:45 INFO : _testdir_path1.._testdir_path2.path1.lst: Copied (replaced existing) to: tmp_032741ra_check_sync_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_check_sync_path2.path1.lst 2024/04/26 03:27:45 (08) : copy-as /tmp/032741ra/datadir/test_check_sync-sisufud5/_testdir_path1.._testdir_path2.path2.lst /tmp/032741ra/workdir/ tmp_032741ra_check_sync_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_check_sync_path2.path2.lst 2024/04/26 03:27:45 INFO : _testdir_path1.._testdir_path2.path2.lst: Copied (replaced existing) to: tmp_032741ra_check_sync_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_check_sync_path2.path2.lst 2024/04/26 03:27:45 (09) : test 3. run check-sync-only on modified listings 2024/04/26 03:27:45 (10) : bisync check-sync-only 2024/04/26 03:27:45 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:45 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:45 INFO : Validating listings for Path1 "/tmp/032741ra/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/" 2024/04/26 03:27:45 ERROR : -  Path1 file not found in Path2 - file2.txt 2024/04/26 03:27:45 ERROR : -  Path2 file not found in Path1 - file1.txt 2024/04/26 03:27:45 ERROR : Bisync critical error: path1 and path2 are out of sync, run --resync to recover 2024/04/26 03:27:45 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:45 Bisync error: bisync aborted 2024/04/26 03:27:45 (11) : copy-listings check-sync-only 2024/04/26 03:27:45 (12) : test 4. run normal sync to check that it aborts 2024/04/26 03:27:45 (13) : bisync 2024/04/26 03:27:45 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:45 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:45 INFO : Synching Path1 "/tmp/032741ra/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/" 2024/04/26 03:27:45 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/032741ra/workdir/tmp_032741ra_check_sync_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_check_sync_path2.path1.lst Path2: /tmp/032741ra/workdir/tmp_032741ra_check_sync_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_check_sync_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/032741ra/workdir" 2024/04/26 03:27:45 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:45 Bisync error: bisync aborted 2024/04/26 03:27:45 (14) : test 5. prune failure listings after critical abort 2024/04/26 03:27:45 (15) : delete-glob /tmp/032741ra/workdir/ *.lst 2024/04/26 03:27:45 (16) : delete-glob /tmp/032741ra/workdir/ *.lst-err 2024/04/26 03:27:45 INFO : tmp_032741ra_check_sync_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_check_sync_path2.path1.lst-err: Deleted 2024/04/26 03:27:45 INFO : tmp_032741ra_check_sync_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_check_sync_path2.path2.lst-err: Deleted 2024/04/26 03:27:45 (17) : delete-glob /tmp/032741ra/workdir/ *.lst-new 2024/04/26 03:27:45 INFO : tmp_032741ra_check_sync_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_check_sync_path2.path1.lst-new: Deleted 2024/04/26 03:27:45 INFO : tmp_032741ra_check_sync_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_check_sync_path2.path2.lst-new: Deleted 2024/04/26 03:27:45 (18) : test 6. run resync 2024/04/26 03:27:45 (19) : bisync resync 2024/04/26 03:27:45 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:45 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:45 INFO : Synching Path1 "/tmp/032741ra/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/" 2024/04/26 03:27:45 INFO : Copying Path2 files to Path1 2024/04/26 03:27:45 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:45 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:45 INFO : Resync updating listings 2024/04/26 03:27:45 INFO : Validating listings for Path1 "/tmp/032741ra/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/" 2024/04/26 03:27:45 INFO : Bisync successful 2024/04/26 03:27:45 (20) : test 7. run normal sync with check-sync enabled (default) 2024/04/26 03:27:45 (21) : bisync 2024/04/26 03:27:45 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:45 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:45 INFO : Synching Path1 "/tmp/032741ra/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/" 2024/04/26 03:27:45 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:45 INFO : Path1 checking for diffs 2024/04/26 03:27:45 INFO : Path2 checking for diffs 2024/04/26 03:27:45 INFO : No changes found 2024/04/26 03:27:45 INFO : Updating listings 2024/04/26 03:27:45 INFO : Validating listings for Path1 "/tmp/032741ra/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/" 2024/04/26 03:27:45 INFO : Bisync successful 2024/04/26 03:27:45 (22) : test 8. run normal sync with no-check-sync 2024/04/26 03:27:45 (23) : bisync no-check-sync 2024/04/26 03:27:45 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:45 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:45 INFO : Synching Path1 "/tmp/032741ra/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/check_sync/path2/" 2024/04/26 03:27:45 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:45 INFO : Path1 checking for diffs 2024/04/26 03:27:45 INFO : Path2 checking for diffs 2024/04/26 03:27:45 INFO : No changes found 2024/04/26 03:27:45 INFO : Updating listings 2024/04/26 03:27:45 INFO : Bisync successful bisync_test.go:553: TEST check_sync PASSED === RUN TestBisyncLocalRemote/compare_all 2024/04/26 03:27:45 DEBUG : Creating backend with remote "/tmp/032741ra/compare_all/path1" 2024/04/26 03:27:45 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:45 DEBUG : path2: Making directory 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:45 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2" 2024/04/26 03:27:45 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:45 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:45 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2" 2024/04/26 03:27:45 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_compare_all-jeyutak5" 2024/04/26 03:27:45 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file1.txt.dapehux3.partial: renamed to: file1.txt 2024/04/26 03:27:45 INFO : file1.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:45 DEBUG : Local file system at /tmp/032741ra/initdir/test_compare_all-jeyutak5: Waiting for checks to finish 2024/04/26 03:27:45 DEBUG : RCLONE_TEST.gifihom3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:45 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:45 DEBUG : Local file system at /tmp/032741ra/initdir/test_compare_all-jeyutak5: Waiting for transfers to finish 2024/04/26 03:27:45 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file3.txt.sexevof3.partial: renamed to: file3.txt 2024/04/26 03:27:45 INFO : file3.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file4.txt.fomenig8.partial: renamed to: file4.txt 2024/04/26 03:27:45 INFO : file4.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file5.txt.ceyimav2.partial: renamed to: file5.txt 2024/04/26 03:27:45 INFO : file5.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file2.txt.hoduvoy8.partial: renamed to: file2.txt 2024/04/26 03:27:45 INFO : file2.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file6.txt.lakinol4.partial: renamed to: file6.txt 2024/04/26 03:27:45 INFO : file6.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file7.txt.duxexef0.partial: renamed to: file7.txt 2024/04/26 03:27:45 INFO : file7.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file8.txt.rejuxib7.partial: renamed to: file8.txt 2024/04/26 03:27:45 INFO : file8.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_compare_all-yoqepid4" 2024/04/26 03:27:45 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:45 DEBUG : file10.txt.mazamog3.partial: renamed to: file10.txt 2024/04/26 03:27:45 INFO : file10.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : Local file system at /tmp/032741ra/datadir/test_compare_all-yoqepid4: Waiting for checks to finish 2024/04/26 03:27:45 DEBUG : Local file system at /tmp/032741ra/datadir/test_compare_all-yoqepid4: Waiting for transfers to finish 2024/04/26 03:27:45 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:45 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:45 DEBUG : file11.txt.cihilop6.partial: renamed to: file11.txt 2024/04/26 03:27:45 INFO : file11.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file2.txt.kuvuqab7.partial: renamed to: file2.txt 2024/04/26 03:27:45 INFO : file2.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:45 DEBUG : file5L.txt.kudebor8.partial: renamed to: file5L.txt 2024/04/26 03:27:45 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:45 DEBUG : file1.txt.visotoh0.partial: renamed to: file1.txt 2024/04/26 03:27:45 INFO : file1.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:45 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:45 DEBUG : file5R.txt.xozupew3.partial: renamed to: file5R.txt 2024/04/26 03:27:45 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file7.txt.teciqiv0.partial: renamed to: file7.txt 2024/04/26 03:27:45 INFO : file7.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:45 DEBUG : file6.txt.lugagot4.partial: renamed to: file6.txt 2024/04/26 03:27:45 INFO : file6.txt: Copied (new) 2024/04/26 03:27:45 ERROR : : error listing: directory not found 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2] 2024/04/26 03:27:45 ERROR : : error listing: directory not found 2024/04/26 03:27:45 checking initFs Local file system at /tmp/032741ra/initdir/test_compare_all-jeyutak5 2024/04/26 03:27:45 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file1.txt.gixinic3.partial: renamed to: file1.txt 2024/04/26 03:27:45 INFO : file1.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : Local file system at /tmp/032741ra/compare_all/path1: Waiting for checks to finish 2024/04/26 03:27:45 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:45 DEBUG : RCLONE_TEST.lebedis8.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:45 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:45 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file2.txt.zevimiw7.partial: renamed to: file2.txt 2024/04/26 03:27:45 INFO : file2.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file3.txt.setuzon4.partial: renamed to: file3.txt 2024/04/26 03:27:45 INFO : file3.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : Local file system at /tmp/032741ra/compare_all/path1: Waiting for transfers to finish 2024/04/26 03:27:45 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file5.txt.cavoran8.partial: renamed to: file5.txt 2024/04/26 03:27:45 INFO : file5.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file6.txt.welicel9.partial: renamed to: file6.txt 2024/04/26 03:27:45 INFO : file6.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file7.txt.rivohad3.partial: renamed to: file7.txt 2024/04/26 03:27:45 INFO : file7.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file8.txt.bebuxey3.partial: renamed to: file8.txt 2024/04/26 03:27:45 INFO : file8.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file4.txt.qiqaday8.partial: renamed to: file4.txt 2024/04/26 03:27:45 INFO : file4.txt: Copied (new) 2024/04/26 03:27:45 checking Path1 Local file system at /tmp/032741ra/compare_all/path1 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2] 2024/04/26 03:27:45 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: Waiting for checks to finish 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: Waiting for transfers to finish 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file1.txt] 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file3.txt] 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/RCLONE_TEST] 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file2.txt] 2024/04/26 03:27:45 INFO : file3.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file4.txt] 2024/04/26 03:27:45 INFO : file1.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file5.txt] 2024/04/26 03:27:45 INFO : file2.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file6.txt] 2024/04/26 03:27:45 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file7.txt] 2024/04/26 03:27:45 INFO : file4.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file8.txt] 2024/04/26 03:27:45 INFO : file5.txt: Copied (new) 2024/04/26 03:27:45 INFO : file6.txt: Copied (new) 2024/04/26 03:27:45 INFO : file7.txt: Copied (new) 2024/04/26 03:27:45 INFO : file8.txt: Copied (new) 2024/04/26 03:27:45 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2] 2024/04/26 03:27:45 (01) : test changes compare-all 2024/04/26 03:27:45 (02) : test initial bisync 2024/04/26 03:27:45 (03) : bisync resync compare-all 2024/04/26 03:27:45 NOTICE: Local file system at /tmp/032741ra/compare_all/path1: will use md5 for same-side diffs on Path1 only 2024/04/26 03:27:45 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:45 INFO : Synching Path1 "/tmp/032741ra/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/" 2024/04/26 03:27:45 INFO : Copying Path2 files to Path1 2024/04/26 03:27:45 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:45 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:45 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:45 INFO : Resync updating listings 2024/04/26 03:27:45 INFO : Validating listings for Path1 "/tmp/032741ra/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/" 2024/04/26 03:27:45 INFO : Bisync successful 2024/04/26 03:27:45 (04) : test make modifications on both paths 2024/04/26 03:27:45 (05) : test new on path2 - file10 2024/04/26 03:27:45 (06) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_compare_all-yoqepid4/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/ 2024/04/26 03:27:45 INFO : file10.txt: Copied (new) 2024/04/26 03:27:45 (07) : test newer on path2 - file1 2024/04/26 03:27:45 (08) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_compare_all-yoqepid4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/ 2024/04/26 03:27:45 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:45 (09) : test new on path1 - file11 2024/04/26 03:27:45 (10) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_compare_all-yoqepid4/file11.txt /tmp/032741ra/compare_all/path1/ 2024/04/26 03:27:45 INFO : file11.txt: Copied (new) 2024/04/26 03:27:45 (11) : test newer on path1 - file2 2024/04/26 03:27:45 (12) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_compare_all-yoqepid4/file2.txt /tmp/032741ra/compare_all/path1/ 2024/04/26 03:27:45 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:45 (13) : test deleted on path2 - file3 2024/04/26 03:27:45 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file3.txt 2024/04/26 03:27:45 INFO : file3.txt: Deleted 2024/04/26 03:27:45 (15) : test deleted on path1 - file4 2024/04/26 03:27:45 (16) : delete-file /tmp/032741ra/compare_all/path1/file4.txt 2024/04/26 03:27:45 INFO : file4.txt: Deleted 2024/04/26 03:27:45 (17) : test deleted on both paths - file8 2024/04/26 03:27:45 (18) : delete-file /tmp/032741ra/compare_all/path1/file8.txt 2024/04/26 03:27:45 INFO : file8.txt: Deleted 2024/04/26 03:27:45 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file8.txt 2024/04/26 03:27:45 INFO : file8.txt: Deleted 2024/04/26 03:27:45 (20) : test changed on both paths - file5 (file5R, file5L) 2024/04/26 03:27:45 (21) : touch-glob 2001-01-02 /tmp/032741ra/datadir/test_compare_all-yoqepid4/ file5R.txt 2024/04/26 03:27:45 (22) : copy-as /tmp/032741ra/datadir/test_compare_all-yoqepid4/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/ file5.txt 2024/04/26 03:27:45 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:45 (23) : touch-glob 2001-03-04 /tmp/032741ra/datadir/test_compare_all-yoqepid4/ file5L.txt 2024/04/26 03:27:45 (24) : copy-as /tmp/032741ra/datadir/test_compare_all-yoqepid4/file5L.txt /tmp/032741ra/compare_all/path1/ file5.txt 2024/04/26 03:27:45 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:45 (25) : test newer on path2 and deleted on path1 - file6 2024/04/26 03:27:45 (26) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_compare_all-yoqepid4/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/ 2024/04/26 03:27:45 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:27:45 (27) : delete-file /tmp/032741ra/compare_all/path1/file6.txt 2024/04/26 03:27:45 INFO : file6.txt: Deleted 2024/04/26 03:27:45 (28) : test newer on path1 and deleted on path2 - file7 2024/04/26 03:27:45 (29) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_compare_all-yoqepid4/file7.txt /tmp/032741ra/compare_all/path1/ 2024/04/26 03:27:45 INFO : file7.txt: Copied (replaced existing) 2024/04/26 03:27:45 (30) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file7.txt 2024/04/26 03:27:45 INFO : file7.txt: Deleted 2024/04/26 03:27:45 (31) : test bisync run 2024/04/26 03:27:45 (32) : bisync compare-all 2024/04/26 03:27:45 NOTICE: Local file system at /tmp/032741ra/compare_all/path1: will use md5 for same-side diffs on Path1 only 2024/04/26 03:27:45 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:45 INFO : Synching Path1 "/tmp/032741ra/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/" 2024/04/26 03:27:45 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:45 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:45 INFO : Path1 checking for diffs 2024/04/26 03:27:45 INFO : - Path1 File changed: size (larger), time (newer), hash - file2.txt 2024/04/26 03:27:45 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:45 INFO : - Path1 File changed: size (larger), time (newer), hash - file5.txt 2024/04/26 03:27:45 INFO : - Path1 File was deleted - file6.txt 2024/04/26 03:27:45 INFO : - Path1 File changed: size (larger), time (newer), hash - file7.txt 2024/04/26 03:27:45 INFO : - Path1 File was deleted - file8.txt 2024/04/26 03:27:45 INFO : - Path1 File is new - file11.txt 2024/04/26 03:27:45 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:45 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2024/04/26 03:27:45 INFO : Path2 checking for diffs 2024/04/26 03:27:45 INFO : - Path2 File changed: size (larger), time (newer), hash - file1.txt 2024/04/26 03:27:45 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:45 INFO : - Path2 File changed: size (larger), time (newer), hash - file5.txt 2024/04/26 03:27:45 INFO : - Path2 File changed: size (larger), time (newer), hash - file6.txt 2024/04/26 03:27:45 INFO : - Path2 File was deleted - file7.txt 2024/04/26 03:27:45 INFO : - Path2 File was deleted - file8.txt 2024/04/26 03:27:45 INFO : - Path2 File is new - file10.txt 2024/04/26 03:27:45 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:45 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2024/04/26 03:27:45 INFO : Applying changes 2024/04/26 03:27:45 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file11.txt 2024/04/26 03:27:45 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file2.txt 2024/04/26 03:27:45 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file4.txt 2024/04/26 03:27:45 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:27:45 NOTICE: - Path1 Renaming Path1 copy - /tmp/032741ra/compare_all/path1/file5.txt.conflict1 2024/04/26 03:27:45 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/04/26 03:27:45 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file5.txt.conflict1 2024/04/26 03:27:45 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file5.txt.conflict2 2024/04/26 03:27:45 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/04/26 03:27:45 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/compare_all/path1/file5.txt.conflict2 2024/04/26 03:27:45 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/compare_all/path1/file6.txt 2024/04/26 03:27:45 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/file7.txt 2024/04/26 03:27:45 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/compare_all/path1/file1.txt 2024/04/26 03:27:45 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/compare_all/path1/file10.txt 2024/04/26 03:27:45 INFO : - Path1 Queue delete - /tmp/032741ra/compare_all/path1/file3.txt 2024/04/26 03:27:45 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:45 INFO : file10.txt: Copied (new) 2024/04/26 03:27:45 INFO : file5.txt.conflict2: Copied (new) 2024/04/26 03:27:45 INFO : file6.txt: Copied (new) 2024/04/26 03:27:45 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:45 INFO : file3.txt: Deleted 2024/04/26 03:27:45 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:45 INFO : file11.txt: Copied (new) 2024/04/26 03:27:45 INFO : file7.txt: Copied (new) 2024/04/26 03:27:45 INFO : file5.txt.conflict1: Copied (new) 2024/04/26 03:27:45 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:45 INFO : file4.txt: Deleted 2024/04/26 03:27:45 INFO : Updating listings 2024/04/26 03:27:45 INFO : Validating listings for Path1 "/tmp/032741ra/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/compare_all/path2/" 2024/04/26 03:27:45 INFO : Bisync successful bisync_test.go:553: TEST compare_all PASSED === RUN TestBisyncLocalRemote/createemptysrcdirs 2024/04/26 03:27:45 DEBUG : Creating backend with remote "/tmp/032741ra/createemptysrcdirs/path1" 2024/04/26 03:27:45 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:45 DEBUG : path2: Making directory 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:45 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2" 2024/04/26 03:27:45 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:45 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:45 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2" 2024/04/26 03:27:45 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_createemptysrcdirs-xecufiy4" 2024/04/26 03:27:45 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file1.copy1.txt.vajewap3.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:45 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file1.copy2.txt.pitowup9.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:45 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : Local file system at /tmp/032741ra/initdir/test_createemptysrcdirs-xecufiy4: Waiting for checks to finish 2024/04/26 03:27:45 DEBUG : Local file system at /tmp/032741ra/initdir/test_createemptysrcdirs-xecufiy4: Waiting for transfers to finish 2024/04/26 03:27:45 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:45 DEBUG : RCLONE_TEST.gogukiv9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:45 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:45 DEBUG : file1.copy3.txt.sohific7.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:45 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file1.copy5.txt.xijerer0.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:45 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file1.copy4.txt.veyeguy8.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:45 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file1.txt.wonakih8.partial: renamed to: file1.txt 2024/04/26 03:27:45 INFO : file1.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1" 2024/04/26 03:27:45 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : Local file system at /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1: Waiting for checks to finish 2024/04/26 03:27:45 DEBUG : Local file system at /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1: Waiting for transfers to finish 2024/04/26 03:27:45 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : placeholder.txt.howakuv8.partial: renamed to: placeholder.txt 2024/04/26 03:27:45 INFO : placeholder.txt: Copied (new) 2024/04/26 03:27:45 ERROR : : error listing: directory not found 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2] 2024/04/26 03:27:45 ERROR : : error listing: directory not found 2024/04/26 03:27:45 checking initFs Local file system at /tmp/032741ra/initdir/test_createemptysrcdirs-xecufiy4 2024/04/26 03:27:45 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : Local file system at /tmp/032741ra/createemptysrcdirs/path1: Waiting for checks to finish 2024/04/26 03:27:45 DEBUG : Local file system at /tmp/032741ra/createemptysrcdirs/path1: Waiting for transfers to finish 2024/04/26 03:27:45 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file1.copy2.txt.jihuwow2.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:45 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file1.copy1.txt.tumikat2.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:45 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file1.copy3.txt.niyacup9.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:45 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : file1.copy4.txt.cewizin6.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:45 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file1.copy5.txt.jobitun8.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:45 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:45 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:45 DEBUG : file1.txt.kewibaf0.partial: renamed to: file1.txt 2024/04/26 03:27:45 DEBUG : RCLONE_TEST.kihomob9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:45 INFO : file1.txt: Copied (new) 2024/04/26 03:27:45 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:45 checking Path1 Local file system at /tmp/032741ra/createemptysrcdirs/path1 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2] 2024/04/26 03:27:45 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/RCLONE_TEST] 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/file1.copy1.txt] 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2: Waiting for checks to finish 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2: Waiting for transfers to finish 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/file1.copy3.txt] 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/file1.copy2.txt] 2024/04/26 03:27:45 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/file1.copy4.txt] 2024/04/26 03:27:45 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/file1.copy5.txt] 2024/04/26 03:27:45 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/file1.txt] 2024/04/26 03:27:45 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:45 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:45 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:45 INFO : file1.txt: Copied (new) 2024/04/26 03:27:45 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2 2024/04/26 03:27:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2] 2024/04/26 03:27:45 (01) : test createemptysrcdirs 2024/04/26 03:27:45 (02) : test initial bisync 2024/04/26 03:27:45 (03) : touch-glob 2001-01-02 /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/ placeholder.txt 2024/04/26 03:27:45 (04) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.txt 2024/04/26 03:27:45 INFO : placeholder.txt: Updated modification time in destination 2024/04/26 03:27:45 (05) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy1.txt 2024/04/26 03:27:45 INFO : placeholder.txt: Updated modification time in destination 2024/04/26 03:27:45 (06) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy2.txt 2024/04/26 03:27:45 INFO : placeholder.txt: Updated modification time in destination 2024/04/26 03:27:45 (07) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy3.txt 2024/04/26 03:27:45 INFO : placeholder.txt: Updated modification time in destination 2024/04/26 03:27:45 (08) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy4.txt 2024/04/26 03:27:45 INFO : placeholder.txt: Updated modification time in destination 2024/04/26 03:27:45 (09) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy5.txt 2024/04/26 03:27:45 INFO : placeholder.txt: Updated modification time in destination 2024/04/26 03:27:45 (10) : bisync resync 2024/04/26 03:27:46 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:46 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:46 INFO : Synching Path1 "/tmp/032741ra/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Copying Path2 files to Path1 2024/04/26 03:27:46 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:46 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:46 INFO : file1.copy1.txt: Copied (replaced existing) 2024/04/26 03:27:46 INFO : file1.copy3.txt: Copied (replaced existing) 2024/04/26 03:27:46 INFO : file1.copy2.txt: Copied (replaced existing) 2024/04/26 03:27:46 INFO : file1.copy4.txt: Copied (replaced existing) 2024/04/26 03:27:46 INFO : file1.copy5.txt: Copied (replaced existing) 2024/04/26 03:27:46 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:46 INFO : Resync updating listings 2024/04/26 03:27:46 INFO : Validating listings for Path1 "/tmp/032741ra/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Bisync successful 2024/04/26 03:27:46 (11) : test 1. Create an empty dir on Path1 by creating subdir/placeholder.txt and then deleting the placeholder 2024/04/26 03:27:46 (12) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ subdir/placeholder.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: subdir/placeholder.txt 2024/04/26 03:27:46 (13) : touch-glob 2001-01-02 /tmp/032741ra/createemptysrcdirs/path1/ subdir 2024/04/26 03:27:46 (14) : delete-file /tmp/032741ra/createemptysrcdirs/path1/subdir/placeholder.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Deleted 2024/04/26 03:27:46 (15) : test 2. Run bisync without --create-empty-src-dirs 2024/04/26 03:27:46 (16) : bisync 2024/04/26 03:27:46 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:46 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:46 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:46 INFO : Synching Path1 "/tmp/032741ra/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:46 INFO : Path1 checking for diffs 2024/04/26 03:27:46 INFO : Path2 checking for diffs 2024/04/26 03:27:46 INFO : No changes found 2024/04/26 03:27:46 INFO : Updating listings 2024/04/26 03:27:46 INFO : Validating listings for Path1 "/tmp/032741ra/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Bisync successful 2024/04/26 03:27:46 (17) : test 3. Confirm the subdir exists only on Path1 and not Path2 2024/04/26 03:27:46 (18) : list-dirs /tmp/032741ra/createemptysrcdirs/path1/ 2024/04/26 03:27:46 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:46 (19) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/ 2024/04/26 03:27:46 (20) : test 4.Run bisync WITH --create-empty-src-dirs 2024/04/26 03:27:46 (21) : bisync create-empty-src-dirs 2024/04/26 03:27:46 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:46 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:46 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:46 INFO : Synching Path1 "/tmp/032741ra/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:46 INFO : Path1 checking for diffs 2024/04/26 03:27:46 INFO : - Path1 File is new - subdir 2024/04/26 03:27:46 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:46 INFO : Path2 checking for diffs 2024/04/26 03:27:46 INFO : Applying changes 2024/04/26 03:27:46 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/subdir 2024/04/26 03:27:46 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:46 INFO : Updating listings 2024/04/26 03:27:46 INFO : Validating listings for Path1 "/tmp/032741ra/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Bisync successful 2024/04/26 03:27:46 (22) : test 5. Confirm the subdir exists on both paths 2024/04/26 03:27:46 (23) : list-dirs /tmp/032741ra/createemptysrcdirs/path1/ 2024/04/26 03:27:46 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:46 (24) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/ 2024/04/26 03:27:46 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:46 (25) : test 6. Delete the empty dir on Path1 using purge-children (and also add files so the path isn't empty) 2024/04/26 03:27:46 (26) : purge-children /tmp/032741ra/createemptysrcdirs/path1/ 2024/04/26 03:27:46 INFO : subdir: Removing directory 2024/04/26 03:27:46 (27) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: file1.txt 2024/04/26 03:27:46 (28) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy1.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2024/04/26 03:27:46 (29) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy2.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2024/04/26 03:27:46 (30) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy3.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2024/04/26 03:27:46 (31) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy4.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2024/04/26 03:27:46 (32) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy5.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2024/04/26 03:27:46 (33) : test 7. Run bisync without --create-empty-src-dirs 2024/04/26 03:27:46 (34) : bisync 2024/04/26 03:27:46 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:46 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:46 INFO : Synching Path1 "/tmp/032741ra/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:46 INFO : Path1 checking for diffs 2024/04/26 03:27:46 INFO : - Path1 File was deleted - RCLONE_TEST 2024/04/26 03:27:46 INFO : - Path1 File was deleted - subdir 2024/04/26 03:27:46 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2024/04/26 03:27:46 INFO : Path2 checking for diffs 2024/04/26 03:27:46 INFO : - Path2 File was deleted - subdir 2024/04/26 03:27:46 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:46 INFO : Applying changes 2024/04/26 03:27:46 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/RCLONE_TEST 2024/04/26 03:27:46 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:46 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:46 INFO : Updating listings 2024/04/26 03:27:46 INFO : Validating listings for Path1 "/tmp/032741ra/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Bisync successful 2024/04/26 03:27:46 (35) : test 8. Confirm the subdir exists only on Path2 and not Path1 2024/04/26 03:27:46 (36) : list-dirs /tmp/032741ra/createemptysrcdirs/path1/ 2024/04/26 03:27:46 (37) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/ 2024/04/26 03:27:46 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:46 (38) : test 9. Reset, do the delete again, and run bisync WITH --create-empty-src-dirs 2024/04/26 03:27:46 (39) : bisync resync create-empty-src-dirs 2024/04/26 03:27:46 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:46 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:46 INFO : Synching Path1 "/tmp/032741ra/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Copying Path2 files to Path1 2024/04/26 03:27:46 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:46 INFO : subdir: Made directory with metadata (mtime=2024-04-26T03:27:46.171Z) 2024/04/26 03:27:46 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:46 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:46 INFO : Resync updating listings 2024/04/26 03:27:46 INFO : Validating listings for Path1 "/tmp/032741ra/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Bisync successful 2024/04/26 03:27:46 (40) : list-dirs /tmp/032741ra/createemptysrcdirs/path1/ 2024/04/26 03:27:46 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:46 (41) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/ 2024/04/26 03:27:46 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:46 (42) : purge-children /tmp/032741ra/createemptysrcdirs/path1/ 2024/04/26 03:27:46 INFO : subdir: Removing directory 2024/04/26 03:27:46 (43) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: file1.txt 2024/04/26 03:27:46 (44) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy1.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2024/04/26 03:27:46 (45) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy2.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2024/04/26 03:27:46 (46) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy3.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2024/04/26 03:27:46 (47) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy4.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2024/04/26 03:27:46 (48) : copy-as /tmp/032741ra/datadir/test_createemptysrcdirs-ceviyak1/placeholder.txt /tmp/032741ra/createemptysrcdirs/path1/ file1.copy5.txt 2024/04/26 03:27:46 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2024/04/26 03:27:46 (49) : list-dirs /tmp/032741ra/createemptysrcdirs/path1/ 2024/04/26 03:27:46 (50) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/ 2024/04/26 03:27:46 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:46 (51) : bisync create-empty-src-dirs 2024/04/26 03:27:46 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:46 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:46 INFO : Synching Path1 "/tmp/032741ra/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:46 INFO : Path1 checking for diffs 2024/04/26 03:27:46 INFO : - Path1 File was deleted - subdir 2024/04/26 03:27:46 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:46 INFO : Path2 checking for diffs 2024/04/26 03:27:46 INFO : Applying changes 2024/04/26 03:27:46 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/subdir 2024/04/26 03:27:46 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:46 INFO : subdir: Removing directory 2024/04/26 03:27:46 INFO : Updating listings 2024/04/26 03:27:46 INFO : Validating listings for Path1 "/tmp/032741ra/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Bisync successful 2024/04/26 03:27:46 (52) : test 10. Confirm the subdir has been removed on both paths 2024/04/26 03:27:46 (53) : list-dirs /tmp/032741ra/createemptysrcdirs/path1/ 2024/04/26 03:27:46 (54) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/ 2024/04/26 03:27:46 (55) : test 11. bisync again (because if we leave subdir in listings, test will fail due to mismatched modtime) 2024/04/26 03:27:46 (56) : bisync create-empty-src-dirs 2024/04/26 03:27:46 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:46 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:46 INFO : Synching Path1 "/tmp/032741ra/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:46 INFO : Path1 checking for diffs 2024/04/26 03:27:46 INFO : Path2 checking for diffs 2024/04/26 03:27:46 INFO : No changes found 2024/04/26 03:27:46 INFO : Updating listings 2024/04/26 03:27:46 INFO : Validating listings for Path1 "/tmp/032741ra/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/createemptysrcdirs/path2/" 2024/04/26 03:27:46 INFO : Bisync successful bisync_test.go:553: TEST createemptysrcdirs PASSED === RUN TestBisyncLocalRemote/dry_run 2024/04/26 03:27:46 DEBUG : Creating backend with remote "/tmp/032741ra/dry_run/path1" 2024/04/26 03:27:46 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:46 DEBUG : path2: Making directory 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:46 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2" 2024/04/26 03:27:46 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:46 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:46 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:46 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:46 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:46 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:46 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2" 2024/04/26 03:27:46 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_dry_run-gukosip9" 2024/04/26 03:27:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file1.txt.novonuy0.partial: renamed to: file1.txt 2024/04/26 03:27:46 INFO : file1.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : Local file system at /tmp/032741ra/initdir/test_dry_run-gukosip9: Waiting for checks to finish 2024/04/26 03:27:46 DEBUG : Local file system at /tmp/032741ra/initdir/test_dry_run-gukosip9: Waiting for transfers to finish 2024/04/26 03:27:46 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file4.txt.kovafah5.partial: renamed to: file4.txt 2024/04/26 03:27:46 INFO : file4.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:46 DEBUG : RCLONE_TEST.cujozub0.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:46 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:46 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file5.txt.tafelon5.partial: renamed to: file5.txt 2024/04/26 03:27:46 DEBUG : file3.txt.dayaqam3.partial: renamed to: file3.txt 2024/04/26 03:27:46 INFO : file5.txt: Copied (new) 2024/04/26 03:27:46 INFO : file3.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file6.txt.cudigak2.partial: renamed to: file6.txt 2024/04/26 03:27:46 INFO : file6.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file7.txt.hewofek6.partial: renamed to: file7.txt 2024/04/26 03:27:46 INFO : file7.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file2.txt.hocuguz7.partial: renamed to: file2.txt 2024/04/26 03:27:46 INFO : file2.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_dry_run-yuxatey7" 2024/04/26 03:27:46 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:46 DEBUG : file1.txt.pumusur1.partial: renamed to: file1.txt 2024/04/26 03:27:46 INFO : file1.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:46 DEBUG : Local file system at /tmp/032741ra/datadir/test_dry_run-yuxatey7: Waiting for checks to finish 2024/04/26 03:27:46 DEBUG : file10.txt.kimuwam9.partial: renamed to: file10.txt 2024/04/26 03:27:46 INFO : file10.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : Local file system at /tmp/032741ra/datadir/test_dry_run-yuxatey7: Waiting for transfers to finish 2024/04/26 03:27:46 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:46 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:46 DEBUG : file2.txt.qimoxoj0.partial: renamed to: file2.txt 2024/04/26 03:27:46 INFO : file2.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file11.txt.fijeyuq8.partial: renamed to: file11.txt 2024/04/26 03:27:46 INFO : file11.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:46 DEBUG : file5L.txt.tuvadat6.partial: renamed to: file5L.txt 2024/04/26 03:27:46 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:46 DEBUG : file6.txt.cakepok3.partial: renamed to: file6.txt 2024/04/26 03:27:46 INFO : file6.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:46 DEBUG : file7.txt.beropog8.partial: renamed to: file7.txt 2024/04/26 03:27:46 INFO : file7.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:46 DEBUG : file5R.txt.fikewuh2.partial: renamed to: file5R.txt 2024/04/26 03:27:46 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:46 ERROR : : error listing: directory not found 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2] 2024/04/26 03:27:46 ERROR : : error listing: directory not found 2024/04/26 03:27:46 checking initFs Local file system at /tmp/032741ra/initdir/test_dry_run-gukosip9 2024/04/26 03:27:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : Local file system at /tmp/032741ra/dry_run/path1: Waiting for checks to finish 2024/04/26 03:27:46 DEBUG : Local file system at /tmp/032741ra/dry_run/path1: Waiting for transfers to finish 2024/04/26 03:27:46 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file2.txt.vewupap1.partial: renamed to: file2.txt 2024/04/26 03:27:46 INFO : file2.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file1.txt.goheqed4.partial: renamed to: file1.txt 2024/04/26 03:27:46 INFO : file1.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file3.txt.xosoleq8.partial: renamed to: file3.txt 2024/04/26 03:27:46 INFO : file3.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:46 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file4.txt.zeyalub3.partial: renamed to: file4.txt 2024/04/26 03:27:46 INFO : file4.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : RCLONE_TEST.duyifuf5.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:46 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:46 DEBUG : file5.txt.hejuqid7.partial: renamed to: file5.txt 2024/04/26 03:27:46 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 INFO : file5.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file7.txt.totuyiw1.partial: renamed to: file7.txt 2024/04/26 03:27:46 INFO : file7.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file6.txt.lekisew7.partial: renamed to: file6.txt 2024/04/26 03:27:46 INFO : file6.txt: Copied (new) 2024/04/26 03:27:46 checking Path1 Local file system at /tmp/032741ra/dry_run/path1 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2] 2024/04/26 03:27:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/RCLONE_TEST] 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file2.txt] 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: Waiting for checks to finish 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file1.txt] 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file3.txt] 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: Waiting for transfers to finish 2024/04/26 03:27:46 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file4.txt] 2024/04/26 03:27:46 INFO : file2.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file5.txt] 2024/04/26 03:27:46 INFO : file1.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file6.txt] 2024/04/26 03:27:46 INFO : file3.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file7.txt] 2024/04/26 03:27:46 INFO : file4.txt: Copied (new) 2024/04/26 03:27:46 INFO : file5.txt: Copied (new) 2024/04/26 03:27:46 INFO : file6.txt: Copied (new) 2024/04/26 03:27:46 INFO : file7.txt: Copied (new) 2024/04/26 03:27:46 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2] 2024/04/26 03:27:46 (01) : test dry-run 2024/04/26 03:27:46 (02) : test initial bisync 2024/04/26 03:27:46 (03) : bisync resync 2024/04/26 03:27:46 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:46 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:46 INFO : Synching Path1 "/tmp/032741ra/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/" 2024/04/26 03:27:46 INFO : Copying Path2 files to Path1 2024/04/26 03:27:46 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:46 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:46 INFO : Resync updating listings 2024/04/26 03:27:46 INFO : Validating listings for Path1 "/tmp/032741ra/dry_run/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/" 2024/04/26 03:27:46 INFO : Bisync successful 2024/04/26 03:27:46 (04) : test new on path2 - file10 2024/04/26 03:27:46 (05) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_dry_run-yuxatey7/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/ 2024/04/26 03:27:46 INFO : file10.txt: Copied (new) 2024/04/26 03:27:46 (06) : test newer on path2 - file1 2024/04/26 03:27:46 (07) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_dry_run-yuxatey7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/ 2024/04/26 03:27:46 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:46 (08) : test new on path1 - file11 2024/04/26 03:27:46 (09) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_dry_run-yuxatey7/file11.txt /tmp/032741ra/dry_run/path1/ 2024/04/26 03:27:46 INFO : file11.txt: Copied (new) 2024/04/26 03:27:46 (10) : test newer on path1 - file2 2024/04/26 03:27:46 (11) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_dry_run-yuxatey7/file2.txt /tmp/032741ra/dry_run/path1/ 2024/04/26 03:27:46 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:46 (12) : test deleted on path2 - file3 2024/04/26 03:27:46 (13) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file3.txt 2024/04/26 03:27:46 INFO : file3.txt: Deleted 2024/04/26 03:27:46 (14) : test deleted on path1 - file4 2024/04/26 03:27:46 (15) : delete-file /tmp/032741ra/dry_run/path1/file4.txt 2024/04/26 03:27:46 INFO : file4.txt: Deleted 2024/04/26 03:27:46 (16) : test changed on path2 and on path1 - file5 (file5R, file5L) 2024/04/26 03:27:46 (17) : touch-glob 2001-01-02 /tmp/032741ra/datadir/test_dry_run-yuxatey7/ file5R.txt 2024/04/26 03:27:46 (18) : copy-as /tmp/032741ra/datadir/test_dry_run-yuxatey7/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/ file5.txt 2024/04/26 03:27:46 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:46 (19) : touch-glob 2001-03-04 /tmp/032741ra/datadir/test_dry_run-yuxatey7/ file5L.txt 2024/04/26 03:27:46 (20) : copy-as /tmp/032741ra/datadir/test_dry_run-yuxatey7/file5L.txt /tmp/032741ra/dry_run/path1/ file5.txt 2024/04/26 03:27:46 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:46 (21) : test newer on path2 and deleted on path1 - file6 2024/04/26 03:27:46 (22) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_dry_run-yuxatey7/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/ 2024/04/26 03:27:46 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:27:46 (23) : delete-file /tmp/032741ra/dry_run/path1/file6.txt 2024/04/26 03:27:46 INFO : file6.txt: Deleted 2024/04/26 03:27:46 (24) : test newer on path1 and deleted on path2 - file7 2024/04/26 03:27:46 (25) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_dry_run-yuxatey7/file7.txt /tmp/032741ra/dry_run/path1/ 2024/04/26 03:27:46 INFO : file7.txt: Copied (replaced existing) 2024/04/26 03:27:46 (26) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file7.txt 2024/04/26 03:27:46 INFO : file7.txt: Deleted 2024/04/26 03:27:46 (27) : test sync with dry-run and resync 2024/04/26 03:27:46 (28) : bisync dry-run resync 2024/04/26 03:27:46 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:46 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:46 INFO : Synching Path1 "/tmp/032741ra/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/" 2024/04/26 03:27:46 INFO : Copying Path2 files to Path1 2024/04/26 03:27:46 NOTICE: - Path2 Resync is copying files to - Path1 2024/04/26 03:27:46 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:46 NOTICE: file4.txt: Skipped copy as --dry-run is set (size 0) 2024/04/26 03:27:46 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:46 NOTICE: - Path1 Resync is copying files to - Path2 2024/04/26 03:27:46 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:46 NOTICE: file3.txt: Skipped copy as --dry-run is set (size 0) 2024/04/26 03:27:46 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:46 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13) 2024/04/26 03:27:46 NOTICE: file5.txt: Skipped copy as --dry-run is set (size 39) 2024/04/26 03:27:46 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 0) 2024/04/26 03:27:46 INFO : Resync updating listings 2024/04/26 03:27:46 INFO : Bisync successful 2024/04/26 03:27:46 (29) : copy-listings dryrun-resync 2024/04/26 03:27:46 (30) : test sync with dry-run 2024/04/26 03:27:46 (31) : bisync dry-run 2024/04/26 03:27:46 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:46 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:46 INFO : Synching Path1 "/tmp/032741ra/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/" 2024/04/26 03:27:46 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:46 INFO : Path1 checking for diffs 2024/04/26 03:27:46 NOTICE: - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:46 NOTICE: - Path1 File was deleted - file4.txt 2024/04/26 03:27:46 NOTICE: - Path1 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:46 NOTICE: - Path1 File was deleted - file6.txt 2024/04/26 03:27:46 NOTICE: - Path1 File changed: size (larger), time (newer) - file7.txt 2024/04/26 03:27:46 NOTICE: - Path1 File is new - file11.txt 2024/04/26 03:27:46 INFO : Path1: 6 changes:  1 new,  3 modified,  2 deleted 2024/04/26 03:27:46 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:46 INFO : Path2 checking for diffs 2024/04/26 03:27:46 NOTICE: - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:46 NOTICE: - Path2 File was deleted - file3.txt 2024/04/26 03:27:46 NOTICE: - Path2 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:46 NOTICE: - Path2 File changed: size (larger), time (newer) - file6.txt 2024/04/26 03:27:46 NOTICE: - Path2 File was deleted - file7.txt 2024/04/26 03:27:46 NOTICE: - Path2 File is new - file10.txt 2024/04/26 03:27:46 INFO : Path2: 6 changes:  1 new,  3 modified,  2 deleted 2024/04/26 03:27:46 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:46 INFO : Applying changes 2024/04/26 03:27:46 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:46 INFO : Checking potential conflicts... 2024/04/26 03:27:46 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: 1 differences found 2024/04/26 03:27:46 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: 1 errors while checking 2024/04/26 03:27:46 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:46 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file11.txt 2024/04/26 03:27:46 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file2.txt 2024/04/26 03:27:46 NOTICE: - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file4.txt 2024/04/26 03:27:46 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:27:46 NOTICE: file5.txt: Skipped rename as --dry-run is set 2024/04/26 03:27:46 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file5.txt.conflict1 2024/04/26 03:27:46 NOTICE: file5.txt: Skipped rename as --dry-run is set 2024/04/26 03:27:46 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/dry_run/path1/file5.txt.conflict2 2024/04/26 03:27:46 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/dry_run/path1/file6.txt 2024/04/26 03:27:46 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file7.txt 2024/04/26 03:27:46 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/dry_run/path1/file1.txt 2024/04/26 03:27:46 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/dry_run/path1/file10.txt 2024/04/26 03:27:46 NOTICE: - Path1 Queue delete - /tmp/032741ra/dry_run/path1/file3.txt 2024/04/26 03:27:46 NOTICE: - Path2 Do queued copies to - Path1 2024/04/26 03:27:46 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:46 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:46 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:46 NOTICE: file3.txt: Skipped delete as --dry-run is set (size 0) 2024/04/26 03:27:46 NOTICE: - Path1 Do queued copies to - Path2 2024/04/26 03:27:46 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:46 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:27:46 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13) 2024/04/26 03:27:46 NOTICE: file4.txt: Skipped delete as --dry-run is set (size 0) 2024/04/26 03:27:46 INFO : Updating listings 2024/04/26 03:27:46 INFO : Bisync successful 2024/04/26 03:27:46 (32) : copy-listings dryrun 2024/04/26 03:27:46 (33) : test sync without dry-run 2024/04/26 03:27:46 (34) : bisync 2024/04/26 03:27:46 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:46 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:46 INFO : Synching Path1 "/tmp/032741ra/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/" 2024/04/26 03:27:46 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:46 INFO : Path1 checking for diffs 2024/04/26 03:27:46 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:46 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:46 INFO : - Path1 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:46 INFO : - Path1 File was deleted - file6.txt 2024/04/26 03:27:46 INFO : - Path1 File changed: size (larger), time (newer) - file7.txt 2024/04/26 03:27:46 INFO : - Path1 File is new - file11.txt 2024/04/26 03:27:46 INFO : Path1: 6 changes:  1 new,  3 modified,  2 deleted 2024/04/26 03:27:46 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:46 INFO : Path2 checking for diffs 2024/04/26 03:27:46 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:46 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:46 INFO : - Path2 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:46 INFO : - Path2 File changed: size (larger), time (newer) - file6.txt 2024/04/26 03:27:46 INFO : - Path2 File was deleted - file7.txt 2024/04/26 03:27:46 INFO : - Path2 File is new - file10.txt 2024/04/26 03:27:46 INFO : Path2: 6 changes:  1 new,  3 modified,  2 deleted 2024/04/26 03:27:46 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:46 INFO : Applying changes 2024/04/26 03:27:46 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:46 INFO : Checking potential conflicts... 2024/04/26 03:27:46 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: 1 differences found 2024/04/26 03:27:46 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2: 1 errors while checking 2024/04/26 03:27:46 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:46 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file11.txt 2024/04/26 03:27:46 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file2.txt 2024/04/26 03:27:46 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file4.txt 2024/04/26 03:27:46 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:27:46 NOTICE: - Path1 Renaming Path1 copy - /tmp/032741ra/dry_run/path1/file5.txt.conflict1 2024/04/26 03:27:46 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/04/26 03:27:46 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file5.txt.conflict1 2024/04/26 03:27:46 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file5.txt.conflict2 2024/04/26 03:27:46 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/04/26 03:27:46 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/dry_run/path1/file5.txt.conflict2 2024/04/26 03:27:46 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/dry_run/path1/file6.txt 2024/04/26 03:27:46 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/file7.txt 2024/04/26 03:27:46 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/dry_run/path1/file1.txt 2024/04/26 03:27:46 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/dry_run/path1/file10.txt 2024/04/26 03:27:46 INFO : - Path1 Queue delete - /tmp/032741ra/dry_run/path1/file3.txt 2024/04/26 03:27:46 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:46 INFO : file5.txt.conflict2: Copied (new) 2024/04/26 03:27:46 INFO : file10.txt: Copied (new) 2024/04/26 03:27:46 INFO : file6.txt: Copied (new) 2024/04/26 03:27:46 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:46 INFO : file3.txt: Deleted 2024/04/26 03:27:46 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:46 INFO : file11.txt: Copied (new) 2024/04/26 03:27:46 INFO : file5.txt.conflict1: Copied (new) 2024/04/26 03:27:46 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:46 INFO : file7.txt: Copied (new) 2024/04/26 03:27:46 INFO : file4.txt: Deleted 2024/04/26 03:27:46 INFO : Updating listings 2024/04/26 03:27:46 INFO : Validating listings for Path1 "/tmp/032741ra/dry_run/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/dry_run/path2/" 2024/04/26 03:27:46 INFO : Bisync successful bisync_test.go:553: TEST dry_run PASSED === RUN TestBisyncLocalRemote/equal 2024/04/26 03:27:46 DEBUG : Creating backend with remote "/tmp/032741ra/equal/path1" 2024/04/26 03:27:46 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:46 DEBUG : path2: Making directory 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:46 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2" 2024/04/26 03:27:46 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:46 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:46 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:46 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:46 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:46 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:46 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2" 2024/04/26 03:27:46 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_equal-zaceced6" 2024/04/26 03:27:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : Local file system at /tmp/032741ra/initdir/test_equal-zaceced6: Waiting for checks to finish 2024/04/26 03:27:46 DEBUG : Local file system at /tmp/032741ra/initdir/test_equal-zaceced6: Waiting for transfers to finish 2024/04/26 03:27:46 DEBUG : file2.txt.mesamuj2.partial: renamed to: file2.txt 2024/04/26 03:27:46 INFO : file2.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:46 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : RCLONE_TEST.yoposoc3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:46 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:46 DEBUG : file1.txt.jelofez9.partial: renamed to: file1.txt 2024/04/26 03:27:46 INFO : file1.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_equal-voyocid7" 2024/04/26 03:27:46 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : Local file system at /tmp/032741ra/datadir/test_equal-voyocid7: Waiting for checks to finish 2024/04/26 03:27:46 DEBUG : Local file system at /tmp/032741ra/datadir/test_equal-voyocid7: Waiting for transfers to finish 2024/04/26 03:27:46 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/04/26 03:27:46 DEBUG : file1L.txt.puduruh2.partial: renamed to: file1L.txt 2024/04/26 03:27:46 INFO : file1L.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/04/26 03:27:46 DEBUG : file2.txt.fegilov3.partial: renamed to: file2.txt 2024/04/26 03:27:46 INFO : file2.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK 2024/04/26 03:27:46 DEBUG : file1R.txt.cazopil1.partial: renamed to: file1R.txt 2024/04/26 03:27:46 INFO : file1R.txt: Copied (new) 2024/04/26 03:27:46 ERROR : : error listing: directory not found 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2] 2024/04/26 03:27:46 ERROR : : error listing: directory not found 2024/04/26 03:27:46 checking initFs Local file system at /tmp/032741ra/initdir/test_equal-zaceced6 2024/04/26 03:27:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : Local file system at /tmp/032741ra/equal/path1: Waiting for checks to finish 2024/04/26 03:27:46 DEBUG : Local file system at /tmp/032741ra/equal/path1: Waiting for transfers to finish 2024/04/26 03:27:46 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:46 DEBUG : file2.txt.vuleyeg3.partial: renamed to: file2.txt 2024/04/26 03:27:46 INFO : file2.txt: Copied (new) 2024/04/26 03:27:46 DEBUG : RCLONE_TEST.xavewaf1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:46 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:46 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:46 DEBUG : file1.txt.pewavow1.partial: renamed to: file1.txt 2024/04/26 03:27:46 INFO : file1.txt: Copied (new) 2024/04/26 03:27:46 checking Path1 Local file system at /tmp/032741ra/equal/path1 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2] 2024/04/26 03:27:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2/file1.txt] 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2/RCLONE_TEST] 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2: Waiting for checks to finish 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2: Waiting for transfers to finish 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2/file2.txt] 2024/04/26 03:27:46 INFO : file1.txt: Copied (new) 2024/04/26 03:27:46 INFO : file2.txt: Copied (new) 2024/04/26 03:27:46 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:46 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2 2024/04/26 03:27:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2] 2024/04/26 03:27:46 (01) : test equal 2024/04/26 03:27:46 (02) : test initial bisync 2024/04/26 03:27:46 (03) : bisync resync 2024/04/26 03:27:46 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:46 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:46 INFO : Synching Path1 "/tmp/032741ra/equal/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2/" 2024/04/26 03:27:46 INFO : Copying Path2 files to Path1 2024/04/26 03:27:46 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:46 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:46 INFO : Resync updating listings 2024/04/26 03:27:46 INFO : Validating listings for Path1 "/tmp/032741ra/equal/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2/" 2024/04/26 03:27:46 INFO : Bisync successful 2024/04/26 03:27:46 (04) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:46 (05) : touch-glob 2001-01-02 /tmp/032741ra/datadir/test_equal-voyocid7/ file1R.txt 2024/04/26 03:27:46 (06) : copy-as /tmp/032741ra/datadir/test_equal-voyocid7/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2/ file1.txt 2024/04/26 03:27:46 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:46 (07) : touch-glob 2001-03-04 /tmp/032741ra/datadir/test_equal-voyocid7/ file1L.txt 2024/04/26 03:27:46 (08) : copy-as /tmp/032741ra/datadir/test_equal-voyocid7/file1L.txt /tmp/032741ra/equal/path1/ file1.txt 2024/04/26 03:27:46 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:46 (09) : test changed on both paths and identical - file2 2024/04/26 03:27:46 (10) : touch-glob 2001-01-02 /tmp/032741ra/datadir/test_equal-voyocid7/ file2.txt 2024/04/26 03:27:46 (11) : copy-as /tmp/032741ra/datadir/test_equal-voyocid7/file2.txt /tmp/032741ra/equal/path1/ file2.txt 2024/04/26 03:27:47 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:47 (12) : copy-as /tmp/032741ra/datadir/test_equal-voyocid7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2/ file2.txt 2024/04/26 03:27:47 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:47 (13) : test bisync run 2024/04/26 03:27:47 (14) : bisync 2024/04/26 03:27:47 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:47 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:47 INFO : Synching Path1 "/tmp/032741ra/equal/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2/" 2024/04/26 03:27:47 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:47 INFO : Path1 checking for diffs 2024/04/26 03:27:47 INFO : - Path1 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:47 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:47 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:27:47 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/04/26 03:27:47 INFO : Path2 checking for diffs 2024/04/26 03:27:47 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:47 INFO : - Path2 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:47 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:27:47 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/04/26 03:27:47 INFO : Applying changes 2024/04/26 03:27:47 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:47 INFO : Checking potential conflicts... 2024/04/26 03:27:47 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2: 1 differences found 2024/04/26 03:27:47 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2: 1 errors while checking 2024/04/26 03:27:47 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2: 1 matching files 2024/04/26 03:27:47 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:47 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:47 NOTICE: - Path1 Renaming Path1 copy - /tmp/032741ra/equal/path1/file1.txt.conflict1 2024/04/26 03:27:47 INFO : file1.txt: Moved (server-side) to: file1.txt.conflict1 2024/04/26 03:27:47 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2/file1.txt.conflict1 2024/04/26 03:27:47 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2/file1.txt.conflict2 2024/04/26 03:27:47 INFO : file1.txt: Moved (server-side) to: file1.txt.conflict2 2024/04/26 03:27:47 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/equal/path1/file1.txt.conflict2 2024/04/26 03:27:47 NOTICE: - WARNING New or changed in both paths - file2.txt 2024/04/26 03:27:47 INFO : Files are equal! Skipping: file2.txt 2024/04/26 03:27:47 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:47 INFO : file1.txt.conflict2: Copied (new) 2024/04/26 03:27:47 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:47 INFO : file1.txt.conflict1: Copied (new) 2024/04/26 03:27:47 INFO : Updating listings 2024/04/26 03:27:47 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:47 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:47 INFO : Validating listings for Path1 "/tmp/032741ra/equal/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/equal/path2/" 2024/04/26 03:27:47 INFO : Bisync successful bisync_test.go:553: TEST equal PASSED === RUN TestBisyncLocalRemote/ext_paths 2024/04/26 03:27:47 DEBUG : Creating backend with remote "/tmp/032741ra/ext_paths/path1" 2024/04/26 03:27:47 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:47 DEBUG : path2: Making directory 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:47 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2" 2024/04/26 03:27:47 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:47 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:47 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2" 2024/04/26 03:27:47 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_ext_paths-sacucif7" 2024/04/26 03:27:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ: Making directory with metadata 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z) 2024/04/26 03:27:47 DEBUG : Added delayed dir = "測試РуÑÑкий ěáñ", newDst=測試РуÑÑкий ěáñ 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/initdir/test_ext_paths-sacucif7: Waiting for checks to finish 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/initdir/test_ext_paths-sacucif7: Waiting for transfers to finish 2024/04/26 03:27:47 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file1.txt.nekiyen2.partial: renamed to: file1.txt 2024/04/26 03:27:47 INFO : file1.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt.sajivog5.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/04/26 03:27:47 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:47 DEBUG : RCLONE_TEST.wajarib1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:47 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt.cuwafas2.partial: renamed to: РуÑÑкий.txt 2024/04/26 03:27:47 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt.moqijah7.partial: renamed to: filename_contains_Ä›_.txt 2024/04/26 03:27:47 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : 測試_check file.qevudil2.partial: renamed to: 測試_check file 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 INFO : 測試_check file: Copied (new) 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt.kutitit0.partial: renamed to: filename_contains_ࢺ_.txt 2024/04/26 03:27:47 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/測試_check file.burazeb6.partial: renamed to: 測試РуÑÑкий ěáñ/測試_check file 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt.yosoniw9.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt.cuzakiw2.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:47 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_ext_paths-lugigot5" 2024/04/26 03:27:47 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/datadir/test_ext_paths-lugigot5: Waiting for checks to finish 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/datadir/test_ext_paths-lugigot5: Waiting for transfers to finish 2024/04/26 03:27:47 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:47 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/04/26 03:27:47 DEBUG : file1.txt.fubefun7.partial: renamed to: file1.txt 2024/04/26 03:27:47 INFO : file1.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : 測試_filtersfile.txt.madukon3.partial: renamed to: 測試_filtersfile.txt 2024/04/26 03:27:47 INFO : 測試_filtersfile.txt: Copied (new) 2024/04/26 03:27:47 ERROR : : error listing: directory not found 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2] 2024/04/26 03:27:47 ERROR : : error listing: directory not found 2024/04/26 03:27:47 checking initFs Local file system at /tmp/032741ra/initdir/test_ext_paths-sacucif7 2024/04/26 03:27:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ: Making directory with metadata 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z) 2024/04/26 03:27:47 DEBUG : Added delayed dir = "測試РуÑÑкий ěáñ", newDst=測試РуÑÑкий ěáñ 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt.paduhig5.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/04/26 03:27:47 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/ext_paths/path1: Waiting for checks to finish 2024/04/26 03:27:47 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/ext_paths/path1: Waiting for transfers to finish 2024/04/26 03:27:47 DEBUG : file1.txt.famiroz2.partial: renamed to: file1.txt 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt.xofewix2.partial: renamed to: filename_contains_ࢺ_.txt 2024/04/26 03:27:47 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt.mayikin6.partial: renamed to: РуÑÑкий.txt 2024/04/26 03:27:47 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:47 DEBUG : RCLONE_TEST.narifit4.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:47 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt.diseriv1.partial: renamed to: filename_contains_Ä›_.txt 2024/04/26 03:27:47 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : 測試_check file.sohoken1.partial: renamed to: 測試_check file 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt.suwizoz6.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt 2024/04/26 03:27:47 INFO : 測試_check file: Copied (new) 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt.yoboled9.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:47 INFO : file1.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/測試_check file.nuwovax7.partial: renamed to: 測試РуÑÑкий ěáñ/測試_check file 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:47 checking Path1 Local file system at /tmp/032741ra/ext_paths/path1 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2] 2024/04/26 03:27:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ: Making directory 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ] 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/RCLONE_TEST] 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/file1.txt] 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/file_enconde_mañana_funcionará.txt] 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/filename_contains_Ä›_.txt] 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: Waiting for checks to finish 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: Waiting for transfers to finish 2024/04/26 03:27:47 INFO : file1.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/filename_contains_ࢺ_.txt] 2024/04/26 03:27:47 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/РуÑÑкий.txt] 2024/04/26 03:27:47 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試_check file] 2024/04/26 03:27:47 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt] 2024/04/26 03:27:47 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt] 2024/04/26 03:27:47 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ/測試_check file] 2024/04/26 03:27:47 INFO : 測試_check file: Copied (new) 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/04/26 03:27:47 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2] 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ] 2024/04/26 03:27:47 (01) : test extended-char-paths 2024/04/26 03:27:47 (02) : fix-names /tmp/032741ra/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/ 2024/04/26 03:27:47 ERROR : Local file system at /tmp/032741ra/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-gicujih0: Server side directory move failed: rename /tmp/032741ra/ext_paths/path1/測試РуÑÑкий eÌŒaÌñ /tmp/032741ra/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-gicujih0: no such file or directory 2024/04/26 03:27:47 INFO : Local file system at /tmp/032741ra/ext_paths/path1/測試РуÑÑкий ěáñ: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2024/04/26 03:27:47 ERROR : Local file system at /tmp/032741ra/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-gicujih0: error reading source root directory: directory not found 2024/04/26 03:27:47 (03) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/ 2024/04/26 03:27:47 ERROR : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-mefiqej7: Server side directory move failed: rename /rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий eÌŒaÌñ: file does not exist 2024/04/26 03:27:47 INFO : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ/: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2024/04/26 03:27:47 ERROR : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-mefiqej7: error reading source root directory: directory not found 2024/04/26 03:27:47 (04) : fix-names /tmp/032741ra/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:27:47 (05) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:27:47 (06) : fix-names /tmp/032741ra/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/filename_contains_Ä›_.txt 2024/04/26 03:27:47 (07) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/filename_contains_Ä›_.txt 2024/04/26 03:27:47 (08) : fix-names /tmp/032741ra/ext_paths/path1/測試_check{spc}file 2024/04/26 03:27:47 (09) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試_check{spc}file 2024/04/26 03:27:47 (10) : fix-names /tmp/032741ra/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:27:47 (11) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:27:47 (12) : test resync subdirs with extended chars 2024/04/26 03:27:47 (13) : bisync subdir=測試РуÑÑкий{spc}{spc}ěáñ resync 2024/04/26 03:27:47 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:47 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:47 INFO : Synching Path1 "/tmp/032741ra/ext_paths/path1/測試РуÑÑкий ěáñ/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/04/26 03:27:47 INFO : Copying Path2 files to Path1 2024/04/26 03:27:47 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:47 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:47 INFO : Resync updating listings 2024/04/26 03:27:47 INFO : Validating listings for Path1 "/tmp/032741ra/ext_paths/path1/測試РуÑÑкий ěáñ/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/04/26 03:27:47 INFO : Bisync successful 2024/04/26 03:27:47 (14) : copy-listings resync 2024/04/26 03:27:47 (15) : test place new files with extended chars on each side 2024/04/26 03:27:47 (16) : touch-glob 2001-01-02 /tmp/032741ra/datadir/test_ext_paths-lugigot5/ file1.txt 2024/04/26 03:27:47 (17) : copy-as /tmp/032741ra/datadir/test_ext_paths-lugigot5/file1.txt /tmp/032741ra/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ 測試_file1p1 2024/04/26 03:27:47 INFO : file1.txt: Copied (new) to: 測試_file1p1 2024/04/26 03:27:47 (18) : copy-as /tmp/032741ra/datadir/test_ext_paths-lugigot5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ 測試_file1p2 2024/04/26 03:27:47 INFO : file1.txt: Copied (new) to: 測試_file1p2 2024/04/26 03:27:47 (19) : test normal sync of subdirs with extended chars 2024/04/26 03:27:47 (20) : bisync subdir=測試РуÑÑкий{spc}{spc}ěáñ 2024/04/26 03:27:47 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:47 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:47 INFO : Synching Path1 "/tmp/032741ra/ext_paths/path1/測試РуÑÑкий ěáñ/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/04/26 03:27:47 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:47 INFO : Path1 checking for diffs 2024/04/26 03:27:47 INFO : - Path1 File is new - 測試_file1p1 2024/04/26 03:27:47 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:47 INFO : Path2 checking for diffs 2024/04/26 03:27:47 INFO : - Path2 File is new - 測試_file1p2 2024/04/26 03:27:47 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:47 INFO : Applying changes 2024/04/26 03:27:47 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ/測試_file1p1 2024/04/26 03:27:47 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/ext_paths/path1/測試РуÑÑкий ěáñ/測試_file1p2 2024/04/26 03:27:47 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:47 INFO : 測試_file1p2: Copied (new) 2024/04/26 03:27:47 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:47 INFO : 測試_file1p1: Copied (new) 2024/04/26 03:27:47 INFO : Updating listings 2024/04/26 03:27:47 INFO : Validating listings for Path1 "/tmp/032741ra/ext_paths/path1/測試РуÑÑкий ěáñ/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/04/26 03:27:47 INFO : Bisync successful 2024/04/26 03:27:47 (21) : move-listings normal-sync 2024/04/26 03:27:47 (22) : test check-filename with extended chars. check should fail. 2024/04/26 03:27:47 (23) : bisync resync 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:47 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:47 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:47 INFO : Synching Path1 "/tmp/032741ra/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/" 2024/04/26 03:27:47 INFO : Copying Path2 files to Path1 2024/04/26 03:27:47 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:47 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:47 INFO : Resync updating listings 2024/04/26 03:27:47 INFO : Validating listings for Path1 "/tmp/032741ra/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/" 2024/04/26 03:27:47 INFO : Bisync successful 2024/04/26 03:27:47 (24) : delete-file /tmp/032741ra/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:27:47 INFO : 測試_check file: Deleted 2024/04/26 03:27:47 (25) : bisync check-access check-filename=測試_check{spc}file 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:47 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:47 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:47 INFO : Synching Path1 "/tmp/032741ra/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/" 2024/04/26 03:27:47 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:47 INFO : Path1 checking for diffs 2024/04/26 03:27:47 INFO : - Path1 File was deleted - 測試РуÑÑкий ěáñ/測試_check file 2024/04/26 03:27:47 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:47 INFO : Path2 checking for diffs 2024/04/26 03:27:47 INFO : Checking access health 2024/04/26 03:27:47 ERROR : Access test failed: Path1 count 1, Path2 count 2 - 測試_check file 2024/04/26 03:27:47 ERROR : -  Access test failed: Path2 file not found in Path1 - 測試РуÑÑкий ěáñ/測試_check file 2024/04/26 03:27:47 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:47 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:47 Bisync error: bisync aborted 2024/04/26 03:27:47 (26) : copy-listings check-access-fail 2024/04/26 03:27:47 (27) : test check-filename with extended chars. check should pass. 2024/04/26 03:27:47 (28) : bisync resync 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:47 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:47 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:47 INFO : Synching Path1 "/tmp/032741ra/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/" 2024/04/26 03:27:47 INFO : Copying Path2 files to Path1 2024/04/26 03:27:47 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:47 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:47 INFO : Resync updating listings 2024/04/26 03:27:47 INFO : Validating listings for Path1 "/tmp/032741ra/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/" 2024/04/26 03:27:47 INFO : Bisync successful 2024/04/26 03:27:47 (29) : bisync check-access check-filename=測試_check{spc}file 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:47 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:47 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:47 INFO : Synching Path1 "/tmp/032741ra/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/" 2024/04/26 03:27:47 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:47 INFO : Path1 checking for diffs 2024/04/26 03:27:47 INFO : Path2 checking for diffs 2024/04/26 03:27:47 INFO : Checking access health 2024/04/26 03:27:47 INFO : Found 2 matching "測試_check file" files on both paths 2024/04/26 03:27:47 INFO : No changes found 2024/04/26 03:27:47 INFO : Updating listings 2024/04/26 03:27:47 INFO : Validating listings for Path1 "/tmp/032741ra/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/" 2024/04/26 03:27:47 INFO : Bisync successful 2024/04/26 03:27:47 (30) : move-listings check-access-pass 2024/04/26 03:27:47 (31) : test filters-file path with extended chars - masks /fileZ.txt 2024/04/26 03:27:47 (32) : copy-file /tmp/032741ra/datadir/test_ext_paths-lugigot5/測試_filtersfile.txt /tmp/032741ra/workdir/ 2024/04/26 03:27:47 INFO : 測試_filtersfile.txt: Copied (new) 2024/04/26 03:27:47 (33) : bisync filters-file=/tmp/032741ra/workdir/測試_filtersfile.txt resync 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:47 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:47 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:47 INFO : Synching Path1 "/tmp/032741ra/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/" 2024/04/26 03:27:47 INFO : Using filters file /tmp/032741ra/workdir/測試_filtersfile.txt 2024/04/26 03:27:47 INFO : Storing filters file hash to /tmp/032741ra/workdir/測試_filtersfile.txt.md5 2024/04/26 03:27:47 INFO : Copying Path2 files to Path1 2024/04/26 03:27:47 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:47 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:47 INFO : Resync updating listings 2024/04/26 03:27:47 INFO : Validating listings for Path1 "/tmp/032741ra/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/" 2024/04/26 03:27:47 INFO : Bisync successful 2024/04/26 03:27:47 (34) : copy-as /tmp/032741ra/datadir/test_ext_paths-lugigot5/file1.txt /tmp/032741ra/ext_paths/path1/ fileZ.txt 2024/04/26 03:27:47 INFO : file1.txt: Copied (new) to: fileZ.txt 2024/04/26 03:27:47 (35) : bisync filters-file=/tmp/032741ra/workdir/測試_filtersfile.txt 2024/04/26 03:27:47 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:47 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:47 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:47 INFO : Synching Path1 "/tmp/032741ra/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/" 2024/04/26 03:27:47 INFO : Using filters file /tmp/032741ra/workdir/測試_filtersfile.txt 2024/04/26 03:27:47 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:47 INFO : Path1 checking for diffs 2024/04/26 03:27:47 INFO : Path2 checking for diffs 2024/04/26 03:27:47 INFO : No changes found 2024/04/26 03:27:47 INFO : Updating listings 2024/04/26 03:27:47 INFO : Validating listings for Path1 "/tmp/032741ra/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ext_paths/path2/" 2024/04/26 03:27:47 INFO : Bisync successful bisync_test.go:553: TEST ext_paths PASSED === RUN TestBisyncLocalRemote/extended_filenames 2024/04/26 03:27:47 DEBUG : Creating backend with remote "/tmp/032741ra/extended_filenames/path1" 2024/04/26 03:27:47 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:47 DEBUG : path2: Making directory 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:47 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2" 2024/04/26 03:27:47 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:47 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:47 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2" 2024/04/26 03:27:47 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_extended_filenames-haviwij4" 2024/04/26 03:27:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_: Making directory with metadata 2024/04/26 03:27:47 INFO : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:47 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_ 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file1 - Copy.txt.jiniriv4.partial: renamed to: file1 - Copy.txt 2024/04/26 03:27:47 INFO : file1 - Copy.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : file1 - Copy (2).txt.waciyop7.partial: renamed to: file1 - Copy (2).txt 2024/04/26 03:27:47 INFO : file1 - Copy (2).txt: Copied (new) 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/initdir/test_extended_filenames-haviwij4: Waiting for checks to finish 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/initdir/test_extended_filenames-haviwij4: Waiting for transfers to finish 2024/04/26 03:27:47 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:47 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file1.txt.luvilec2.partial: renamed to: file1.txt 2024/04/26 03:27:47 INFO : file1.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : RCLONE_TEST.yaxutev6.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:47 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt.nunarav4.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/04/26 03:27:47 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt.yexapuy9.partial: renamed to: filename_contains_Ä›_.txt 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt.pohujur2.partial: renamed to: РуÑÑкий.txt 2024/04/26 03:27:47 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:47 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt.razufoq4.partial: renamed to: filename_contains_ࢺ_.txt 2024/04/26 03:27:47 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt.yadosip3.partial: renamed to: subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:27:47 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.sifuhah6.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt 2024/04/26 03:27:47 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:47 INFO : subdir_with_ࢺ_: Set directory modification time (using SetModTime) 2024/04/26 03:27:47 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_extended_filenames-yohowin4" 2024/04/26 03:27:47 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/datadir/test_extended_filenames-yohowin4: Waiting for checks to finish 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/datadir/test_extended_filenames-yohowin4: Waiting for transfers to finish 2024/04/26 03:27:47 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:47 DEBUG : file1.txt.nedopub4.partial: renamed to: file1.txt 2024/04/26 03:27:47 INFO : file1.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : file2.txt: md5 = 40b811fb5009223b6da573f169619d8e OK 2024/04/26 03:27:47 DEBUG : file2.txt.jicirij0.partial: renamed to: file2.txt 2024/04/26 03:27:47 INFO : file2.txt: Copied (new) 2024/04/26 03:27:47 ERROR : : error listing: directory not found 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2] 2024/04/26 03:27:47 ERROR : : error listing: directory not found 2024/04/26 03:27:47 checking initFs Local file system at /tmp/032741ra/initdir/test_extended_filenames-haviwij4 2024/04/26 03:27:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_: Making directory with metadata 2024/04/26 03:27:47 INFO : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:47 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_ 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file1 - Copy.txt.zadadoq2.partial: renamed to: file1 - Copy.txt 2024/04/26 03:27:47 INFO : file1 - Copy.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/extended_filenames/path1: Waiting for checks to finish 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/extended_filenames/path1: Waiting for transfers to finish 2024/04/26 03:27:47 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file1.txt.bubuwiq0.partial: renamed to: file1.txt 2024/04/26 03:27:47 INFO : file1.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt.pawidar8.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/04/26 03:27:47 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : RCLONE_TEST.hululat8.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:47 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:47 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file1 - Copy (2).txt.jesajur5.partial: renamed to: file1 - Copy (2).txt 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt.sadamil4.partial: renamed to: filename_contains_Ä›_.txt 2024/04/26 03:27:47 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt.muginop0.partial: renamed to: РуÑÑкий.txt 2024/04/26 03:27:47 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 INFO : file1 - Copy (2).txt: Copied (new) 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt.secikaz6.partial: renamed to: filename_contains_ࢺ_.txt 2024/04/26 03:27:47 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt.duyuxaj3.partial: renamed to: subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:27:47 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.cufijuw1.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt 2024/04/26 03:27:47 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:47 INFO : subdir_with_ࢺ_: Set directory modification time (using SetModTime) 2024/04/26 03:27:47 checking Path1 Local file system at /tmp/032741ra/extended_filenames/path1 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2] 2024/04/26 03:27:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_: Making directory 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/subdir_with_ࢺ_] 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/RCLONE_TEST] 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/file1 - Copy (2).txt] 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/file1 - Copy.txt] 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/file1.txt] 2024/04/26 03:27:47 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: Waiting for checks to finish 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: Waiting for transfers to finish 2024/04/26 03:27:47 INFO : file1.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/file_enconde_mañana_funcionará.txt] 2024/04/26 03:27:47 INFO : file1 - Copy (2).txt: Copied (new) 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/filename_contains_Ä›_.txt] 2024/04/26 03:27:47 INFO : file1 - Copy.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/filename_contains_ࢺ_.txt] 2024/04/26 03:27:47 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/РуÑÑкий.txt] 2024/04/26 03:27:47 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_Ä›_.txt] 2024/04/26 03:27:47 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ࢺ_.txt] 2024/04/26 03:27:47 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:47 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:27:47 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:47 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:47 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2] 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/subdir_with_ࢺ_] 2024/04/26 03:27:47 (01) : test extended-filenames 2024/04/26 03:27:47 (02) : fix-names /tmp/032741ra/extended_filenames/path1/subdir_with_ࢺ_/ 2024/04/26 03:27:47 (03) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/subdir_with_ࢺ_/ 2024/04/26 03:27:47 (04) : fix-names /tmp/032741ra/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:27:47 (05) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:27:47 (06) : fix-names /tmp/032741ra/extended_filenames/path1/РуÑÑкий.txt 2024/04/26 03:27:47 (07) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/РуÑÑкий.txt 2024/04/26 03:27:47 (08) : fix-names /tmp/032741ra/extended_filenames/path1/file_enconde_mañana_funcionará.txt 2024/04/26 03:27:47 (09) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2/file_enconde_mañana_funcionará.txt 2024/04/26 03:27:47 (10) : test initial bisync 2024/04/26 03:27:47 (11) : bisync resync 2024/04/26 03:27:47 NOTICE: Local file system at /tmp/032741ra/extended_filenames/path1: Replacing invalid UTF-8 characters in "eÌŒ\x81\xfe aÌñhࢺ_測試РуÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬eÌö" 2024/04/26 03:27:47 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:27:47 NOTICE: Local file system at /tmp/032741ra/extended_filenames/path1: Replacing invalid UTF-8 characters in "Ä›\x81\xfe áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö" 2024/04/26 03:27:47 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/04/26 03:27:47 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:27:47 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) bisync_test.go:1012: Fs is incapable of running test as the paths produce different results, skipping: extended_filenames (path1: file1 - Copy (2).txtfile1 - Copy (2).txt (BOTH) path2: РуÑÑкий.txtÄ›þ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶ (РуÑÑкий.txtÄ›þ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶)) (fs1: Local file system at /tmp/032741ra/extended_filenames/path1 fs2: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/extended_filenames/path2) @@ -1 +1 @@ -file1 - Copy (2).txtfile1 - Copy (2).txt+РуÑÑкий.txtÄ›þ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶ === RUN TestBisyncLocalRemote/filters 2024/04/26 03:27:47 DEBUG : Creating backend with remote "/tmp/032741ra/filters/path1" 2024/04/26 03:27:47 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:47 DEBUG : path2: Making directory 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:47 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2" 2024/04/26 03:27:47 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:47 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:47 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2" 2024/04/26 03:27:47 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_filters-dasosun1" 2024/04/26 03:27:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:47 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:47 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:47 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/initdir/test_filters-dasosun1: Waiting for checks to finish 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/initdir/test_filters-dasosun1: Waiting for transfers to finish 2024/04/26 03:27:47 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file2.txt.zifeyoy2.partial: renamed to: file2.txt 2024/04/26 03:27:47 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 INFO : file2.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : file1.txt.fijoyak4.partial: renamed to: file1.txt 2024/04/26 03:27:47 INFO : file1.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file3.txt.puqucoh0.partial: renamed to: file3.txt 2024/04/26 03:27:47 INFO : file3.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file4.txt.tizuxaf0.partial: renamed to: file4.txt 2024/04/26 03:27:47 INFO : file4.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : file5.txt.nulevux6.partial: renamed to: file5.txt 2024/04/26 03:27:47 INFO : file5.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : file7.txt.winecid8.partial: renamed to: file7.txt 2024/04/26 03:27:47 INFO : file7.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : file6.txt.hehepuk1.partial: renamed to: file6.txt 2024/04/26 03:27:47 INFO : file6.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:47 DEBUG : subdir/file20.txt.yojuveb1.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:47 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:47 DEBUG : RCLONE_TEST.vehuhom3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:47 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:47 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:47 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_filters-hobiway0" 2024/04/26 03:27:47 DEBUG : fileZ.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : filtersfile.flt: Need to transfer - File not found at Destination 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/datadir/test_filters-hobiway0: Waiting for checks to finish 2024/04/26 03:27:47 DEBUG : Local file system at /tmp/032741ra/datadir/test_filters-hobiway0: Waiting for transfers to finish 2024/04/26 03:27:47 DEBUG : fileZ.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:47 DEBUG : filtersfile.flt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/04/26 03:27:47 DEBUG : fileZ.txt.hepivel8.partial: renamed to: fileZ.txt 2024/04/26 03:27:47 INFO : fileZ.txt: Copied (new) 2024/04/26 03:27:47 DEBUG : filtersfile.flt.wicizih9.partial: renamed to: filtersfile.flt 2024/04/26 03:27:47 INFO : filtersfile.flt: Copied (new) 2024/04/26 03:27:47 ERROR : : error listing: directory not found 2024/04/26 03:27:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2] 2024/04/26 03:27:47 ERROR : : error listing: directory not found 2024/04/26 03:27:47 checking initFs Local file system at /tmp/032741ra/initdir/test_filters-dasosun1 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:48 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:48 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:48 DEBUG : RCLONE_TEST.gefosof9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:48 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:48 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.txt.ricazib8.partial: renamed to: file1.txt 2024/04/26 03:27:48 INFO : file1.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file2.txt.wecizam0.partial: renamed to: file2.txt 2024/04/26 03:27:48 INFO : file2.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file3.txt.cohiwed4.partial: renamed to: file3.txt 2024/04/26 03:27:48 INFO : file3.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file4.txt.kunoduy1.partial: renamed to: file4.txt 2024/04/26 03:27:48 INFO : file4.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file5.txt.kugiban6.partial: renamed to: file5.txt 2024/04/26 03:27:48 INFO : file5.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file6.txt.nocoquz1.partial: renamed to: file6.txt 2024/04/26 03:27:48 INFO : file6.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file7.txt.cebizat2.partial: renamed to: file7.txt 2024/04/26 03:27:48 INFO : file7.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : subdir/file20.txt.haxakim9.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:48 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/filters/path1: Waiting for checks to finish 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/filters/path1: Waiting for transfers to finish 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 checking Path1 Local file system at /tmp/032741ra/filters/path1 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2] 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : subdir: Making directory 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/subdir] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/RCLONE_TEST] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/file2.txt] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/file3.txt] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/file1.txt] 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: Waiting for checks to finish 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: Waiting for transfers to finish 2024/04/26 03:27:48 INFO : file2.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/file4.txt] 2024/04/26 03:27:48 INFO : file3.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/file5.txt] 2024/04/26 03:27:48 INFO : file1.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/file6.txt] 2024/04/26 03:27:48 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/file7.txt] 2024/04/26 03:27:48 INFO : file4.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/subdir/file20.txt] 2024/04/26 03:27:48 INFO : file5.txt: Copied (new) 2024/04/26 03:27:48 INFO : file6.txt: Copied (new) 2024/04/26 03:27:48 INFO : file7.txt: Copied (new) 2024/04/26 03:27:48 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:48 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/subdir] 2024/04/26 03:27:48 (01) : test filters 2024/04/26 03:27:48 (02) : copy-file /tmp/032741ra/datadir/test_filters-hobiway0/filtersfile.flt /tmp/032741ra/workdir/ 2024/04/26 03:27:48 INFO : filtersfile.flt: Copied (new) 2024/04/26 03:27:48 (03) : test resync to force building of the filters md5 hash 2024/04/26 03:27:48 (04) : bisync filters-file=/tmp/032741ra/workdir/filtersfile.flt resync 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/" 2024/04/26 03:27:48 INFO : Using filters file /tmp/032741ra/workdir/filtersfile.flt 2024/04/26 03:27:48 INFO : Storing filters file hash to /tmp/032741ra/workdir/filtersfile.flt.md5 2024/04/26 03:27:48 INFO : Copying Path2 files to Path1 2024/04/26 03:27:48 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:48 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:48 INFO : Resync updating listings 2024/04/26 03:27:48 INFO : Validating listings for Path1 "/tmp/032741ra/filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/" 2024/04/26 03:27:48 INFO : Bisync successful 2024/04/26 03:27:48 (05) : copy-listings resync 2024/04/26 03:27:48 (06) : test place new files on the remote 2024/04/26 03:27:48 (07) : touch-glob 2001-01-02 /tmp/032741ra/datadir/test_filters-hobiway0/ fileZ.txt 2024/04/26 03:27:48 (08) : copy-as /tmp/032741ra/datadir/test_filters-hobiway0/fileZ.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/ fileZ.txt 2024/04/26 03:27:48 INFO : fileZ.txt: Copied (new) 2024/04/26 03:27:48 (09) : copy-as /tmp/032741ra/datadir/test_filters-hobiway0/fileZ.txt /tmp/032741ra/filters/path1/subdir fileZ.txt 2024/04/26 03:27:48 INFO : fileZ.txt: Copied (new) 2024/04/26 03:27:48 (10) : test bisync with filters-file. path2-side fileZ.txt will be filtered. 2024/04/26 03:27:48 (11) : bisync filters-file=/tmp/032741ra/workdir/filtersfile.flt 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/" 2024/04/26 03:27:48 INFO : Using filters file /tmp/032741ra/workdir/filtersfile.flt 2024/04/26 03:27:48 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:48 INFO : Path1 checking for diffs 2024/04/26 03:27:48 INFO : - Path1 File is new - subdir/fileZ.txt 2024/04/26 03:27:48 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:48 INFO : Path2 checking for diffs 2024/04/26 03:27:48 INFO : Applying changes 2024/04/26 03:27:48 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/subdir/fileZ.txt 2024/04/26 03:27:48 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:48 INFO : subdir/fileZ.txt: Copied (new) 2024/04/26 03:27:48 INFO : Updating listings 2024/04/26 03:27:48 INFO : Validating listings for Path1 "/tmp/032741ra/filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filters/path2/" 2024/04/26 03:27:48 INFO : Bisync successful bisync_test.go:553: TEST filters PASSED === RUN TestBisyncLocalRemote/filtersfile_checks 2024/04/26 03:27:48 DEBUG : Creating backend with remote "/tmp/032741ra/filtersfile_checks/path1" 2024/04/26 03:27:48 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:48 DEBUG : path2: Making directory 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:48 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2" 2024/04/26 03:27:48 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:48 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:48 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:48 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:48 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:48 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:48 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2" 2024/04/26 03:27:48 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_filtersfile_checks-mopafux8" 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:48 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:48 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.txt.veporoy9.partial: renamed to: file1.txt 2024/04/26 03:27:48 INFO : file1.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file2.txt.kageleb5.partial: renamed to: file2.txt 2024/04/26 03:27:48 INFO : file2.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/initdir/test_filtersfile_checks-mopafux8: Waiting for checks to finish 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/initdir/test_filtersfile_checks-mopafux8: Waiting for transfers to finish 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:48 DEBUG : RCLONE_TEST.vopiqow3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:48 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:48 DEBUG : subdir/file20.txt.ceyulot5.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:48 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_filtersfile_checks-meruxos8" 2024/04/26 03:27:48 DEBUG : filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : filtersfile2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/datadir/test_filtersfile_checks-meruxos8: Waiting for checks to finish 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/datadir/test_filtersfile_checks-meruxos8: Waiting for transfers to finish 2024/04/26 03:27:48 DEBUG : filtersfile.txt: md5 = cbf4389cb34d9e160689d1578eb5707f OK 2024/04/26 03:27:48 DEBUG : filtersfile2.txt: md5 = 95acc1e3b5beda465d9b2cb32808588c OK 2024/04/26 03:27:48 DEBUG : filtersfile.txt.felixin1.partial: renamed to: filtersfile.txt 2024/04/26 03:27:48 INFO : filtersfile.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:27:48 DEBUG : filtersfile2.txt.sadovew6.partial: renamed to: filtersfile2.txt 2024/04/26 03:27:48 INFO : filtersfile2.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : hold.txt.matovep9.partial: renamed to: hold.txt 2024/04/26 03:27:48 INFO : hold.txt: Copied (new) 2024/04/26 03:27:48 ERROR : : error listing: directory not found 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2] 2024/04/26 03:27:48 ERROR : : error listing: directory not found 2024/04/26 03:27:48 checking initFs Local file system at /tmp/032741ra/initdir/test_filtersfile_checks-mopafux8 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:48 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:48 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.txt.salomuy1.partial: renamed to: file1.txt 2024/04/26 03:27:48 INFO : file1.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/filtersfile_checks/path1: Waiting for checks to finish 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/filtersfile_checks/path1: Waiting for transfers to finish 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : RCLONE_TEST.negigos5.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:48 DEBUG : subdir/file20.txt.quqewov6.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:48 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:48 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:48 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file2.txt.jacebot8.partial: renamed to: file2.txt 2024/04/26 03:27:48 INFO : file2.txt: Copied (new) 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 checking Path1 Local file system at /tmp/032741ra/filtersfile_checks/path1 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2] 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : subdir: Making directory 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/RCLONE_TEST] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/file1.txt] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/subdir] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/file2.txt] 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/subdir/file20.txt] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2: Waiting for checks to finish 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2: Waiting for transfers to finish 2024/04/26 03:27:48 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:48 INFO : file1.txt: Copied (new) 2024/04/26 03:27:48 INFO : file2.txt: Copied (new) 2024/04/26 03:27:48 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:48 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/subdir] 2024/04/26 03:27:48 (01) : test filtersfile-checks 2024/04/26 03:27:48 (02) : test initial bisync 2024/04/26 03:27:48 (03) : bisync resync 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/" 2024/04/26 03:27:48 INFO : Copying Path2 files to Path1 2024/04/26 03:27:48 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:48 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:48 INFO : Resync updating listings 2024/04/26 03:27:48 INFO : Validating listings for Path1 "/tmp/032741ra/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/" 2024/04/26 03:27:48 INFO : Bisync successful 2024/04/26 03:27:48 (04) : test 1. inject filters file in workdir. 2024/04/26 03:27:48 (05) : copy-file /tmp/032741ra/datadir/test_filtersfile_checks-meruxos8/filtersfile.txt /tmp/032741ra/workdir/ 2024/04/26 03:27:48 INFO : filtersfile.txt: Copied (new) 2024/04/26 03:27:48 (06) : test 2. run with filters-file but without md5. should abort. 2024/04/26 03:27:48 (07) : bisync filters-file=/tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/" 2024/04/26 03:27:48 INFO : Using filters file /tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 ERROR : Bisync critical error: filters file md5 hash not found (must run --resync): /tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:48 Bisync error: bisync aborted 2024/04/26 03:27:48 (08) : test 3. run without filters-file. should be blocked due to prior abort. 2024/04/26 03:27:48 (09) : bisync 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/" 2024/04/26 03:27:48 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/032741ra/workdir/tmp_032741ra_filtersfile_checks_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_filtersfile_checks_path2.path1.lst Path2: /tmp/032741ra/workdir/tmp_032741ra_filtersfile_checks_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_filtersfile_checks_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/032741ra/workdir" 2024/04/26 03:27:48 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:48 Bisync error: bisync aborted 2024/04/26 03:27:48 (10) : test 4. run with filters-file and resync. 2024/04/26 03:27:48 (11) : bisync filters-file=/tmp/032741ra/workdir/filtersfile.txt resync 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/" 2024/04/26 03:27:48 INFO : Using filters file /tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 INFO : Storing filters file hash to /tmp/032741ra/workdir/filtersfile.txt.md5 2024/04/26 03:27:48 INFO : Copying Path2 files to Path1 2024/04/26 03:27:48 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:48 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:48 INFO : Resync updating listings 2024/04/26 03:27:48 INFO : Validating listings for Path1 "/tmp/032741ra/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/" 2024/04/26 03:27:48 INFO : Bisync successful 2024/04/26 03:27:48 (12) : test 5. run with filters-file alone. should run. 2024/04/26 03:27:48 (13) : bisync filters-file=/tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/" 2024/04/26 03:27:48 INFO : Using filters file /tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:48 INFO : Path1 checking for diffs 2024/04/26 03:27:48 INFO : Path2 checking for diffs 2024/04/26 03:27:48 INFO : No changes found 2024/04/26 03:27:48 INFO : Updating listings 2024/04/26 03:27:48 INFO : Validating listings for Path1 "/tmp/032741ra/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/" 2024/04/26 03:27:48 INFO : Bisync successful 2024/04/26 03:27:48 (14) : test 6. push changed filters-file to workdir. 2024/04/26 03:27:48 (15) : copy-as /tmp/032741ra/datadir/test_filtersfile_checks-meruxos8/filtersfile2.txt /tmp/032741ra/workdir/ filtersfile.txt 2024/04/26 03:27:48 INFO : filtersfile2.txt: Copied (replaced existing) to: filtersfile.txt 2024/04/26 03:27:48 (16) : test 7. run with filters-file alone. should abort. 2024/04/26 03:27:48 (17) : bisync filters-file=/tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/" 2024/04/26 03:27:48 INFO : Using filters file /tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:48 Bisync error: bisync aborted 2024/04/26 03:27:48 (18) : test 8. run with filters-file and resync and dry-run. should do the dry-run but still cause next non-resync run to abort. 2024/04/26 03:27:48 (19) : bisync filters-file=/tmp/032741ra/workdir/filtersfile.txt resync dry-run 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/" 2024/04/26 03:27:48 INFO : Using filters file /tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 INFO : Skipped storing filters file hash to /tmp/032741ra/workdir/filtersfile.txt.md5 as --dry-run is set 2024/04/26 03:27:48 INFO : Copying Path2 files to Path1 2024/04/26 03:27:48 NOTICE: - Path2 Resync is copying files to - Path1 2024/04/26 03:27:48 NOTICE: - Path1 Resync is copying files to - Path2 2024/04/26 03:27:48 INFO : Resync updating listings 2024/04/26 03:27:48 INFO : Bisync successful 2024/04/26 03:27:48 (20) : test 9. run with filters-file alone. should abort. 2024/04/26 03:27:48 (21) : bisync filters-file=/tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/filtersfile_checks/path2/" 2024/04/26 03:27:48 INFO : Using filters file /tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/032741ra/workdir/filtersfile.txt 2024/04/26 03:27:48 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:48 Bisync error: bisync aborted bisync_test.go:553: TEST filtersfile_checks PASSED === RUN TestBisyncLocalRemote/ignorelistingchecksum 2024/04/26 03:27:48 DEBUG : Creating backend with remote "/tmp/032741ra/ignorelistingchecksum/path1" 2024/04/26 03:27:48 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:48 DEBUG : path2: Making directory 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:48 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2" 2024/04/26 03:27:48 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:48 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:48 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:48 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:48 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:48 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:48 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2" 2024/04/26 03:27:48 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_ignorelistingchecksum-ciniqar5" 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:48 INFO : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/04/26 03:27:48 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.copy1.txt.cuhuped1.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:48 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.copy2.txt.pebedok9.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:48 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file1.copy4.txt.tunuwuz3.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:48 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/initdir/test_ignorelistingchecksum-ciniqar5: Waiting for checks to finish 2024/04/26 03:27:48 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/initdir/test_ignorelistingchecksum-ciniqar5: Waiting for transfers to finish 2024/04/26 03:27:48 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.copy5.txt.faqacig2.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:48 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.txt.reyitax1.partial: renamed to: file1.txt 2024/04/26 03:27:48 INFO : file1.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file1.copy3.txt.hulihap3.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:48 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : subdir/file20.txt.jihaqeg2.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:48 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:48 DEBUG : RCLONE_TEST.ximumiv7.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:48 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_ignorelistingchecksum-lepeqaw5" 2024/04/26 03:27:48 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/datadir/test_ignorelistingchecksum-lepeqaw5: Waiting for checks to finish 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/datadir/test_ignorelistingchecksum-lepeqaw5: Waiting for transfers to finish 2024/04/26 03:27:48 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:48 DEBUG : file1.txt.lokizix2.partial: renamed to: file1.txt 2024/04/26 03:27:48 INFO : file1.txt: Copied (new) 2024/04/26 03:27:48 ERROR : : error listing: directory not found 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2] 2024/04/26 03:27:48 ERROR : : error listing: directory not found 2024/04/26 03:27:48 checking initFs Local file system at /tmp/032741ra/initdir/test_ignorelistingchecksum-ciniqar5 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:48 INFO : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/04/26 03:27:48 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:48 DEBUG : RCLONE_TEST.calufuz5.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:48 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/ignorelistingchecksum/path1: Waiting for checks to finish 2024/04/26 03:27:48 DEBUG : Local file system at /tmp/032741ra/ignorelistingchecksum/path1: Waiting for transfers to finish 2024/04/26 03:27:48 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.copy2.txt.bejiqac6.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:48 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.copy1.txt.furageq1.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:48 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.copy5.txt.hiceyuf3.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:48 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:48 DEBUG : subdir/file20.txt.cututav4.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:48 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file1.txt.wekekub3.partial: renamed to: file1.txt 2024/04/26 03:27:48 INFO : file1.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file1.copy3.txt.yazagaf2.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:48 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : file1.copy4.txt.fapoxig9.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:48 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 checking Path1 Local file system at /tmp/032741ra/ignorelistingchecksum/path1 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2] 2024/04/26 03:27:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : subdir: Making directory 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/subdir] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/RCLONE_TEST] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/file1.copy1.txt] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/file1.copy2.txt] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/file1.copy3.txt] 2024/04/26 03:27:48 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: Waiting for checks to finish 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: Waiting for transfers to finish 2024/04/26 03:27:48 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/file1.copy4.txt] 2024/04/26 03:27:48 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/file1.copy5.txt] 2024/04/26 03:27:48 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/file1.txt] 2024/04/26 03:27:48 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/subdir/file20.txt] 2024/04/26 03:27:48 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:48 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:48 INFO : file1.txt: Copied (new) 2024/04/26 03:27:48 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:48 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2] 2024/04/26 03:27:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/subdir] 2024/04/26 03:27:48 (01) : test basic 2024/04/26 03:27:48 (02) : test initial bisync 2024/04/26 03:27:48 (03) : bisync resync 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/" 2024/04/26 03:27:48 INFO : Copying Path2 files to Path1 2024/04/26 03:27:48 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:48 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:48 INFO : Resync updating listings 2024/04/26 03:27:48 INFO : Validating listings for Path1 "/tmp/032741ra/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/" 2024/04/26 03:27:48 INFO : Bisync successful 2024/04/26 03:27:48 (04) : bisync resync ignore-listing-checksum 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/" 2024/04/26 03:27:48 INFO : Copying Path2 files to Path1 2024/04/26 03:27:48 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:48 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:48 INFO : Resync updating listings 2024/04/26 03:27:48 INFO : Validating listings for Path1 "/tmp/032741ra/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/" 2024/04/26 03:27:48 INFO : Bisync successful 2024/04/26 03:27:48 (05) : test place newer files on both paths 2024/04/26 03:27:48 (06) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_ignorelistingchecksum-lepeqaw5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/ 2024/04/26 03:27:48 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:48 (07) : copy-as /tmp/032741ra/datadir/test_ignorelistingchecksum-lepeqaw5/file1.txt /tmp/032741ra/ignorelistingchecksum/path1/subdir file20.txt 2024/04/26 03:27:48 INFO : file1.txt: Copied (replaced existing) to: file20.txt 2024/04/26 03:27:48 (08) : test bisync run 2024/04/26 03:27:48 (09) : bisync ignore-listing-checksum 2024/04/26 03:27:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:48 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:48 INFO : Synching Path1 "/tmp/032741ra/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/" 2024/04/26 03:27:48 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:48 INFO : Path1 checking for diffs 2024/04/26 03:27:48 INFO : - Path1 File changed: size (larger), time (newer) - subdir/file20.txt 2024/04/26 03:27:48 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:48 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:48 INFO : Path2 checking for diffs 2024/04/26 03:27:48 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:48 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:48 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:48 INFO : Applying changes 2024/04/26 03:27:48 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/subdir/file20.txt 2024/04/26 03:27:48 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/ignorelistingchecksum/path1/file1.txt 2024/04/26 03:27:48 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:48 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:48 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:48 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:48 INFO : Updating listings 2024/04/26 03:27:48 INFO : Validating listings for Path1 "/tmp/032741ra/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/ignorelistingchecksum/path2/" 2024/04/26 03:27:48 INFO : Bisync successful bisync_test.go:553: TEST ignorelistingchecksum PASSED === RUN TestBisyncLocalRemote/max_delete_path1 2024/04/26 03:27:49 DEBUG : Creating backend with remote "/tmp/032741ra/max_delete_path1/path1" 2024/04/26 03:27:49 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:49 DEBUG : path2: Making directory 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:49 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2" 2024/04/26 03:27:49 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:49 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:49 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2" 2024/04/26 03:27:49 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_max_delete_path1-bijuwov5" 2024/04/26 03:27:49 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/initdir/test_max_delete_path1-bijuwov5: Waiting for checks to finish 2024/04/26 03:27:49 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file1.txt.cufesek7.partial: renamed to: file1.txt 2024/04/26 03:27:49 INFO : file1.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file2.txt.meviqeb0.partial: renamed to: file2.txt 2024/04/26 03:27:49 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 INFO : file2.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file3.txt.behuzul5.partial: renamed to: file3.txt 2024/04/26 03:27:49 INFO : file3.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file5.txt.jejopec0.partial: renamed to: file5.txt 2024/04/26 03:27:49 INFO : file5.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file6.txt.cegolug1.partial: renamed to: file6.txt 2024/04/26 03:27:49 INFO : file6.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/initdir/test_max_delete_path1-bijuwov5: Waiting for transfers to finish 2024/04/26 03:27:49 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file8.txt.sayenow2.partial: renamed to: file8.txt 2024/04/26 03:27:49 INFO : file8.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file4.txt.xasahox8.partial: renamed to: file4.txt 2024/04/26 03:27:49 INFO : file4.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file7.txt.zusekac3.partial: renamed to: file7.txt 2024/04/26 03:27:49 INFO : file7.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:49 DEBUG : file9.txt.winiqig5.partial: renamed to: file9.txt 2024/04/26 03:27:49 INFO : file9.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_max_delete_path1-zarowag8" 2024/04/26 03:27:49 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/datadir/test_max_delete_path1-zarowag8: Waiting for checks to finish 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/datadir/test_max_delete_path1-zarowag8: Waiting for transfers to finish 2024/04/26 03:27:49 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:27:49 DEBUG : hold.txt.jocucis8.partial: renamed to: hold.txt 2024/04/26 03:27:49 INFO : hold.txt: Copied (new) 2024/04/26 03:27:49 ERROR : : error listing: directory not found 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2] 2024/04/26 03:27:49 ERROR : : error listing: directory not found 2024/04/26 03:27:49 checking initFs Local file system at /tmp/032741ra/initdir/test_max_delete_path1-bijuwov5 2024/04/26 03:27:49 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/max_delete_path1/path1: Waiting for checks to finish 2024/04/26 03:27:49 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/max_delete_path1/path1: Waiting for transfers to finish 2024/04/26 03:27:49 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file2.txt.rajeyom2.partial: renamed to: file2.txt 2024/04/26 03:27:49 INFO : file2.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file4.txt.puqejob5.partial: renamed to: file4.txt 2024/04/26 03:27:49 INFO : file4.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file3.txt.riveqef1.partial: renamed to: file3.txt 2024/04/26 03:27:49 INFO : file3.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file5.txt.turekiy6.partial: renamed to: file5.txt 2024/04/26 03:27:49 INFO : file5.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file7.txt.fohemab6.partial: renamed to: file7.txt 2024/04/26 03:27:49 INFO : file7.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file6.txt.wureloz7.partial: renamed to: file6.txt 2024/04/26 03:27:49 INFO : file6.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file1.txt.rocehez8.partial: renamed to: file1.txt 2024/04/26 03:27:49 INFO : file1.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:49 DEBUG : file9.txt.yizihig5.partial: renamed to: file9.txt 2024/04/26 03:27:49 INFO : file9.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file8.txt.jodesum8.partial: renamed to: file8.txt 2024/04/26 03:27:49 INFO : file8.txt: Copied (new) 2024/04/26 03:27:49 checking Path1 Local file system at /tmp/032741ra/max_delete_path1/path1 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2] 2024/04/26 03:27:49 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: Waiting for checks to finish 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file1.txt] 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file2.txt] 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file3.txt] 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: Waiting for transfers to finish 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file4.txt] 2024/04/26 03:27:49 INFO : file2.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file5.txt] 2024/04/26 03:27:49 INFO : file1.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file6.txt] 2024/04/26 03:27:49 INFO : file3.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file7.txt] 2024/04/26 03:27:49 INFO : file4.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file8.txt] 2024/04/26 03:27:49 INFO : file5.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file9.txt] 2024/04/26 03:27:49 INFO : file6.txt: Copied (new) 2024/04/26 03:27:49 INFO : file7.txt: Copied (new) 2024/04/26 03:27:49 INFO : file8.txt: Copied (new) 2024/04/26 03:27:49 INFO : file9.txt: Copied (new) 2024/04/26 03:27:49 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2] 2024/04/26 03:27:49 (01) : test max-delete-path1 2024/04/26 03:27:49 (02) : test initial bisync 2024/04/26 03:27:49 (03) : bisync resync 2024/04/26 03:27:49 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:49 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:49 INFO : Synching Path1 "/tmp/032741ra/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/" 2024/04/26 03:27:49 INFO : Copying Path2 files to Path1 2024/04/26 03:27:49 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:49 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:49 INFO : Resync updating listings 2024/04/26 03:27:49 INFO : Validating listings for Path1 "/tmp/032741ra/max_delete_path1/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/" 2024/04/26 03:27:49 INFO : Bisync successful 2024/04/26 03:27:49 (04) : test delete >50% of local files 2024/04/26 03:27:49 (05) : delete-file /tmp/032741ra/max_delete_path1/path1/file1.txt 2024/04/26 03:27:49 INFO : file1.txt: Deleted 2024/04/26 03:27:49 (06) : delete-file /tmp/032741ra/max_delete_path1/path1/file2.txt 2024/04/26 03:27:49 INFO : file2.txt: Deleted 2024/04/26 03:27:49 (07) : delete-file /tmp/032741ra/max_delete_path1/path1/file3.txt 2024/04/26 03:27:49 INFO : file3.txt: Deleted 2024/04/26 03:27:49 (08) : delete-file /tmp/032741ra/max_delete_path1/path1/file4.txt 2024/04/26 03:27:49 INFO : file4.txt: Deleted 2024/04/26 03:27:49 (09) : delete-file /tmp/032741ra/max_delete_path1/path1/file5.txt 2024/04/26 03:27:49 INFO : file5.txt: Deleted 2024/04/26 03:27:49 (10) : test sync should fail due to too many local deletes 2024/04/26 03:27:49 (11) : bisync 2024/04/26 03:27:49 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:49 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:49 INFO : Synching Path1 "/tmp/032741ra/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/" 2024/04/26 03:27:49 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:49 INFO : Path1 checking for diffs 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file1.txt 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file2.txt 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file3.txt 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file5.txt 2024/04/26 03:27:49 INFO : Path1: 5 changes:  0 new,  0 modified,  5 deleted 2024/04/26 03:27:49 INFO : Path2 checking for diffs 2024/04/26 03:27:49 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path1 "/tmp/032741ra/max_delete_path1/path1/". Run with --force if desired. 2024/04/26 03:27:49 NOTICE: Bisync aborted. Please try again. 2024/04/26 03:27:49 Bisync error: too many deletes 2024/04/26 03:27:49 (12) : copy-listings initial-fail 2024/04/26 03:27:49 (13) : test change max-delete limit to 60%. sync should run. 2024/04/26 03:27:49 (14) : bisync max-delete=60 2024/04/26 03:27:49 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:49 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:49 INFO : Synching Path1 "/tmp/032741ra/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/" 2024/04/26 03:27:49 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:49 INFO : Path1 checking for diffs 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file1.txt 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file2.txt 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file3.txt 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file5.txt 2024/04/26 03:27:49 INFO : Path1: 5 changes:  0 new,  0 modified,  5 deleted 2024/04/26 03:27:49 INFO : Path2 checking for diffs 2024/04/26 03:27:49 INFO : Applying changes 2024/04/26 03:27:49 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file1.txt 2024/04/26 03:27:49 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file2.txt 2024/04/26 03:27:49 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file3.txt 2024/04/26 03:27:49 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file4.txt 2024/04/26 03:27:49 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/file5.txt 2024/04/26 03:27:49 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:49 INFO : file1.txt: Deleted 2024/04/26 03:27:49 INFO : file2.txt: Deleted 2024/04/26 03:27:49 INFO : file3.txt: Deleted 2024/04/26 03:27:49 INFO : file4.txt: Deleted 2024/04/26 03:27:49 INFO : file5.txt: Deleted 2024/04/26 03:27:49 INFO : Updating listings 2024/04/26 03:27:49 INFO : Validating listings for Path1 "/tmp/032741ra/max_delete_path1/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path1/path2/" 2024/04/26 03:27:49 INFO : Bisync successful bisync_test.go:553: TEST max_delete_path1 PASSED === RUN TestBisyncLocalRemote/max_delete_path2_force 2024/04/26 03:27:49 DEBUG : Creating backend with remote "/tmp/032741ra/max_delete_path2_force/path1" 2024/04/26 03:27:49 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:49 DEBUG : path2: Making directory 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:49 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2" 2024/04/26 03:27:49 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:49 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:49 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2" 2024/04/26 03:27:49 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_max_delete_path2_force-wazoxip7" 2024/04/26 03:27:49 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/initdir/test_max_delete_path2_force-wazoxip7: Waiting for checks to finish 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/initdir/test_max_delete_path2_force-wazoxip7: Waiting for transfers to finish 2024/04/26 03:27:49 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file1.txt.dewanad7.partial: renamed to: file1.txt 2024/04/26 03:27:49 INFO : file1.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file2.txt.fosijup0.partial: renamed to: file2.txt 2024/04/26 03:27:49 INFO : file2.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file3.txt.xovujob4.partial: renamed to: file3.txt 2024/04/26 03:27:49 INFO : file3.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file4.txt.xovuwez9.partial: renamed to: file4.txt 2024/04/26 03:27:49 INFO : file4.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file5.txt.cejejep9.partial: renamed to: file5.txt 2024/04/26 03:27:49 INFO : file5.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file8.txt.hilicag0.partial: renamed to: file8.txt 2024/04/26 03:27:49 INFO : file8.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file7.txt.xikitil0.partial: renamed to: file7.txt 2024/04/26 03:27:49 INFO : file7.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:49 DEBUG : file9.txt.bacogeq3.partial: renamed to: file9.txt 2024/04/26 03:27:49 INFO : file9.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file6.txt.kizasel0.partial: renamed to: file6.txt 2024/04/26 03:27:49 INFO : file6.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_max_delete_path2_force-wemapaf3" 2024/04/26 03:27:49 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/datadir/test_max_delete_path2_force-wemapaf3: Waiting for checks to finish 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/datadir/test_max_delete_path2_force-wemapaf3: Waiting for transfers to finish 2024/04/26 03:27:49 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:27:49 DEBUG : hold.txt.zuwekem2.partial: renamed to: hold.txt 2024/04/26 03:27:49 INFO : hold.txt: Copied (new) 2024/04/26 03:27:49 ERROR : : error listing: directory not found 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2] 2024/04/26 03:27:49 ERROR : : error listing: directory not found 2024/04/26 03:27:49 checking initFs Local file system at /tmp/032741ra/initdir/test_max_delete_path2_force-wazoxip7 2024/04/26 03:27:49 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/max_delete_path2_force/path1: Waiting for checks to finish 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/max_delete_path2_force/path1: Waiting for transfers to finish 2024/04/26 03:27:49 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file1.txt.rilicor3.partial: renamed to: file1.txt 2024/04/26 03:27:49 INFO : file1.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file2.txt.noziqij1.partial: renamed to: file2.txt 2024/04/26 03:27:49 INFO : file2.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file3.txt.simufin4.partial: renamed to: file3.txt 2024/04/26 03:27:49 INFO : file3.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file4.txt.vapibif6.partial: renamed to: file4.txt 2024/04/26 03:27:49 INFO : file4.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file5.txt.diqajib5.partial: renamed to: file5.txt 2024/04/26 03:27:49 INFO : file5.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file6.txt.luzisav7.partial: renamed to: file6.txt 2024/04/26 03:27:49 INFO : file6.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file8.txt.yuvepib6.partial: renamed to: file8.txt 2024/04/26 03:27:49 INFO : file8.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file7.txt.keketey7.partial: renamed to: file7.txt 2024/04/26 03:27:49 INFO : file7.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:49 DEBUG : file9.txt.jowadaf2.partial: renamed to: file9.txt 2024/04/26 03:27:49 INFO : file9.txt: Copied (new) 2024/04/26 03:27:49 checking Path1 Local file system at /tmp/032741ra/max_delete_path2_force/path1 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2] 2024/04/26 03:27:49 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file1.txt] 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file2.txt] 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file3.txt] 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file4.txt] 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: Waiting for checks to finish 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: Waiting for transfers to finish 2024/04/26 03:27:49 INFO : file1.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file5.txt] 2024/04/26 03:27:49 INFO : file2.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file6.txt] 2024/04/26 03:27:49 INFO : file3.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file7.txt] 2024/04/26 03:27:49 INFO : file4.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file8.txt] 2024/04/26 03:27:49 INFO : file5.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file9.txt] 2024/04/26 03:27:49 INFO : file6.txt: Copied (new) 2024/04/26 03:27:49 INFO : file7.txt: Copied (new) 2024/04/26 03:27:49 INFO : file8.txt: Copied (new) 2024/04/26 03:27:49 INFO : file9.txt: Copied (new) 2024/04/26 03:27:49 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2] 2024/04/26 03:27:49 (01) : test max-delete-path2-force 2024/04/26 03:27:49 (02) : test initial bisync 2024/04/26 03:27:49 (03) : bisync resync 2024/04/26 03:27:49 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:49 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:49 INFO : Synching Path1 "/tmp/032741ra/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/" 2024/04/26 03:27:49 INFO : Copying Path2 files to Path1 2024/04/26 03:27:49 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:49 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:49 INFO : Resync updating listings 2024/04/26 03:27:49 INFO : Validating listings for Path1 "/tmp/032741ra/max_delete_path2_force/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/" 2024/04/26 03:27:49 INFO : Bisync successful 2024/04/26 03:27:49 (04) : test delete >50% of remote files 2024/04/26 03:27:49 (05) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file1.txt 2024/04/26 03:27:49 INFO : file1.txt: Deleted 2024/04/26 03:27:49 (06) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file2.txt 2024/04/26 03:27:49 INFO : file2.txt: Deleted 2024/04/26 03:27:49 (07) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file3.txt 2024/04/26 03:27:49 INFO : file3.txt: Deleted 2024/04/26 03:27:49 (08) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file4.txt 2024/04/26 03:27:49 INFO : file4.txt: Deleted 2024/04/26 03:27:49 (09) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/file5.txt 2024/04/26 03:27:49 INFO : file5.txt: Deleted 2024/04/26 03:27:49 (10) : test sync should fail due to too many path2 deletes 2024/04/26 03:27:49 (11) : bisync 2024/04/26 03:27:49 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:49 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:49 INFO : Synching Path1 "/tmp/032741ra/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/" 2024/04/26 03:27:49 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:49 INFO : Path1 checking for diffs 2024/04/26 03:27:49 INFO : Path2 checking for diffs 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file1.txt 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file2.txt 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file4.txt 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file5.txt 2024/04/26 03:27:49 INFO : Path2: 5 changes:  0 new,  0 modified,  5 deleted 2024/04/26 03:27:49 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/". Run with --force if desired. 2024/04/26 03:27:49 NOTICE: Bisync aborted. Please try again. 2024/04/26 03:27:49 Bisync error: too many deletes 2024/04/26 03:27:49 (12) : copy-listings initial-fail 2024/04/26 03:27:49 (13) : test apply force option. sync should run. 2024/04/26 03:27:49 (14) : bisync force 2024/04/26 03:27:49 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:49 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:49 INFO : Synching Path1 "/tmp/032741ra/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/" 2024/04/26 03:27:49 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:49 INFO : Path1 checking for diffs 2024/04/26 03:27:49 INFO : Path2 checking for diffs 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file1.txt 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file2.txt 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file4.txt 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file5.txt 2024/04/26 03:27:49 INFO : Path2: 5 changes:  0 new,  0 modified,  5 deleted 2024/04/26 03:27:49 INFO : Applying changes 2024/04/26 03:27:49 INFO : - Path1 Queue delete - /tmp/032741ra/max_delete_path2_force/path1/file1.txt 2024/04/26 03:27:49 INFO : - Path1 Queue delete - /tmp/032741ra/max_delete_path2_force/path1/file2.txt 2024/04/26 03:27:49 INFO : - Path1 Queue delete - /tmp/032741ra/max_delete_path2_force/path1/file3.txt 2024/04/26 03:27:49 INFO : - Path1 Queue delete - /tmp/032741ra/max_delete_path2_force/path1/file4.txt 2024/04/26 03:27:49 INFO : - Path1 Queue delete - /tmp/032741ra/max_delete_path2_force/path1/file5.txt 2024/04/26 03:27:49 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:49 INFO : file1.txt: Deleted 2024/04/26 03:27:49 INFO : file3.txt: Deleted 2024/04/26 03:27:49 INFO : file4.txt: Deleted 2024/04/26 03:27:49 INFO : file2.txt: Deleted 2024/04/26 03:27:49 INFO : file5.txt: Deleted 2024/04/26 03:27:49 INFO : Updating listings 2024/04/26 03:27:49 INFO : Validating listings for Path1 "/tmp/032741ra/max_delete_path2_force/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/max_delete_path2_force/path2/" 2024/04/26 03:27:49 INFO : Bisync successful bisync_test.go:553: TEST max_delete_path2_force PASSED === RUN TestBisyncLocalRemote/nomodtime 2024/04/26 03:27:49 DEBUG : Creating backend with remote "/tmp/032741ra/nomodtime/path1" 2024/04/26 03:27:49 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:49 DEBUG : path2: Making directory 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:49 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2" 2024/04/26 03:27:49 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:49 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:49 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2" 2024/04/26 03:27:49 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_nomodtime-zuseyeb4" 2024/04/26 03:27:49 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/initdir/test_nomodtime-zuseyeb4: Waiting for checks to finish 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/initdir/test_nomodtime-zuseyeb4: Waiting for transfers to finish 2024/04/26 03:27:49 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file3.txt.mofusew4.partial: renamed to: file3.txt 2024/04/26 03:27:49 INFO : file3.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file1.txt.rirarib7.partial: renamed to: file1.txt 2024/04/26 03:27:49 INFO : file1.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file5.txt.qezumup7.partial: renamed to: file5.txt 2024/04/26 03:27:49 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:49 INFO : file5.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file4.txt.luceqic7.partial: renamed to: file4.txt 2024/04/26 03:27:49 INFO : file4.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : RCLONE_TEST.vawiqep0.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:49 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:49 DEBUG : file2.txt.guyaviy6.partial: renamed to: file2.txt 2024/04/26 03:27:49 INFO : file2.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file6.txt.cugufix3.partial: renamed to: file6.txt 2024/04/26 03:27:49 INFO : file6.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file8.txt.kacadoy9.partial: renamed to: file8.txt 2024/04/26 03:27:49 INFO : file8.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file7.txt.kafubuw3.partial: renamed to: file7.txt 2024/04/26 03:27:49 INFO : file7.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_nomodtime-zazoyik1" 2024/04/26 03:27:49 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/datadir/test_nomodtime-zazoyik1: Waiting for checks to finish 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/datadir/test_nomodtime-zazoyik1: Waiting for transfers to finish 2024/04/26 03:27:49 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:49 DEBUG : file1.txt.zuraquz8.partial: renamed to: file1.txt 2024/04/26 03:27:49 INFO : file1.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:49 DEBUG : file2.txt.gerofen6.partial: renamed to: file2.txt 2024/04/26 03:27:49 INFO : file2.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:49 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:49 DEBUG : file11.txt.macegez5.partial: renamed to: file11.txt 2024/04/26 03:27:49 INFO : file11.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file10.txt.fosayev5.partial: renamed to: file10.txt 2024/04/26 03:27:49 INFO : file10.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:49 DEBUG : file5L.txt.tuvosij0.partial: renamed to: file5L.txt 2024/04/26 03:27:49 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:49 DEBUG : file5R.txt.yovivig7.partial: renamed to: file5R.txt 2024/04/26 03:27:49 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:49 DEBUG : file6.txt.lolasuk1.partial: renamed to: file6.txt 2024/04/26 03:27:49 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:49 INFO : file6.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file7.txt.woxelaj5.partial: renamed to: file7.txt 2024/04/26 03:27:49 INFO : file7.txt: Copied (new) 2024/04/26 03:27:49 ERROR : : error listing: directory not found 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2] 2024/04/26 03:27:49 ERROR : : error listing: directory not found 2024/04/26 03:27:49 checking initFs Local file system at /tmp/032741ra/initdir/test_nomodtime-zuseyeb4 2024/04/26 03:27:49 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/nomodtime/path1: Waiting for checks to finish 2024/04/26 03:27:49 DEBUG : Local file system at /tmp/032741ra/nomodtime/path1: Waiting for transfers to finish 2024/04/26 03:27:49 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file3.txt.mugelus6.partial: renamed to: file3.txt 2024/04/26 03:27:49 DEBUG : file1.txt.werecaq9.partial: renamed to: file1.txt 2024/04/26 03:27:49 INFO : file3.txt: Copied (new) 2024/04/26 03:27:49 INFO : file1.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file2.txt.yixujud2.partial: renamed to: file2.txt 2024/04/26 03:27:49 INFO : file2.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file4.txt.momizin4.partial: renamed to: file4.txt 2024/04/26 03:27:49 DEBUG : file5.txt.zozidil4.partial: renamed to: file5.txt 2024/04/26 03:27:49 INFO : file4.txt: Copied (new) 2024/04/26 03:27:49 INFO : file5.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:49 DEBUG : RCLONE_TEST.lifepos3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:49 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:49 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file6.txt.lababep7.partial: renamed to: file6.txt 2024/04/26 03:27:49 INFO : file6.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 DEBUG : file7.txt.nuquhal2.partial: renamed to: file7.txt 2024/04/26 03:27:49 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:49 INFO : file7.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : file8.txt.sojobur3.partial: renamed to: file8.txt 2024/04/26 03:27:49 INFO : file8.txt: Copied (new) 2024/04/26 03:27:49 checking Path1 Local file system at /tmp/032741ra/nomodtime/path1 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2] 2024/04/26 03:27:49 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file1.txt] 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/RCLONE_TEST] 2024/04/26 03:27:49 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: Waiting for checks to finish 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: Waiting for transfers to finish 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file2.txt] 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file3.txt] 2024/04/26 03:27:49 INFO : file1.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file4.txt] 2024/04/26 03:27:49 INFO : file3.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file5.txt] 2024/04/26 03:27:49 INFO : file2.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file6.txt] 2024/04/26 03:27:49 INFO : file4.txt: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file7.txt] 2024/04/26 03:27:49 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file8.txt] 2024/04/26 03:27:49 INFO : file5.txt: Copied (new) 2024/04/26 03:27:49 INFO : file6.txt: Copied (new) 2024/04/26 03:27:49 INFO : file7.txt: Copied (new) 2024/04/26 03:27:49 INFO : file8.txt: Copied (new) 2024/04/26 03:27:49 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2 2024/04/26 03:27:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2] 2024/04/26 03:27:49 (01) : test changes 2024/04/26 03:27:49 (02) : test initial bisync 2024/04/26 03:27:49 (03) : bisync resync nomodtime 2024/04/26 03:27:49 NOTICE: Local file system at /tmp/032741ra/nomodtime/path1: will use md5 for same-side diffs on Path1 only 2024/04/26 03:27:49 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:49 INFO : Synching Path1 "/tmp/032741ra/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/" 2024/04/26 03:27:49 INFO : Copying Path2 files to Path1 2024/04/26 03:27:49 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:49 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:49 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:49 INFO : Resync updating listings 2024/04/26 03:27:49 INFO : Validating listings for Path1 "/tmp/032741ra/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/" 2024/04/26 03:27:49 INFO : Bisync successful 2024/04/26 03:27:49 (04) : test make modifications on both paths 2024/04/26 03:27:49 (05) : test new on path2 - file10 2024/04/26 03:27:49 (06) : copy-file /tmp/032741ra/datadir/test_nomodtime-zazoyik1/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/ 2024/04/26 03:27:49 INFO : file10.txt: Copied (new) 2024/04/26 03:27:49 (07) : test changed on path2 - file1 2024/04/26 03:27:49 (08) : copy-file /tmp/032741ra/datadir/test_nomodtime-zazoyik1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/ 2024/04/26 03:27:49 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:49 (09) : test new on path1 - file11 2024/04/26 03:27:49 (10) : copy-file /tmp/032741ra/datadir/test_nomodtime-zazoyik1/file11.txt /tmp/032741ra/nomodtime/path1/ 2024/04/26 03:27:49 INFO : file11.txt: Copied (new) 2024/04/26 03:27:49 (11) : test changed on path1 - file2 2024/04/26 03:27:49 (12) : copy-file /tmp/032741ra/datadir/test_nomodtime-zazoyik1/file2.txt /tmp/032741ra/nomodtime/path1/ 2024/04/26 03:27:49 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:49 (13) : test deleted on path2 - file3 2024/04/26 03:27:49 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file3.txt 2024/04/26 03:27:49 INFO : file3.txt: Deleted 2024/04/26 03:27:49 (15) : test deleted on path1 - file4 2024/04/26 03:27:49 (16) : delete-file /tmp/032741ra/nomodtime/path1/file4.txt 2024/04/26 03:27:49 INFO : file4.txt: Deleted 2024/04/26 03:27:49 (17) : test deleted on both paths - file8 2024/04/26 03:27:49 (18) : delete-file /tmp/032741ra/nomodtime/path1/file8.txt 2024/04/26 03:27:49 INFO : file8.txt: Deleted 2024/04/26 03:27:49 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file8.txt 2024/04/26 03:27:49 INFO : file8.txt: Deleted 2024/04/26 03:27:49 (20) : test changed on both paths - file5 (file5R, file5L) 2024/04/26 03:27:49 (21) : copy-as /tmp/032741ra/datadir/test_nomodtime-zazoyik1/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/ file5.txt 2024/04/26 03:27:49 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:49 (22) : copy-as /tmp/032741ra/datadir/test_nomodtime-zazoyik1/file5L.txt /tmp/032741ra/nomodtime/path1/ file5.txt 2024/04/26 03:27:49 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:49 (23) : test changed on path2 and deleted on path1 - file6 2024/04/26 03:27:49 (24) : copy-file /tmp/032741ra/datadir/test_nomodtime-zazoyik1/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/ 2024/04/26 03:27:49 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:27:49 (25) : delete-file /tmp/032741ra/nomodtime/path1/file6.txt 2024/04/26 03:27:49 INFO : file6.txt: Deleted 2024/04/26 03:27:49 (26) : test changed on path1 and deleted on path2 - file7 2024/04/26 03:27:49 (27) : copy-file /tmp/032741ra/datadir/test_nomodtime-zazoyik1/file7.txt /tmp/032741ra/nomodtime/path1/ 2024/04/26 03:27:49 INFO : file7.txt: Copied (replaced existing) 2024/04/26 03:27:49 (28) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file7.txt 2024/04/26 03:27:49 INFO : file7.txt: Deleted 2024/04/26 03:27:49 (29) : test bisync run 2024/04/26 03:27:49 (30) : bisync nomodtime 2024/04/26 03:27:49 NOTICE: Local file system at /tmp/032741ra/nomodtime/path1: will use md5 for same-side diffs on Path1 only 2024/04/26 03:27:49 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:49 INFO : Synching Path1 "/tmp/032741ra/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/" 2024/04/26 03:27:49 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:49 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:49 INFO : Path1 checking for diffs 2024/04/26 03:27:49 INFO : - Path1 File changed: size (larger), hash - file2.txt 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:49 INFO : - Path1 File changed: size (larger), hash - file5.txt 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file6.txt 2024/04/26 03:27:49 INFO : - Path1 File changed: size (larger), hash - file7.txt 2024/04/26 03:27:49 INFO : - Path1 File was deleted - file8.txt 2024/04/26 03:27:49 INFO : - Path1 File is new - file11.txt 2024/04/26 03:27:49 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:49 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2024/04/26 03:27:49 INFO : Path2 checking for diffs 2024/04/26 03:27:49 INFO : - Path2 File changed: size (larger), hash - file1.txt 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:49 INFO : - Path2 File changed: size (larger), hash - file5.txt 2024/04/26 03:27:49 INFO : - Path2 File changed: size (larger), hash - file6.txt 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file7.txt 2024/04/26 03:27:49 INFO : - Path2 File was deleted - file8.txt 2024/04/26 03:27:49 INFO : - Path2 File is new - file10.txt 2024/04/26 03:27:49 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:49 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2024/04/26 03:27:49 INFO : Applying changes 2024/04/26 03:27:49 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file11.txt 2024/04/26 03:27:49 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file2.txt 2024/04/26 03:27:49 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file4.txt 2024/04/26 03:27:49 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:27:49 NOTICE: - Path1 Renaming Path1 copy - /tmp/032741ra/nomodtime/path1/file5.txt.conflict1 2024/04/26 03:27:49 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/04/26 03:27:49 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file5.txt.conflict1 2024/04/26 03:27:49 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file5.txt.conflict2 2024/04/26 03:27:49 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/04/26 03:27:49 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/nomodtime/path1/file5.txt.conflict2 2024/04/26 03:27:49 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/nomodtime/path1/file6.txt 2024/04/26 03:27:49 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/file7.txt 2024/04/26 03:27:49 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/nomodtime/path1/file1.txt 2024/04/26 03:27:49 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/nomodtime/path1/file10.txt 2024/04/26 03:27:49 INFO : - Path1 Queue delete - /tmp/032741ra/nomodtime/path1/file3.txt 2024/04/26 03:27:49 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:49 INFO : file10.txt: Copied (new) 2024/04/26 03:27:50 INFO : file5.txt.conflict2: Copied (new) 2024/04/26 03:27:50 INFO : file6.txt: Copied (new) 2024/04/26 03:27:50 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : file3.txt: Deleted 2024/04/26 03:27:50 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:50 INFO : file11.txt: Copied (new) 2024/04/26 03:27:50 INFO : file7.txt: Copied (new) 2024/04/26 03:27:50 INFO : file5.txt.conflict1: Copied (new) 2024/04/26 03:27:50 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : file4.txt: Deleted 2024/04/26 03:27:50 INFO : Updating listings 2024/04/26 03:27:50 INFO : Validating listings for Path1 "/tmp/032741ra/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/nomodtime/path2/" 2024/04/26 03:27:50 INFO : Bisync successful bisync_test.go:553: TEST nomodtime PASSED === RUN TestBisyncLocalRemote/normalization 2024/04/26 03:27:50 DEBUG : Creating backend with remote "/tmp/032741ra/normalization/path1" 2024/04/26 03:27:50 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:50 DEBUG : path2: Making directory 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:50 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2" 2024/04/26 03:27:50 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:50 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:50 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:50 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:50 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:50 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:50 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2" 2024/04/26 03:27:50 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_normalization-soqozib3" 2024/04/26 03:27:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory with metadata 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/04/26 03:27:50 DEBUG : Added delayed dir = "測試_РуÑÑкий_ _ _Ä›_áñ", newDst=測試_РуÑÑкий_ _ _Ä›_áñ 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:50 DEBUG : file1.txt.gagoyux3.partial: renamed to: file1.txt 2024/04/26 03:27:50 INFO : file1.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : Local file system at /tmp/032741ra/initdir/test_normalization-soqozib3: Waiting for checks to finish 2024/04/26 03:27:50 DEBUG : Local file system at /tmp/032741ra/initdir/test_normalization-soqozib3: Waiting for transfers to finish 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt.pohiyar0.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:50 DEBUG : RCLONE_TEST.nawezit6.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:50 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt.qavoboj5.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file.yanafov5.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_normalization-tofujol1" 2024/04/26 03:27:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : Local file system at /tmp/032741ra/datadir/test_normalization-tofujol1: Waiting for checks to finish 2024/04/26 03:27:50 DEBUG : Local file system at /tmp/032741ra/datadir/test_normalization-tofujol1: Waiting for transfers to finish 2024/04/26 03:27:50 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:50 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/04/26 03:27:50 DEBUG : file1.txt.tizoqim0.partial: renamed to: file1.txt 2024/04/26 03:27:50 INFO : file1.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : 測試_filtersfile.txt.lixoxab5.partial: renamed to: 測試_filtersfile.txt 2024/04/26 03:27:50 INFO : 測試_filtersfile.txt: Copied (new) 2024/04/26 03:27:50 ERROR : : error listing: directory not found 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2] 2024/04/26 03:27:50 ERROR : : error listing: directory not found 2024/04/26 03:27:50 checking initFs Local file system at /tmp/032741ra/initdir/test_normalization-soqozib3 2024/04/26 03:27:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory with metadata 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/04/26 03:27:50 DEBUG : Added delayed dir = "測試_РуÑÑкий_ _ _Ä›_áñ", newDst=測試_РуÑÑкий_ _ _Ä›_áñ 2024/04/26 03:27:50 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:50 DEBUG : file1.txt.docehuj9.partial: renamed to: file1.txt 2024/04/26 03:27:50 INFO : file1.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : Local file system at /tmp/032741ra/normalization/path1: Waiting for checks to finish 2024/04/26 03:27:50 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:50 DEBUG : RCLONE_TEST.kajoguf0.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:50 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:50 DEBUG : Local file system at /tmp/032741ra/normalization/path1: Waiting for transfers to finish 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file.zatelal9.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt.xasekat2.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt.najones6.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 checking Path1 Local file system at /tmp/032741ra/normalization/path1 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2] 2024/04/26 03:27:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2/RCLONE_TEST] 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2/file1.txt] 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt] 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2: Waiting for checks to finish 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt] 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2: Waiting for transfers to finish 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file] 2024/04/26 03:27:50 INFO : file1.txt: Copied (new) 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:27:50 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:50 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/04/26 03:27:50 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2] 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/04/26 03:27:50 (01) : test normalization 2024/04/26 03:27:50 (02) : touch-copy 2001-01-02 /tmp/032741ra/datadir/test_normalization-tofujol1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2/ 2024/04/26 03:27:50 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:50 (03) : test initial bisync 2024/04/26 03:27:50 (04) : bisync resync 2024/04/26 03:27:50 NOTICE: Local file system at /tmp/032741ra/normalization/path1: Replacing invalid UTF-8 characters in "eÌŒ\x81\xfe aÌñhࢺ_測試РуÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬eÌö" 2024/04/26 03:27:50 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:27:50 NOTICE: Local file system at /tmp/032741ra/normalization/path1: Replacing invalid UTF-8 characters in "Ä›\x81\xfe áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö" 2024/04/26 03:27:50 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/04/26 03:27:50 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:27:50 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) bisync_test.go:1012: Fs is incapable of running test as the paths produce different results, skipping: normalization (path1: 測試_РуÑÑкий_ _ _Ä›_áñ測試_РуÑÑкий_ _ _Ä›_áñ (NFC) path2: 測試_РуÑÑкий_ _ _Ä›_áñěþ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶ (測試_РуÑÑкий_ _ _Ä›_áñěþ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶)) (fs1: Local file system at /tmp/032741ra/normalization/path1 fs2: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/normalization/path2) @@ -1 +1 @@ -測試_РуÑÑкий_ _ _Ä›_áñ測試_РуÑÑкий_ _ _Ä›_áñ+測試_РуÑÑкий_ _ _Ä›_áñěþ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶ === RUN TestBisyncLocalRemote/rclone_args 2024/04/26 03:27:50 DEBUG : Creating backend with remote "/tmp/032741ra/rclone_args/path1" 2024/04/26 03:27:50 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:50 DEBUG : path2: Making directory 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:50 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2" 2024/04/26 03:27:50 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:50 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:50 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:50 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:50 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:50 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:50 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2" 2024/04/26 03:27:50 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_rclone_args-poqexak5" 2024/04/26 03:27:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:50 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:50 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:50 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:50 DEBUG : file2.txt.nihepas2.partial: renamed to: file2.txt 2024/04/26 03:27:50 INFO : file2.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : Local file system at /tmp/032741ra/initdir/test_rclone_args-poqexak5: Waiting for checks to finish 2024/04/26 03:27:50 DEBUG : Local file system at /tmp/032741ra/initdir/test_rclone_args-poqexak5: Waiting for transfers to finish 2024/04/26 03:27:50 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:50 DEBUG : subdir/file20.txt.zuvinos6.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:50 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:50 DEBUG : subdir/file21.txt.rorefop2.partial: renamed to: subdir/file21.txt 2024/04/26 03:27:50 INFO : subdir/file21.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2024/04/26 03:27:50 DEBUG : file1.txt.mewatik2.partial: renamed to: file1.txt 2024/04/26 03:27:50 INFO : file1.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:50 DEBUG : RCLONE_TEST.rocawed1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:50 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_rclone_args-tonecov0" 2024/04/26 03:27:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file21.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : Local file system at /tmp/032741ra/datadir/test_rclone_args-tonecov0: Waiting for checks to finish 2024/04/26 03:27:50 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:50 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:50 DEBUG : Local file system at /tmp/032741ra/datadir/test_rclone_args-tonecov0: Waiting for transfers to finish 2024/04/26 03:27:50 DEBUG : file2.txt.xecacus0.partial: renamed to: file2.txt 2024/04/26 03:27:50 INFO : file2.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : file21.txt.suwejok6.partial: renamed to: file21.txt 2024/04/26 03:27:50 INFO : file21.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:50 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:50 DEBUG : file20.txt.higekic3.partial: renamed to: file20.txt 2024/04/26 03:27:50 INFO : file20.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : file1.txt.detopex7.partial: renamed to: file1.txt 2024/04/26 03:27:50 INFO : file1.txt: Copied (new) 2024/04/26 03:27:50 ERROR : : error listing: directory not found 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2] 2024/04/26 03:27:50 ERROR : : error listing: directory not found 2024/04/26 03:27:50 checking initFs Local file system at /tmp/032741ra/initdir/test_rclone_args-poqexak5 2024/04/26 03:27:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:50 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:50 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:50 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : Local file system at /tmp/032741ra/rclone_args/path1: Waiting for checks to finish 2024/04/26 03:27:50 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:50 DEBUG : Local file system at /tmp/032741ra/rclone_args/path1: Waiting for transfers to finish 2024/04/26 03:27:50 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:50 DEBUG : file2.txt.dodupid9.partial: renamed to: file2.txt 2024/04/26 03:27:50 DEBUG : subdir/file20.txt.cubiyaz7.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:50 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2024/04/26 03:27:50 INFO : file2.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : file1.txt.foquxov9.partial: renamed to: file1.txt 2024/04/26 03:27:50 INFO : file1.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:50 DEBUG : subdir/file21.txt.femofar9.partial: renamed to: subdir/file21.txt 2024/04/26 03:27:50 INFO : subdir/file21.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:50 DEBUG : RCLONE_TEST.nixumah9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:50 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 checking Path1 Local file system at /tmp/032741ra/rclone_args/path1 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2] 2024/04/26 03:27:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : subdir: Making directory 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/subdir] 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/file1.txt] 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/file2.txt] 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/RCLONE_TEST] 2024/04/26 03:27:50 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2: Waiting for checks to finish 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2: Waiting for transfers to finish 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/subdir/file20.txt] 2024/04/26 03:27:50 INFO : file2.txt: Copied (new) 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/subdir/file21.txt] 2024/04/26 03:27:50 INFO : file1.txt: Copied (new) 2024/04/26 03:27:50 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:50 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:50 INFO : subdir/file21.txt: Copied (new) 2024/04/26 03:27:50 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2] 2024/04/26 03:27:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/subdir] 2024/04/26 03:27:50 (01) : test rclone-args 2024/04/26 03:27:50 (02) : touch-glob 2001-01-02 /tmp/032741ra/datadir/test_rclone_args-tonecov0/ * 2024/04/26 03:27:50 (03) : test initial bisync 2024/04/26 03:27:50 (04) : bisync resync checksum 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 NOTICE: Local file system at /tmp/032741ra/rclone_args/path1: will use md5 for same-side diffs on Path1 only 2024/04/26 03:27:50 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:50 INFO : Synching Path1 "/tmp/032741ra/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Copying Path2 files to Path1 2024/04/26 03:27:50 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:50 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:50 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:50 INFO : Resync updating listings 2024/04/26 03:27:50 INFO : Validating listings for Path1 "/tmp/032741ra/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Bisync successful 2024/04/26 03:27:50 (05) : test place newer files on both paths 2024/04/26 03:27:50 (06) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file1.txt /tmp/032741ra/rclone_args/path1/ 2024/04/26 03:27:50 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:50 (07) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/ 2024/04/26 03:27:50 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:50 (08) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file20.txt /tmp/032741ra/rclone_args/path1/subdir 2024/04/26 03:27:50 INFO : file20.txt: Updated modification time in destination 2024/04/26 03:27:50 (09) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/subdir 2024/04/26 03:27:50 INFO : file21.txt: Copied (replaced existing) 2024/04/26 03:27:50 (10) : touch-glob 2001-01-02 /tmp/032741ra/rclone_args/path1/ file1.txt 2024/04/26 03:27:50 (11) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/ file2.txt 2024/04/26 03:27:50 (12) : touch-glob 2001-01-02 /tmp/032741ra/rclone_args/path1/subdir/ file20.txt 2024/04/26 03:27:50 (13) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/subdir/ file21.txt 2024/04/26 03:27:50 (14) : test run bisync with custom options 2024/04/26 03:27:50 (15) : bisync checksum 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 NOTICE: Local file system at /tmp/032741ra/rclone_args/path1: will use md5 for same-side diffs on Path1 only 2024/04/26 03:27:50 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:50 INFO : Synching Path1 "/tmp/032741ra/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:50 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:50 INFO : Path1 checking for diffs 2024/04/26 03:27:50 INFO : - Path1 File changed: hash - file1.txt 2024/04/26 03:27:50 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:50 INFO : (Modified:  1 hash differs) 2024/04/26 03:27:50 INFO : Path2 checking for diffs 2024/04/26 03:27:50 INFO : - Path2 File changed: size (larger), hash - file2.txt 2024/04/26 03:27:50 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:50 INFO : (Modified:  1 larger,  0 smaller,  1 hash differs) 2024/04/26 03:27:50 INFO : Applying changes 2024/04/26 03:27:50 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/file1.txt 2024/04/26 03:27:50 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/rclone_args/path1/file2.txt 2024/04/26 03:27:50 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:50 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:50 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : Updating listings 2024/04/26 03:27:50 INFO : Validating listings for Path1 "/tmp/032741ra/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Bisync successful 2024/04/26 03:27:50 (16) : touch-glob 2007-07-23 /tmp/032741ra/datadir/test_rclone_args-tonecov0/ * 2024/04/26 03:27:50 (17) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file1.txt /tmp/032741ra/rclone_args/path1/ 2024/04/26 03:27:50 INFO : file1.txt: Updated modification time in destination 2024/04/26 03:27:50 (18) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/ 2024/04/26 03:27:50 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:50 (19) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file20.txt /tmp/032741ra/rclone_args/path1/subdir 2024/04/26 03:27:50 INFO : file20.txt: Updated modification time in destination 2024/04/26 03:27:50 (20) : copy-as /tmp/032741ra/datadir/test_rclone_args-tonecov0/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/ file1.txt 2024/04/26 03:27:50 INFO : file21.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:50 (21) : touch-glob 2007-07-23 /tmp/032741ra/rclone_args/path1/ file1.txt 2024/04/26 03:27:50 (22) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/ file2.txt 2024/04/26 03:27:50 (23) : touch-glob 2007-07-23 /tmp/032741ra/rclone_args/path1/subdir/ file20.txt 2024/04/26 03:27:50 (24) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/subdir/ file21.txt 2024/04/26 03:27:50 (25) : bisync size-only 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:50 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:50 INFO : Synching Path1 "/tmp/032741ra/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:50 INFO : Path1 checking for diffs 2024/04/26 03:27:50 INFO : Path2 checking for diffs 2024/04/26 03:27:50 INFO : - Path2 File changed: size (smaller) - file1.txt 2024/04/26 03:27:50 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:50 INFO : (Modified:  0 larger,  1 smaller) 2024/04/26 03:27:50 INFO : Applying changes 2024/04/26 03:27:50 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/rclone_args/path1/file1.txt 2024/04/26 03:27:50 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:50 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : Updating listings 2024/04/26 03:27:50 INFO : Validating listings for Path1 "/tmp/032741ra/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Bisync successful 2024/04/26 03:27:50 (26) : bisync resync 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:50 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:50 INFO : Synching Path1 "/tmp/032741ra/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Copying Path2 files to Path1 2024/04/26 03:27:50 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:50 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:50 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : subdir/file21.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : Resync updating listings 2024/04/26 03:27:50 INFO : Validating listings for Path1 "/tmp/032741ra/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Bisync successful 2024/04/26 03:27:50 (27) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file1.txt /tmp/032741ra/rclone_args/path1/ 2024/04/26 03:27:50 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:50 (28) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/ 2024/04/26 03:27:50 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:50 (29) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file20.txt /tmp/032741ra/rclone_args/path1/subdir 2024/04/26 03:27:50 (30) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/subdir 2024/04/26 03:27:50 INFO : file21.txt: Copied (replaced existing) 2024/04/26 03:27:50 (31) : touch-glob 2007-07-23 /tmp/032741ra/rclone_args/path1/ file1.txt 2024/04/26 03:27:50 (32) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/ file2.txt 2024/04/26 03:27:50 (33) : touch-glob 2007-07-23 /tmp/032741ra/rclone_args/path1/subdir/ file20.txt 2024/04/26 03:27:50 (34) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/subdir/ file21.txt 2024/04/26 03:27:50 (35) : bisync ignore-size 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:50 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": false, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:50 INFO : Synching Path1 "/tmp/032741ra/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:50 INFO : Path1 checking for diffs 2024/04/26 03:27:50 INFO : Path2 checking for diffs 2024/04/26 03:27:50 INFO : - Path2 File changed: time (newer) - file2.txt 2024/04/26 03:27:50 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2024/04/26 03:27:50 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:27:50 INFO : (Modified:  2 newer,  0 older) 2024/04/26 03:27:50 INFO : Applying changes 2024/04/26 03:27:50 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/rclone_args/path1/file2.txt 2024/04/26 03:27:50 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/rclone_args/path1/subdir/file21.txt 2024/04/26 03:27:50 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 INFO : subdir/file21.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 INFO : Updating listings 2024/04/26 03:27:50 INFO : Validating listings for Path1 "/tmp/032741ra/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Bisync successful 2024/04/26 03:27:50 (36) : bisync resync compare-all 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 NOTICE: Local file system at /tmp/032741ra/rclone_args/path1: will use md5 for same-side diffs on Path1 only 2024/04/26 03:27:50 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:50 INFO : Synching Path1 "/tmp/032741ra/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Copying Path2 files to Path1 2024/04/26 03:27:50 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:50 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:50 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:50 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : Resync updating listings 2024/04/26 03:27:50 INFO : Validating listings for Path1 "/tmp/032741ra/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Bisync successful 2024/04/26 03:27:50 (37) : copy-as /tmp/032741ra/datadir/test_rclone_args-tonecov0/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/ file2.txt 2024/04/26 03:27:50 INFO : file21.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:50 (38) : touch-glob 2023-08-26 /tmp/032741ra/datadir/test_rclone_args-tonecov0/ * 2024/04/26 03:27:50 (39) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file1.txt /tmp/032741ra/rclone_args/path1/ 2024/04/26 03:27:50 INFO : file1.txt: Updated modification time in destination 2024/04/26 03:27:50 (40) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file20.txt /tmp/032741ra/rclone_args/path1/subdir 2024/04/26 03:27:50 INFO : file20.txt: Updated modification time in destination 2024/04/26 03:27:50 (41) : copy-file /tmp/032741ra/datadir/test_rclone_args-tonecov0/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/subdir 2024/04/26 03:27:50 INFO : file21.txt: Copied (replaced existing) 2024/04/26 03:27:50 (42) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/ file2.txt 2024/04/26 03:27:50 (43) : touch-glob 2023-08-26 /tmp/032741ra/rclone_args/path1/ file1.txt 2024/04/26 03:27:50 (44) : touch-glob 2023-08-26 /tmp/032741ra/rclone_args/path1/subdir/ file20.txt 2024/04/26 03:27:50 (45) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/subdir/ file21.txt 2024/04/26 03:27:50 (46) : bisync compare-all 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 NOTICE: Local file system at /tmp/032741ra/rclone_args/path1: will use md5 for same-side diffs on Path1 only 2024/04/26 03:27:50 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/04/26 03:27:50 INFO : Synching Path1 "/tmp/032741ra/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:50 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:50 INFO : Path1 checking for diffs 2024/04/26 03:27:50 INFO : - Path1 File changed: time (newer) - file1.txt 2024/04/26 03:27:50 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2024/04/26 03:27:50 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:27:50 INFO : (Modified:  2 newer,  0 older) 2024/04/26 03:27:50 INFO : Path2 checking for diffs 2024/04/26 03:27:50 INFO : - Path2 File changed: size (smaller), hash - file2.txt 2024/04/26 03:27:50 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2024/04/26 03:27:50 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:27:50 INFO : (Modified:  1 newer,  0 older,  0 larger,  1 smaller,  1 hash differs) 2024/04/26 03:27:50 INFO : Applying changes 2024/04/26 03:27:50 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/file1.txt 2024/04/26 03:27:50 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/subdir/file20.txt 2024/04/26 03:27:50 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/rclone_args/path1/file2.txt 2024/04/26 03:27:50 INFO : - Path2 Queue copy to Path1 - /tmp/032741ra/rclone_args/path1/subdir/file21.txt 2024/04/26 03:27:50 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : subdir/file21.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:50 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:50 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:50 INFO : Updating listings 2024/04/26 03:27:50 INFO : Validating listings for Path1 "/tmp/032741ra/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rclone_args/path2/" 2024/04/26 03:27:50 INFO : Bisync successful bisync_test.go:553: TEST rclone_args PASSED === RUN TestBisyncLocalRemote/resolve 2024/04/26 03:27:51 DEBUG : Creating backend with remote "/tmp/032741ra/resolve/path1" 2024/04/26 03:27:51 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:51 DEBUG : path2: Making directory 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:51 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2" 2024/04/26 03:27:51 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:51 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:51 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2" 2024/04/26 03:27:51 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_resolve-tesuyiw3" 2024/04/26 03:27:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : Local file system at /tmp/032741ra/initdir/test_resolve-tesuyiw3: Waiting for checks to finish 2024/04/26 03:27:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file2.txt.wuxokuj3.partial: renamed to: file2.txt 2024/04/26 03:27:51 DEBUG : Local file system at /tmp/032741ra/initdir/test_resolve-tesuyiw3: Waiting for transfers to finish 2024/04/26 03:27:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file1.txt.qomowoy2.partial: renamed to: file1.txt 2024/04/26 03:27:51 INFO : file1.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:51 DEBUG : RCLONE_TEST.huyivof8.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:51 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:51 INFO : file2.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_resolve-nubaxid4" 2024/04/26 03:27:51 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : Local file system at /tmp/032741ra/datadir/test_resolve-nubaxid4: Waiting for checks to finish 2024/04/26 03:27:51 DEBUG : Local file system at /tmp/032741ra/datadir/test_resolve-nubaxid4: Waiting for transfers to finish 2024/04/26 03:27:51 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK 2024/04/26 03:27:51 DEBUG : file1R.txt.kopuwot8.partial: renamed to: file1R.txt 2024/04/26 03:27:51 INFO : file1R.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/04/26 03:27:51 DEBUG : file2.txt.rolunol9.partial: renamed to: file2.txt 2024/04/26 03:27:51 INFO : file2.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/04/26 03:27:51 DEBUG : file1L.txt.jaxoqak4.partial: renamed to: file1L.txt 2024/04/26 03:27:51 INFO : file1L.txt: Copied (new) 2024/04/26 03:27:51 ERROR : : error listing: directory not found 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2] 2024/04/26 03:27:51 ERROR : : error listing: directory not found 2024/04/26 03:27:51 checking initFs Local file system at /tmp/032741ra/initdir/test_resolve-tesuyiw3 2024/04/26 03:27:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : Local file system at /tmp/032741ra/resolve/path1: Waiting for checks to finish 2024/04/26 03:27:51 DEBUG : Local file system at /tmp/032741ra/resolve/path1: Waiting for transfers to finish 2024/04/26 03:27:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file2.txt.qapetog5.partial: renamed to: file2.txt 2024/04/26 03:27:51 INFO : file2.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:51 DEBUG : RCLONE_TEST.mihayix0.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:51 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file1.txt.junovay6.partial: renamed to: file1.txt 2024/04/26 03:27:51 INFO : file1.txt: Copied (new) 2024/04/26 03:27:51 checking Path1 Local file system at /tmp/032741ra/resolve/path1 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2] 2024/04/26 03:27:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/RCLONE_TEST] 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/file1.txt] 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/file2.txt] 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: Waiting for checks to finish 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: Waiting for transfers to finish 2024/04/26 03:27:51 INFO : file1.txt: Copied (new) 2024/04/26 03:27:51 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:51 INFO : file2.txt: Copied (new) 2024/04/26 03:27:51 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2] 2024/04/26 03:27:51 (01) : test resolve 2024/04/26 03:27:51 (02) : test initial bisync 2024/04/26 03:27:51 (03) : bisync resync 2024/04/26 03:27:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:51 INFO : Synching Path1 "/tmp/032741ra/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Copying Path2 files to Path1 2024/04/26 03:27:51 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:51 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:51 INFO : Resync updating listings 2024/04/26 03:27:51 INFO : Validating listings for Path1 "/tmp/032741ra/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Bisync successful 2024/04/26 03:27:51 (04) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:51 (05) : touch-glob 2001-01-02 /tmp/032741ra/datadir/test_resolve-nubaxid4/ file1R.txt 2024/04/26 03:27:51 (06) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/ file1.txt 2024/04/26 03:27:51 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:51 (07) : touch-glob 2001-03-04 /tmp/032741ra/datadir/test_resolve-nubaxid4/ file1L.txt 2024/04/26 03:27:51 (08) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1L.txt /tmp/032741ra/resolve/path1/ file1.txt 2024/04/26 03:27:51 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:51 (09) : test bisync run with --conflict-resolve=newer --conflict-loser=delete --conflict-suffix=potato 2024/04/26 03:27:51 (10) : bisync conflict-resolve=newer conflict-loser=delete conflict-suffix=potato 2024/04/26 03:27:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:51 INFO : Synching Path1 "/tmp/032741ra/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:51 INFO : Path1 checking for diffs 2024/04/26 03:27:51 INFO : - Path1 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:51 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:51 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:51 INFO : Path2 checking for diffs 2024/04/26 03:27:51 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:51 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:51 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:51 INFO : Applying changes 2024/04/26 03:27:51 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:51 INFO : Checking potential conflicts... 2024/04/26 03:27:51 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: 1 differences found 2024/04/26 03:27:51 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: 1 errors while checking 2024/04/26 03:27:51 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:51 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:51 INFO : file1.txt: Path1 is newer. Path1: 2001-03-04 00:00:00 +0000 UTC, Path2: 2001-01-02 00:00:00 +0000 UTC, Difference: 1464h0m0s 2024/04/26 03:27:51 INFO : file1.txt: The winner is: Path1 2024/04/26 03:27:51 NOTICE: - Path2 Deleting Path2 copy - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/file1.txt 2024/04/26 03:27:51 INFO : file1.txt: Deleted 2024/04/26 03:27:51 INFO : - Path1 Queue copy to Path2 - file1.txt 2024/04/26 03:27:51 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:51 INFO : file1.txt: Copied (new) 2024/04/26 03:27:51 INFO : Updating listings 2024/04/26 03:27:51 INFO : Validating listings for Path1 "/tmp/032741ra/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Bisync successful 2024/04/26 03:27:51 (11) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:51 (12) : touch-glob 2001-07-23 /tmp/032741ra/datadir/test_resolve-nubaxid4/ file1R.txt 2024/04/26 03:27:51 (13) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/ file1.txt 2024/04/26 03:27:51 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:51 (14) : touch-glob 2001-08-26 /tmp/032741ra/datadir/test_resolve-nubaxid4/ file1L.txt 2024/04/26 03:27:51 (15) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1L.txt /tmp/032741ra/resolve/path1/ file1.txt 2024/04/26 03:27:51 INFO : file1L.txt: Updated modification time in destination 2024/04/26 03:27:51 (16) : test bisync run with --conflict-resolve=path2 --conflict-loser=num --conflict-suffix=dinosaur 2024/04/26 03:27:51 (17) : bisync conflict-resolve=path2 conflict-loser=num conflict-suffix=dinosaur 2024/04/26 03:27:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:51 INFO : Synching Path1 "/tmp/032741ra/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:51 INFO : Path1 checking for diffs 2024/04/26 03:27:51 INFO : - Path1 File changed: time (newer) - file1.txt 2024/04/26 03:27:51 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:51 INFO : (Modified:  1 newer,  0 older) 2024/04/26 03:27:51 INFO : Path2 checking for diffs 2024/04/26 03:27:51 INFO : - Path2 File changed: time (newer) - file1.txt 2024/04/26 03:27:51 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:51 INFO : (Modified:  1 newer,  0 older) 2024/04/26 03:27:51 INFO : Applying changes 2024/04/26 03:27:51 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:51 INFO : Checking potential conflicts... 2024/04/26 03:27:51 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: 1 differences found 2024/04/26 03:27:51 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: 1 errors while checking 2024/04/26 03:27:51 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:51 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:51 INFO : file1.txt: The winner is: Path2 2024/04/26 03:27:51 NOTICE: - Path1 Renaming Path1 copy - /tmp/032741ra/resolve/path1/file1.txt.dinosaur1 2024/04/26 03:27:51 INFO : file1.txt: Moved (server-side) to: file1.txt.dinosaur1 2024/04/26 03:27:51 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/file1.txt.dinosaur1 2024/04/26 03:27:51 NOTICE: - Path2 Not renaming Path2 copy, as it was determined the winner - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/file1.txt 2024/04/26 03:27:51 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/resolve/path1/file1.txt 2024/04/26 03:27:51 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:51 INFO : file1.txt: Copied (new) 2024/04/26 03:27:51 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:51 INFO : file1.txt.dinosaur1: Copied (new) 2024/04/26 03:27:51 INFO : Updating listings 2024/04/26 03:27:51 INFO : Validating listings for Path1 "/tmp/032741ra/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Bisync successful 2024/04/26 03:27:51 (18) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:51 (19) : touch-glob 2002-07-23 /tmp/032741ra/datadir/test_resolve-nubaxid4/ file1R.txt 2024/04/26 03:27:51 (20) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/ file1.txt 2024/04/26 03:27:51 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:51 (21) : touch-glob 2002-08-26 /tmp/032741ra/datadir/test_resolve-nubaxid4/ file1L.txt 2024/04/26 03:27:51 (22) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1L.txt /tmp/032741ra/resolve/path1/ file1.txt 2024/04/26 03:27:51 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:51 (23) : test bisync run with --conflict-resolve=larger --conflict-loser=num --conflict-suffix=apple 2024/04/26 03:27:51 (24) : bisync conflict-resolve=larger conflict-loser=num conflict-suffix=apple 2024/04/26 03:27:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:51 INFO : Synching Path1 "/tmp/032741ra/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:51 INFO : Path1 checking for diffs 2024/04/26 03:27:51 INFO : - Path1 File is new - file1.txt 2024/04/26 03:27:51 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:51 INFO : Path2 checking for diffs 2024/04/26 03:27:51 INFO : - Path2 File is new - file1.txt 2024/04/26 03:27:51 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:51 INFO : Applying changes 2024/04/26 03:27:51 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:51 INFO : Checking potential conflicts... 2024/04/26 03:27:51 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: 1 differences found 2024/04/26 03:27:51 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: 1 errors while checking 2024/04/26 03:27:51 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:51 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:51 INFO : file1.txt: Winner cannot be determined as sizes are equal. Path1: 33, Path2: 33, Difference: 0 2024/04/26 03:27:51 INFO : file1.txt: A winner could not be determined. 2024/04/26 03:27:51 NOTICE: - Path1 Renaming Path1 copy - /tmp/032741ra/resolve/path1/file1.txt.apple1 2024/04/26 03:27:51 INFO : file1.txt: Moved (server-side) to: file1.txt.apple1 2024/04/26 03:27:51 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/file1.txt.apple1 2024/04/26 03:27:51 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/file1.txt.apple2 2024/04/26 03:27:51 INFO : file1.txt: Moved (server-side) to: file1.txt.apple2 2024/04/26 03:27:51 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/resolve/path1/file1.txt.apple2 2024/04/26 03:27:51 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:51 INFO : file1.txt.apple2: Copied (new) 2024/04/26 03:27:51 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:51 INFO : file1.txt.apple1: Copied (new) 2024/04/26 03:27:51 INFO : Updating listings 2024/04/26 03:27:51 INFO : Validating listings for Path1 "/tmp/032741ra/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Bisync successful 2024/04/26 03:27:51 (25) : test different suffixes 2024/04/26 03:27:51 (26) : touch-glob 2003-07-23 /tmp/032741ra/datadir/test_resolve-nubaxid4/ file1R.txt 2024/04/26 03:27:51 (27) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/ file1.txt 2024/04/26 03:27:51 INFO : file1R.txt: Copied (new) to: file1.txt 2024/04/26 03:27:51 (28) : touch-glob 2003-07-23 /tmp/032741ra/datadir/test_resolve-nubaxid4/ file1L.txt 2024/04/26 03:27:51 (29) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1L.txt /tmp/032741ra/resolve/path1/ file1.txt 2024/04/26 03:27:51 INFO : file1L.txt: Copied (new) to: file1.txt 2024/04/26 03:27:51 (30) : test bisync run with --conflict-resolve=older --conflict-loser=num --conflict-suffix=cloud,local 2024/04/26 03:27:51 (31) : bisync conflict-resolve=older conflict-loser=num conflict-suffix=cloud,local 2024/04/26 03:27:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:51 INFO : Synching Path1 "/tmp/032741ra/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:51 INFO : Path1 checking for diffs 2024/04/26 03:27:51 INFO : - Path1 File is new - file1.txt 2024/04/26 03:27:51 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:51 INFO : Path2 checking for diffs 2024/04/26 03:27:51 INFO : - Path2 File is new - file1.txt 2024/04/26 03:27:51 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:51 INFO : Applying changes 2024/04/26 03:27:51 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:51 INFO : Checking potential conflicts... 2024/04/26 03:27:51 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: 1 differences found 2024/04/26 03:27:51 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: 1 errors while checking 2024/04/26 03:27:51 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:51 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:51 INFO : file1.txt: Winner cannot be determined as times are equal. Path1: 2003-07-23 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 0s 2024/04/26 03:27:51 INFO : file1.txt: A winner could not be determined. 2024/04/26 03:27:51 NOTICE: - Path1 Renaming Path1 copy - /tmp/032741ra/resolve/path1/file1.txt.cloud1 2024/04/26 03:27:51 INFO : file1.txt: Moved (server-side) to: file1.txt.cloud1 2024/04/26 03:27:51 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/file1.txt.cloud1 2024/04/26 03:27:51 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/file1.txt.local1 2024/04/26 03:27:51 INFO : file1.txt: Moved (server-side) to: file1.txt.local1 2024/04/26 03:27:51 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/resolve/path1/file1.txt.local1 2024/04/26 03:27:51 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:51 INFO : file1.txt.local1: Copied (new) 2024/04/26 03:27:51 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:51 INFO : file1.txt.cloud1: Copied (new) 2024/04/26 03:27:51 INFO : Updating listings 2024/04/26 03:27:51 INFO : Validating listings for Path1 "/tmp/032741ra/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Bisync successful 2024/04/26 03:27:51 (32) : test legacy 2024/04/26 03:27:51 (33) : touch-glob 2004-07-23 /tmp/032741ra/datadir/test_resolve-nubaxid4/ file1R.txt 2024/04/26 03:27:51 (34) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/ file1.txt 2024/04/26 03:27:51 INFO : file1R.txt: Copied (new) to: file1.txt 2024/04/26 03:27:51 (35) : touch-glob 2004-07-23 /tmp/032741ra/datadir/test_resolve-nubaxid4/ file1L.txt 2024/04/26 03:27:51 (36) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1L.txt /tmp/032741ra/resolve/path1/ file1.txt 2024/04/26 03:27:51 INFO : file1L.txt: Copied (new) to: file1.txt 2024/04/26 03:27:51 (37) : test bisync run with --conflict-resolve=none --conflict-loser=pathname --conflict-suffix=.path 2024/04/26 03:27:51 (38) : bisync conflict-resolve=none conflict-loser=pathname conflict-suffix=.path 2024/04/26 03:27:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:51 INFO : Synching Path1 "/tmp/032741ra/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:51 INFO : Path1 checking for diffs 2024/04/26 03:27:51 INFO : - Path1 File is new - file1.txt 2024/04/26 03:27:51 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:51 INFO : Path2 checking for diffs 2024/04/26 03:27:51 INFO : - Path2 File is new - file1.txt 2024/04/26 03:27:51 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:27:51 INFO : Applying changes 2024/04/26 03:27:51 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:51 INFO : Checking potential conflicts... 2024/04/26 03:27:51 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: 1 differences found 2024/04/26 03:27:51 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: 1 errors while checking 2024/04/26 03:27:51 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:51 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:51 NOTICE: - Path1 Renaming Path1 copy - /tmp/032741ra/resolve/path1/file1.txt..path1 2024/04/26 03:27:51 INFO : file1.txt: Moved (server-side) to: file1.txt..path1 2024/04/26 03:27:51 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/file1.txt..path1 2024/04/26 03:27:51 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/file1.txt..path2 2024/04/26 03:27:51 INFO : file1.txt: Moved (server-side) to: file1.txt..path2 2024/04/26 03:27:51 NOTICE: - Path2 Queue copy to Path1 - /tmp/032741ra/resolve/path1/file1.txt..path2 2024/04/26 03:27:51 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:51 INFO : file1.txt..path2: Copied (new) 2024/04/26 03:27:51 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:51 INFO : file1.txt..path1: Copied (new) 2024/04/26 03:27:51 INFO : Updating listings 2024/04/26 03:27:51 INFO : Validating listings for Path1 "/tmp/032741ra/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Bisync successful 2024/04/26 03:27:51 (39) : test deletes on both sides with default suffix 2024/04/26 03:27:51 (40) : touch-glob 2005-01-02 /tmp/032741ra/datadir/test_resolve-nubaxid4/ file1R.txt 2024/04/26 03:27:51 (41) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/ file1.txt 2024/04/26 03:27:51 INFO : file1R.txt: Copied (new) to: file1.txt 2024/04/26 03:27:51 (42) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1R.txt /tmp/032741ra/resolve/path1/ file2.txt 2024/04/26 03:27:51 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:51 (43) : touch-glob 2006-03-04 /tmp/032741ra/datadir/test_resolve-nubaxid4/ file1L.txt 2024/04/26 03:27:51 (44) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1L.txt /tmp/032741ra/resolve/path1/ file1.txt 2024/04/26 03:27:51 INFO : file1L.txt: Copied (new) to: file1.txt 2024/04/26 03:27:51 (45) : copy-as /tmp/032741ra/datadir/test_resolve-nubaxid4/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/ file2.txt 2024/04/26 03:27:51 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:51 (46) : test bisync run with --conflict-resolve=newer --conflict-loser=delete 2024/04/26 03:27:51 (47) : bisync conflict-resolve=newer conflict-loser=delete 2024/04/26 03:27:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:51 INFO : Synching Path1 "/tmp/032741ra/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:51 INFO : Path1 checking for diffs 2024/04/26 03:27:51 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:51 INFO : - Path1 File is new - file1.txt 2024/04/26 03:27:51 INFO : Path1: 2 changes:  1 new,  1 modified,  0 deleted 2024/04/26 03:27:51 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:51 INFO : Path2 checking for diffs 2024/04/26 03:27:51 INFO : - Path2 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:51 INFO : - Path2 File is new - file1.txt 2024/04/26 03:27:51 INFO : Path2: 2 changes:  1 new,  1 modified,  0 deleted 2024/04/26 03:27:51 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:51 INFO : Applying changes 2024/04/26 03:27:51 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:51 INFO : Checking potential conflicts... 2024/04/26 03:27:51 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: 2 differences found 2024/04/26 03:27:51 NOTICE: hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2: 2 errors while checking 2024/04/26 03:27:51 INFO : Finished checking the potential conflicts. 2 differences found 2024/04/26 03:27:51 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:27:51 INFO : file1.txt: Path1 is newer. Path1: 2006-03-04 00:00:00 +0000 UTC, Path2: 2005-01-02 00:00:00 +0000 UTC, Difference: 10224h0m0s 2024/04/26 03:27:51 INFO : file1.txt: The winner is: Path1 2024/04/26 03:27:51 NOTICE: - Path2 Deleting Path2 copy - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/file1.txt 2024/04/26 03:27:51 INFO : file1.txt: Deleted 2024/04/26 03:27:51 INFO : - Path1 Queue copy to Path2 - file1.txt 2024/04/26 03:27:51 NOTICE: - WARNING New or changed in both paths - file2.txt 2024/04/26 03:27:51 INFO : file2.txt: Path2 is newer. Path1: 2005-01-02 00:00:00 +0000 UTC, Path2: 2006-03-04 00:00:00 +0000 UTC, Difference: 10224h0m0s 2024/04/26 03:27:51 INFO : file2.txt: The winner is: Path2 2024/04/26 03:27:51 NOTICE: - Path1 Deleting Path1 copy - /tmp/032741ra/resolve/path1/file2.txt 2024/04/26 03:27:51 INFO : file2.txt: Deleted 2024/04/26 03:27:51 INFO : - Path2 Queue copy to Path1 - file2.txt 2024/04/26 03:27:51 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:51 INFO : file2.txt: Copied (new) 2024/04/26 03:27:51 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:51 INFO : file1.txt: Copied (new) 2024/04/26 03:27:51 INFO : Updating listings 2024/04/26 03:27:51 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:51 INFO : Validating listings for Path1 "/tmp/032741ra/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resolve/path2/" 2024/04/26 03:27:51 INFO : Bisync successful bisync_test.go:553: TEST resolve PASSED === RUN TestBisyncLocalRemote/resync 2024/04/26 03:27:51 DEBUG : Creating backend with remote "/tmp/032741ra/resync/path1" 2024/04/26 03:27:51 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:51 DEBUG : path2: Making directory 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:51 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2" 2024/04/26 03:27:51 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:51 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:51 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2" 2024/04/26 03:27:51 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_resync-yamicin4" 2024/04/26 03:27:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : Local file system at /tmp/032741ra/initdir/test_resync-yamicin4: Waiting for checks to finish 2024/04/26 03:27:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file1.txt.cegiziw6.partial: renamed to: file1.txt 2024/04/26 03:27:51 INFO : file1.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : RCLONE_TEST.safilib6.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:51 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:51 DEBUG : file2.txt.jadilub8.partial: renamed to: file2.txt 2024/04/26 03:27:51 INFO : file2.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : Local file system at /tmp/032741ra/initdir/test_resync-yamicin4: Waiting for transfers to finish 2024/04/26 03:27:51 DEBUG : file3.txt.comurop9.partial: renamed to: file3.txt 2024/04/26 03:27:51 INFO : file3.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file6.txt.kawobil7.partial: renamed to: file6.txt 2024/04/26 03:27:51 DEBUG : file4.txt.bomuyib4.partial: renamed to: file4.txt 2024/04/26 03:27:51 INFO : file6.txt: Copied (new) 2024/04/26 03:27:51 INFO : file4.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file7.txt.cebijoc8.partial: renamed to: file7.txt 2024/04/26 03:27:51 INFO : file7.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : file5.txt.nekedix3.partial: renamed to: file5.txt 2024/04/26 03:27:51 INFO : file5.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_resync-datuziq0" 2024/04/26 03:27:51 DEBUG : fileA.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : fileB.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : Local file system at /tmp/032741ra/datadir/test_resync-datuziq0: Waiting for checks to finish 2024/04/26 03:27:51 DEBUG : Local file system at /tmp/032741ra/datadir/test_resync-datuziq0: Waiting for transfers to finish 2024/04/26 03:27:51 DEBUG : fileB.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:51 DEBUG : fileA.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:51 DEBUG : fileB.txt.nayetac4.partial: renamed to: fileB.txt 2024/04/26 03:27:51 DEBUG : fileA.txt.colojew3.partial: renamed to: fileA.txt 2024/04/26 03:27:51 INFO : fileB.txt: Copied (new) 2024/04/26 03:27:51 INFO : fileA.txt: Copied (new) 2024/04/26 03:27:51 ERROR : : error listing: directory not found 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2] 2024/04/26 03:27:51 ERROR : : error listing: directory not found 2024/04/26 03:27:51 checking initFs Local file system at /tmp/032741ra/initdir/test_resync-yamicin4 2024/04/26 03:27:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : Local file system at /tmp/032741ra/resync/path1: Waiting for checks to finish 2024/04/26 03:27:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file1.txt.vosuyiq1.partial: renamed to: file1.txt 2024/04/26 03:27:51 INFO : file1.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file4.txt.fasiteh4.partial: renamed to: file4.txt 2024/04/26 03:27:51 INFO : file4.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:51 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : RCLONE_TEST.yinaguv6.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:51 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:51 DEBUG : file5.txt.gunaboq1.partial: renamed to: file5.txt 2024/04/26 03:27:51 INFO : file5.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : Local file system at /tmp/032741ra/resync/path1: Waiting for transfers to finish 2024/04/26 03:27:51 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file7.txt.ciwepoq5.partial: renamed to: file7.txt 2024/04/26 03:27:51 INFO : file7.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:51 DEBUG : file6.txt.capaxes8.partial: renamed to: file6.txt 2024/04/26 03:27:51 INFO : file6.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : file3.txt.sunidin7.partial: renamed to: file3.txt 2024/04/26 03:27:51 INFO : file3.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : file2.txt.ruqegic2.partial: renamed to: file2.txt 2024/04/26 03:27:51 INFO : file2.txt: Copied (new) 2024/04/26 03:27:51 checking Path1 Local file system at /tmp/032741ra/resync/path1 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2] 2024/04/26 03:27:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/file2.txt] 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/RCLONE_TEST] 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: Waiting for checks to finish 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: Waiting for transfers to finish 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/file3.txt] 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/file1.txt] 2024/04/26 03:27:51 INFO : file2.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/file4.txt] 2024/04/26 03:27:51 INFO : file3.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/file5.txt] 2024/04/26 03:27:51 INFO : file1.txt: Copied (new) 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/file6.txt] 2024/04/26 03:27:51 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/file7.txt] 2024/04/26 03:27:51 INFO : file4.txt: Copied (new) 2024/04/26 03:27:51 INFO : file5.txt: Copied (new) 2024/04/26 03:27:51 INFO : file6.txt: Copied (new) 2024/04/26 03:27:51 INFO : file7.txt: Copied (new) 2024/04/26 03:27:51 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2 2024/04/26 03:27:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2] 2024/04/26 03:27:51 (01) : test resync 2024/04/26 03:27:51 (02) : test 1. resync with empty path1, resulting in copying all content from path2. 2024/04/26 03:27:51 (03) : purge-children /tmp/032741ra/resync/path1/ 2024/04/26 03:27:51 (04) : bisync resync 2024/04/26 03:27:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:51 INFO : Synching Path1 "/tmp/032741ra/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/" 2024/04/26 03:27:51 INFO : Copying Path2 files to Path1 2024/04/26 03:27:51 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:51 INFO : file1.txt: Copied (new) 2024/04/26 03:27:51 INFO : file2.txt: Copied (new) 2024/04/26 03:27:51 INFO : file3.txt: Copied (new) 2024/04/26 03:27:51 INFO : file4.txt: Copied (new) 2024/04/26 03:27:51 INFO : file5.txt: Copied (new) 2024/04/26 03:27:51 INFO : file6.txt: Copied (new) 2024/04/26 03:27:51 INFO : file7.txt: Copied (new) 2024/04/26 03:27:51 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:51 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:51 INFO : Resync updating listings 2024/04/26 03:27:51 INFO : Validating listings for Path1 "/tmp/032741ra/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/" 2024/04/26 03:27:51 INFO : Bisync successful 2024/04/26 03:27:51 (05) : move-listings empty-path1 2024/04/26 03:27:51 (06) : test 2. resync with empty path2, resulting in synching all content to path2. 2024/04/26 03:27:51 (07) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/ 2024/04/26 03:27:51 (08) : bisync resync 2024/04/26 03:27:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:51 INFO : Synching Path1 "/tmp/032741ra/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/" 2024/04/26 03:27:51 INFO : Copying Path2 files to Path1 2024/04/26 03:27:51 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:51 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:51 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:51 INFO : file1.txt: Copied (new) 2024/04/26 03:27:51 INFO : file2.txt: Copied (new) 2024/04/26 03:27:51 INFO : file3.txt: Copied (new) 2024/04/26 03:27:51 INFO : file4.txt: Copied (new) 2024/04/26 03:27:52 INFO : file5.txt: Copied (new) 2024/04/26 03:27:52 INFO : file6.txt: Copied (new) 2024/04/26 03:27:52 INFO : file7.txt: Copied (new) 2024/04/26 03:27:52 INFO : Resync updating listings 2024/04/26 03:27:52 INFO : Validating listings for Path1 "/tmp/032741ra/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/" 2024/04/26 03:27:52 INFO : Bisync successful 2024/04/26 03:27:52 (09) : move-listings empty-path2 2024/04/26 03:27:52 (10) : test 3. exercise all of the various file difference scenarios during a resync. 2024/04/26 03:27:52 (11) : touch-glob 2002-02-02 /tmp/032741ra/datadir/test_resync-datuziq0/ fileA.txt 2024/04/26 03:27:52 (12) : touch-glob 1999-09-09 /tmp/032741ra/datadir/test_resync-datuziq0/ fileB.txt 2024/04/26 03:27:52 (13) : test = file - path1 - path2 - expected action - who wins 2024/04/26 03:27:52 (14) : test - file1.txt - exists - missing - sync path1 > path2 - path1 2024/04/26 03:27:52 (15) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/file1.txt 2024/04/26 03:27:52 INFO : file1.txt: Deleted 2024/04/26 03:27:52 (16) : test - file2.txt - missing - exists - copy path2 > path1 - path2 2024/04/26 03:27:52 (17) : delete-file /tmp/032741ra/resync/path1/file2.txt 2024/04/26 03:27:52 INFO : file2.txt: Deleted 2024/04/26 03:27:52 (18) : test - file3.txt - exists - newer date - sync path1 > path2 - path1 2024/04/26 03:27:52 (19) : copy-as /tmp/032741ra/datadir/test_resync-datuziq0/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/ file3.txt 2024/04/26 03:27:52 INFO : fileA.txt: Copied (replaced existing) to: file3.txt 2024/04/26 03:27:52 (20) : test - file4.txt - missing - newer date - copy path2 > path1 - path2 2024/04/26 03:27:52 (21) : delete-file /tmp/032741ra/resync/path1/file4.txt 2024/04/26 03:27:52 INFO : file4.txt: Deleted 2024/04/26 03:27:52 (22) : copy-as /tmp/032741ra/datadir/test_resync-datuziq0/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/ file4.txt 2024/04/26 03:27:52 INFO : fileA.txt: Copied (replaced existing) to: file4.txt 2024/04/26 03:27:52 (23) : test - file5.txt - exists - older date - sync path1 > path2 - path1 2024/04/26 03:27:52 (24) : copy-as /tmp/032741ra/datadir/test_resync-datuziq0/fileB.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/ file5.txt 2024/04/26 03:27:52 INFO : fileB.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:52 (25) : test - file6.txt - older date - newer date - sync path1 > path2 - path1 2024/04/26 03:27:52 (26) : copy-as /tmp/032741ra/datadir/test_resync-datuziq0/fileB.txt /tmp/032741ra/resync/path1/ file6.txt 2024/04/26 03:27:52 INFO : fileB.txt: Copied (replaced existing) to: file6.txt 2024/04/26 03:27:52 (27) : copy-as /tmp/032741ra/datadir/test_resync-datuziq0/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/ file6.txt 2024/04/26 03:27:52 INFO : fileA.txt: Copied (replaced existing) to: file6.txt 2024/04/26 03:27:52 (28) : test - file7.txt - exists - exists (same) - none - same 2024/04/26 03:27:52 (29) : test run bisync with resync 2024/04/26 03:27:52 (30) : bisync resync 2024/04/26 03:27:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:52 INFO : Synching Path1 "/tmp/032741ra/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/" 2024/04/26 03:27:52 INFO : Copying Path2 files to Path1 2024/04/26 03:27:52 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:52 INFO : file2.txt: Copied (new) 2024/04/26 03:27:52 INFO : file4.txt: Copied (new) 2024/04/26 03:27:52 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:52 INFO : file1.txt: Copied (new) 2024/04/26 03:27:52 INFO : file3.txt: Copied (replaced existing) 2024/04/26 03:27:52 INFO : file5.txt: Copied (replaced existing) 2024/04/26 03:27:52 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:27:52 INFO : Resync updating listings 2024/04/26 03:27:52 INFO : Validating listings for Path1 "/tmp/032741ra/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/" 2024/04/26 03:27:52 INFO : Bisync successful 2024/04/26 03:27:52 (31) : copy-listings mixed-diffs 2024/04/26 03:27:52 (32) : test run normal bisync 2024/04/26 03:27:52 (33) : bisync 2024/04/26 03:27:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:52 INFO : Synching Path1 "/tmp/032741ra/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/" 2024/04/26 03:27:52 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:52 INFO : Path1 checking for diffs 2024/04/26 03:27:52 INFO : Path2 checking for diffs 2024/04/26 03:27:52 INFO : No changes found 2024/04/26 03:27:52 INFO : Updating listings 2024/04/26 03:27:52 INFO : Validating listings for Path1 "/tmp/032741ra/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/" 2024/04/26 03:27:52 INFO : Bisync successful 2024/04/26 03:27:52 (34) : test 4. confirm critical error on normal sync of empty path. 2024/04/26 03:27:52 (35) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/ 2024/04/26 03:27:52 (36) : bisync 2024/04/26 03:27:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:52 INFO : Synching Path1 "/tmp/032741ra/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync/path2/" 2024/04/26 03:27:52 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:52 INFO : Path1 checking for diffs 2024/04/26 03:27:52 INFO : Path2 checking for diffs 2024/04/26 03:27:52 ERROR : Empty current Path2 listing. Cannot sync to an empty directory: /tmp/032741ra/workdir/tmp_032741ra_resync_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_resync_path2.path2.lst-new 2024/04/26 03:27:52 ERROR : Bisync critical error: empty current Path2 listing: /tmp/032741ra/workdir/tmp_032741ra_resync_path1..TestHdfs_rclone-test-buqefin8mofibej2lakocub8_032741ra_resync_path2.path2.lst-new 2024/04/26 03:27:52 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:52 Bisync error: bisync aborted bisync_test.go:553: TEST resync PASSED === RUN TestBisyncLocalRemote/resync_modes 2024/04/26 03:27:52 DEBUG : Creating backend with remote "/tmp/032741ra/resync_modes/path1" 2024/04/26 03:27:52 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:52 DEBUG : path2: Making directory 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:52 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2" 2024/04/26 03:27:52 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:52 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:52 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:52 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:52 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:52 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:52 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2" 2024/04/26 03:27:52 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_resync_modes-mulidij3" 2024/04/26 03:27:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : Local file system at /tmp/032741ra/initdir/test_resync_modes-mulidij3: Waiting for checks to finish 2024/04/26 03:27:52 DEBUG : Local file system at /tmp/032741ra/initdir/test_resync_modes-mulidij3: Waiting for transfers to finish 2024/04/26 03:27:52 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : file1.txt.hopopex9.partial: renamed to: file1.txt 2024/04/26 03:27:52 INFO : file1.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:52 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : RCLONE_TEST.dehanih9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:52 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:52 DEBUG : file2.txt.keqiyil1.partial: renamed to: file2.txt 2024/04/26 03:27:52 INFO : file2.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_resync_modes-mipopav0" 2024/04/26 03:27:52 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : Local file system at /tmp/032741ra/datadir/test_resync_modes-mipopav0: Waiting for checks to finish 2024/04/26 03:27:52 DEBUG : Local file system at /tmp/032741ra/datadir/test_resync_modes-mipopav0: Waiting for transfers to finish 2024/04/26 03:27:52 DEBUG : file1R.txt: md5 = 705bb3c0ef02925739e834ca98c099c3 OK 2024/04/26 03:27:52 DEBUG : file1R.txt.jafekef2.partial: renamed to: file1R.txt 2024/04/26 03:27:52 INFO : file1R.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/04/26 03:27:52 DEBUG : file1L.txt.zavekix0.partial: renamed to: file1L.txt 2024/04/26 03:27:52 INFO : file1L.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/04/26 03:27:52 DEBUG : file2.txt.qubotuv5.partial: renamed to: file2.txt 2024/04/26 03:27:52 INFO : file2.txt: Copied (new) 2024/04/26 03:27:52 ERROR : : error listing: directory not found 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2] 2024/04/26 03:27:52 ERROR : : error listing: directory not found 2024/04/26 03:27:52 checking initFs Local file system at /tmp/032741ra/initdir/test_resync_modes-mulidij3 2024/04/26 03:27:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : Local file system at /tmp/032741ra/resync_modes/path1: Waiting for checks to finish 2024/04/26 03:27:52 DEBUG : Local file system at /tmp/032741ra/resync_modes/path1: Waiting for transfers to finish 2024/04/26 03:27:52 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:52 DEBUG : RCLONE_TEST.jovolak1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:52 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:52 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : file2.txt.yolelop7.partial: renamed to: file2.txt 2024/04/26 03:27:52 INFO : file2.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : file1.txt.sumumos8.partial: renamed to: file1.txt 2024/04/26 03:27:52 INFO : file1.txt: Copied (new) 2024/04/26 03:27:52 checking Path1 Local file system at /tmp/032741ra/resync_modes/path1 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2] 2024/04/26 03:27:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/RCLONE_TEST] 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/file1.txt] 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/file2.txt] 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2: Waiting for checks to finish 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2: Waiting for transfers to finish 2024/04/26 03:27:52 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:52 INFO : file1.txt: Copied (new) 2024/04/26 03:27:52 INFO : file2.txt: Copied (new) 2024/04/26 03:27:52 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2] 2024/04/26 03:27:52 (01) : test resync-mode 2024/04/26 03:27:52 (02) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:52 (03) : touch-glob 2001-01-02 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1R.txt 2024/04/26 03:27:52 (04) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/ file1.txt 2024/04/26 03:27:52 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:52 (05) : touch-glob 2001-03-04 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1L.txt 2024/04/26 03:27:52 (06) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1L.txt /tmp/032741ra/resync_modes/path1/ file1.txt 2024/04/26 03:27:52 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:52 (07) : test bisync run with --resync-mode=newer 2024/04/26 03:27:52 (08) : bisync resync resync-mode=newer 2024/04/26 03:27:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:52 INFO : Synching Path1 "/tmp/032741ra/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Copying Path2 files to Path1 2024/04/26 03:27:52 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:52 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:52 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:52 INFO : Resync updating listings 2024/04/26 03:27:52 INFO : Validating listings for Path1 "/tmp/032741ra/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Bisync successful 2024/04/26 03:27:52 (09) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:52 (10) : touch-glob 2001-07-23 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1R.txt 2024/04/26 03:27:52 (11) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/ file1.txt 2024/04/26 03:27:52 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:52 (12) : touch-glob 2001-08-26 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1L.txt 2024/04/26 03:27:52 (13) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1L.txt /tmp/032741ra/resync_modes/path1/ file1.txt 2024/04/26 03:27:52 INFO : file1L.txt: Updated modification time in destination 2024/04/26 03:27:52 (14) : test bisync run with --resync-mode=path2 2024/04/26 03:27:52 (15) : bisync resync resync-mode=path2 2024/04/26 03:27:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:52 INFO : Synching Path1 "/tmp/032741ra/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Copying Path2 files to Path1 2024/04/26 03:27:52 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:52 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:52 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:52 INFO : Resync updating listings 2024/04/26 03:27:52 INFO : Validating listings for Path1 "/tmp/032741ra/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Bisync successful 2024/04/26 03:27:52 (16) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:52 (17) : touch-glob 2002-07-23 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1R.txt 2024/04/26 03:27:52 (18) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/ file1.txt 2024/04/26 03:27:52 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:52 (19) : touch-glob 2002-08-26 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1L.txt 2024/04/26 03:27:52 (20) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1L.txt /tmp/032741ra/resync_modes/path1/ file1.txt 2024/04/26 03:27:52 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:52 (21) : test bisync run with --resync-mode=larger 2024/04/26 03:27:52 (22) : bisync resync resync-mode=larger 2024/04/26 03:27:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:52 INFO : Synching Path1 "/tmp/032741ra/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Copying Path2 files to Path1 2024/04/26 03:27:52 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:52 INFO : file1.txt: Path2 is larger. Path1: 33, Path2: 42, Difference: 9 2024/04/26 03:27:52 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:52 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:52 INFO : Resync updating listings 2024/04/26 03:27:52 INFO : Validating listings for Path1 "/tmp/032741ra/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Bisync successful 2024/04/26 03:27:52 (23) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:52 (24) : touch-glob 2003-07-23 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1R.txt 2024/04/26 03:27:52 (25) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/ file1.txt 2024/04/26 03:27:52 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:52 (26) : touch-glob 2003-09-04 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1L.txt 2024/04/26 03:27:52 (27) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1L.txt /tmp/032741ra/resync_modes/path1/ file1.txt 2024/04/26 03:27:52 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:52 (28) : test bisync run with --resync-mode=older 2024/04/26 03:27:52 (29) : bisync resync resync-mode=older 2024/04/26 03:27:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:52 INFO : Synching Path1 "/tmp/032741ra/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Copying Path2 files to Path1 2024/04/26 03:27:52 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:52 INFO : file1.txt: Path2 is older. Path1: 2003-09-04 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 1032h0m0s 2024/04/26 03:27:52 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:52 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:52 INFO : Resync updating listings 2024/04/26 03:27:52 INFO : Validating listings for Path1 "/tmp/032741ra/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Bisync successful 2024/04/26 03:27:52 (30) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:52 (31) : touch-glob 2004-07-23 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1R.txt 2024/04/26 03:27:52 (32) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/ file1.txt 2024/04/26 03:27:52 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:52 (33) : touch-glob 2004-07-23 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1L.txt 2024/04/26 03:27:52 (34) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1L.txt /tmp/032741ra/resync_modes/path1/ file1.txt 2024/04/26 03:27:52 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:52 (35) : test bisync run with --resync-mode=smaller 2024/04/26 03:27:52 (36) : bisync resync resync-mode=smaller 2024/04/26 03:27:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:52 INFO : Synching Path1 "/tmp/032741ra/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Copying Path2 files to Path1 2024/04/26 03:27:52 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:52 INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9 2024/04/26 03:27:52 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:52 INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9 2024/04/26 03:27:52 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:52 INFO : Resync updating listings 2024/04/26 03:27:52 INFO : Validating listings for Path1 "/tmp/032741ra/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Bisync successful 2024/04/26 03:27:52 (37) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:27:52 (38) : touch-glob 2005-01-02 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1R.txt 2024/04/26 03:27:52 (39) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/ file1.txt 2024/04/26 03:27:52 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:52 (40) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1R.txt /tmp/032741ra/resync_modes/path1/ file2.txt 2024/04/26 03:27:52 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:52 (41) : touch-glob 2006-03-04 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1L.txt 2024/04/26 03:27:52 (42) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1L.txt /tmp/032741ra/resync_modes/path1/ file1.txt 2024/04/26 03:27:52 INFO : file1L.txt: Updated modification time in destination 2024/04/26 03:27:52 (43) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/ file2.txt 2024/04/26 03:27:52 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:52 (44) : test bisync run with --resync-mode=path1 2024/04/26 03:27:52 (45) : bisync resync resync-mode=path1 2024/04/26 03:27:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:52 INFO : Synching Path1 "/tmp/032741ra/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Copying Path2 files to Path1 2024/04/26 03:27:52 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:52 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:52 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:52 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:52 INFO : Resync updating listings 2024/04/26 03:27:52 INFO : Validating listings for Path1 "/tmp/032741ra/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Bisync successful 2024/04/26 03:27:52 (46) : test no winner 2024/04/26 03:27:52 (47) : touch-glob 2022-02-22 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1R.txt 2024/04/26 03:27:52 (48) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/ file1.txt 2024/04/26 03:27:52 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:27:52 (49) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1R.txt /tmp/032741ra/resync_modes/path1/ file2.txt 2024/04/26 03:27:52 INFO : file1R.txt: Updated modification time in destination 2024/04/26 03:27:52 (50) : touch-glob 2022-02-22 /tmp/032741ra/datadir/test_resync_modes-mipopav0/ file1L.txt 2024/04/26 03:27:52 (51) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1L.txt /tmp/032741ra/resync_modes/path1/ file1.txt 2024/04/26 03:27:52 INFO : file1L.txt: Updated modification time in destination 2024/04/26 03:27:52 (52) : copy-as /tmp/032741ra/datadir/test_resync_modes-mipopav0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/ file2.txt 2024/04/26 03:27:52 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:27:52 (53) : test bisync run with --resync-mode=newer 2024/04/26 03:27:52 (54) : bisync resync resync-mode=newer 2024/04/26 03:27:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:52 INFO : Synching Path1 "/tmp/032741ra/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Copying Path2 files to Path1 2024/04/26 03:27:52 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:52 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:52 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:52 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:52 INFO : Resync updating listings 2024/04/26 03:27:52 INFO : Validating listings for Path1 "/tmp/032741ra/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/resync_modes/path2/" 2024/04/26 03:27:52 INFO : Bisync successful bisync_test.go:553: TEST resync_modes PASSED === RUN TestBisyncLocalRemote/rmdirs 2024/04/26 03:27:52 DEBUG : Creating backend with remote "/tmp/032741ra/rmdirs/path1" 2024/04/26 03:27:52 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:52 DEBUG : path2: Making directory 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:52 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2" 2024/04/26 03:27:52 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:52 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:52 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:52 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:52 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:52 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:52 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2" 2024/04/26 03:27:52 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_rmdirs-sirixer7" 2024/04/26 03:27:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:52 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:52 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:52 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:52 DEBUG : file1.copy2.txt.vesatic8.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:52 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : RCLONE_TEST.wuwakaw3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:52 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:52 DEBUG : file1.copy1.txt.qilivux7.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:52 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : Local file system at /tmp/032741ra/initdir/test_rmdirs-sirixer7: Waiting for checks to finish 2024/04/26 03:27:52 DEBUG : Local file system at /tmp/032741ra/initdir/test_rmdirs-sirixer7: Waiting for transfers to finish 2024/04/26 03:27:52 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : file1.copy3.txt.cisajix9.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:52 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : file1.copy4.txt.qapixuf1.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:52 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : file1.txt.tubuwar3.partial: renamed to: file1.txt 2024/04/26 03:27:52 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 INFO : file1.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : file1.copy5.txt.kuyofos2.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:52 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : subdir/file20.txt.texecug2.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:52 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:52 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_rmdirs-zibudaw6" 2024/04/26 03:27:52 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : Local file system at /tmp/032741ra/datadir/test_rmdirs-zibudaw6: Waiting for checks to finish 2024/04/26 03:27:52 DEBUG : Local file system at /tmp/032741ra/datadir/test_rmdirs-zibudaw6: Waiting for transfers to finish 2024/04/26 03:27:52 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:52 DEBUG : file1.txt.maqecut8.partial: renamed to: file1.txt 2024/04/26 03:27:52 INFO : file1.txt: Copied (new) 2024/04/26 03:27:52 ERROR : : error listing: directory not found 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2] 2024/04/26 03:27:52 ERROR : : error listing: directory not found 2024/04/26 03:27:52 checking initFs Local file system at /tmp/032741ra/initdir/test_rmdirs-sirixer7 2024/04/26 03:27:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:52 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:52 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:52 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy1.txt.zavufal8.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:52 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : Local file system at /tmp/032741ra/rmdirs/path1: Waiting for checks to finish 2024/04/26 03:27:52 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : Local file system at /tmp/032741ra/rmdirs/path1: Waiting for transfers to finish 2024/04/26 03:27:52 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : file1.copy3.txt.bijifet4.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:52 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : file1.copy2.txt.nowugob8.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:52 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : file1.copy4.txt.xevuwuw0.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:52 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:52 DEBUG : file1.copy5.txt.zagenub2.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:52 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : subdir/file20.txt.mamopoq3.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:52 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:52 DEBUG : RCLONE_TEST.yiyikom4.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:52 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:52 DEBUG : file1.txt.zajolir7.partial: renamed to: file1.txt 2024/04/26 03:27:52 INFO : file1.txt: Copied (new) 2024/04/26 03:27:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:52 checking Path1 Local file system at /tmp/032741ra/rmdirs/path1 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2] 2024/04/26 03:27:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : subdir: Making directory 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/subdir] 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/RCLONE_TEST] 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/file1.copy3.txt] 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/file1.copy2.txt] 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/file1.copy1.txt] 2024/04/26 03:27:52 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: Waiting for checks to finish 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: Waiting for transfers to finish 2024/04/26 03:27:52 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/file1.copy4.txt] 2024/04/26 03:27:52 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/file1.copy5.txt] 2024/04/26 03:27:52 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/file1.txt] 2024/04/26 03:27:52 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/subdir/file20.txt] 2024/04/26 03:27:52 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:52 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:52 INFO : file1.txt: Copied (new) 2024/04/26 03:27:53 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:53 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/subdir] 2024/04/26 03:27:53 (01) : test rmdirs 2024/04/26 03:27:53 (02) : test initial bisync 2024/04/26 03:27:53 (03) : bisync resync 2024/04/26 03:27:53 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:53 INFO : Synching Path1 "/tmp/032741ra/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/" 2024/04/26 03:27:53 INFO : Copying Path2 files to Path1 2024/04/26 03:27:53 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:53 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:53 INFO : Resync updating listings 2024/04/26 03:27:53 INFO : Validating listings for Path1 "/tmp/032741ra/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/" 2024/04/26 03:27:53 INFO : Bisync successful 2024/04/26 03:27:53 (04) : test 1. delete path1 subdir file 2024/04/26 03:27:53 (05) : delete-file /tmp/032741ra/rmdirs/path1/subdir/file20.txt 2024/04/26 03:27:53 INFO : file20.txt: Deleted 2024/04/26 03:27:53 (06) : test 2. run bisync without remove-empty-dirs 2024/04/26 03:27:53 (07) : bisync 2024/04/26 03:27:53 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:53 INFO : Synching Path1 "/tmp/032741ra/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/" 2024/04/26 03:27:53 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:53 INFO : Path1 checking for diffs 2024/04/26 03:27:53 INFO : - Path1 File was deleted - subdir/file20.txt 2024/04/26 03:27:53 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:53 INFO : Path2 checking for diffs 2024/04/26 03:27:53 INFO : Applying changes 2024/04/26 03:27:53 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/subdir/file20.txt 2024/04/26 03:27:53 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:53 INFO : subdir/file20.txt: Deleted 2024/04/26 03:27:53 INFO : Updating listings 2024/04/26 03:27:53 INFO : Validating listings for Path1 "/tmp/032741ra/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/" 2024/04/26 03:27:53 INFO : Bisync successful 2024/04/26 03:27:53 (08) : test 3. confirm the subdir still exists on both paths 2024/04/26 03:27:53 (09) : list-dirs /tmp/032741ra/rmdirs/path1/ 2024/04/26 03:27:53 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:53 (10) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/ 2024/04/26 03:27:53 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:27:53 (11) : test 4. run bisync with remove-empty-dirs 2024/04/26 03:27:53 (12) : bisync remove-empty-dirs 2024/04/26 03:27:53 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/04/26 03:27:53 INFO : Synching Path1 "/tmp/032741ra/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/" 2024/04/26 03:27:53 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:53 INFO : Path1 checking for diffs 2024/04/26 03:27:53 INFO : Path2 checking for diffs 2024/04/26 03:27:53 INFO : No changes found 2024/04/26 03:27:53 INFO : Updating listings 2024/04/26 03:27:53 INFO : Validating listings for Path1 "/tmp/032741ra/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/" 2024/04/26 03:27:53 INFO : Removing empty directories 2024/04/26 03:27:53 INFO : subdir: Removing directory 2024/04/26 03:27:53 INFO : subdir: Removing directory 2024/04/26 03:27:53 INFO : Bisync successful 2024/04/26 03:27:53 (13) : test 5. confirm the subdir has been removed on both paths 2024/04/26 03:27:53 (14) : list-dirs /tmp/032741ra/rmdirs/path1/ 2024/04/26 03:27:53 (15) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-buqefin8mofibej2lakocub8/032741ra/rmdirs/path2/ bisync_test.go:553: TEST rmdirs PASSED === RUN TestBisyncLocalRemote/volatile 2024/04/26 03:27:53 DEBUG : Creating backend with remote "/tmp/032741ra/volatile/path1" 2024/04/26 03:27:53 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra" for canonical name "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra" 2024/04/26 03:27:53 DEBUG : path2: Making directory 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra: mkdir [/rclone-test-buqefin8mofibej2lakocub8/032741ra/path2] 2024/04/26 03:27:53 DEBUG : Creating backend with remote "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2" 2024/04/26 03:27:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:53 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2" 2024/04/26 03:27:53 DEBUG : Creating backend with remote "/tmp/032741ra/initdir/test_volatile-linovay1" 2024/04/26 03:27:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : Local file system at /tmp/032741ra/initdir/test_volatile-linovay1: Waiting for checks to finish 2024/04/26 03:27:53 DEBUG : Local file system at /tmp/032741ra/initdir/test_volatile-linovay1: Waiting for transfers to finish 2024/04/26 03:27:53 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file2.txt.xavojes6.partial: renamed to: file2.txt 2024/04/26 03:27:53 INFO : file2.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file1.txt.ruyowuc1.partial: renamed to: file1.txt 2024/04/26 03:27:53 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 INFO : file1.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file4.txt.wubexiq1.partial: renamed to: file4.txt 2024/04/26 03:27:53 INFO : file4.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file3.txt.nojujod5.partial: renamed to: file3.txt 2024/04/26 03:27:53 INFO : file3.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file5.txt.hamugoq0.partial: renamed to: file5.txt 2024/04/26 03:27:53 INFO : file5.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file6.txt.jahenal2.partial: renamed to: file6.txt 2024/04/26 03:27:53 INFO : file6.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:53 DEBUG : RCLONE_TEST.zuzuwuv2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:53 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:53 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file7.txt.xupegac6.partial: renamed to: file7.txt 2024/04/26 03:27:53 INFO : file7.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file8.txt.guroyug5.partial: renamed to: file8.txt 2024/04/26 03:27:53 INFO : file8.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : Creating backend with remote "/tmp/032741ra/datadir/test_volatile-furarid7" 2024/04/26 03:27:53 DEBUG : dummy.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : dummy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : dummy.txt.kefimoc6.partial: renamed to: dummy.txt 2024/04/26 03:27:53 INFO : dummy.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : Local file system at /tmp/032741ra/datadir/test_volatile-furarid7: Waiting for checks to finish 2024/04/26 03:27:53 DEBUG : Local file system at /tmp/032741ra/datadir/test_volatile-furarid7: Waiting for transfers to finish 2024/04/26 03:27:53 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:53 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:53 DEBUG : file1.txt.qucojas4.partial: renamed to: file1.txt 2024/04/26 03:27:53 INFO : file1.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:53 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:53 DEBUG : file10.txt.zefeqoq3.partial: renamed to: file10.txt 2024/04/26 03:27:53 INFO : file10.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file11.txt.repecid2.partial: renamed to: file11.txt 2024/04/26 03:27:53 INFO : file11.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file2.txt.kacabep1.partial: renamed to: file2.txt 2024/04/26 03:27:53 INFO : file2.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:53 DEBUG : file5L.txt.yayezaw6.partial: renamed to: file5L.txt 2024/04/26 03:27:53 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:53 DEBUG : file5R.txt.tojoriv4.partial: renamed to: file5R.txt 2024/04/26 03:27:53 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:53 DEBUG : file7.txt.sazefew8.partial: renamed to: file7.txt 2024/04/26 03:27:53 INFO : file7.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:53 DEBUG : file6.txt.soveneq5.partial: renamed to: file6.txt 2024/04/26 03:27:53 INFO : file6.txt: Copied (new) 2024/04/26 03:27:53 ERROR : : error listing: directory not found 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2] 2024/04/26 03:27:53 ERROR : : error listing: directory not found 2024/04/26 03:27:53 checking initFs Local file system at /tmp/032741ra/initdir/test_volatile-linovay1 2024/04/26 03:27:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file1.txt.gawijog4.partial: renamed to: file1.txt 2024/04/26 03:27:53 INFO : file1.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : Local file system at /tmp/032741ra/volatile/path1: Waiting for checks to finish 2024/04/26 03:27:53 DEBUG : Local file system at /tmp/032741ra/volatile/path1: Waiting for transfers to finish 2024/04/26 03:27:53 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file4.txt.puveduh8.partial: renamed to: file4.txt 2024/04/26 03:27:53 INFO : file4.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file2.txt.heyuyey4.partial: renamed to: file2.txt 2024/04/26 03:27:53 INFO : file2.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:53 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : RCLONE_TEST.cokomaz3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:53 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:53 DEBUG : file6.txt.vuroyud0.partial: renamed to: file6.txt 2024/04/26 03:27:53 INFO : file6.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file3.txt.sinizat7.partial: renamed to: file3.txt 2024/04/26 03:27:53 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 INFO : file3.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file7.txt.biditoq2.partial: renamed to: file7.txt 2024/04/26 03:27:53 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 INFO : file7.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file5.txt.cutigod8.partial: renamed to: file5.txt 2024/04/26 03:27:53 INFO : file5.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file8.txt.nimukal6.partial: renamed to: file8.txt 2024/04/26 03:27:53 INFO : file8.txt: Copied (new) 2024/04/26 03:27:53 checking Path1 Local file system at /tmp/032741ra/volatile/path1 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2] 2024/04/26 03:27:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2/RCLONE_TEST] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2/file1.txt] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2/file2.txt] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: Waiting for checks to finish 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: Waiting for transfers to finish 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2/file3.txt] 2024/04/26 03:27:53 INFO : file1.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2/file4.txt] 2024/04/26 03:27:53 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2/file5.txt] 2024/04/26 03:27:53 INFO : file2.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2/file6.txt] 2024/04/26 03:27:53 INFO : file3.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2/file7.txt] 2024/04/26 03:27:53 INFO : file4.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: update [/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2/file8.txt] 2024/04/26 03:27:53 INFO : file5.txt: Copied (new) 2024/04/26 03:27:53 INFO : file6.txt: Copied (new) 2024/04/26 03:27:53 INFO : file7.txt: Copied (new) 2024/04/26 03:27:53 INFO : file8.txt: Copied (new) 2024/04/26 03:27:53 checking path2 hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2: list [/rclone-test-buqefin8mofibej2lakocub8/032741ra/volatile/path2] 2024/04/26 03:27:53 (01) : test volatile 2024/04/26 03:27:53 (02) : test initial bisync 2024/04/26 03:27:53 (03) : bisync resync bisync_test.go:921: skipping 'volatile' test on non-local as it requires uploading 100 files 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8: Purge remote 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-buqefin8mofibej2lakocub8: purge [/rclone-test-buqefin8mofibej2lakocub8] --- PASS: TestBisyncLocalRemote (11.97s) --- PASS: TestBisyncLocalRemote/all_changed (0.65s) --- SKIP: TestBisyncLocalRemote/backupdir (0.20s) --- PASS: TestBisyncLocalRemote/basic (0.33s) --- PASS: TestBisyncLocalRemote/changes (0.52s) --- PASS: TestBisyncLocalRemote/check_access (0.53s) --- PASS: TestBisyncLocalRemote/check_access_filters (0.87s) --- PASS: TestBisyncLocalRemote/check_filename (0.33s) --- PASS: TestBisyncLocalRemote/check_sync (0.49s) --- PASS: TestBisyncLocalRemote/compare_all (0.49s) --- PASS: TestBisyncLocalRemote/createemptysrcdirs (0.55s) --- PASS: TestBisyncLocalRemote/dry_run (0.53s) --- PASS: TestBisyncLocalRemote/equal (0.22s) --- PASS: TestBisyncLocalRemote/ext_paths (0.54s) --- SKIP: TestBisyncLocalRemote/extended_filenames (0.33s) --- PASS: TestBisyncLocalRemote/filters (0.33s) --- PASS: TestBisyncLocalRemote/filtersfile_checks (0.34s) --- PASS: TestBisyncLocalRemote/ignorelistingchecksum (0.34s) --- PASS: TestBisyncLocalRemote/max_delete_path1 (0.32s) --- PASS: TestBisyncLocalRemote/max_delete_path2_force (0.31s) --- PASS: TestBisyncLocalRemote/nomodtime (0.51s) --- SKIP: TestBisyncLocalRemote/normalization (0.23s) --- PASS: TestBisyncLocalRemote/rclone_args (0.67s) --- PASS: TestBisyncLocalRemote/resolve (0.62s) --- PASS: TestBisyncLocalRemote/resync (0.66s) --- PASS: TestBisyncLocalRemote/resync_modes (0.50s) --- PASS: TestBisyncLocalRemote/rmdirs (0.33s) --- SKIP: TestBisyncLocalRemote/volatile (0.20s) === RUN TestBisyncRemoteRemote 2024/04/26 03:27:53 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5" 2024/04/26 03:27:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:53 remote: TestHdfs:rclone-test-xihadop0devojij8dukeboy5 === RUN TestBisyncRemoteRemote/all_changed 2024/04/26 03:27:53 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:53 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/04/26 03:27:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:53 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:53 DEBUG : path1: Making directory 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:27:53 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1" 2024/04/26 03:27:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:53 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1" 2024/04/26 03:27:53 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:53 DEBUG : path2: Making directory 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:27:53 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2" 2024/04/26 03:27:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:53 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2" 2024/04/26 03:27:53 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_all_changed-negomed2" 2024/04/26 03:27:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:53 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:53 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:53 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : Local file system at /tmp/032753ne/initdir/test_all_changed-negomed2: Waiting for checks to finish 2024/04/26 03:27:53 DEBUG : Local file system at /tmp/032753ne/initdir/test_all_changed-negomed2: Waiting for transfers to finish 2024/04/26 03:27:53 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file1.copy1.txt.fokidoc7.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:53 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file1.copy2.txt.cuvitic1.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:53 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file1.copy3.txt.xavenex0.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:53 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file1.copy4.txt.paxuxoh9.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:53 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file1.copy5.txt.rebotej7.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:53 DEBUG : subdir/file20.txt.mitafud0.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:53 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:53 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:53 DEBUG : RCLONE_TEST.nonabuc7.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:53 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:53 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:53 DEBUG : file1.txt.facurey5.partial: renamed to: file1.txt 2024/04/26 03:27:53 INFO : file1.txt: Copied (new) 2024/04/26 03:27:53 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1] 2024/04/26 03:27:53 ERROR : : error listing: directory not found 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2] 2024/04/26 03:27:53 ERROR : : error listing: directory not found 2024/04/26 03:27:53 checking initFs Local file system at /tmp/032753ne/initdir/test_all_changed-negomed2 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1] 2024/04/26 03:27:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : subdir: Making directory 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/subdir] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/RCLONE_TEST] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/file1.copy1.txt] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/file1.copy3.txt] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/file1.copy2.txt] 2024/04/26 03:27:53 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: Waiting for checks to finish 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: Waiting for transfers to finish 2024/04/26 03:27:53 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/file1.copy4.txt] 2024/04/26 03:27:53 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/file1.copy5.txt] 2024/04/26 03:27:53 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/file1.txt] 2024/04/26 03:27:53 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/subdir/file20.txt] 2024/04/26 03:27:53 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:53 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:53 INFO : file1.txt: Copied (new) 2024/04/26 03:27:53 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:53 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/subdir] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2] 2024/04/26 03:27:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : subdir: Making directory 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/subdir] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/RCLONE_TEST] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy2.txt] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy3.txt] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy1.txt] 2024/04/26 03:27:53 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: Waiting for checks to finish 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: Waiting for transfers to finish 2024/04/26 03:27:53 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy4.txt] 2024/04/26 03:27:53 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy5.txt] 2024/04/26 03:27:53 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.txt] 2024/04/26 03:27:53 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/subdir/file20.txt] 2024/04/26 03:27:53 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:53 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:53 INFO : file1.txt: Copied (new) 2024/04/26 03:27:53 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:53 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2] 2024/04/26 03:27:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/subdir] 2024/04/26 03:27:53 (01) : test all-changed 2024/04/26 03:27:53 (02) : test initial bisync 2024/04/26 03:27:53 (03) : bisync resync 2024/04/26 03:27:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/" 2024/04/26 03:27:53 INFO : Copying Path2 files to Path1 2024/04/26 03:27:53 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:53 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:53 INFO : Resync updating listings 2024/04/26 03:27:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/" 2024/04/26 03:27:53 INFO : Bisync successful 2024/04/26 03:27:53 (04) : test change timestamp on all files except RCLONE_TEST 2024/04/26 03:27:53 (05) : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/ file* 2024/04/26 03:27:53 (06) : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/subdir file* 2024/04/26 03:27:53 (07) : test sync should pass 2024/04/26 03:27:53 (08) : bisync 2024/04/26 03:27:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/" 2024/04/26 03:27:53 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:53 INFO : Path1 checking for diffs 2024/04/26 03:27:53 INFO : - Path1 File changed: time (newer) - file1.copy1.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (newer) - file1.copy2.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (newer) - file1.copy3.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (newer) - file1.copy4.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (newer) - file1.copy5.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (newer) - file1.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2024/04/26 03:27:53 INFO : Path1: 7 changes:  0 new,  7 modified,  0 deleted 2024/04/26 03:27:53 INFO : (Modified:  7 newer,  0 older) 2024/04/26 03:27:53 INFO : Path2 checking for diffs 2024/04/26 03:27:53 INFO : Applying changes 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy1.txt 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy2.txt 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy3.txt 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy4.txt 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy5.txt 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.txt 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/subdir/file20.txt 2024/04/26 03:27:53 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:53 INFO : file1.copy2.txt: Copied (replaced existing) 2024/04/26 03:27:53 INFO : file1.copy3.txt: Copied (replaced existing) 2024/04/26 03:27:53 INFO : file1.copy4.txt: Copied (replaced existing) 2024/04/26 03:27:53 INFO : file1.copy1.txt: Copied (replaced existing) 2024/04/26 03:27:53 INFO : file1.copy5.txt: Copied (replaced existing) 2024/04/26 03:27:53 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:53 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:53 INFO : Updating listings 2024/04/26 03:27:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/" 2024/04/26 03:27:53 INFO : Bisync successful 2024/04/26 03:27:53 (09) : test change timestamp on all files including RCLONE_TEST 2024/04/26 03:27:53 (10) : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/ * 2024/04/26 03:27:53 (11) : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/subdir * 2024/04/26 03:27:53 (12) : test sync should fail 2024/04/26 03:27:53 (13) : bisync 2024/04/26 03:27:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/" 2024/04/26 03:27:53 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:53 INFO : Path1 checking for diffs 2024/04/26 03:27:53 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - file1.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2024/04/26 03:27:53 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2024/04/26 03:27:53 INFO : (Modified:  1 newer,  7 older) 2024/04/26 03:27:53 INFO : Path2 checking for diffs 2024/04/26 03:27:53 ERROR : Safety abort: all files were changed on Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/". Run with --force if desired. 2024/04/26 03:27:53 NOTICE: Bisync aborted. Please try again. 2024/04/26 03:27:53 Bisync error: all files were changed 2024/04/26 03:27:53 (14) : test sync with force should pass 2024/04/26 03:27:53 (15) : bisync force 2024/04/26 03:27:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/" 2024/04/26 03:27:53 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:53 INFO : Path1 checking for diffs 2024/04/26 03:27:53 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - file1.txt 2024/04/26 03:27:53 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2024/04/26 03:27:53 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2024/04/26 03:27:53 INFO : (Modified:  1 newer,  7 older) 2024/04/26 03:27:53 INFO : Path2 checking for diffs 2024/04/26 03:27:53 INFO : Applying changes 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/RCLONE_TEST 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy1.txt 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy2.txt 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy3.txt 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy4.txt 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.copy5.txt 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/file1.txt 2024/04/26 03:27:53 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/subdir/file20.txt 2024/04/26 03:27:53 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:53 INFO : file1.copy1.txt: Copied (replaced existing) 2024/04/26 03:27:53 INFO : RCLONE_TEST: Copied (replaced existing) 2024/04/26 03:27:54 INFO : file1.copy4.txt: Copied (replaced existing) 2024/04/26 03:27:54 INFO : file1.copy3.txt: Copied (replaced existing) 2024/04/26 03:27:54 INFO : file1.copy2.txt: Copied (replaced existing) 2024/04/26 03:27:54 INFO : file1.copy5.txt: Copied (replaced existing) 2024/04/26 03:27:54 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:54 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:54 INFO : Updating listings 2024/04/26 03:27:54 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/all_changed/path2/" 2024/04/26 03:27:54 INFO : Bisync successful bisync_test.go:553: TEST all_changed PASSED === RUN TestBisyncRemoteRemote/backupdir 2024/04/26 03:27:54 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:54 DEBUG : path1: Making directory 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:27:54 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1" 2024/04/26 03:27:54 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:54 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:54 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1" 2024/04/26 03:27:54 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:54 DEBUG : path2: Making directory 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:27:54 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2" 2024/04/26 03:27:54 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:54 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:54 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2" 2024/04/26 03:27:54 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_backupdir-hiriyeg3" 2024/04/26 03:27:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : Local file system at /tmp/032753ne/initdir/test_backupdir-hiriyeg3: Waiting for checks to finish 2024/04/26 03:27:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file1.txt.nawizef6.partial: renamed to: file1.txt 2024/04/26 03:27:54 INFO : file1.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file2.txt.xinezan8.partial: renamed to: file2.txt 2024/04/26 03:27:54 INFO : file2.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : Local file system at /tmp/032753ne/initdir/test_backupdir-hiriyeg3: Waiting for transfers to finish 2024/04/26 03:27:54 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file4.txt.cifirik6.partial: renamed to: file4.txt 2024/04/26 03:27:54 INFO : file4.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file3.txt.wasebov5.partial: renamed to: file3.txt 2024/04/26 03:27:54 INFO : file3.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file5.txt.givojac1.partial: renamed to: file5.txt 2024/04/26 03:27:54 INFO : file5.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file6.txt.yedefac5.partial: renamed to: file6.txt 2024/04/26 03:27:54 INFO : file6.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file7.txt.binotiq1.partial: renamed to: file7.txt 2024/04/26 03:27:54 INFO : file7.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:54 DEBUG : RCLONE_TEST.xoseqec2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:54 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:54 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file8.txt.hehefoq5.partial: renamed to: file8.txt 2024/04/26 03:27:54 INFO : file8.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_backupdir-zaredit4" 2024/04/26 03:27:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : Local file system at /tmp/032753ne/datadir/test_backupdir-zaredit4: Waiting for checks to finish 2024/04/26 03:27:54 DEBUG : Local file system at /tmp/032753ne/datadir/test_backupdir-zaredit4: Waiting for transfers to finish 2024/04/26 03:27:54 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:54 DEBUG : file10.txt.paxujim7.partial: renamed to: file10.txt 2024/04/26 03:27:54 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:54 DEBUG : file1.txt.meliyab9.partial: renamed to: file1.txt 2024/04/26 03:27:54 INFO : file1.txt: Copied (new) 2024/04/26 03:27:54 INFO : file10.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:54 DEBUG : file2.txt.dovimet8.partial: renamed to: file2.txt 2024/04/26 03:27:54 INFO : file2.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:54 DEBUG : file5L.txt.jacixeb1.partial: renamed to: file5L.txt 2024/04/26 03:27:54 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:54 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:54 DEBUG : file5R.txt.posijuz9.partial: renamed to: file5R.txt 2024/04/26 03:27:54 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file11.txt.necacay7.partial: renamed to: file11.txt 2024/04/26 03:27:54 INFO : file11.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:54 DEBUG : file6.txt.qulazej9.partial: renamed to: file6.txt 2024/04/26 03:27:54 INFO : file6.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:54 DEBUG : file7.txt.limequv7.partial: renamed to: file7.txt 2024/04/26 03:27:54 INFO : file7.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1] 2024/04/26 03:27:54 ERROR : : error listing: directory not found 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2] 2024/04/26 03:27:54 ERROR : : error listing: directory not found 2024/04/26 03:27:54 checking initFs Local file system at /tmp/032753ne/initdir/test_backupdir-hiriyeg3 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1] 2024/04/26 03:27:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1/RCLONE_TEST] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1/file1.txt] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1/file2.txt] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: Waiting for checks to finish 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1/file3.txt] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: Waiting for transfers to finish 2024/04/26 03:27:54 INFO : file1.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1/file4.txt] 2024/04/26 03:27:54 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1/file5.txt] 2024/04/26 03:27:54 INFO : file3.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1/file6.txt] 2024/04/26 03:27:54 INFO : file2.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1/file7.txt] 2024/04/26 03:27:54 INFO : file4.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1/file8.txt] 2024/04/26 03:27:54 INFO : file5.txt: Copied (new) 2024/04/26 03:27:54 INFO : file6.txt: Copied (new) 2024/04/26 03:27:54 INFO : file7.txt: Copied (new) 2024/04/26 03:27:54 INFO : file8.txt: Copied (new) 2024/04/26 03:27:54 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path1] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2] 2024/04/26 03:27:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2/RCLONE_TEST] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2/file1.txt] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: Waiting for checks to finish 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: Waiting for transfers to finish 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2/file3.txt] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2/file2.txt] 2024/04/26 03:27:54 INFO : file1.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2/file4.txt] 2024/04/26 03:27:54 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2/file5.txt] 2024/04/26 03:27:54 INFO : file3.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2/file6.txt] 2024/04/26 03:27:54 INFO : file2.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2/file7.txt] 2024/04/26 03:27:54 INFO : file4.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2/file8.txt] 2024/04/26 03:27:54 INFO : file5.txt: Copied (new) 2024/04/26 03:27:54 INFO : file6.txt: Copied (new) 2024/04/26 03:27:54 INFO : file7.txt: Copied (new) 2024/04/26 03:27:54 INFO : file8.txt: Copied (new) 2024/04/26 03:27:54 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/backupdir/path2] 2024/04/26 03:27:54 (01) : test backupdir 2024/04/26 03:27:54 (02) : test initial bisync 2024/04/26 03:27:54 (03) : bisync resync backupdir1=/tmp/032753ne/workdir/backupdirs/backupdir1 backupdir2=/tmp/032753ne/workdir/backupdirs/backupdir2 bisync_test.go:918: backupdir test currently only works on local (it uses the workdir) === RUN TestBisyncRemoteRemote/basic 2024/04/26 03:27:54 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:54 DEBUG : path1: Making directory 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:27:54 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1" 2024/04/26 03:27:54 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:54 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:54 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1" 2024/04/26 03:27:54 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:54 DEBUG : path2: Making directory 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:27:54 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2" 2024/04/26 03:27:54 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:54 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:54 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2" 2024/04/26 03:27:54 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_basic-qimayek5" 2024/04/26 03:27:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:54 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:54 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:54 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : Local file system at /tmp/032753ne/initdir/test_basic-qimayek5: Waiting for checks to finish 2024/04/26 03:27:54 DEBUG : Local file system at /tmp/032753ne/initdir/test_basic-qimayek5: Waiting for transfers to finish 2024/04/26 03:27:54 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file1.copy2.txt.xenaquz9.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:54 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:54 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : RCLONE_TEST.xoyanom1.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:54 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:54 DEBUG : file1.copy4.txt.nilazah0.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:54 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file1.txt.riribul2.partial: renamed to: file1.txt 2024/04/26 03:27:54 INFO : file1.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file1.copy5.txt.muqiser4.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:54 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:54 DEBUG : file1.copy1.txt.liqureh9.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:54 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : subdir/file20.txt.nomisev3.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:54 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : file1.copy3.txt.dinagey9.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:54 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:54 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:54 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_basic-fakoyef3" 2024/04/26 03:27:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : Local file system at /tmp/032753ne/datadir/test_basic-fakoyef3: Waiting for checks to finish 2024/04/26 03:27:54 DEBUG : Local file system at /tmp/032753ne/datadir/test_basic-fakoyef3: Waiting for transfers to finish 2024/04/26 03:27:54 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:54 DEBUG : file1.txt.mujonin4.partial: renamed to: file1.txt 2024/04/26 03:27:54 INFO : file1.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1] 2024/04/26 03:27:54 ERROR : : error listing: directory not found 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2] 2024/04/26 03:27:54 ERROR : : error listing: directory not found 2024/04/26 03:27:54 checking initFs Local file system at /tmp/032753ne/initdir/test_basic-qimayek5 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1] 2024/04/26 03:27:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : subdir: Making directory 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/subdir] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/RCLONE_TEST] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/file1.copy1.txt] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/file1.copy2.txt] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/file1.copy3.txt] 2024/04/26 03:27:54 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: Waiting for checks to finish 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: Waiting for transfers to finish 2024/04/26 03:27:54 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/file1.copy4.txt] 2024/04/26 03:27:54 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/file1.copy5.txt] 2024/04/26 03:27:54 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/file1.txt] 2024/04/26 03:27:54 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/subdir/file20.txt] 2024/04/26 03:27:54 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:54 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:54 INFO : file1.txt: Copied (new) 2024/04/26 03:27:54 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:54 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/subdir] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2] 2024/04/26 03:27:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/RCLONE_TEST] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/file1.copy1.txt] 2024/04/26 03:27:54 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : subdir: Making directory 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/subdir] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/file1.copy3.txt] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/file1.copy2.txt] 2024/04/26 03:27:54 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: Waiting for checks to finish 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: Waiting for transfers to finish 2024/04/26 03:27:54 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/file1.copy4.txt] 2024/04/26 03:27:54 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/file1.copy5.txt] 2024/04/26 03:27:54 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/file1.txt] 2024/04/26 03:27:54 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/subdir/file20.txt] 2024/04/26 03:27:54 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:54 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:54 INFO : file1.txt: Copied (new) 2024/04/26 03:27:54 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:54 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2] 2024/04/26 03:27:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/subdir] 2024/04/26 03:27:54 (01) : test basic 2024/04/26 03:27:54 (02) : test initial bisync 2024/04/26 03:27:54 (03) : bisync resync 2024/04/26 03:27:54 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:54 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/" 2024/04/26 03:27:54 INFO : Copying Path2 files to Path1 2024/04/26 03:27:54 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:54 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:54 INFO : Resync updating listings 2024/04/26 03:27:54 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/" 2024/04/26 03:27:54 INFO : Bisync successful 2024/04/26 03:27:54 (04) : test place newer files on both paths 2024/04/26 03:27:54 (05) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_basic-fakoyef3/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/ 2024/04/26 03:27:54 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:54 (06) : copy-as /tmp/032753ne/datadir/test_basic-fakoyef3/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/subdir file20.txt 2024/04/26 03:27:54 INFO : file1.txt: Copied (replaced existing) to: file20.txt 2024/04/26 03:27:54 (07) : test bisync run 2024/04/26 03:27:54 (08) : bisync 2024/04/26 03:27:54 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:54 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/" 2024/04/26 03:27:54 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:54 INFO : Path1 checking for diffs 2024/04/26 03:27:54 INFO : - Path1 File changed: size (larger), time (newer) - subdir/file20.txt 2024/04/26 03:27:54 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:54 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:54 INFO : Path2 checking for diffs 2024/04/26 03:27:54 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:54 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:27:54 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:27:54 INFO : Applying changes 2024/04/26 03:27:54 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/subdir/file20.txt 2024/04/26 03:27:54 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/file1.txt 2024/04/26 03:27:54 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:54 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:54 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:54 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:27:54 INFO : Updating listings 2024/04/26 03:27:55 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/basic/path2/" 2024/04/26 03:27:55 INFO : Bisync successful bisync_test.go:553: TEST basic PASSED === RUN TestBisyncRemoteRemote/changes 2024/04/26 03:27:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:55 DEBUG : path1: Making directory 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:27:55 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1" 2024/04/26 03:27:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:55 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1" 2024/04/26 03:27:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:55 DEBUG : path2: Making directory 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:27:55 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2" 2024/04/26 03:27:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:55 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2" 2024/04/26 03:27:55 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_changes-qapevaf2" 2024/04/26 03:27:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : Local file system at /tmp/032753ne/initdir/test_changes-qapevaf2: Waiting for checks to finish 2024/04/26 03:27:55 DEBUG : Local file system at /tmp/032753ne/initdir/test_changes-qapevaf2: Waiting for transfers to finish 2024/04/26 03:27:55 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 DEBUG : file3.txt.bohojup5.partial: renamed to: file3.txt 2024/04/26 03:27:55 INFO : file3.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file1.txt.hagojut8.partial: renamed to: file1.txt 2024/04/26 03:27:55 INFO : file1.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file2.txt.gevelep9.partial: renamed to: file2.txt 2024/04/26 03:27:55 INFO : file2.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 DEBUG : file4.txt.fukerab2.partial: renamed to: file4.txt 2024/04/26 03:27:55 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 INFO : file4.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 DEBUG : file6.txt.moyanuf7.partial: renamed to: file6.txt 2024/04/26 03:27:55 INFO : file6.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file5.txt.dorofuw0.partial: renamed to: file5.txt 2024/04/26 03:27:55 INFO : file5.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 DEBUG : file7.txt.sayomiz3.partial: renamed to: file7.txt 2024/04/26 03:27:55 INFO : file7.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 DEBUG : file8.txt.wifetuj7.partial: renamed to: file8.txt 2024/04/26 03:27:55 INFO : file8.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:55 DEBUG : RCLONE_TEST.yebevev9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:55 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:55 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_changes-sisixex6" 2024/04/26 03:27:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : Local file system at /tmp/032753ne/datadir/test_changes-sisixex6: Waiting for checks to finish 2024/04/26 03:27:55 DEBUG : Local file system at /tmp/032753ne/datadir/test_changes-sisixex6: Waiting for transfers to finish 2024/04/26 03:27:55 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:55 DEBUG : file1.txt.qodilub6.partial: renamed to: file1.txt 2024/04/26 03:27:55 INFO : file1.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:55 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:55 DEBUG : file10.txt.zacutiz0.partial: renamed to: file10.txt 2024/04/26 03:27:55 DEBUG : file11.txt.pequbup7.partial: renamed to: file11.txt 2024/04/26 03:27:55 INFO : file10.txt: Copied (new) 2024/04/26 03:27:55 INFO : file11.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:55 DEBUG : file2.txt.topikil7.partial: renamed to: file2.txt 2024/04/26 03:27:55 INFO : file2.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:55 DEBUG : file5L.txt.favameg1.partial: renamed to: file5L.txt 2024/04/26 03:27:55 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:55 DEBUG : file7.txt.sodokud3.partial: renamed to: file7.txt 2024/04/26 03:27:55 INFO : file7.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:55 DEBUG : file6.txt.dakiyuw3.partial: renamed to: file6.txt 2024/04/26 03:27:55 INFO : file6.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:55 DEBUG : file5R.txt.weyitib3.partial: renamed to: file5R.txt 2024/04/26 03:27:55 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1] 2024/04/26 03:27:55 ERROR : : error listing: directory not found 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2] 2024/04/26 03:27:55 ERROR : : error listing: directory not found 2024/04/26 03:27:55 checking initFs Local file system at /tmp/032753ne/initdir/test_changes-qapevaf2 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1] 2024/04/26 03:27:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/RCLONE_TEST] 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: Waiting for checks to finish 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file1.txt] 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file2.txt] 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: Waiting for transfers to finish 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file3.txt] 2024/04/26 03:27:55 INFO : file3.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file4.txt] 2024/04/26 03:27:55 INFO : file1.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file5.txt] 2024/04/26 03:27:55 INFO : file2.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file6.txt] 2024/04/26 03:27:55 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file7.txt] 2024/04/26 03:27:55 INFO : file4.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file8.txt] 2024/04/26 03:27:55 INFO : file5.txt: Copied (new) 2024/04/26 03:27:55 INFO : file6.txt: Copied (new) 2024/04/26 03:27:55 INFO : file7.txt: Copied (new) 2024/04/26 03:27:55 INFO : file8.txt: Copied (new) 2024/04/26 03:27:55 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1] 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2] 2024/04/26 03:27:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/RCLONE_TEST] 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file2.txt] 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: Waiting for checks to finish 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file3.txt] 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: Waiting for transfers to finish 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file1.txt] 2024/04/26 03:27:55 INFO : file2.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file4.txt] 2024/04/26 03:27:55 INFO : file3.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file5.txt] 2024/04/26 03:27:55 INFO : file1.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file6.txt] 2024/04/26 03:27:55 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file7.txt] 2024/04/26 03:27:55 INFO : file4.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file8.txt] 2024/04/26 03:27:55 INFO : file5.txt: Copied (new) 2024/04/26 03:27:55 INFO : file6.txt: Copied (new) 2024/04/26 03:27:55 INFO : file7.txt: Copied (new) 2024/04/26 03:27:55 INFO : file8.txt: Copied (new) 2024/04/26 03:27:55 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2] 2024/04/26 03:27:55 (01) : test changes 2024/04/26 03:27:55 (02) : test initial bisync 2024/04/26 03:27:55 (03) : bisync resync 2024/04/26 03:27:55 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:55 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:55 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/" 2024/04/26 03:27:55 INFO : Copying Path2 files to Path1 2024/04/26 03:27:55 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:55 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:55 INFO : Resync updating listings 2024/04/26 03:27:55 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/" 2024/04/26 03:27:55 INFO : Bisync successful 2024/04/26 03:27:55 (04) : test make modifications on both paths 2024/04/26 03:27:55 (05) : test new on path2 - file10 2024/04/26 03:27:55 (06) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_changes-sisixex6/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/ 2024/04/26 03:27:55 INFO : file10.txt: Copied (new) 2024/04/26 03:27:55 (07) : test newer on path2 - file1 2024/04/26 03:27:55 (08) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_changes-sisixex6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/ 2024/04/26 03:27:55 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:55 (09) : test new on path1 - file11 2024/04/26 03:27:55 (10) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_changes-sisixex6/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/ 2024/04/26 03:27:55 INFO : file11.txt: Copied (new) 2024/04/26 03:27:55 (11) : test newer on path1 - file2 2024/04/26 03:27:55 (12) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_changes-sisixex6/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/ 2024/04/26 03:27:55 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:55 (13) : test deleted on path2 - file3 2024/04/26 03:27:55 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file3.txt 2024/04/26 03:27:55 INFO : file3.txt: Deleted 2024/04/26 03:27:55 (15) : test deleted on path1 - file4 2024/04/26 03:27:55 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file4.txt 2024/04/26 03:27:55 INFO : file4.txt: Deleted 2024/04/26 03:27:55 (17) : test deleted on both paths - file8 2024/04/26 03:27:55 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file8.txt 2024/04/26 03:27:55 INFO : file8.txt: Deleted 2024/04/26 03:27:55 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file8.txt 2024/04/26 03:27:55 INFO : file8.txt: Deleted 2024/04/26 03:27:55 (20) : test changed on both paths - file5 (file5R, file5L) 2024/04/26 03:27:55 (21) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_changes-sisixex6/ file5R.txt 2024/04/26 03:27:55 (22) : copy-as /tmp/032753ne/datadir/test_changes-sisixex6/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/ file5.txt 2024/04/26 03:27:55 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:55 (23) : touch-glob 2001-03-04 /tmp/032753ne/datadir/test_changes-sisixex6/ file5L.txt 2024/04/26 03:27:55 (24) : copy-as /tmp/032753ne/datadir/test_changes-sisixex6/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/ file5.txt 2024/04/26 03:27:55 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:55 (25) : test newer on path2 and deleted on path1 - file6 2024/04/26 03:27:55 (26) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_changes-sisixex6/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/ 2024/04/26 03:27:55 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:27:55 (27) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file6.txt 2024/04/26 03:27:55 INFO : file6.txt: Deleted 2024/04/26 03:27:55 (28) : test newer on path1 and deleted on path2 - file7 2024/04/26 03:27:55 (29) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_changes-sisixex6/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/ 2024/04/26 03:27:55 INFO : file7.txt: Copied (replaced existing) 2024/04/26 03:27:55 (30) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file7.txt 2024/04/26 03:27:55 INFO : file7.txt: Deleted 2024/04/26 03:27:55 (31) : test bisync run 2024/04/26 03:27:55 (32) : bisync 2024/04/26 03:27:55 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:55 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:55 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/" 2024/04/26 03:27:55 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:55 INFO : Path1 checking for diffs 2024/04/26 03:27:55 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:27:55 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:55 INFO : - Path1 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:55 INFO : - Path1 File was deleted - file6.txt 2024/04/26 03:27:55 INFO : - Path1 File changed: size (larger), time (newer) - file7.txt 2024/04/26 03:27:55 INFO : - Path1 File was deleted - file8.txt 2024/04/26 03:27:55 INFO : - Path1 File is new - file11.txt 2024/04/26 03:27:55 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:55 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:55 INFO : Path2 checking for diffs 2024/04/26 03:27:55 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:27:55 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:55 INFO : - Path2 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:27:55 INFO : - Path2 File changed: size (larger), time (newer) - file6.txt 2024/04/26 03:27:55 INFO : - Path2 File was deleted - file7.txt 2024/04/26 03:27:55 INFO : - Path2 File was deleted - file8.txt 2024/04/26 03:27:55 INFO : - Path2 File is new - file10.txt 2024/04/26 03:27:55 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:55 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:27:55 INFO : Applying changes 2024/04/26 03:27:55 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:27:55 INFO : Checking potential conflicts... 2024/04/26 03:27:55 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: 1 differences found 2024/04/26 03:27:55 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2: 1 errors while checking 2024/04/26 03:27:55 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:27:55 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file11.txt 2024/04/26 03:27:55 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file2.txt 2024/04/26 03:27:55 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file4.txt 2024/04/26 03:27:55 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:27:55 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file5.txt.conflict1 2024/04/26 03:27:55 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/04/26 03:27:55 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file5.txt.conflict1 2024/04/26 03:27:55 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file5.txt.conflict2 2024/04/26 03:27:55 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/04/26 03:27:55 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file5.txt.conflict2 2024/04/26 03:27:55 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file6.txt 2024/04/26 03:27:55 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/file7.txt 2024/04/26 03:27:55 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file1.txt 2024/04/26 03:27:55 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file10.txt 2024/04/26 03:27:55 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/file3.txt 2024/04/26 03:27:55 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:55 INFO : file10.txt: Copied (new) 2024/04/26 03:27:55 INFO : file6.txt: Copied (new) 2024/04/26 03:27:55 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:55 INFO : file5.txt.conflict2: Copied (new) 2024/04/26 03:27:55 INFO : file3.txt: Deleted 2024/04/26 03:27:55 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:55 INFO : file5.txt.conflict1: Copied (new) 2024/04/26 03:27:55 INFO : file7.txt: Copied (new) 2024/04/26 03:27:55 INFO : file11.txt: Copied (new) 2024/04/26 03:27:55 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:55 INFO : file4.txt: Deleted 2024/04/26 03:27:55 INFO : Updating listings 2024/04/26 03:27:55 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/changes/path2/" 2024/04/26 03:27:55 INFO : Bisync successful bisync_test.go:553: TEST changes PASSED === RUN TestBisyncRemoteRemote/check_access 2024/04/26 03:27:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:55 DEBUG : path1: Making directory 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:27:55 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1" 2024/04/26 03:27:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:55 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1" 2024/04/26 03:27:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:55 DEBUG : path2: Making directory 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:27:55 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2" 2024/04/26 03:27:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:55 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2" 2024/04/26 03:27:55 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_check_access-fohoqod1" 2024/04/26 03:27:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:55 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:55 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:55 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : Local file system at /tmp/032753ne/initdir/test_check_access-fohoqod1: Waiting for checks to finish 2024/04/26 03:27:55 DEBUG : Local file system at /tmp/032753ne/initdir/test_check_access-fohoqod1: Waiting for transfers to finish 2024/04/26 03:27:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 DEBUG : file1.txt.kezehel8.partial: renamed to: file1.txt 2024/04/26 03:27:55 INFO : file1.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 DEBUG : file3.txt.xonigad9.partial: renamed to: file3.txt 2024/04/26 03:27:55 INFO : file3.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file4.txt.kozoven6.partial: renamed to: file4.txt 2024/04/26 03:27:55 INFO : file4.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : file2.txt.fobafej6.partial: renamed to: file2.txt 2024/04/26 03:27:55 INFO : file2.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:55 DEBUG : subdir/file20.txt.vorohav9.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:55 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:55 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : RCLONE_TEST.rezavev2.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:55 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:55 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:55 DEBUG : subdir/RCLONE_TEST.dodufax6.partial: renamed to: subdir/RCLONE_TEST 2024/04/26 03:27:55 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:55 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:55 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_check_access-kahebib3" 2024/04/26 03:27:55 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : Local file system at /tmp/032753ne/datadir/test_check_access-kahebib3: Waiting for checks to finish 2024/04/26 03:27:55 DEBUG : Local file system at /tmp/032753ne/datadir/test_check_access-kahebib3: Waiting for transfers to finish 2024/04/26 03:27:55 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:27:55 DEBUG : hold.txt.covatul1.partial: renamed to: hold.txt 2024/04/26 03:27:55 INFO : hold.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1] 2024/04/26 03:27:55 ERROR : : error listing: directory not found 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2] 2024/04/26 03:27:55 ERROR : : error listing: directory not found 2024/04/26 03:27:55 checking initFs Local file system at /tmp/032753ne/initdir/test_check_access-fohoqod1 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1] 2024/04/26 03:27:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : subdir: Making directory 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/subdir] 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/RCLONE_TEST] 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/file1.txt] 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/file2.txt] 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/file3.txt] 2024/04/26 03:27:55 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: Waiting for checks to finish 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: Waiting for transfers to finish 2024/04/26 03:27:55 INFO : file1.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/file4.txt] 2024/04/26 03:27:55 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/subdir/RCLONE_TEST] 2024/04/26 03:27:55 INFO : file2.txt: Copied (new) 2024/04/26 03:27:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/subdir/file20.txt] 2024/04/26 03:27:55 INFO : file3.txt: Copied (new) 2024/04/26 03:27:55 INFO : file4.txt: Copied (new) 2024/04/26 03:27:56 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:56 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/subdir] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2] 2024/04/26 03:27:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/subdir] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/RCLONE_TEST] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/file1.txt] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/file2.txt] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/file3.txt] 2024/04/26 03:27:56 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: Waiting for checks to finish 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: Waiting for transfers to finish 2024/04/26 03:27:56 INFO : file1.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/file4.txt] 2024/04/26 03:27:56 INFO : file2.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/subdir/RCLONE_TEST] 2024/04/26 03:27:56 INFO : file3.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/subdir/file20.txt] 2024/04/26 03:27:56 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 INFO : file4.txt: Copied (new) 2024/04/26 03:27:56 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:56 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/subdir] 2024/04/26 03:27:56 (01) : test check-access 2024/04/26 03:27:56 (02) : test initial bisync 2024/04/26 03:27:56 (03) : bisync resync 2024/04/26 03:27:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Copying Path2 files to Path1 2024/04/26 03:27:56 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:56 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:56 INFO : Resync updating listings 2024/04/26 03:27:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Bisync successful 2024/04/26 03:27:56 (04) : test 1. see that check-access passes with the initial setup 2024/04/26 03:27:56 (05) : bisync check-access 2024/04/26 03:27:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:56 INFO : Path1 checking for diffs 2024/04/26 03:27:56 INFO : Path2 checking for diffs 2024/04/26 03:27:56 INFO : Checking access health 2024/04/26 03:27:56 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:56 INFO : No changes found 2024/04/26 03:27:56 INFO : Updating listings 2024/04/26 03:27:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Bisync successful 2024/04/26 03:27:56 (06) : test 2. delete the path2 subdir RCLONE_TEST and run sync. should fail critical. 2024/04/26 03:27:56 (07) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/subdir/RCLONE_TEST 2024/04/26 03:27:56 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:56 (08) : bisync check-access 2024/04/26 03:27:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:56 INFO : Path1 checking for diffs 2024/04/26 03:27:56 INFO : Path2 checking for diffs 2024/04/26 03:27:56 INFO : - Path2 File was deleted - subdir/RCLONE_TEST 2024/04/26 03:27:56 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:56 INFO : Checking access health 2024/04/26 03:27:56 ERROR : Access test failed: Path1 count 2, Path2 count 1 - RCLONE_TEST 2024/04/26 03:27:56 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/RCLONE_TEST 2024/04/26 03:27:56 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:56 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:56 Bisync error: bisync aborted 2024/04/26 03:27:56 (09) : copy-listings path2-missing 2024/04/26 03:27:56 (10) : test 3. put the path2 subdir RCLONE_TEST back, resync. 2024/04/26 03:27:56 (11) : copy-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/subdir/RCLONE_TEST TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/ 2024/04/26 03:27:56 (12) : bisync resync 2024/04/26 03:27:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Copying Path2 files to Path1 2024/04/26 03:27:56 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:56 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:56 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 INFO : Resync updating listings 2024/04/26 03:27:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Bisync successful 2024/04/26 03:27:56 (13) : test 4. run sync with check-access. should pass. 2024/04/26 03:27:56 (14) : bisync check-access 2024/04/26 03:27:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:56 INFO : Path1 checking for diffs 2024/04/26 03:27:56 INFO : Path2 checking for diffs 2024/04/26 03:27:56 INFO : Checking access health 2024/04/26 03:27:56 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:56 INFO : No changes found 2024/04/26 03:27:56 INFO : Updating listings 2024/04/26 03:27:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Bisync successful 2024/04/26 03:27:56 (15) : test 5. delete path1 top level RCLONE_TEST, run sync. should fail critical. 2024/04/26 03:27:56 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/RCLONE_TEST 2024/04/26 03:27:56 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:56 (17) : bisync check-access 2024/04/26 03:27:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:56 INFO : Path1 checking for diffs 2024/04/26 03:27:56 INFO : - Path1 File was deleted - RCLONE_TEST 2024/04/26 03:27:56 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:56 INFO : Path2 checking for diffs 2024/04/26 03:27:56 INFO : Checking access health 2024/04/26 03:27:56 ERROR : Access test failed: Path1 count 1, Path2 count 2 - RCLONE_TEST 2024/04/26 03:27:56 ERROR : -  Access test failed: Path2 file not found in Path1 - RCLONE_TEST 2024/04/26 03:27:56 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:56 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:56 Bisync error: bisync aborted 2024/04/26 03:27:56 (18) : copy-listings path1-missing 2024/04/26 03:27:56 (19) : test 6. run again. should fail critical due to missing listings. 2024/04/26 03:27:56 (20) : bisync check-access 2024/04/26 03:27:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/032753ne/workdir/TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_access_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_access_path2.path1.lst Path2: /tmp/032753ne/workdir/TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_access_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_access_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/032753ne/workdir" 2024/04/26 03:27:56 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:56 Bisync error: bisync aborted 2024/04/26 03:27:56 (21) : move-listings missing-listings 2024/04/26 03:27:56 (22) : test 7. run resync, which will copy the path2 top level back to path1. 2024/04/26 03:27:56 (23) : bisync resync 2024/04/26 03:27:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Copying Path2 files to Path1 2024/04/26 03:27:56 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:56 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:56 INFO : Resync updating listings 2024/04/26 03:27:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Bisync successful 2024/04/26 03:27:56 (24) : test 8. run sync with --check-access. should pass. 2024/04/26 03:27:56 (25) : bisync check-access 2024/04/26 03:27:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:56 INFO : Path1 checking for diffs 2024/04/26 03:27:56 INFO : Path2 checking for diffs 2024/04/26 03:27:56 INFO : Checking access health 2024/04/26 03:27:56 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:56 INFO : No changes found 2024/04/26 03:27:56 INFO : Updating listings 2024/04/26 03:27:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access/path2/" 2024/04/26 03:27:56 INFO : Bisync successful bisync_test.go:553: TEST check_access PASSED === RUN TestBisyncRemoteRemote/check_access_filters 2024/04/26 03:27:56 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:56 DEBUG : path1: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:27:56 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1" 2024/04/26 03:27:56 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:56 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:56 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1" 2024/04/26 03:27:56 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:56 DEBUG : path2: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:27:56 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2" 2024/04/26 03:27:56 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:56 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:56 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2" 2024/04/26 03:27:56 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_check_access_filters-ceguzuv5" 2024/04/26 03:27:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:56 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:56 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:56 DEBUG : subdir-not: Making directory with metadata 2024/04/26 03:27:56 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:56 INFO : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:56 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not 2024/04/26 03:27:56 DEBUG : subdirX: Making directory with metadata 2024/04/26 03:27:56 DEBUG : file1.txt.ciqupoj3.partial: renamed to: file1.txt 2024/04/26 03:27:56 INFO : file1.txt: Copied (new) 2024/04/26 03:27:56 INFO : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:56 DEBUG : Added delayed dir = "subdirX", newDst=subdirX 2024/04/26 03:27:56 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1: Making directory with metadata 2024/04/26 03:27:56 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:56 DEBUG : file3.txt.jasuhac3.partial: renamed to: file3.txt 2024/04/26 03:27:56 INFO : file3.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:56 DEBUG : file2.txt.xeguqiv9.partial: renamed to: file2.txt 2024/04/26 03:27:56 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:56 DEBUG : file4.txt.kuvahub7.partial: renamed to: file4.txt 2024/04/26 03:27:56 INFO : file4.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirA: Making directory with metadata 2024/04/26 03:27:56 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:56 INFO : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:56 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1 2024/04/26 03:27:56 DEBUG : RCLONE_TEST.yuzuyip9.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:56 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 INFO : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:56 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA 2024/04/26 03:27:56 DEBUG : subdir/subdirB: Making directory with metadata 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:56 INFO : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:56 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB 2024/04/26 03:27:56 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2: Making directory with metadata 2024/04/26 03:27:56 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdirX/file20.txt.mitejak8.partial: renamed to: subdirX/file20.txt 2024/04/26 03:27:56 INFO : subdirX/file20.txt: Copied (new) 2024/04/26 03:27:56 INFO : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:56 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 INFO : file2.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:56 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:56 DEBUG : subdir/file20.txt.geduziw9.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:56 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : subdirX/RCLONE_TEST.xewabig0.partial: renamed to: subdirX/RCLONE_TEST 2024/04/26 03:27:56 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1/file30.txt.qibajut4.partial: renamed to: subdirX/subdirX1/file30.txt 2024/04/26 03:27:56 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1/RCLONE_TEST.cepiduk2.partial: renamed to: subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:56 DEBUG : subdir-not/file20.txt.xacorab2.partial: renamed to: subdir-not/file20.txt 2024/04/26 03:27:56 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 INFO : subdir-not/file20.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:56 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:56 DEBUG : subdir/RCLONE_TEST.qequgun4.partial: renamed to: subdir/RCLONE_TEST 2024/04/26 03:27:56 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 DEBUG : subdir/subdirB/file30.txt.gocipon7.partial: renamed to: subdir/subdirB/file30.txt 2024/04/26 03:27:56 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2/file30.txt.gujanod2.partial: renamed to: subdir-not/subdir-not2/file30.txt 2024/04/26 03:27:56 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:56 DEBUG : subdir/subdirB/RCLONE_TEST.saqerip0.partial: renamed to: subdir/subdirB/RCLONE_TEST 2024/04/26 03:27:56 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.tolayuq8.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST 2024/04/26 03:27:56 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 DEBUG : Local file system at /tmp/032753ne/initdir/test_check_access_filters-ceguzuv5: Waiting for checks to finish 2024/04/26 03:27:56 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:56 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:56 DEBUG : subdir-not/RCLONE_TEST.vekixam9.partial: renamed to: subdir-not/RCLONE_TEST 2024/04/26 03:27:56 DEBUG : subdir/subdirA/file30.txt.kehunav6.partial: renamed to: subdir/subdirA/file30.txt 2024/04/26 03:27:56 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : Local file system at /tmp/032753ne/initdir/test_check_access_filters-ceguzuv5: Waiting for transfers to finish 2024/04/26 03:27:56 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:56 DEBUG : subdir/subdirA/RCLONE_TEST.caxizas6.partial: renamed to: subdir/subdirA/RCLONE_TEST 2024/04/26 03:27:56 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/04/26 03:27:56 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/04/26 03:27:56 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/04/26 03:27:56 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/04/26 03:27:56 INFO : subdirX: Set directory modification time (using SetModTime) 2024/04/26 03:27:56 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:56 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/04/26 03:27:56 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_check_access_filters-rigeper6" 2024/04/26 03:27:56 DEBUG : exclude-other-filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : include-other-filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : Local file system at /tmp/032753ne/datadir/test_check_access_filters-rigeper6: Waiting for checks to finish 2024/04/26 03:27:56 DEBUG : Local file system at /tmp/032753ne/datadir/test_check_access_filters-rigeper6: Waiting for transfers to finish 2024/04/26 03:27:56 DEBUG : include-other-filtersfile.txt: md5 = 2ec13b2813141ed088e5978ef5a47b0e OK 2024/04/26 03:27:56 DEBUG : exclude-other-filtersfile.txt: md5 = 5fcc6205d7df1c2e9ed3a15a1356b345 OK 2024/04/26 03:27:56 DEBUG : include-other-filtersfile.txt.totaceb4.partial: renamed to: include-other-filtersfile.txt 2024/04/26 03:27:56 INFO : include-other-filtersfile.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : exclude-other-filtersfile.txt.kegolin3.partial: renamed to: exclude-other-filtersfile.txt 2024/04/26 03:27:56 INFO : exclude-other-filtersfile.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1] 2024/04/26 03:27:56 ERROR : : error listing: directory not found 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2] 2024/04/26 03:27:56 ERROR : : error listing: directory not found 2024/04/26 03:27:56 checking initFs Local file system at /tmp/032753ne/initdir/test_check_access_filters-ceguzuv5 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1] 2024/04/26 03:27:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/file2.txt] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/RCLONE_TEST] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/file3.txt] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/file1.txt] 2024/04/26 03:27:56 DEBUG : subdir-not: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir-not] 2024/04/26 03:27:56 DEBUG : subdirX: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdirX] 2024/04/26 03:27:56 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdirX/subdirX1] 2024/04/26 03:27:56 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir-not/subdir-not2] 2024/04/26 03:27:56 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirA: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir/subdirA] 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirB: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir/subdirB] 2024/04/26 03:27:56 INFO : file2.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/file4.txt] 2024/04/26 03:27:56 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: Waiting for checks to finish 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: Waiting for transfers to finish 2024/04/26 03:27:56 INFO : file3.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdirX/RCLONE_TEST] 2024/04/26 03:27:56 INFO : file1.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdirX/file20.txt] 2024/04/26 03:27:56 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir-not/RCLONE_TEST] 2024/04/26 03:27:56 INFO : file4.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir-not/file20.txt] 2024/04/26 03:27:56 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir/RCLONE_TEST] 2024/04/26 03:27:56 INFO : subdirX/file20.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir/file20.txt] 2024/04/26 03:27:56 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST] 2024/04/26 03:27:56 INFO : subdir-not/file20.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdirX/subdirX1/file30.txt] 2024/04/26 03:27:56 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir-not/subdir-not2/RCLONE_TEST] 2024/04/26 03:27:56 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir-not/subdir-not2/file30.txt] 2024/04/26 03:27:56 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir/subdirB/RCLONE_TEST] 2024/04/26 03:27:56 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir/subdirB/file30.txt] 2024/04/26 03:27:56 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir/subdirA/RCLONE_TEST] 2024/04/26 03:27:56 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir/subdirA/file30.txt] 2024/04/26 03:27:56 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/04/26 03:27:56 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/04/26 03:27:56 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/04/26 03:27:56 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdirX] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir-not] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir/subdirB] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir/subdirA] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdirX/subdirX1] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir-not/subdir-not2] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2] 2024/04/26 03:27:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/RCLONE_TEST] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/file1.txt] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/file2.txt] 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/file3.txt] 2024/04/26 03:27:56 DEBUG : subdir-not: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir-not] 2024/04/26 03:27:56 DEBUG : subdirX: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdirX] 2024/04/26 03:27:56 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirA: Making directory 2024/04/26 03:27:56 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir/subdirA] 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdirX/subdirX1] 2024/04/26 03:27:56 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir-not/subdir-not2] 2024/04/26 03:27:56 INFO : file1.txt: Copied (new) 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/file4.txt] 2024/04/26 03:27:56 DEBUG : subdir/subdirB: Making directory 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir/subdirB] 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: Waiting for checks to finish 2024/04/26 03:27:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: Waiting for transfers to finish 2024/04/26 03:27:57 INFO : file2.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir/RCLONE_TEST] 2024/04/26 03:27:57 INFO : file3.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir/file20.txt] 2024/04/26 03:27:57 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdirX/RCLONE_TEST] 2024/04/26 03:27:57 INFO : file4.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdirX/file20.txt] 2024/04/26 03:27:57 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir-not/RCLONE_TEST] 2024/04/26 03:27:57 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir-not/file20.txt] 2024/04/26 03:27:57 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdirX/subdirX1/RCLONE_TEST] 2024/04/26 03:27:57 INFO : subdirX/file20.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdirX/subdirX1/file30.txt] 2024/04/26 03:27:57 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST] 2024/04/26 03:27:57 INFO : subdir-not/file20.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir-not/subdir-not2/file30.txt] 2024/04/26 03:27:57 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir/subdirA/RCLONE_TEST] 2024/04/26 03:27:57 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir/subdirA/file30.txt] 2024/04/26 03:27:57 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir/subdirB/RCLONE_TEST] 2024/04/26 03:27:57 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir/subdirB/file30.txt] 2024/04/26 03:27:57 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/04/26 03:27:57 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/04/26 03:27:57 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2] 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdirX] 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir] 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir-not] 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdirX/subdirX1] 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir/subdirB] 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir/subdirA] 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir-not/subdir-not2] 2024/04/26 03:27:57 (01) : test check-access-filters 2024/04/26 03:27:57 (02) : test EXCLUDE - OTHER TESTS 2024/04/26 03:27:57 (03) : copy-file /tmp/032753ne/datadir/test_check_access_filters-rigeper6/exclude-other-filtersfile.txt /tmp/032753ne/workdir/ 2024/04/26 03:27:57 INFO : exclude-other-filtersfile.txt: Copied (new) 2024/04/26 03:27:57 (04) : test resync to get the filters file md5 built. 2024/04/26 03:27:57 (05) : bisync resync filters-file=/tmp/032753ne/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Using filters file /tmp/032753ne/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Storing filters file hash to /tmp/032753ne/workdir/exclude-other-filtersfile.txt.md5 2024/04/26 03:27:57 INFO : Copying Path2 files to Path1 2024/04/26 03:27:57 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:57 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:57 INFO : Resync updating listings 2024/04/26 03:27:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Bisync successful 2024/04/26 03:27:57 (06) : test EXCLUDE - test filters for check access 2024/04/26 03:27:57 (07) : bisync check-access filters-file=/tmp/032753ne/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Using filters file /tmp/032753ne/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:57 INFO : Path1 checking for diffs 2024/04/26 03:27:57 INFO : Path2 checking for diffs 2024/04/26 03:27:57 INFO : Checking access health 2024/04/26 03:27:57 INFO : Found 3 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:57 INFO : No changes found 2024/04/26 03:27:57 INFO : Updating listings 2024/04/26 03:27:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Bisync successful 2024/04/26 03:27:57 (08) : copy-listings exclude-initial 2024/04/26 03:27:57 (09) : test EXCLUDE - delete RCLONE_TEST files in excluded directories 2024/04/26 03:27:57 (10) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir/subdirA/RCLONE_TEST 2024/04/26 03:27:57 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:57 (11) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir-not/RCLONE_TEST 2024/04/26 03:27:57 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:57 (12) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST 2024/04/26 03:27:57 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:57 (13) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdirX/RCLONE_TEST 2024/04/26 03:27:57 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:57 (14) : test EXCLUDE - test should PASS 2024/04/26 03:27:57 (15) : bisync check-access filters-file=/tmp/032753ne/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Using filters file /tmp/032753ne/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:57 INFO : Path1 checking for diffs 2024/04/26 03:27:57 INFO : Path2 checking for diffs 2024/04/26 03:27:57 INFO : Checking access health 2024/04/26 03:27:57 INFO : Found 3 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:57 INFO : No changes found 2024/04/26 03:27:57 INFO : Updating listings 2024/04/26 03:27:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Bisync successful 2024/04/26 03:27:57 (16) : copy-listings exclude-pass-run 2024/04/26 03:27:57 (17) : test EXCLUDE - delete RCLONE_TEST files in included directories 2024/04/26 03:27:57 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/RCLONE_TEST 2024/04/26 03:27:57 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:57 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir/RCLONE_TEST 2024/04/26 03:27:57 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:57 (20) : test EXCLUDE - test should ABORT 2024/04/26 03:27:57 (21) : bisync check-access filters-file=/tmp/032753ne/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Using filters file /tmp/032753ne/workdir/exclude-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:57 INFO : Path1 checking for diffs 2024/04/26 03:27:57 INFO : - Path1 File was deleted - subdir/RCLONE_TEST 2024/04/26 03:27:57 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:57 INFO : Path2 checking for diffs 2024/04/26 03:27:57 INFO : - Path2 File was deleted - RCLONE_TEST 2024/04/26 03:27:57 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:57 INFO : Checking access health 2024/04/26 03:27:57 ERROR : -  Access test failed: Path1 file not found in Path2 - RCLONE_TEST 2024/04/26 03:27:57 ERROR : -  Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST 2024/04/26 03:27:57 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:57 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:57 Bisync error: bisync aborted 2024/04/26 03:27:57 (22) : move-listings exclude-error-run 2024/04/26 03:27:57 (23) : test INCLUDE - OTHER TESTS 2024/04/26 03:27:57 (24) : test reset to the initial state 2024/04/26 03:27:57 (25) : copy-dir /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/initial TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/ 2024/04/26 03:27:57 INFO : subdir/RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 (26) : sync-dir TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/ TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/ 2024/04/26 03:27:57 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/04/26 03:27:57 (27) : copy-file /tmp/032753ne/datadir/test_check_access_filters-rigeper6/include-other-filtersfile.txt /tmp/032753ne/workdir/ 2024/04/26 03:27:57 INFO : include-other-filtersfile.txt: Copied (new) 2024/04/26 03:27:57 (28) : bisync resync filters-file=/tmp/032753ne/workdir/include-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Using filters file /tmp/032753ne/workdir/include-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Storing filters file hash to /tmp/032753ne/workdir/include-other-filtersfile.txt.md5 2024/04/26 03:27:57 INFO : Copying Path2 files to Path1 2024/04/26 03:27:57 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:57 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:57 INFO : Resync updating listings 2024/04/26 03:27:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Bisync successful 2024/04/26 03:27:57 (29) : test INCLUDE - test include/exclude filters for check access 2024/04/26 03:27:57 (30) : bisync check-access filters-file=/tmp/032753ne/workdir/include-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Using filters file /tmp/032753ne/workdir/include-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:57 INFO : Path1 checking for diffs 2024/04/26 03:27:57 INFO : Path2 checking for diffs 2024/04/26 03:27:57 INFO : Checking access health 2024/04/26 03:27:57 INFO : Found 5 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:57 INFO : No changes found 2024/04/26 03:27:57 INFO : Updating listings 2024/04/26 03:27:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Bisync successful 2024/04/26 03:27:57 (31) : copy-listings include-initial 2024/04/26 03:27:57 (32) : test INCLUDE - delete RCLONE_TEST files in excluded directories 2024/04/26 03:27:57 (33) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir/subdirA/RCLONE_TEST 2024/04/26 03:27:57 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:57 (34) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir-not/RCLONE_TEST 2024/04/26 03:27:57 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:57 (35) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST 2024/04/26 03:27:57 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:57 (36) : test INCLUDE - test should PASS 2024/04/26 03:27:57 (37) : bisync check-access filters-file=/tmp/032753ne/workdir/include-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Using filters file /tmp/032753ne/workdir/include-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:57 INFO : Path1 checking for diffs 2024/04/26 03:27:57 INFO : Path2 checking for diffs 2024/04/26 03:27:57 INFO : Checking access health 2024/04/26 03:27:57 INFO : Found 5 matching "RCLONE_TEST" files on both paths 2024/04/26 03:27:57 INFO : No changes found 2024/04/26 03:27:57 INFO : Updating listings 2024/04/26 03:27:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Bisync successful 2024/04/26 03:27:57 (38) : copy-listings include-pass-run 2024/04/26 03:27:57 (39) : test INCLUDE - delete RCLONE_TEST files in included directories 2024/04/26 03:27:57 (40) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/RCLONE_TEST 2024/04/26 03:27:57 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:57 (41) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdir/RCLONE_TEST 2024/04/26 03:27:57 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:57 (42) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:57 INFO : RCLONE_TEST: Deleted 2024/04/26 03:27:57 (43) : test INCLUDE - test should ABORT 2024/04/26 03:27:57 (44) : bisync check-access filters-file=/tmp/032753ne/workdir/include-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_access_filters/path2/" 2024/04/26 03:27:57 INFO : Using filters file /tmp/032753ne/workdir/include-other-filtersfile.txt 2024/04/26 03:27:57 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:57 INFO : Path1 checking for diffs 2024/04/26 03:27:57 INFO : - Path1 File was deleted - subdir/RCLONE_TEST 2024/04/26 03:27:57 INFO : - Path1 File was deleted - subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:57 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2024/04/26 03:27:57 INFO : Path2 checking for diffs 2024/04/26 03:27:57 INFO : - Path2 File was deleted - RCLONE_TEST 2024/04/26 03:27:57 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:57 INFO : Checking access health 2024/04/26 03:27:57 ERROR : Access test failed: Path1 count 3, Path2 count 4 - RCLONE_TEST 2024/04/26 03:27:57 ERROR : -  Access test failed: Path1 file not found in Path2 - RCLONE_TEST 2024/04/26 03:27:57 ERROR : -  Access test failed: Path2 file not found in Path1 - subdirX/subdirX1/RCLONE_TEST 2024/04/26 03:27:57 ERROR : -  Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST 2024/04/26 03:27:57 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:57 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:57 Bisync error: bisync aborted 2024/04/26 03:27:57 (45) : move-listings include-error-run bisync_test.go:553: TEST check_access_filters PASSED === RUN TestBisyncRemoteRemote/check_filename 2024/04/26 03:27:57 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:57 DEBUG : path1: Making directory 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:27:57 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1" 2024/04/26 03:27:57 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:57 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:57 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1" 2024/04/26 03:27:57 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:57 DEBUG : path2: Making directory 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:27:57 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2" 2024/04/26 03:27:57 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:57 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:57 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2" 2024/04/26 03:27:57 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_check_filename-matawon4" 2024/04/26 03:27:57 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : subdir: Making directory with metadata 2024/04/26 03:27:57 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:27:57 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:27:57 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : Local file system at /tmp/032753ne/initdir/test_check_filename-matawon4: Waiting for checks to finish 2024/04/26 03:27:57 DEBUG : Local file system at /tmp/032753ne/initdir/test_check_filename-matawon4: Waiting for transfers to finish 2024/04/26 03:27:57 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:57 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:57 DEBUG : file2.txt.cukuxah9.partial: renamed to: file2.txt 2024/04/26 03:27:57 INFO : file2.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : file3.txt.woquyoh7.partial: renamed to: file3.txt 2024/04/26 03:27:57 INFO : file3.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:57 DEBUG : file1.txt.puwunod4.partial: renamed to: file1.txt 2024/04/26 03:27:57 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:57 INFO : file1.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : .chk_file.lusogoh5.partial: renamed to: .chk_file 2024/04/26 03:27:57 INFO : .chk_file: Copied (new) 2024/04/26 03:27:57 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:57 DEBUG : file4.txt.sohuyem2.partial: renamed to: file4.txt 2024/04/26 03:27:57 INFO : file4.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:57 DEBUG : subdir/file20.txt.heheken8.partial: renamed to: subdir/file20.txt 2024/04/26 03:27:57 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:57 DEBUG : subdir/.chk_file.wogumam1.partial: renamed to: subdir/.chk_file 2024/04/26 03:27:57 INFO : subdir/.chk_file: Copied (new) 2024/04/26 03:27:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:27:57 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_check_filename-bohezir1" 2024/04/26 03:27:57 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : Local file system at /tmp/032753ne/datadir/test_check_filename-bohezir1: Waiting for checks to finish 2024/04/26 03:27:57 DEBUG : Local file system at /tmp/032753ne/datadir/test_check_filename-bohezir1: Waiting for transfers to finish 2024/04/26 03:27:57 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:27:57 DEBUG : hold.txt.dujibov0.partial: renamed to: hold.txt 2024/04/26 03:27:57 INFO : hold.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1] 2024/04/26 03:27:57 ERROR : : error listing: directory not found 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2] 2024/04/26 03:27:57 ERROR : : error listing: directory not found 2024/04/26 03:27:57 checking initFs Local file system at /tmp/032753ne/initdir/test_check_filename-matawon4 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1] 2024/04/26 03:27:57 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : subdir: Making directory 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/subdir] 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/.chk_file] 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/file1.txt] 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/file2.txt] 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/file3.txt] 2024/04/26 03:27:57 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: Waiting for checks to finish 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: Waiting for transfers to finish 2024/04/26 03:27:57 INFO : file1.txt: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/file4.txt] 2024/04/26 03:27:57 INFO : .chk_file: Copied (new) 2024/04/26 03:27:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/subdir/.chk_file] 2024/04/26 03:27:58 INFO : file2.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/subdir/file20.txt] 2024/04/26 03:27:58 INFO : file3.txt: Copied (new) 2024/04/26 03:27:58 INFO : file4.txt: Copied (new) 2024/04/26 03:27:58 INFO : subdir/.chk_file: Copied (new) 2024/04/26 03:27:58 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:58 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/subdir] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2] 2024/04/26 03:27:58 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : subdir: Making directory 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/subdir] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/.chk_file] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/file2.txt] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/file3.txt] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/file1.txt] 2024/04/26 03:27:58 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: Waiting for checks to finish 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: Waiting for transfers to finish 2024/04/26 03:27:58 INFO : file2.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/file4.txt] 2024/04/26 03:27:58 INFO : .chk_file: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/subdir/.chk_file] 2024/04/26 03:27:58 INFO : file3.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/subdir/file20.txt] 2024/04/26 03:27:58 INFO : file1.txt: Copied (new) 2024/04/26 03:27:58 INFO : file4.txt: Copied (new) 2024/04/26 03:27:58 INFO : subdir/.chk_file: Copied (new) 2024/04/26 03:27:58 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:27:58 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/subdir] 2024/04/26 03:27:58 (01) : test check-filename 2024/04/26 03:27:58 (02) : test initial bisync 2024/04/26 03:27:58 (03) : bisync resync 2024/04/26 03:27:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/" 2024/04/26 03:27:58 INFO : Copying Path2 files to Path1 2024/04/26 03:27:58 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:58 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:58 INFO : Resync updating listings 2024/04/26 03:27:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/" 2024/04/26 03:27:58 INFO : Bisync successful 2024/04/26 03:27:58 (04) : test 1. see that check-access passes with the initial setup 2024/04/26 03:27:58 (05) : bisync check-access check-filename=.chk_file 2024/04/26 03:27:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/" 2024/04/26 03:27:58 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:58 INFO : Path1 checking for diffs 2024/04/26 03:27:58 INFO : Path2 checking for diffs 2024/04/26 03:27:58 INFO : Checking access health 2024/04/26 03:27:58 INFO : Found 2 matching ".chk_file" files on both paths 2024/04/26 03:27:58 INFO : No changes found 2024/04/26 03:27:58 INFO : Updating listings 2024/04/26 03:27:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/" 2024/04/26 03:27:58 INFO : Bisync successful 2024/04/26 03:27:58 (06) : copy-listings initial-pass 2024/04/26 03:27:58 (07) : test 2. delete the remote subdir .chk_file, run sync. should fail critical. 2024/04/26 03:27:58 (08) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/subdir/.chk_file 2024/04/26 03:27:58 INFO : .chk_file: Deleted 2024/04/26 03:27:58 (09) : bisync check-access check-filename=.chk_file 2024/04/26 03:27:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/" 2024/04/26 03:27:58 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:58 INFO : Path1 checking for diffs 2024/04/26 03:27:58 INFO : Path2 checking for diffs 2024/04/26 03:27:58 INFO : - Path2 File was deleted - subdir/.chk_file 2024/04/26 03:27:58 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:27:58 INFO : Checking access health 2024/04/26 03:27:58 ERROR : Access test failed: Path1 count 2, Path2 count 1 - .chk_file 2024/04/26 03:27:58 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/.chk_file 2024/04/26 03:27:58 ERROR : Bisync critical error: check file check failed 2024/04/26 03:27:58 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:58 Bisync error: bisync aborted 2024/04/26 03:27:58 (10) : move-listings path2-missing 2024/04/26 03:27:58 (11) : test 3. put the remote subdir .chk_file back, run resync. 2024/04/26 03:27:58 (12) : copy-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/subdir/.chk_file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/subdir/ 2024/04/26 03:27:58 INFO : .chk_file: Copied (new) 2024/04/26 03:27:58 (13) : bisync check-access resync check-filename=.chk_file 2024/04/26 03:27:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/" 2024/04/26 03:27:58 INFO : Copying Path2 files to Path1 2024/04/26 03:27:58 INFO : Checking access health 2024/04/26 03:27:58 INFO : Found 2 matching ".chk_file" files on both paths 2024/04/26 03:27:58 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:58 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:58 INFO : Resync updating listings 2024/04/26 03:27:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/" 2024/04/26 03:27:58 INFO : Bisync successful 2024/04/26 03:27:58 (14) : test 4. run sync with check-access. should pass. 2024/04/26 03:27:58 (15) : bisync check-access check-filename=.chk_file 2024/04/26 03:27:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/" 2024/04/26 03:27:58 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:58 INFO : Path1 checking for diffs 2024/04/26 03:27:58 INFO : Path2 checking for diffs 2024/04/26 03:27:58 INFO : Checking access health 2024/04/26 03:27:58 INFO : Found 2 matching ".chk_file" files on both paths 2024/04/26 03:27:58 INFO : No changes found 2024/04/26 03:27:58 INFO : Updating listings 2024/04/26 03:27:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_filename/path2/" 2024/04/26 03:27:58 INFO : Bisync successful bisync_test.go:553: TEST check_filename PASSED === RUN TestBisyncRemoteRemote/check_sync 2024/04/26 03:27:58 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:58 DEBUG : path1: Making directory 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:27:58 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1" 2024/04/26 03:27:58 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:58 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:58 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1" 2024/04/26 03:27:58 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:58 DEBUG : path2: Making directory 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:27:58 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2" 2024/04/26 03:27:58 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:58 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:58 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2" 2024/04/26 03:27:58 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_check_sync-febufuv6" 2024/04/26 03:27:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : Local file system at /tmp/032753ne/initdir/test_check_sync-febufuv6: Waiting for checks to finish 2024/04/26 03:27:58 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:58 DEBUG : Local file system at /tmp/032753ne/initdir/test_check_sync-febufuv6: Waiting for transfers to finish 2024/04/26 03:27:58 DEBUG : file1.txt.towoqoj8.partial: renamed to: file1.txt 2024/04/26 03:27:58 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:58 INFO : file1.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : file2.txt.bufotev7.partial: renamed to: file2.txt 2024/04/26 03:27:58 INFO : file2.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:58 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:58 DEBUG : file3.txt.licewih9.partial: renamed to: file3.txt 2024/04/26 03:27:58 INFO : file3.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : RCLONE_TEST.naviram3.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:58 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:58 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:58 DEBUG : file4.txt.tiyaraw9.partial: renamed to: file4.txt 2024/04/26 03:27:58 INFO : file4.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:58 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:58 DEBUG : file7.txt.bahaxub9.partial: renamed to: file7.txt 2024/04/26 03:27:58 INFO : file7.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:58 DEBUG : file5.txt.hulugad4.partial: renamed to: file5.txt 2024/04/26 03:27:58 INFO : file5.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : file8.txt.vajeviw1.partial: renamed to: file8.txt 2024/04/26 03:27:58 INFO : file8.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:58 DEBUG : file6.txt.sihekit4.partial: renamed to: file6.txt 2024/04/26 03:27:58 INFO : file6.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_check_sync-yugoxaq1" 2024/04/26 03:27:58 DEBUG : _testdir_path1.._testdir_path2.path1.lst: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : _testdir_path1.._testdir_path2.path2.lst: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : Local file system at /tmp/032753ne/datadir/test_check_sync-yugoxaq1: Waiting for checks to finish 2024/04/26 03:27:58 DEBUG : Local file system at /tmp/032753ne/datadir/test_check_sync-yugoxaq1: Waiting for transfers to finish 2024/04/26 03:27:58 DEBUG : _testdir_path1.._testdir_path2.path2.lst: md5 = d6ce44a26af9c2110b1750fe88dc4b69 OK 2024/04/26 03:27:58 DEBUG : _testdir_path1.._testdir_path2.path1.lst: md5 = fdb18e0dff6961813e12c57227d2e854 OK 2024/04/26 03:27:58 DEBUG : _testdir_path1.._testdir_path2.path2.lst.xanupop8.partial: renamed to: _testdir_path1.._testdir_path2.path2.lst 2024/04/26 03:27:58 INFO : _testdir_path1.._testdir_path2.path2.lst: Copied (new) 2024/04/26 03:27:58 DEBUG : _testdir_path1.._testdir_path2.path1.lst.guxayox0.partial: renamed to: _testdir_path1.._testdir_path2.path1.lst 2024/04/26 03:27:58 INFO : _testdir_path1.._testdir_path2.path1.lst: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1] 2024/04/26 03:27:58 ERROR : : error listing: directory not found 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2] 2024/04/26 03:27:58 ERROR : : error listing: directory not found 2024/04/26 03:27:58 checking initFs Local file system at /tmp/032753ne/initdir/test_check_sync-febufuv6 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1] 2024/04/26 03:27:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/RCLONE_TEST] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: Waiting for checks to finish 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: Waiting for transfers to finish 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/file3.txt] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/file1.txt] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/file2.txt] 2024/04/26 03:27:58 INFO : file3.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/file4.txt] 2024/04/26 03:27:58 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/file5.txt] 2024/04/26 03:27:58 INFO : file1.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/file6.txt] 2024/04/26 03:27:58 INFO : file2.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/file7.txt] 2024/04/26 03:27:58 INFO : file4.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/file8.txt] 2024/04/26 03:27:58 INFO : file5.txt: Copied (new) 2024/04/26 03:27:58 INFO : file6.txt: Copied (new) 2024/04/26 03:27:58 INFO : file7.txt: Copied (new) 2024/04/26 03:27:58 INFO : file8.txt: Copied (new) 2024/04/26 03:27:58 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2] 2024/04/26 03:27:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/RCLONE_TEST] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/file2.txt] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: Waiting for checks to finish 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/file1.txt] 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: Waiting for transfers to finish 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/file3.txt] 2024/04/26 03:27:58 INFO : file2.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/file4.txt] 2024/04/26 03:27:58 INFO : file1.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/file5.txt] 2024/04/26 03:27:58 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/file6.txt] 2024/04/26 03:27:58 INFO : file3.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/file7.txt] 2024/04/26 03:27:58 INFO : file4.txt: Copied (new) 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/file8.txt] 2024/04/26 03:27:58 INFO : file5.txt: Copied (new) 2024/04/26 03:27:58 INFO : file6.txt: Copied (new) 2024/04/26 03:27:58 INFO : file7.txt: Copied (new) 2024/04/26 03:27:58 INFO : file8.txt: Copied (new) 2024/04/26 03:27:58 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2 2024/04/26 03:27:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2] 2024/04/26 03:27:58 (01) : test check-sync 2024/04/26 03:27:58 (02) : test initial bisync 2024/04/26 03:27:58 (03) : bisync resync 2024/04/26 03:27:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/" 2024/04/26 03:27:58 INFO : Copying Path2 files to Path1 2024/04/26 03:27:58 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:58 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:58 INFO : Resync updating listings 2024/04/26 03:27:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/" 2024/04/26 03:27:58 INFO : Bisync successful 2024/04/26 03:27:58 (04) : test 1. run check-sync-only on a clean sync 2024/04/26 03:27:58 (05) : bisync check-sync-only 2024/04/26 03:27:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/" 2024/04/26 03:27:58 INFO : Bisync successful 2024/04/26 03:27:58 (06) : test 2. inject modified listings into the workdir 2024/04/26 03:27:58 (07) : copy-as /tmp/032753ne/datadir/test_check_sync-yugoxaq1/_testdir_path1.._testdir_path2.path1.lst /tmp/032753ne/workdir/ TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path2.path1.lst 2024/04/26 03:27:58 INFO : _testdir_path1.._testdir_path2.path1.lst: Copied (replaced existing) to: TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path2.path1.lst 2024/04/26 03:27:58 (08) : copy-as /tmp/032753ne/datadir/test_check_sync-yugoxaq1/_testdir_path1.._testdir_path2.path2.lst /tmp/032753ne/workdir/ TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path2.path2.lst 2024/04/26 03:27:58 INFO : _testdir_path1.._testdir_path2.path2.lst: Copied (replaced existing) to: TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path2.path2.lst 2024/04/26 03:27:58 (09) : test 3. run check-sync-only on modified listings 2024/04/26 03:27:58 (10) : bisync check-sync-only 2024/04/26 03:27:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/" 2024/04/26 03:27:58 ERROR : -  Path1 file not found in Path2 - file2.txt 2024/04/26 03:27:58 ERROR : -  Path2 file not found in Path1 - file1.txt 2024/04/26 03:27:58 ERROR : Bisync critical error: path1 and path2 are out of sync, run --resync to recover 2024/04/26 03:27:58 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:58 Bisync error: bisync aborted 2024/04/26 03:27:58 (11) : copy-listings check-sync-only 2024/04/26 03:27:58 (12) : test 4. run normal sync to check that it aborts 2024/04/26 03:27:58 (13) : bisync 2024/04/26 03:27:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/" 2024/04/26 03:27:58 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/032753ne/workdir/TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path2.path1.lst Path2: /tmp/032753ne/workdir/TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/032753ne/workdir" 2024/04/26 03:27:58 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:27:58 Bisync error: bisync aborted 2024/04/26 03:27:58 (14) : test 5. prune failure listings after critical abort 2024/04/26 03:27:58 (15) : delete-glob /tmp/032753ne/workdir/ *.lst 2024/04/26 03:27:58 (16) : delete-glob /tmp/032753ne/workdir/ *.lst-err 2024/04/26 03:27:58 INFO : TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path2.path1.lst-err: Deleted 2024/04/26 03:27:58 INFO : TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path2.path2.lst-err: Deleted 2024/04/26 03:27:58 (17) : delete-glob /tmp/032753ne/workdir/ *.lst-new 2024/04/26 03:27:58 INFO : TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path2.path1.lst-new: Deleted 2024/04/26 03:27:58 INFO : TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_check_sync_path2.path2.lst-new: Deleted 2024/04/26 03:27:58 (18) : test 6. run resync 2024/04/26 03:27:58 (19) : bisync resync 2024/04/26 03:27:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/" 2024/04/26 03:27:58 INFO : Copying Path2 files to Path1 2024/04/26 03:27:58 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:58 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:58 INFO : Resync updating listings 2024/04/26 03:27:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/" 2024/04/26 03:27:58 INFO : Bisync successful 2024/04/26 03:27:58 (20) : test 7. run normal sync with check-sync enabled (default) 2024/04/26 03:27:58 (21) : bisync 2024/04/26 03:27:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/" 2024/04/26 03:27:58 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:58 INFO : Path1 checking for diffs 2024/04/26 03:27:58 INFO : Path2 checking for diffs 2024/04/26 03:27:58 INFO : No changes found 2024/04/26 03:27:58 INFO : Updating listings 2024/04/26 03:27:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/" 2024/04/26 03:27:58 INFO : Bisync successful 2024/04/26 03:27:58 (22) : test 8. run normal sync with no-check-sync 2024/04/26 03:27:58 (23) : bisync no-check-sync 2024/04/26 03:27:59 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:27:59 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:27:59 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/check_sync/path2/" 2024/04/26 03:27:59 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:59 INFO : Path1 checking for diffs 2024/04/26 03:27:59 INFO : Path2 checking for diffs 2024/04/26 03:27:59 INFO : No changes found 2024/04/26 03:27:59 INFO : Updating listings 2024/04/26 03:27:59 INFO : Bisync successful bisync_test.go:553: TEST check_sync PASSED === RUN TestBisyncRemoteRemote/compare_all 2024/04/26 03:27:59 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:59 DEBUG : path1: Making directory 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:27:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1" 2024/04/26 03:27:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:59 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1" 2024/04/26 03:27:59 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:59 DEBUG : path2: Making directory 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:27:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2" 2024/04/26 03:27:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:59 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2" 2024/04/26 03:27:59 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_compare_all-niwoqur5" 2024/04/26 03:27:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : file1.txt.nodohiw7.partial: renamed to: file1.txt 2024/04/26 03:27:59 INFO : file1.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : Local file system at /tmp/032753ne/initdir/test_compare_all-niwoqur5: Waiting for checks to finish 2024/04/26 03:27:59 DEBUG : Local file system at /tmp/032753ne/initdir/test_compare_all-niwoqur5: Waiting for transfers to finish 2024/04/26 03:27:59 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : file2.txt.taweran6.partial: renamed to: file2.txt 2024/04/26 03:27:59 INFO : file2.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file3.txt.xabazur4.partial: renamed to: file3.txt 2024/04/26 03:27:59 INFO : file3.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : file4.txt.yecesaj7.partial: renamed to: file4.txt 2024/04/26 03:27:59 INFO : file4.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file5.txt.busuyak0.partial: renamed to: file5.txt 2024/04/26 03:27:59 INFO : file5.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : file6.txt.lipulid2.partial: renamed to: file6.txt 2024/04/26 03:27:59 INFO : file6.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:59 DEBUG : RCLONE_TEST.jujiqud7.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:59 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:59 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : file8.txt.gasuqem3.partial: renamed to: file8.txt 2024/04/26 03:27:59 INFO : file8.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : file7.txt.lugafak6.partial: renamed to: file7.txt 2024/04/26 03:27:59 INFO : file7.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_compare_all-nomozar8" 2024/04/26 03:27:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : Local file system at /tmp/032753ne/datadir/test_compare_all-nomozar8: Waiting for checks to finish 2024/04/26 03:27:59 DEBUG : Local file system at /tmp/032753ne/datadir/test_compare_all-nomozar8: Waiting for transfers to finish 2024/04/26 03:27:59 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:27:59 DEBUG : file2.txt.qazuseq1.partial: renamed to: file2.txt 2024/04/26 03:27:59 INFO : file2.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:59 DEBUG : file1.txt.yodoset8.partial: renamed to: file1.txt 2024/04/26 03:27:59 INFO : file1.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:59 DEBUG : file11.txt.pozukal3.partial: renamed to: file11.txt 2024/04/26 03:27:59 INFO : file11.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:59 DEBUG : file10.txt.pivilom9.partial: renamed to: file10.txt 2024/04/26 03:27:59 INFO : file10.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:27:59 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:27:59 DEBUG : file5L.txt.qeguduv1.partial: renamed to: file5L.txt 2024/04/26 03:27:59 INFO : file5L.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file5R.txt.favokeg5.partial: renamed to: file5R.txt 2024/04/26 03:27:59 INFO : file5R.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:59 DEBUG : file6.txt.jafidaj3.partial: renamed to: file6.txt 2024/04/26 03:27:59 INFO : file6.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:27:59 DEBUG : file7.txt.jalucab3.partial: renamed to: file7.txt 2024/04/26 03:27:59 INFO : file7.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1] 2024/04/26 03:27:59 ERROR : : error listing: directory not found 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2] 2024/04/26 03:27:59 ERROR : : error listing: directory not found 2024/04/26 03:27:59 checking initFs Local file system at /tmp/032753ne/initdir/test_compare_all-niwoqur5 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1] 2024/04/26 03:27:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/RCLONE_TEST] 2024/04/26 03:27:59 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: Waiting for checks to finish 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file1.txt] 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: Waiting for transfers to finish 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file2.txt] 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file3.txt] 2024/04/26 03:27:59 INFO : file1.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file4.txt] 2024/04/26 03:27:59 INFO : file2.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file5.txt] 2024/04/26 03:27:59 INFO : file3.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file6.txt] 2024/04/26 03:27:59 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file7.txt] 2024/04/26 03:27:59 INFO : file4.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file8.txt] 2024/04/26 03:27:59 INFO : file5.txt: Copied (new) 2024/04/26 03:27:59 INFO : file6.txt: Copied (new) 2024/04/26 03:27:59 INFO : file7.txt: Copied (new) 2024/04/26 03:27:59 INFO : file8.txt: Copied (new) 2024/04/26 03:27:59 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1] 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2] 2024/04/26 03:27:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file1.txt] 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/RCLONE_TEST] 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file2.txt] 2024/04/26 03:27:59 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: Waiting for checks to finish 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: Waiting for transfers to finish 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file3.txt] 2024/04/26 03:27:59 INFO : file2.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file4.txt] 2024/04/26 03:27:59 INFO : file1.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file5.txt] 2024/04/26 03:27:59 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file6.txt] 2024/04/26 03:27:59 INFO : file3.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file7.txt] 2024/04/26 03:27:59 INFO : file4.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file8.txt] 2024/04/26 03:27:59 INFO : file5.txt: Copied (new) 2024/04/26 03:27:59 INFO : file6.txt: Copied (new) 2024/04/26 03:27:59 INFO : file7.txt: Copied (new) 2024/04/26 03:27:59 INFO : file8.txt: Copied (new) 2024/04/26 03:27:59 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2] 2024/04/26 03:27:59 (01) : test changes compare-all 2024/04/26 03:27:59 (02) : test initial bisync 2024/04/26 03:27:59 (03) : bisync resync compare-all 2024/04/26 03:27:59 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/04/26 03:27:59 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/" 2024/04/26 03:27:59 INFO : Copying Path2 files to Path1 2024/04/26 03:27:59 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:27:59 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:59 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:27:59 INFO : Resync updating listings 2024/04/26 03:27:59 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/" 2024/04/26 03:27:59 INFO : Bisync successful 2024/04/26 03:27:59 (04) : test make modifications on both paths 2024/04/26 03:27:59 (05) : test new on path2 - file10 2024/04/26 03:27:59 (06) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_compare_all-nomozar8/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/ 2024/04/26 03:27:59 INFO : file10.txt: Copied (new) 2024/04/26 03:27:59 (07) : test newer on path2 - file1 2024/04/26 03:27:59 (08) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_compare_all-nomozar8/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/ 2024/04/26 03:27:59 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:59 (09) : test new on path1 - file11 2024/04/26 03:27:59 (10) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_compare_all-nomozar8/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/ 2024/04/26 03:27:59 INFO : file11.txt: Copied (new) 2024/04/26 03:27:59 (11) : test newer on path1 - file2 2024/04/26 03:27:59 (12) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_compare_all-nomozar8/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/ 2024/04/26 03:27:59 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:59 (13) : test deleted on path2 - file3 2024/04/26 03:27:59 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file3.txt 2024/04/26 03:27:59 INFO : file3.txt: Deleted 2024/04/26 03:27:59 (15) : test deleted on path1 - file4 2024/04/26 03:27:59 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file4.txt 2024/04/26 03:27:59 INFO : file4.txt: Deleted 2024/04/26 03:27:59 (17) : test deleted on both paths - file8 2024/04/26 03:27:59 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file8.txt 2024/04/26 03:27:59 INFO : file8.txt: Deleted 2024/04/26 03:27:59 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file8.txt 2024/04/26 03:27:59 INFO : file8.txt: Deleted 2024/04/26 03:27:59 (20) : test changed on both paths - file5 (file5R, file5L) 2024/04/26 03:27:59 (21) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_compare_all-nomozar8/ file5R.txt 2024/04/26 03:27:59 (22) : copy-as /tmp/032753ne/datadir/test_compare_all-nomozar8/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/ file5.txt 2024/04/26 03:27:59 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:59 (23) : touch-glob 2001-03-04 /tmp/032753ne/datadir/test_compare_all-nomozar8/ file5L.txt 2024/04/26 03:27:59 (24) : copy-as /tmp/032753ne/datadir/test_compare_all-nomozar8/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/ file5.txt 2024/04/26 03:27:59 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:27:59 (25) : test newer on path2 and deleted on path1 - file6 2024/04/26 03:27:59 (26) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_compare_all-nomozar8/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/ 2024/04/26 03:27:59 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:27:59 (27) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file6.txt 2024/04/26 03:27:59 INFO : file6.txt: Deleted 2024/04/26 03:27:59 (28) : test newer on path1 and deleted on path2 - file7 2024/04/26 03:27:59 (29) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_compare_all-nomozar8/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/ 2024/04/26 03:27:59 INFO : file7.txt: Copied (replaced existing) 2024/04/26 03:27:59 (30) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file7.txt 2024/04/26 03:27:59 INFO : file7.txt: Deleted 2024/04/26 03:27:59 (31) : test bisync run 2024/04/26 03:27:59 (32) : bisync compare-all 2024/04/26 03:27:59 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/04/26 03:27:59 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/" 2024/04/26 03:27:59 INFO : Building Path1 and Path2 listings 2024/04/26 03:27:59 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:27:59 INFO : Path1 checking for diffs 2024/04/26 03:27:59 INFO : - Path1 File changed: size (larger), time (newer), hash - file2.txt 2024/04/26 03:27:59 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:27:59 INFO : - Path1 File changed: size (larger), time (newer), hash - file5.txt 2024/04/26 03:27:59 INFO : - Path1 File was deleted - file6.txt 2024/04/26 03:27:59 INFO : - Path1 File changed: size (larger), time (newer), hash - file7.txt 2024/04/26 03:27:59 INFO : - Path1 File was deleted - file8.txt 2024/04/26 03:27:59 INFO : - Path1 File is new - file11.txt 2024/04/26 03:27:59 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:59 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2024/04/26 03:27:59 INFO : Path2 checking for diffs 2024/04/26 03:27:59 INFO : - Path2 File changed: size (larger), time (newer), hash - file1.txt 2024/04/26 03:27:59 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:27:59 INFO : - Path2 File changed: size (larger), time (newer), hash - file5.txt 2024/04/26 03:27:59 INFO : - Path2 File changed: size (larger), time (newer), hash - file6.txt 2024/04/26 03:27:59 INFO : - Path2 File was deleted - file7.txt 2024/04/26 03:27:59 INFO : - Path2 File was deleted - file8.txt 2024/04/26 03:27:59 INFO : - Path2 File is new - file10.txt 2024/04/26 03:27:59 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:27:59 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2024/04/26 03:27:59 INFO : Applying changes 2024/04/26 03:27:59 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file11.txt 2024/04/26 03:27:59 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file2.txt 2024/04/26 03:27:59 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file4.txt 2024/04/26 03:27:59 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:27:59 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file5.txt.conflict1 2024/04/26 03:27:59 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/04/26 03:27:59 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file5.txt.conflict1 2024/04/26 03:27:59 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file5.txt.conflict2 2024/04/26 03:27:59 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/04/26 03:27:59 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file5.txt.conflict2 2024/04/26 03:27:59 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file6.txt 2024/04/26 03:27:59 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/file7.txt 2024/04/26 03:27:59 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file1.txt 2024/04/26 03:27:59 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file10.txt 2024/04/26 03:27:59 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/file3.txt 2024/04/26 03:27:59 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:27:59 INFO : file10.txt: Copied (new) 2024/04/26 03:27:59 INFO : file5.txt.conflict2: Copied (new) 2024/04/26 03:27:59 INFO : file6.txt: Copied (new) 2024/04/26 03:27:59 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:27:59 INFO : file3.txt: Deleted 2024/04/26 03:27:59 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:27:59 INFO : file11.txt: Copied (new) 2024/04/26 03:27:59 INFO : file5.txt.conflict1: Copied (new) 2024/04/26 03:27:59 INFO : file7.txt: Copied (new) 2024/04/26 03:27:59 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:27:59 INFO : file4.txt: Deleted 2024/04/26 03:27:59 INFO : Updating listings 2024/04/26 03:27:59 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/compare_all/path2/" 2024/04/26 03:27:59 INFO : Bisync successful bisync_test.go:553: TEST compare_all PASSED === RUN TestBisyncRemoteRemote/createemptysrcdirs 2024/04/26 03:27:59 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:59 DEBUG : path1: Making directory 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:27:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1" 2024/04/26 03:27:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:59 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1" 2024/04/26 03:27:59 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:27:59 DEBUG : path2: Making directory 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:27:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2" 2024/04/26 03:27:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:27:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:27:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:27:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:27:59 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2" 2024/04/26 03:27:59 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_createemptysrcdirs-yebesuk9" 2024/04/26 03:27:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : Local file system at /tmp/032753ne/initdir/test_createemptysrcdirs-yebesuk9: Waiting for checks to finish 2024/04/26 03:27:59 DEBUG : Local file system at /tmp/032753ne/initdir/test_createemptysrcdirs-yebesuk9: Waiting for transfers to finish 2024/04/26 03:27:59 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : file1.copy2.txt.xiqofip9.partial: renamed to: file1.copy2.txt 2024/04/26 03:27:59 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:27:59 DEBUG : file1.copy3.txt.lavabey4.partial: renamed to: file1.copy3.txt 2024/04/26 03:27:59 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : RCLONE_TEST.wanehib7.partial: renamed to: RCLONE_TEST 2024/04/26 03:27:59 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:27:59 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : file1.copy4.txt.meletox5.partial: renamed to: file1.copy4.txt 2024/04/26 03:27:59 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : file1.txt.yecoxax3.partial: renamed to: file1.txt 2024/04/26 03:27:59 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 INFO : file1.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : file1.copy5.txt.xeheguv4.partial: renamed to: file1.copy5.txt 2024/04/26 03:27:59 DEBUG : file1.copy1.txt.gowuwos2.partial: renamed to: file1.copy1.txt 2024/04/26 03:27:59 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:27:59 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9" 2024/04/26 03:27:59 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : Local file system at /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9: Waiting for checks to finish 2024/04/26 03:27:59 DEBUG : Local file system at /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9: Waiting for transfers to finish 2024/04/26 03:27:59 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:27:59 DEBUG : placeholder.txt.goxugog0.partial: renamed to: placeholder.txt 2024/04/26 03:27:59 INFO : placeholder.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1] 2024/04/26 03:27:59 ERROR : : error listing: directory not found 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2] 2024/04/26 03:27:59 ERROR : : error listing: directory not found 2024/04/26 03:27:59 checking initFs Local file system at /tmp/032753ne/initdir/test_createemptysrcdirs-yebesuk9 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1] 2024/04/26 03:27:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/file1.copy1.txt] 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/RCLONE_TEST] 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1: Waiting for checks to finish 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1: Waiting for transfers to finish 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/file1.copy3.txt] 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/file1.copy2.txt] 2024/04/26 03:27:59 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/file1.copy4.txt] 2024/04/26 03:27:59 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:27:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/file1.copy5.txt] 2024/04/26 03:28:00 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/file1.txt] 2024/04/26 03:28:00 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:28:00 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:00 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:28:00 INFO : file1.txt: Copied (new) 2024/04/26 03:28:00 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2] 2024/04/26 03:28:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/RCLONE_TEST] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/file1.copy3.txt] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/file1.copy1.txt] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2: Waiting for checks to finish 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/file1.copy2.txt] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2: Waiting for transfers to finish 2024/04/26 03:28:00 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/file1.copy4.txt] 2024/04/26 03:28:00 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/file1.copy5.txt] 2024/04/26 03:28:00 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/file1.txt] 2024/04/26 03:28:00 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:28:00 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:28:00 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:28:00 INFO : file1.txt: Copied (new) 2024/04/26 03:28:00 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2] 2024/04/26 03:28:00 (01) : test createemptysrcdirs 2024/04/26 03:28:00 (02) : test initial bisync 2024/04/26 03:28:00 (03) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/ placeholder.txt 2024/04/26 03:28:00 (04) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:00 (05) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy1.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy1.txt 2024/04/26 03:28:00 (06) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy2.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy2.txt 2024/04/26 03:28:00 (07) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy3.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy3.txt 2024/04/26 03:28:00 (08) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy4.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy4.txt 2024/04/26 03:28:00 (09) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy5.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy5.txt 2024/04/26 03:28:00 (10) : bisync resync 2024/04/26 03:28:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Copying Path2 files to Path1 2024/04/26 03:28:00 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:00 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:00 INFO : file1.copy4.txt: Copied (replaced existing) 2024/04/26 03:28:00 INFO : file1.copy1.txt: Copied (replaced existing) 2024/04/26 03:28:00 INFO : file1.copy2.txt: Copied (replaced existing) 2024/04/26 03:28:00 INFO : file1.copy3.txt: Copied (replaced existing) 2024/04/26 03:28:00 INFO : file1.copy5.txt: Copied (replaced existing) 2024/04/26 03:28:00 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:00 INFO : Resync updating listings 2024/04/26 03:28:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Bisync successful 2024/04/26 03:28:00 (11) : test 1. Create an empty dir on Path1 by creating subdir/placeholder.txt and then deleting the placeholder 2024/04/26 03:28:00 (12) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ subdir/placeholder.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: subdir/placeholder.txt 2024/04/26 03:28:00 (13) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ subdir 2024/04/26 03:28:00 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/subdir/placeholder.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Deleted 2024/04/26 03:28:00 (15) : test 2. Run bisync without --create-empty-src-dirs 2024/04/26 03:28:00 (16) : bisync 2024/04/26 03:28:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:00 INFO : Path1 checking for diffs 2024/04/26 03:28:00 INFO : Path2 checking for diffs 2024/04/26 03:28:00 INFO : No changes found 2024/04/26 03:28:00 INFO : Updating listings 2024/04/26 03:28:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Bisync successful 2024/04/26 03:28:00 (17) : test 3. Confirm the subdir exists only on Path1 and not Path2 2024/04/26 03:28:00 (18) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ 2024/04/26 03:28:00 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:28:00 (19) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/ 2024/04/26 03:28:00 (20) : test 4.Run bisync WITH --create-empty-src-dirs 2024/04/26 03:28:00 (21) : bisync create-empty-src-dirs 2024/04/26 03:28:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:00 INFO : Path1 checking for diffs 2024/04/26 03:28:00 INFO : - Path1 File is new - subdir 2024/04/26 03:28:00 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:28:00 INFO : Path2 checking for diffs 2024/04/26 03:28:00 INFO : Applying changes 2024/04/26 03:28:00 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/subdir 2024/04/26 03:28:00 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:00 INFO : Updating listings 2024/04/26 03:28:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Bisync successful 2024/04/26 03:28:00 (22) : test 5. Confirm the subdir exists on both paths 2024/04/26 03:28:00 (23) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ 2024/04/26 03:28:00 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:28:00 (24) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/ 2024/04/26 03:28:00 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:28:00 (25) : test 6. Delete the empty dir on Path1 using purge-children (and also add files so the path isn't empty) 2024/04/26 03:28:00 (26) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ 2024/04/26 03:28:00 (27) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: file1.txt 2024/04/26 03:28:00 (28) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy1.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2024/04/26 03:28:00 (29) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy2.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2024/04/26 03:28:00 (30) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy3.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2024/04/26 03:28:00 (31) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy4.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2024/04/26 03:28:00 (32) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy5.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2024/04/26 03:28:00 (33) : test 7. Run bisync without --create-empty-src-dirs 2024/04/26 03:28:00 (34) : bisync 2024/04/26 03:28:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:00 INFO : Path1 checking for diffs 2024/04/26 03:28:00 INFO : - Path1 File was deleted - RCLONE_TEST 2024/04/26 03:28:00 INFO : - Path1 File was deleted - subdir 2024/04/26 03:28:00 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2024/04/26 03:28:00 INFO : Path2 checking for diffs 2024/04/26 03:28:00 INFO : - Path2 File was deleted - subdir 2024/04/26 03:28:00 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:28:00 INFO : Applying changes 2024/04/26 03:28:00 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/RCLONE_TEST 2024/04/26 03:28:00 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:00 INFO : RCLONE_TEST: Deleted 2024/04/26 03:28:00 INFO : Updating listings 2024/04/26 03:28:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Bisync successful 2024/04/26 03:28:00 (35) : test 8. Confirm the subdir exists only on Path2 and not Path1 2024/04/26 03:28:00 (36) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ 2024/04/26 03:28:00 (37) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/ 2024/04/26 03:28:00 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:28:00 (38) : test 9. Reset, do the delete again, and run bisync WITH --create-empty-src-dirs 2024/04/26 03:28:00 (39) : bisync resync create-empty-src-dirs 2024/04/26 03:28:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Copying Path2 files to Path1 2024/04/26 03:28:00 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:00 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:00 INFO : Resync updating listings 2024/04/26 03:28:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Bisync successful 2024/04/26 03:28:00 (40) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ 2024/04/26 03:28:00 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:28:00 (41) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/ 2024/04/26 03:28:00 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:28:00 (42) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ 2024/04/26 03:28:00 (43) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: file1.txt 2024/04/26 03:28:00 (44) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy1.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2024/04/26 03:28:00 (45) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy2.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2024/04/26 03:28:00 (46) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy3.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2024/04/26 03:28:00 (47) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy4.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2024/04/26 03:28:00 (48) : copy-as /tmp/032753ne/datadir/test_createemptysrcdirs-veyevun9/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ file1.copy5.txt 2024/04/26 03:28:00 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2024/04/26 03:28:00 (49) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ 2024/04/26 03:28:00 (50) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/ 2024/04/26 03:28:00 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:28:00 (51) : bisync create-empty-src-dirs 2024/04/26 03:28:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:00 INFO : Path1 checking for diffs 2024/04/26 03:28:00 INFO : - Path1 File was deleted - subdir 2024/04/26 03:28:00 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:28:00 INFO : Path2 checking for diffs 2024/04/26 03:28:00 INFO : Applying changes 2024/04/26 03:28:00 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/subdir 2024/04/26 03:28:00 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:00 INFO : subdir: Removing directory 2024/04/26 03:28:00 INFO : Updating listings 2024/04/26 03:28:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Bisync successful 2024/04/26 03:28:00 (52) : test 10. Confirm the subdir has been removed on both paths 2024/04/26 03:28:00 (53) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/ 2024/04/26 03:28:00 (54) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/ 2024/04/26 03:28:00 (55) : test 11. bisync again (because if we leave subdir in listings, test will fail due to mismatched modtime) 2024/04/26 03:28:00 (56) : bisync create-empty-src-dirs 2024/04/26 03:28:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:00 INFO : Path1 checking for diffs 2024/04/26 03:28:00 INFO : Path2 checking for diffs 2024/04/26 03:28:00 INFO : No changes found 2024/04/26 03:28:00 INFO : Updating listings 2024/04/26 03:28:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/createemptysrcdirs/path2/" 2024/04/26 03:28:00 INFO : Bisync successful bisync_test.go:553: TEST createemptysrcdirs PASSED === RUN TestBisyncRemoteRemote/dry_run 2024/04/26 03:28:00 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:00 DEBUG : path1: Making directory 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:00 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1" 2024/04/26 03:28:00 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:00 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:00 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1" 2024/04/26 03:28:00 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:00 DEBUG : path2: Making directory 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:00 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2" 2024/04/26 03:28:00 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:00 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:00 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2" 2024/04/26 03:28:00 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_dry_run-lenuyol6" 2024/04/26 03:28:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:00 DEBUG : file1.txt.jesuxay8.partial: renamed to: file1.txt 2024/04/26 03:28:00 INFO : file1.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:00 DEBUG : file2.txt.rujuyij9.partial: renamed to: file2.txt 2024/04/26 03:28:00 INFO : file2.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:00 DEBUG : file3.txt.gejeyer3.partial: renamed to: file3.txt 2024/04/26 03:28:00 INFO : file3.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : Local file system at /tmp/032753ne/initdir/test_dry_run-lenuyol6: Waiting for checks to finish 2024/04/26 03:28:00 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:00 DEBUG : Local file system at /tmp/032753ne/initdir/test_dry_run-lenuyol6: Waiting for transfers to finish 2024/04/26 03:28:00 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:00 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:00 DEBUG : RCLONE_TEST.suyoyor6.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:00 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:00 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:00 DEBUG : file5.txt.cuzodeh6.partial: renamed to: file5.txt 2024/04/26 03:28:00 INFO : file5.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : file4.txt.kozazon2.partial: renamed to: file4.txt 2024/04/26 03:28:00 INFO : file4.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : file6.txt.samiveb1.partial: renamed to: file6.txt 2024/04/26 03:28:00 INFO : file6.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:00 DEBUG : file7.txt.noduvet5.partial: renamed to: file7.txt 2024/04/26 03:28:00 INFO : file7.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_dry_run-fopolov8" 2024/04/26 03:28:00 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : Local file system at /tmp/032753ne/datadir/test_dry_run-fopolov8: Waiting for checks to finish 2024/04/26 03:28:00 DEBUG : Local file system at /tmp/032753ne/datadir/test_dry_run-fopolov8: Waiting for transfers to finish 2024/04/26 03:28:00 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:00 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:00 DEBUG : file1.txt.cewilan9.partial: renamed to: file1.txt 2024/04/26 03:28:00 DEBUG : file10.txt.yuyofal6.partial: renamed to: file10.txt 2024/04/26 03:28:00 INFO : file1.txt: Copied (new) 2024/04/26 03:28:00 INFO : file10.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:00 DEBUG : file11.txt.pufupah6.partial: renamed to: file11.txt 2024/04/26 03:28:00 INFO : file11.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:28:00 DEBUG : file5L.txt.gidomed5.partial: renamed to: file5L.txt 2024/04/26 03:28:00 INFO : file5L.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:28:00 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:28:00 DEBUG : file5R.txt.liwurih4.partial: renamed to: file5R.txt 2024/04/26 03:28:00 INFO : file5R.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : file2.txt.muwepov5.partial: renamed to: file2.txt 2024/04/26 03:28:00 INFO : file2.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:00 DEBUG : file6.txt.ramexip9.partial: renamed to: file6.txt 2024/04/26 03:28:00 INFO : file6.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:00 DEBUG : file7.txt.litalim3.partial: renamed to: file7.txt 2024/04/26 03:28:00 INFO : file7.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1] 2024/04/26 03:28:00 ERROR : : error listing: directory not found 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2] 2024/04/26 03:28:00 ERROR : : error listing: directory not found 2024/04/26 03:28:00 checking initFs Local file system at /tmp/032753ne/initdir/test_dry_run-lenuyol6 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1] 2024/04/26 03:28:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/RCLONE_TEST] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file1.txt] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file2.txt] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file3.txt] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: Waiting for checks to finish 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: Waiting for transfers to finish 2024/04/26 03:28:00 INFO : file1.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file4.txt] 2024/04/26 03:28:00 INFO : file2.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file5.txt] 2024/04/26 03:28:00 INFO : file3.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file6.txt] 2024/04/26 03:28:00 INFO : file4.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file7.txt] 2024/04/26 03:28:00 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:00 INFO : file5.txt: Copied (new) 2024/04/26 03:28:00 INFO : file6.txt: Copied (new) 2024/04/26 03:28:00 INFO : file7.txt: Copied (new) 2024/04/26 03:28:00 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2] 2024/04/26 03:28:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/RCLONE_TEST] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: Waiting for checks to finish 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: Waiting for transfers to finish 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file1.txt] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file2.txt] 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file3.txt] 2024/04/26 03:28:00 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file4.txt] 2024/04/26 03:28:00 INFO : file1.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file5.txt] 2024/04/26 03:28:00 INFO : file2.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file6.txt] 2024/04/26 03:28:00 INFO : file3.txt: Copied (new) 2024/04/26 03:28:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file7.txt] 2024/04/26 03:28:00 INFO : file4.txt: Copied (new) 2024/04/26 03:28:00 INFO : file5.txt: Copied (new) 2024/04/26 03:28:01 INFO : file6.txt: Copied (new) 2024/04/26 03:28:01 INFO : file7.txt: Copied (new) 2024/04/26 03:28:01 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2] 2024/04/26 03:28:01 (01) : test dry-run 2024/04/26 03:28:01 (02) : test initial bisync 2024/04/26 03:28:01 (03) : bisync resync 2024/04/26 03:28:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/" 2024/04/26 03:28:01 INFO : Copying Path2 files to Path1 2024/04/26 03:28:01 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:01 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:01 INFO : Resync updating listings 2024/04/26 03:28:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/" 2024/04/26 03:28:01 INFO : Bisync successful 2024/04/26 03:28:01 (04) : test new on path2 - file10 2024/04/26 03:28:01 (05) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_dry_run-fopolov8/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/ 2024/04/26 03:28:01 INFO : file10.txt: Copied (new) 2024/04/26 03:28:01 (06) : test newer on path2 - file1 2024/04/26 03:28:01 (07) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_dry_run-fopolov8/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/ 2024/04/26 03:28:01 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:01 (08) : test new on path1 - file11 2024/04/26 03:28:01 (09) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_dry_run-fopolov8/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/ 2024/04/26 03:28:01 INFO : file11.txt: Copied (new) 2024/04/26 03:28:01 (10) : test newer on path1 - file2 2024/04/26 03:28:01 (11) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_dry_run-fopolov8/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/ 2024/04/26 03:28:01 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:01 (12) : test deleted on path2 - file3 2024/04/26 03:28:01 (13) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file3.txt 2024/04/26 03:28:01 INFO : file3.txt: Deleted 2024/04/26 03:28:01 (14) : test deleted on path1 - file4 2024/04/26 03:28:01 (15) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file4.txt 2024/04/26 03:28:01 INFO : file4.txt: Deleted 2024/04/26 03:28:01 (16) : test changed on path2 and on path1 - file5 (file5R, file5L) 2024/04/26 03:28:01 (17) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_dry_run-fopolov8/ file5R.txt 2024/04/26 03:28:01 (18) : copy-as /tmp/032753ne/datadir/test_dry_run-fopolov8/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/ file5.txt 2024/04/26 03:28:01 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:28:01 (19) : touch-glob 2001-03-04 /tmp/032753ne/datadir/test_dry_run-fopolov8/ file5L.txt 2024/04/26 03:28:01 (20) : copy-as /tmp/032753ne/datadir/test_dry_run-fopolov8/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/ file5.txt 2024/04/26 03:28:01 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:28:01 (21) : test newer on path2 and deleted on path1 - file6 2024/04/26 03:28:01 (22) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_dry_run-fopolov8/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/ 2024/04/26 03:28:01 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:28:01 (23) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file6.txt 2024/04/26 03:28:01 INFO : file6.txt: Deleted 2024/04/26 03:28:01 (24) : test newer on path1 and deleted on path2 - file7 2024/04/26 03:28:01 (25) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_dry_run-fopolov8/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/ 2024/04/26 03:28:01 INFO : file7.txt: Copied (replaced existing) 2024/04/26 03:28:01 (26) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file7.txt 2024/04/26 03:28:01 INFO : file7.txt: Deleted 2024/04/26 03:28:01 (27) : test sync with dry-run and resync 2024/04/26 03:28:01 (28) : bisync dry-run resync 2024/04/26 03:28:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/" 2024/04/26 03:28:01 INFO : Copying Path2 files to Path1 2024/04/26 03:28:01 NOTICE: - Path2 Resync is copying files to - Path1 2024/04/26 03:28:01 NOTICE: file4.txt: Skipped copy as --dry-run is set (size 0) 2024/04/26 03:28:01 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:28:01 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:28:01 NOTICE: - Path1 Resync is copying files to - Path2 2024/04/26 03:28:01 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:28:01 NOTICE: file3.txt: Skipped copy as --dry-run is set (size 0) 2024/04/26 03:28:01 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:28:01 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 0) 2024/04/26 03:28:01 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13) 2024/04/26 03:28:01 NOTICE: file5.txt: Skipped copy as --dry-run is set (size 39) 2024/04/26 03:28:01 INFO : Resync updating listings 2024/04/26 03:28:01 INFO : Bisync successful 2024/04/26 03:28:01 (29) : copy-listings dryrun-resync 2024/04/26 03:28:01 (30) : test sync with dry-run 2024/04/26 03:28:01 (31) : bisync dry-run 2024/04/26 03:28:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/" 2024/04/26 03:28:01 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:01 INFO : Path1 checking for diffs 2024/04/26 03:28:01 NOTICE: - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:28:01 NOTICE: - Path1 File was deleted - file4.txt 2024/04/26 03:28:01 NOTICE: - Path1 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:28:01 NOTICE: - Path1 File was deleted - file6.txt 2024/04/26 03:28:01 NOTICE: - Path1 File changed: size (larger), time (newer) - file7.txt 2024/04/26 03:28:01 NOTICE: - Path1 File is new - file11.txt 2024/04/26 03:28:01 INFO : Path1: 6 changes:  1 new,  3 modified,  2 deleted 2024/04/26 03:28:01 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:28:01 INFO : Path2 checking for diffs 2024/04/26 03:28:01 NOTICE: - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:28:01 NOTICE: - Path2 File was deleted - file3.txt 2024/04/26 03:28:01 NOTICE: - Path2 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:28:01 NOTICE: - Path2 File changed: size (larger), time (newer) - file6.txt 2024/04/26 03:28:01 NOTICE: - Path2 File was deleted - file7.txt 2024/04/26 03:28:01 NOTICE: - Path2 File is new - file10.txt 2024/04/26 03:28:01 INFO : Path2: 6 changes:  1 new,  3 modified,  2 deleted 2024/04/26 03:28:01 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:28:01 INFO : Applying changes 2024/04/26 03:28:01 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:01 INFO : Checking potential conflicts... 2024/04/26 03:28:01 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: 1 differences found 2024/04/26 03:28:01 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: 1 errors while checking 2024/04/26 03:28:01 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:28:01 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file11.txt 2024/04/26 03:28:01 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file2.txt 2024/04/26 03:28:01 NOTICE: - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file4.txt 2024/04/26 03:28:01 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:28:01 NOTICE: file5.txt: Skipped rename as --dry-run is set 2024/04/26 03:28:01 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file5.txt.conflict1 2024/04/26 03:28:01 NOTICE: file5.txt: Skipped rename as --dry-run is set 2024/04/26 03:28:01 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file5.txt.conflict2 2024/04/26 03:28:01 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file6.txt 2024/04/26 03:28:01 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file7.txt 2024/04/26 03:28:01 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file1.txt 2024/04/26 03:28:01 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file10.txt 2024/04/26 03:28:01 NOTICE: - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file3.txt 2024/04/26 03:28:01 NOTICE: - Path2 Do queued copies to - Path1 2024/04/26 03:28:01 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:28:01 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:28:01 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:28:01 NOTICE: file3.txt: Skipped delete as --dry-run is set (size 0) 2024/04/26 03:28:01 NOTICE: - Path1 Do queued copies to - Path2 2024/04/26 03:28:01 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:28:01 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19) 2024/04/26 03:28:01 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13) 2024/04/26 03:28:01 NOTICE: file4.txt: Skipped delete as --dry-run is set (size 0) 2024/04/26 03:28:01 INFO : Updating listings 2024/04/26 03:28:01 INFO : Bisync successful 2024/04/26 03:28:01 (32) : copy-listings dryrun 2024/04/26 03:28:01 (33) : test sync without dry-run 2024/04/26 03:28:01 (34) : bisync 2024/04/26 03:28:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/" 2024/04/26 03:28:01 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:01 INFO : Path1 checking for diffs 2024/04/26 03:28:01 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:28:01 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:28:01 INFO : - Path1 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:28:01 INFO : - Path1 File was deleted - file6.txt 2024/04/26 03:28:01 INFO : - Path1 File changed: size (larger), time (newer) - file7.txt 2024/04/26 03:28:01 INFO : - Path1 File is new - file11.txt 2024/04/26 03:28:01 INFO : Path1: 6 changes:  1 new,  3 modified,  2 deleted 2024/04/26 03:28:01 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:28:01 INFO : Path2 checking for diffs 2024/04/26 03:28:01 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:28:01 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:28:01 INFO : - Path2 File changed: size (larger), time (newer) - file5.txt 2024/04/26 03:28:01 INFO : - Path2 File changed: size (larger), time (newer) - file6.txt 2024/04/26 03:28:01 INFO : - Path2 File was deleted - file7.txt 2024/04/26 03:28:01 INFO : - Path2 File is new - file10.txt 2024/04/26 03:28:01 INFO : Path2: 6 changes:  1 new,  3 modified,  2 deleted 2024/04/26 03:28:01 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/04/26 03:28:01 INFO : Applying changes 2024/04/26 03:28:01 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:01 INFO : Checking potential conflicts... 2024/04/26 03:28:01 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: 1 differences found 2024/04/26 03:28:01 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2: 1 errors while checking 2024/04/26 03:28:01 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:28:01 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file11.txt 2024/04/26 03:28:01 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file2.txt 2024/04/26 03:28:01 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file4.txt 2024/04/26 03:28:01 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:28:01 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file5.txt.conflict1 2024/04/26 03:28:01 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/04/26 03:28:01 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file5.txt.conflict1 2024/04/26 03:28:01 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file5.txt.conflict2 2024/04/26 03:28:01 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/04/26 03:28:01 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file5.txt.conflict2 2024/04/26 03:28:01 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file6.txt 2024/04/26 03:28:01 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/file7.txt 2024/04/26 03:28:01 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file1.txt 2024/04/26 03:28:01 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file10.txt 2024/04/26 03:28:01 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/file3.txt 2024/04/26 03:28:01 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:01 INFO : file10.txt: Copied (new) 2024/04/26 03:28:01 INFO : file6.txt: Copied (new) 2024/04/26 03:28:01 INFO : file5.txt.conflict2: Copied (new) 2024/04/26 03:28:01 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:01 INFO : file3.txt: Deleted 2024/04/26 03:28:01 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:01 INFO : file11.txt: Copied (new) 2024/04/26 03:28:01 INFO : file5.txt.conflict1: Copied (new) 2024/04/26 03:28:01 INFO : file7.txt: Copied (new) 2024/04/26 03:28:01 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:01 INFO : file4.txt: Deleted 2024/04/26 03:28:01 INFO : Updating listings 2024/04/26 03:28:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/dry_run/path2/" 2024/04/26 03:28:01 INFO : Bisync successful bisync_test.go:553: TEST dry_run PASSED === RUN TestBisyncRemoteRemote/equal 2024/04/26 03:28:01 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:01 DEBUG : path1: Making directory 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:01 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1" 2024/04/26 03:28:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:01 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1" 2024/04/26 03:28:01 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:01 DEBUG : path2: Making directory 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:01 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2" 2024/04/26 03:28:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:01 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2" 2024/04/26 03:28:01 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_equal-gibocub5" 2024/04/26 03:28:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : Local file system at /tmp/032753ne/initdir/test_equal-gibocub5: Waiting for checks to finish 2024/04/26 03:28:01 DEBUG : Local file system at /tmp/032753ne/initdir/test_equal-gibocub5: Waiting for transfers to finish 2024/04/26 03:28:01 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:01 DEBUG : file1.txt.xelesuw1.partial: renamed to: file1.txt 2024/04/26 03:28:01 INFO : file1.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:01 DEBUG : file2.txt.wuvuyab0.partial: renamed to: file2.txt 2024/04/26 03:28:01 INFO : file2.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:01 DEBUG : RCLONE_TEST.dolakav2.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:01 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:01 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_equal-beqerot0" 2024/04/26 03:28:01 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : Local file system at /tmp/032753ne/datadir/test_equal-beqerot0: Waiting for checks to finish 2024/04/26 03:28:01 DEBUG : Local file system at /tmp/032753ne/datadir/test_equal-beqerot0: Waiting for transfers to finish 2024/04/26 03:28:01 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/04/26 03:28:01 DEBUG : file1L.txt.jusujat0.partial: renamed to: file1L.txt 2024/04/26 03:28:01 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/04/26 03:28:01 INFO : file1L.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK 2024/04/26 03:28:01 DEBUG : file2.txt.moneyol2.partial: renamed to: file2.txt 2024/04/26 03:28:01 INFO : file2.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : file1R.txt.yamenem5.partial: renamed to: file1R.txt 2024/04/26 03:28:01 INFO : file1R.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1] 2024/04/26 03:28:01 ERROR : : error listing: directory not found 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2] 2024/04/26 03:28:01 ERROR : : error listing: directory not found 2024/04/26 03:28:01 checking initFs Local file system at /tmp/032753ne/initdir/test_equal-gibocub5 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1] 2024/04/26 03:28:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1/RCLONE_TEST] 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1/file1.txt] 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1/file2.txt] 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1: Waiting for checks to finish 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1: Waiting for transfers to finish 2024/04/26 03:28:01 INFO : file1.txt: Copied (new) 2024/04/26 03:28:01 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:01 INFO : file2.txt: Copied (new) 2024/04/26 03:28:01 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1] 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2] 2024/04/26 03:28:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2/RCLONE_TEST] 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2/file1.txt] 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2: Waiting for checks to finish 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2/file2.txt] 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2: Waiting for transfers to finish 2024/04/26 03:28:01 INFO : file1.txt: Copied (new) 2024/04/26 03:28:01 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:01 INFO : file2.txt: Copied (new) 2024/04/26 03:28:01 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2] 2024/04/26 03:28:01 (01) : test equal 2024/04/26 03:28:01 (02) : test initial bisync 2024/04/26 03:28:01 (03) : bisync resync 2024/04/26 03:28:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2/" 2024/04/26 03:28:01 INFO : Copying Path2 files to Path1 2024/04/26 03:28:01 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:01 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:01 INFO : Resync updating listings 2024/04/26 03:28:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2/" 2024/04/26 03:28:01 INFO : Bisync successful 2024/04/26 03:28:01 (04) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:28:01 (05) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_equal-beqerot0/ file1R.txt 2024/04/26 03:28:01 (06) : copy-as /tmp/032753ne/datadir/test_equal-beqerot0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2/ file1.txt 2024/04/26 03:28:01 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:01 (07) : touch-glob 2001-03-04 /tmp/032753ne/datadir/test_equal-beqerot0/ file1L.txt 2024/04/26 03:28:01 (08) : copy-as /tmp/032753ne/datadir/test_equal-beqerot0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1/ file1.txt 2024/04/26 03:28:01 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:01 (09) : test changed on both paths and identical - file2 2024/04/26 03:28:01 (10) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_equal-beqerot0/ file2.txt 2024/04/26 03:28:01 (11) : copy-as /tmp/032753ne/datadir/test_equal-beqerot0/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1/ file2.txt 2024/04/26 03:28:01 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:01 (12) : copy-as /tmp/032753ne/datadir/test_equal-beqerot0/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2/ file2.txt 2024/04/26 03:28:01 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:01 (13) : test bisync run 2024/04/26 03:28:01 (14) : bisync 2024/04/26 03:28:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2/" 2024/04/26 03:28:01 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:01 INFO : Path1 checking for diffs 2024/04/26 03:28:01 INFO : - Path1 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:28:01 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:28:01 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:28:01 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/04/26 03:28:01 INFO : Path2 checking for diffs 2024/04/26 03:28:01 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:28:01 INFO : - Path2 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:28:01 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:28:01 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/04/26 03:28:01 INFO : Applying changes 2024/04/26 03:28:01 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:01 INFO : Checking potential conflicts... 2024/04/26 03:28:01 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2: 1 differences found 2024/04/26 03:28:01 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2: 1 errors while checking 2024/04/26 03:28:01 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2: 1 matching files 2024/04/26 03:28:01 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:28:01 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:28:01 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1/file1.txt.conflict1 2024/04/26 03:28:01 INFO : file1.txt: Moved (server-side) to: file1.txt.conflict1 2024/04/26 03:28:01 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2/file1.txt.conflict1 2024/04/26 03:28:01 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2/file1.txt.conflict2 2024/04/26 03:28:01 INFO : file1.txt: Moved (server-side) to: file1.txt.conflict2 2024/04/26 03:28:01 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1/file1.txt.conflict2 2024/04/26 03:28:01 NOTICE: - WARNING New or changed in both paths - file2.txt 2024/04/26 03:28:01 INFO : Files are equal! Skipping: file2.txt 2024/04/26 03:28:01 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:01 INFO : file1.txt.conflict2: Copied (new) 2024/04/26 03:28:01 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:01 INFO : file1.txt.conflict1: Copied (new) 2024/04/26 03:28:01 INFO : Updating listings 2024/04/26 03:28:01 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:01 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/equal/path2/" 2024/04/26 03:28:01 INFO : Bisync successful bisync_test.go:553: TEST equal PASSED === RUN TestBisyncRemoteRemote/ext_paths 2024/04/26 03:28:01 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:01 DEBUG : path1: Making directory 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:01 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1" 2024/04/26 03:28:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:01 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1" 2024/04/26 03:28:01 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:01 DEBUG : path2: Making directory 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:01 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2" 2024/04/26 03:28:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:01 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2" 2024/04/26 03:28:01 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_ext_paths-pagupov0" 2024/04/26 03:28:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:01 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ: Making directory with metadata 2024/04/26 03:28:01 DEBUG : file1.txt.suqonuv1.partial: renamed to: file1.txt 2024/04/26 03:28:01 INFO : file1.txt: Copied (new) 2024/04/26 03:28:01 INFO : 測試РуÑÑкий ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z) 2024/04/26 03:28:01 DEBUG : Added delayed dir = "測試РуÑÑкий ěáñ", newDst=測試РуÑÑкий ěáñ 2024/04/26 03:28:01 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:01 DEBUG : file_enconde_mañana_funcionará.txt.gorojec8.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/04/26 03:28:01 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:01 DEBUG : РуÑÑкий.txt.kulugih6.partial: renamed to: РуÑÑкий.txt 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : Local file system at /tmp/032753ne/initdir/test_ext_paths-pagupov0: Waiting for checks to finish 2024/04/26 03:28:01 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:01 DEBUG : Local file system at /tmp/032753ne/initdir/test_ext_paths-pagupov0: Waiting for transfers to finish 2024/04/26 03:28:01 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:01 DEBUG : RCLONE_TEST.janetas3.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:01 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:01 DEBUG : 測試_check file.nidigab4.partial: renamed to: 測試_check file 2024/04/26 03:28:01 INFO : 測試_check file: Copied (new) 2024/04/26 03:28:01 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:28:01 DEBUG : filename_contains_ࢺ_.txt.raluyih2.partial: renamed to: filename_contains_ࢺ_.txt 2024/04/26 03:28:01 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:28:01 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : filename_contains_Ä›_.txt.zupewif4.partial: renamed to: filename_contains_Ä›_.txt 2024/04/26 03:28:01 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt.mixojas2.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt 2024/04/26 03:28:01 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ/測試_check file.zofepat4.partial: renamed to: 測試РуÑÑкий ěáñ/測試_check file 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:28:01 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt.cuvajij4.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt 2024/04/26 03:28:01 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:01 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/04/26 03:28:01 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_ext_paths-romozot1" 2024/04/26 03:28:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : Local file system at /tmp/032753ne/datadir/test_ext_paths-romozot1: Waiting for checks to finish 2024/04/26 03:28:01 DEBUG : Local file system at /tmp/032753ne/datadir/test_ext_paths-romozot1: Waiting for transfers to finish 2024/04/26 03:28:01 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:01 DEBUG : file1.txt.tisoxob2.partial: renamed to: file1.txt 2024/04/26 03:28:01 INFO : file1.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/04/26 03:28:01 DEBUG : 測試_filtersfile.txt.cigolug5.partial: renamed to: 測試_filtersfile.txt 2024/04/26 03:28:01 INFO : 測試_filtersfile.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1] 2024/04/26 03:28:01 ERROR : : error listing: directory not found 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2] 2024/04/26 03:28:01 ERROR : : error listing: directory not found 2024/04/26 03:28:01 checking initFs Local file system at /tmp/032753ne/initdir/test_ext_paths-pagupov0 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1] 2024/04/26 03:28:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ: Making directory 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ] 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/RCLONE_TEST] 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/file1.txt] 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/filename_contains_Ä›_.txt] 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/file_enconde_mañana_funcionará.txt] 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: Waiting for checks to finish 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: Waiting for transfers to finish 2024/04/26 03:28:01 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/filename_contains_ࢺ_.txt] 2024/04/26 03:28:01 INFO : file1.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/РуÑÑкий.txt] 2024/04/26 03:28:01 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試_check file] 2024/04/26 03:28:01 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt] 2024/04/26 03:28:01 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt] 2024/04/26 03:28:01 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:28:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ/測試_check file] 2024/04/26 03:28:01 INFO : 測試_check file: Copied (new) 2024/04/26 03:28:02 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:02 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:02 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/04/26 03:28:02 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2] 2024/04/26 03:28:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : 測試РуÑÑкий ěáñ: Making directory 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/RCLONE_TEST] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/file1.txt] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/file_enconde_mañana_funcionará.txt] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/filename_contains_Ä›_.txt] 2024/04/26 03:28:02 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: Waiting for checks to finish 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: Waiting for transfers to finish 2024/04/26 03:28:02 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/filename_contains_ࢺ_.txt] 2024/04/26 03:28:02 INFO : file1.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/РуÑÑкий.txt] 2024/04/26 03:28:02 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試_check file] 2024/04/26 03:28:02 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt] 2024/04/26 03:28:02 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt] 2024/04/26 03:28:02 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ/測試_check file] 2024/04/26 03:28:02 INFO : 測試_check file: Copied (new) 2024/04/26 03:28:02 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:02 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:02 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/04/26 03:28:02 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ] 2024/04/26 03:28:02 (01) : test extended-char-paths 2024/04/26 03:28:02 (02) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/ 2024/04/26 03:28:02 ERROR : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-suwaseg4: Server side directory move failed: rename /rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий eÌŒaÌñ: file does not exist 2024/04/26 03:28:02 INFO : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ/: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2024/04/26 03:28:02 ERROR : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-suwaseg4: error reading source root directory: directory not found 2024/04/26 03:28:02 (03) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/ 2024/04/26 03:28:02 ERROR : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-jiwocek4: Server side directory move failed: rename /rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий eÌŒaÌñ: file does not exist 2024/04/26 03:28:02 INFO : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ/: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2024/04/26 03:28:02 ERROR : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-jiwocek4: error reading source root directory: directory not found 2024/04/26 03:28:02 (04) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:28:02 (05) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:28:02 (06) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/filename_contains_Ä›_.txt 2024/04/26 03:28:02 (07) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/filename_contains_Ä›_.txt 2024/04/26 03:28:02 (08) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試_check{spc}file 2024/04/26 03:28:02 (09) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試_check{spc}file 2024/04/26 03:28:02 (10) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:28:02 (11) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:28:02 (12) : test resync subdirs with extended chars 2024/04/26 03:28:02 (13) : bisync subdir=測試РуÑÑкий{spc}{spc}ěáñ resync 2024/04/26 03:28:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:02 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/04/26 03:28:02 INFO : Copying Path2 files to Path1 2024/04/26 03:28:02 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:02 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:02 INFO : Resync updating listings 2024/04/26 03:28:02 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/04/26 03:28:02 INFO : Bisync successful 2024/04/26 03:28:02 (14) : copy-listings resync 2024/04/26 03:28:02 (15) : test place new files with extended chars on each side 2024/04/26 03:28:02 (16) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_ext_paths-romozot1/ file1.txt 2024/04/26 03:28:02 (17) : copy-as /tmp/032753ne/datadir/test_ext_paths-romozot1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ 測試_file1p1 2024/04/26 03:28:02 INFO : file1.txt: Copied (new) to: 測試_file1p1 2024/04/26 03:28:02 (18) : copy-as /tmp/032753ne/datadir/test_ext_paths-romozot1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ 測試_file1p2 2024/04/26 03:28:02 INFO : file1.txt: Copied (new) to: 測試_file1p2 2024/04/26 03:28:02 (19) : test normal sync of subdirs with extended chars 2024/04/26 03:28:02 (20) : bisync subdir=測試РуÑÑкий{spc}{spc}ěáñ 2024/04/26 03:28:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:02 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/04/26 03:28:02 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:02 INFO : Path1 checking for diffs 2024/04/26 03:28:02 INFO : - Path1 File is new - 測試_file1p1 2024/04/26 03:28:02 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:28:02 INFO : Path2 checking for diffs 2024/04/26 03:28:02 INFO : - Path2 File is new - 測試_file1p2 2024/04/26 03:28:02 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:28:02 INFO : Applying changes 2024/04/26 03:28:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ/測試_file1p1 2024/04/26 03:28:02 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ/測試_file1p2 2024/04/26 03:28:02 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:02 INFO : 測試_file1p2: Copied (new) 2024/04/26 03:28:02 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:02 INFO : 測試_file1p1: Copied (new) 2024/04/26 03:28:02 INFO : Updating listings 2024/04/26 03:28:02 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий ěáñ/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/04/26 03:28:02 INFO : Bisync successful 2024/04/26 03:28:02 (21) : move-listings normal-sync 2024/04/26 03:28:02 (22) : test check-filename with extended chars. check should fail. 2024/04/26 03:28:02 (23) : bisync resync 2024/04/26 03:28:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:02 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/" 2024/04/26 03:28:02 INFO : Copying Path2 files to Path1 2024/04/26 03:28:02 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:02 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:02 INFO : Resync updating listings 2024/04/26 03:28:02 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/" 2024/04/26 03:28:02 INFO : Bisync successful 2024/04/26 03:28:02 (24) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/04/26 03:28:02 INFO : 測試_check file: Deleted 2024/04/26 03:28:02 (25) : bisync check-access check-filename=測試_check{spc}file 2024/04/26 03:28:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:02 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/" 2024/04/26 03:28:02 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:02 INFO : Path1 checking for diffs 2024/04/26 03:28:02 INFO : - Path1 File was deleted - 測試РуÑÑкий ěáñ/測試_check file 2024/04/26 03:28:02 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:28:02 INFO : Path2 checking for diffs 2024/04/26 03:28:02 INFO : Checking access health 2024/04/26 03:28:02 ERROR : Access test failed: Path1 count 1, Path2 count 2 - 測試_check file 2024/04/26 03:28:02 ERROR : -  Access test failed: Path2 file not found in Path1 - 測試РуÑÑкий ěáñ/測試_check file 2024/04/26 03:28:02 ERROR : Bisync critical error: check file check failed 2024/04/26 03:28:02 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:28:02 Bisync error: bisync aborted 2024/04/26 03:28:02 (26) : copy-listings check-access-fail 2024/04/26 03:28:02 (27) : test check-filename with extended chars. check should pass. 2024/04/26 03:28:02 (28) : bisync resync 2024/04/26 03:28:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:02 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/" 2024/04/26 03:28:02 INFO : Copying Path2 files to Path1 2024/04/26 03:28:02 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:02 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/04/26 03:28:02 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:02 INFO : Resync updating listings 2024/04/26 03:28:02 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/" 2024/04/26 03:28:02 INFO : Bisync successful 2024/04/26 03:28:02 (29) : bisync check-access check-filename=測試_check{spc}file 2024/04/26 03:28:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:02 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/" 2024/04/26 03:28:02 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:02 INFO : Path1 checking for diffs 2024/04/26 03:28:02 INFO : Path2 checking for diffs 2024/04/26 03:28:02 INFO : Checking access health 2024/04/26 03:28:02 INFO : Found 2 matching "測試_check file" files on both paths 2024/04/26 03:28:02 INFO : No changes found 2024/04/26 03:28:02 INFO : Updating listings 2024/04/26 03:28:02 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/" 2024/04/26 03:28:02 INFO : Bisync successful 2024/04/26 03:28:02 (30) : move-listings check-access-pass 2024/04/26 03:28:02 (31) : test filters-file path with extended chars - masks /fileZ.txt 2024/04/26 03:28:02 (32) : copy-file /tmp/032753ne/datadir/test_ext_paths-romozot1/測試_filtersfile.txt /tmp/032753ne/workdir/ 2024/04/26 03:28:02 INFO : 測試_filtersfile.txt: Copied (new) 2024/04/26 03:28:02 (33) : bisync filters-file=/tmp/032753ne/workdir/測試_filtersfile.txt resync 2024/04/26 03:28:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:02 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/" 2024/04/26 03:28:02 INFO : Using filters file /tmp/032753ne/workdir/測試_filtersfile.txt 2024/04/26 03:28:02 INFO : Storing filters file hash to /tmp/032753ne/workdir/測試_filtersfile.txt.md5 2024/04/26 03:28:02 INFO : Copying Path2 files to Path1 2024/04/26 03:28:02 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:02 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:02 INFO : Resync updating listings 2024/04/26 03:28:02 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/" 2024/04/26 03:28:02 INFO : Bisync successful 2024/04/26 03:28:02 (34) : copy-as /tmp/032753ne/datadir/test_ext_paths-romozot1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/ fileZ.txt 2024/04/26 03:28:02 INFO : file1.txt: Copied (new) to: fileZ.txt 2024/04/26 03:28:02 (35) : bisync filters-file=/tmp/032753ne/workdir/測試_filtersfile.txt 2024/04/26 03:28:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:02 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/" 2024/04/26 03:28:02 INFO : Using filters file /tmp/032753ne/workdir/測試_filtersfile.txt 2024/04/26 03:28:02 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:02 INFO : Path1 checking for diffs 2024/04/26 03:28:02 INFO : Path2 checking for diffs 2024/04/26 03:28:02 INFO : No changes found 2024/04/26 03:28:02 INFO : Updating listings 2024/04/26 03:28:02 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ext_paths/path2/" 2024/04/26 03:28:02 INFO : Bisync successful bisync_test.go:553: TEST ext_paths PASSED === RUN TestBisyncRemoteRemote/extended_filenames 2024/04/26 03:28:02 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:02 DEBUG : path1: Making directory 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:02 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1" 2024/04/26 03:28:02 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:02 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:02 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1" 2024/04/26 03:28:02 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:02 DEBUG : path2: Making directory 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:02 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2" 2024/04/26 03:28:02 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:02 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:02 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2" 2024/04/26 03:28:02 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_extended_filenames-jexizuy7" 2024/04/26 03:28:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_: Making directory with metadata 2024/04/26 03:28:02 INFO : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:28:02 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_ 2024/04/26 03:28:02 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:02 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:02 DEBUG : file1 - Copy (2).txt.muluwab4.partial: renamed to: file1 - Copy (2).txt 2024/04/26 03:28:02 INFO : file1 - Copy (2).txt: Copied (new) 2024/04/26 03:28:02 DEBUG : file1 - Copy.txt.kaberiq7.partial: renamed to: file1 - Copy.txt 2024/04/26 03:28:02 INFO : file1 - Copy.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:02 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:02 DEBUG : Local file system at /tmp/032753ne/initdir/test_extended_filenames-jexizuy7: Waiting for checks to finish 2024/04/26 03:28:02 DEBUG : Local file system at /tmp/032753ne/initdir/test_extended_filenames-jexizuy7: Waiting for transfers to finish 2024/04/26 03:28:02 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:02 DEBUG : file1.txt.hetupir0.partial: renamed to: file1.txt 2024/04/26 03:28:02 INFO : file1.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : RCLONE_TEST.gokihaw9.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:02 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:02 DEBUG : file_enconde_mañana_funcionará.txt.puqites4.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/04/26 03:28:02 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:28:02 DEBUG : filename_contains_Ä›_.txt.nuceked3.partial: renamed to: filename_contains_Ä›_.txt 2024/04/26 03:28:02 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:28:02 DEBUG : РуÑÑкий.txt.bonuhif1.partial: renamed to: РуÑÑкий.txt 2024/04/26 03:28:02 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt.rovanow3.partial: renamed to: subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:28:02 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:28:02 DEBUG : filename_contains_ࢺ_.txt.tumifuc8.partial: renamed to: filename_contains_ࢺ_.txt 2024/04/26 03:28:02 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.huqafir8.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt 2024/04/26 03:28:02 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:02 INFO : subdir_with_ࢺ_: Set directory modification time (using SetModTime) 2024/04/26 03:28:02 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_extended_filenames-takomor2" 2024/04/26 03:28:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : Local file system at /tmp/032753ne/datadir/test_extended_filenames-takomor2: Waiting for checks to finish 2024/04/26 03:28:02 DEBUG : Local file system at /tmp/032753ne/datadir/test_extended_filenames-takomor2: Waiting for transfers to finish 2024/04/26 03:28:02 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:02 DEBUG : file2.txt: md5 = 40b811fb5009223b6da573f169619d8e OK 2024/04/26 03:28:02 DEBUG : file2.txt.jelalol3.partial: renamed to: file2.txt 2024/04/26 03:28:02 INFO : file2.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : file1.txt.zenaweh3.partial: renamed to: file1.txt 2024/04/26 03:28:02 INFO : file1.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1] 2024/04/26 03:28:02 ERROR : : error listing: directory not found 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2] 2024/04/26 03:28:02 ERROR : : error listing: directory not found 2024/04/26 03:28:02 checking initFs Local file system at /tmp/032753ne/initdir/test_extended_filenames-jexizuy7 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1] 2024/04/26 03:28:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_: Making directory 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/RCLONE_TEST] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/file1 - Copy (2).txt] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/file1 - Copy.txt] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/file1.txt] 2024/04/26 03:28:02 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: Waiting for checks to finish 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: Waiting for transfers to finish 2024/04/26 03:28:02 INFO : file1.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/file_enconde_mañana_funcionará.txt] 2024/04/26 03:28:02 INFO : file1 - Copy (2).txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/filename_contains_Ä›_.txt] 2024/04/26 03:28:02 INFO : file1 - Copy.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/filename_contains_ࢺ_.txt] 2024/04/26 03:28:02 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/РуÑÑкий.txt] 2024/04/26 03:28:02 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_Ä›_.txt] 2024/04/26 03:28:02 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ࢺ_.txt] 2024/04/26 03:28:02 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:02 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:28:02 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:02 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:02 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2] 2024/04/26 03:28:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/file1 - Copy (2).txt] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/file1 - Copy.txt] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/file1.txt] 2024/04/26 03:28:02 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_: Making directory 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_] 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/RCLONE_TEST] 2024/04/26 03:28:02 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: Waiting for checks to finish 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: Waiting for transfers to finish 2024/04/26 03:28:02 INFO : file1 - Copy (2).txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/file_enconde_mañana_funcionará.txt] 2024/04/26 03:28:02 INFO : file1 - Copy.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/filename_contains_Ä›_.txt] 2024/04/26 03:28:02 INFO : file1.txt: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/filename_contains_ࢺ_.txt] 2024/04/26 03:28:02 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/РуÑÑкий.txt] 2024/04/26 03:28:03 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_Ä›_.txt] 2024/04/26 03:28:03 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ࢺ_.txt] 2024/04/26 03:28:03 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:03 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:28:03 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:03 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:03 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2] 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_] 2024/04/26 03:28:03 (01) : test extended-filenames 2024/04/26 03:28:03 (02) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_/ 2024/04/26 03:28:03 (03) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_/ 2024/04/26 03:28:03 (04) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:28:03 (05) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:28:03 (06) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/РуÑÑкий.txt 2024/04/26 03:28:03 (07) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/РуÑÑкий.txt 2024/04/26 03:28:03 (08) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/file_enconde_mañana_funcionará.txt 2024/04/26 03:28:03 (09) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/file_enconde_mañana_funcionará.txt 2024/04/26 03:28:03 (10) : test initial bisync 2024/04/26 03:28:03 (11) : bisync resync 2024/04/26 03:28:03 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:28:03 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/04/26 03:28:03 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:03 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:03 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/" 2024/04/26 03:28:03 INFO : Copying Path2 files to Path1 2024/04/26 03:28:03 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:03 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:03 INFO : Resync updating listings 2024/04/26 03:28:03 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/" 2024/04/26 03:28:03 INFO : Bisync successful 2024/04/26 03:28:03 (12) : test place a newer files on both paths 2024/04/26 03:28:03 (13) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_extended_filenames-takomor2/ file1.txt 2024/04/26 03:28:03 (14) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_extended_filenames-takomor2/ file2.txt 2024/04/26 03:28:03 (15) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/ New_top_level_mañana_funcionará.txt 2024/04/26 03:28:03 INFO : file1.txt: Copied (new) to: New_top_level_mañana_funcionará.txt 2024/04/26 03:28:03 (16) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/ file_enconde_mañana_funcionará.txt 2024/04/26 03:28:03 INFO : file1.txt: Copied (replaced existing) to: file_enconde_mañana_funcionará.txt 2024/04/26 03:28:03 (17) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/ filename_contains_ࢺ_p1m.txt 2024/04/26 03:28:03 INFO : file1.txt: Copied (new) to: filename_contains_ࢺ_p1m.txt 2024/04/26 03:28:03 (18) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/ РуÑÑкий.txt 2024/04/26 03:28:03 INFO : file1.txt: Copied (replaced existing) to: РуÑÑкий.txt 2024/04/26 03:28:03 (19) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/ file1_with{spc}white{spc}space.txt 2024/04/26 03:28:03 INFO : file1.txt: Copied (new) to: file1_with white space.txt 2024/04/26 03:28:03 (20) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_ test.txt 2024/04/26 03:28:03 INFO : file1.txt: Copied (new) to: test.txt 2024/04/26 03:28:03 (21) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_ mañana_funcionará.txt 2024/04/26 03:28:03 INFO : file1.txt: Copied (new) to: mañana_funcionará.txt 2024/04/26 03:28:03 (22) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_ file_with_測試_.txt 2024/04/26 03:28:03 INFO : file1.txt: Copied (new) to: file_with_測試_.txt 2024/04/26 03:28:03 (23) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_ filename_contains_ࢺ_p2s.txt 2024/04/26 03:28:03 INFO : file1.txt: Copied (new) to: filename_contains_ࢺ_p2s.txt 2024/04/26 03:28:03 (24) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir{spc}with{eol}white{spc}space.txt file2{spc}with{eol}white{spc}space.txt 2024/04/26 03:28:03 INFO : file1.txt: Copied (new) to: file2 with white space.txt 2024/04/26 03:28:03 (25) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_rawchars_{chr:19}_{chr:81}_{chr:fe} file3_{chr:19}_{chr:81}_{chr:fe} 2024/04/26 03:28:03 INFO : file1.txt: Copied (new) to: file3___þ 2024/04/26 03:28:03 (26) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir{spc}with{eol}white{spc}space.txt/file2{spc}with{eol}white{spc}space.txt 2024/04/26 03:28:03 (27) : test place a new file on both paths 2024/04/26 03:28:03 (28) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_ filechangedbothpaths_ࢺ_.txt 2024/04/26 03:28:03 INFO : file2.txt: Copied (new) to: filechangedbothpaths_ࢺ_.txt 2024/04/26 03:28:03 (29) : touch-glob 2001-01-03 /tmp/032753ne/datadir/test_extended_filenames-takomor2/ file1.txt 2024/04/26 03:28:03 (30) : copy-as /tmp/032753ne/datadir/test_extended_filenames-takomor2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_ filechangedbothpaths_ࢺ_.txt 2024/04/26 03:28:03 INFO : file1.txt: Copied (new) to: filechangedbothpaths_ࢺ_.txt 2024/04/26 03:28:03 (31) : test delete files on both paths 2024/04/26 03:28:03 (32) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/filename_contains_ࢺ_.txt 2024/04/26 03:28:03 INFO : filename_contains_ࢺ_.txt: Deleted 2024/04/26 03:28:03 (33) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:28:03 INFO : filename_contains_Ä›_.txt: Deleted 2024/04/26 03:28:03 (34) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/РуÑÑкий.txt 2024/04/26 03:28:03 INFO : РуÑÑкий.txt: Deleted 2024/04/26 03:28:03 (35) : test bisync run 2024/04/26 03:28:03 (36) : bisync 2024/04/26 03:28:03 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:28:03 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/04/26 03:28:03 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:03 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:03 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/" 2024/04/26 03:28:03 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:03 INFO : Path1 checking for diffs 2024/04/26 03:28:03 INFO : - Path1 File was deleted - РуÑÑкий.txt 2024/04/26 03:28:03 INFO : - Path1 File is new - file1_with white space.txt 2024/04/26 03:28:03 INFO : - Path1 File is new - filename_contains_ࢺ_p1m.txt 2024/04/26 03:28:03 INFO : - Path1 File is new - subdir_with_ࢺ_/file_with_測試_.txt 2024/04/26 03:28:03 INFO : - Path1 File is new - subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt 2024/04/26 03:28:03 INFO : - Path1 File is new - subdir_with_ࢺ_/mañana_funcionará.txt 2024/04/26 03:28:03 INFO : - Path1 File is new - subdir_with_ࢺ_/test.txt 2024/04/26 03:28:03 INFO : Path1: 7 changes:  6 new,  0 modified,  1 deleted 2024/04/26 03:28:03 INFO : Path2 checking for diffs 2024/04/26 03:28:03 INFO : - Path2 File changed: size (larger), time (newer) - file_enconde_mañana_funcionará.txt 2024/04/26 03:28:03 INFO : - Path2 File was deleted - filename_contains_ࢺ_.txt 2024/04/26 03:28:03 INFO : - Path2 File was deleted - subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:28:03 INFO : - Path2 File changed: size (larger), time (newer) - РуÑÑкий.txt 2024/04/26 03:28:03 INFO : - Path2 File is new - New_top_level_mañana_funcionará.txt 2024/04/26 03:28:03 INFO : - Path2 File is new - subdir withâŠwhite space.txt/file2 withâŠwhite space.txt 2024/04/26 03:28:03 INFO : - Path2 File is new - "subdir_rawchars_â™_\x81_\xfe/file3_â™_\x81_\xfe" 2024/04/26 03:28:03 INFO : - Path2 File is new - subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt 2024/04/26 03:28:03 INFO : - Path2 File is new - subdir_with_ࢺ_/filename_contains_ࢺ_p2s.txt 2024/04/26 03:28:03 INFO : Path2: 9 changes:  5 new,  2 modified,  2 deleted 2024/04/26 03:28:03 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/04/26 03:28:03 INFO : Applying changes 2024/04/26 03:28:03 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/file1_with white space.txt 2024/04/26 03:28:03 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/filename_contains_ࢺ_p1m.txt 2024/04/26 03:28:03 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_/file_with_測試_.txt 2024/04/26 03:28:03 NOTICE: - WARNING New or changed in both paths - subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt 2024/04/26 03:28:03 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict1 2024/04/26 03:28:03 INFO : subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt: Moved (server-side) to: subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict1 2024/04/26 03:28:03 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict1 2024/04/26 03:28:03 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict2 2024/04/26 03:28:03 INFO : subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt: Moved (server-side) to: subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict2 2024/04/26 03:28:03 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict2 2024/04/26 03:28:03 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_/mañana_funcionará.txt 2024/04/26 03:28:03 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/subdir_with_ࢺ_/test.txt 2024/04/26 03:28:03 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/РуÑÑкий.txt 2024/04/26 03:28:03 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/New_top_level_mañana_funcionará.txt 2024/04/26 03:28:03 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/file_enconde_mañana_funcionará.txt 2024/04/26 03:28:03 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/filename_contains_ࢺ_.txt 2024/04/26 03:28:03 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir withâŠwhite space.txt/file2 withâŠwhite space.txt 2024/04/26 03:28:03 INFO : - Path2 Queue copy to Path1 - "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_rawchars_â™_\x81_\xfe/file3_â™_\x81_\xfe" 2024/04/26 03:28:03 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/04/26 03:28:03 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ࢺ_p2s.txt 2024/04/26 03:28:03 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:03 INFO : New_top_level_mañana_funcionará.txt: Copied (new) 2024/04/26 03:28:03 INFO : РуÑÑкий.txt: Copied (new) 2024/04/26 03:28:03 INFO : subdir_rawchars_â™__þ/file3_â™__þ: Copied (new) 2024/04/26 03:28:03 INFO : file_enconde_mañana_funcionará.txt: Copied (replaced existing) 2024/04/26 03:28:03 INFO : subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict2: Copied (new) 2024/04/26 03:28:03 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_p2s.txt: Copied (new) 2024/04/26 03:28:03 INFO : subdir withâŠwhite space.txt/file2 withâŠwhite space.txt: Copied (new) 2024/04/26 03:28:03 INFO : filename_contains_ࢺ_.txt: Deleted 2024/04/26 03:28:03 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Deleted 2024/04/26 03:28:03 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:03 INFO : file1_with white space.txt: Copied (new) 2024/04/26 03:28:03 INFO : filename_contains_ࢺ_p1m.txt: Copied (new) 2024/04/26 03:28:03 INFO : subdir_with_ࢺ_/file_with_測試_.txt: Copied (new) 2024/04/26 03:28:03 INFO : subdir_with_ࢺ_/mañana_funcionará.txt: Copied (new) 2024/04/26 03:28:03 INFO : subdir_with_ࢺ_/test.txt: Copied (new) 2024/04/26 03:28:03 INFO : subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict1: Copied (new) 2024/04/26 03:28:03 INFO : Updating listings 2024/04/26 03:28:03 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/extended_filenames/path2/" 2024/04/26 03:28:03 INFO : Bisync successful bisync_test.go:553: TEST extended_filenames PASSED === RUN TestBisyncRemoteRemote/filters 2024/04/26 03:28:03 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:03 DEBUG : path1: Making directory 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:03 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1" 2024/04/26 03:28:03 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:03 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:03 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:03 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:03 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:03 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:03 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1" 2024/04/26 03:28:03 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:03 DEBUG : path2: Making directory 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:03 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2" 2024/04/26 03:28:03 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:03 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:03 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:03 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:03 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:03 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:03 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2" 2024/04/26 03:28:03 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_filters-joselis0" 2024/04/26 03:28:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : subdir: Making directory with metadata 2024/04/26 03:28:03 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:28:03 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:28:03 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : Local file system at /tmp/032753ne/initdir/test_filters-joselis0: Waiting for checks to finish 2024/04/26 03:28:03 DEBUG : Local file system at /tmp/032753ne/initdir/test_filters-joselis0: Waiting for transfers to finish 2024/04/26 03:28:03 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:03 DEBUG : file2.txt.hiromow5.partial: renamed to: file2.txt 2024/04/26 03:28:03 INFO : file2.txt: Copied (new) 2024/04/26 03:28:03 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:03 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:03 DEBUG : file3.txt.pedipaz2.partial: renamed to: file3.txt 2024/04/26 03:28:03 INFO : file3.txt: Copied (new) 2024/04/26 03:28:03 DEBUG : file1.txt.xogugap5.partial: renamed to: file1.txt 2024/04/26 03:28:03 INFO : file1.txt: Copied (new) 2024/04/26 03:28:03 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:03 DEBUG : file4.txt.viluyut8.partial: renamed to: file4.txt 2024/04/26 03:28:03 INFO : file4.txt: Copied (new) 2024/04/26 03:28:03 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:03 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:03 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:03 DEBUG : RCLONE_TEST.cuqodoq1.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:03 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:03 DEBUG : file6.txt.kilahas1.partial: renamed to: file6.txt 2024/04/26 03:28:03 INFO : file6.txt: Copied (new) 2024/04/26 03:28:03 DEBUG : file5.txt.luhoweh3.partial: renamed to: file5.txt 2024/04/26 03:28:03 INFO : file5.txt: Copied (new) 2024/04/26 03:28:03 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:03 DEBUG : file7.txt.xakacap3.partial: renamed to: file7.txt 2024/04/26 03:28:03 INFO : file7.txt: Copied (new) 2024/04/26 03:28:03 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:03 DEBUG : subdir/file20.txt.ruzazah5.partial: renamed to: subdir/file20.txt 2024/04/26 03:28:03 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:03 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:28:03 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_filters-zegiqok7" 2024/04/26 03:28:03 DEBUG : fileZ.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : filtersfile.flt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : Local file system at /tmp/032753ne/datadir/test_filters-zegiqok7: Waiting for checks to finish 2024/04/26 03:28:03 DEBUG : Local file system at /tmp/032753ne/datadir/test_filters-zegiqok7: Waiting for transfers to finish 2024/04/26 03:28:03 DEBUG : fileZ.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:03 DEBUG : filtersfile.flt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/04/26 03:28:03 DEBUG : fileZ.txt.daxokuv4.partial: renamed to: fileZ.txt 2024/04/26 03:28:03 INFO : fileZ.txt: Copied (new) 2024/04/26 03:28:03 DEBUG : filtersfile.flt.magikoh0.partial: renamed to: filtersfile.flt 2024/04/26 03:28:03 INFO : filtersfile.flt: Copied (new) 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1] 2024/04/26 03:28:03 ERROR : : error listing: directory not found 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2] 2024/04/26 03:28:03 ERROR : : error listing: directory not found 2024/04/26 03:28:03 checking initFs Local file system at /tmp/032753ne/initdir/test_filters-joselis0 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1] 2024/04/26 03:28:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/file1.txt] 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/RCLONE_TEST] 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/file2.txt] 2024/04/26 03:28:03 DEBUG : subdir: Making directory 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/subdir] 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/file3.txt] 2024/04/26 03:28:03 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: Waiting for checks to finish 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: Waiting for transfers to finish 2024/04/26 03:28:03 INFO : file3.txt: Copied (new) 2024/04/26 03:28:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/file4.txt] 2024/04/26 03:28:04 INFO : file1.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/file5.txt] 2024/04/26 03:28:04 INFO : file2.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/file6.txt] 2024/04/26 03:28:04 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/file7.txt] 2024/04/26 03:28:04 INFO : file4.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/subdir/file20.txt] 2024/04/26 03:28:04 INFO : file5.txt: Copied (new) 2024/04/26 03:28:04 INFO : file6.txt: Copied (new) 2024/04/26 03:28:04 INFO : file7.txt: Copied (new) 2024/04/26 03:28:04 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:04 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/subdir] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2] 2024/04/26 03:28:04 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : subdir: Making directory 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/subdir] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/file1.txt] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/RCLONE_TEST] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/file2.txt] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/file3.txt] 2024/04/26 03:28:04 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: Waiting for checks to finish 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: Waiting for transfers to finish 2024/04/26 03:28:04 INFO : file1.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/file4.txt] 2024/04/26 03:28:04 INFO : file2.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/file5.txt] 2024/04/26 03:28:04 INFO : file3.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/file6.txt] 2024/04/26 03:28:04 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/file7.txt] 2024/04/26 03:28:04 INFO : file4.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/subdir/file20.txt] 2024/04/26 03:28:04 INFO : file5.txt: Copied (new) 2024/04/26 03:28:04 INFO : file6.txt: Copied (new) 2024/04/26 03:28:04 INFO : file7.txt: Copied (new) 2024/04/26 03:28:04 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:04 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/subdir] 2024/04/26 03:28:04 (01) : test filters 2024/04/26 03:28:04 (02) : copy-file /tmp/032753ne/datadir/test_filters-zegiqok7/filtersfile.flt /tmp/032753ne/workdir/ 2024/04/26 03:28:04 INFO : filtersfile.flt: Copied (new) 2024/04/26 03:28:04 (03) : test resync to force building of the filters md5 hash 2024/04/26 03:28:04 (04) : bisync filters-file=/tmp/032753ne/workdir/filtersfile.flt resync 2024/04/26 03:28:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:04 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/" 2024/04/26 03:28:04 INFO : Using filters file /tmp/032753ne/workdir/filtersfile.flt 2024/04/26 03:28:04 INFO : Storing filters file hash to /tmp/032753ne/workdir/filtersfile.flt.md5 2024/04/26 03:28:04 INFO : Copying Path2 files to Path1 2024/04/26 03:28:04 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:04 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:04 INFO : Resync updating listings 2024/04/26 03:28:04 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/" 2024/04/26 03:28:04 INFO : Bisync successful 2024/04/26 03:28:04 (05) : copy-listings resync 2024/04/26 03:28:04 (06) : test place new files on the remote 2024/04/26 03:28:04 (07) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_filters-zegiqok7/ fileZ.txt 2024/04/26 03:28:04 (08) : copy-as /tmp/032753ne/datadir/test_filters-zegiqok7/fileZ.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/ fileZ.txt 2024/04/26 03:28:04 INFO : fileZ.txt: Copied (new) 2024/04/26 03:28:04 (09) : copy-as /tmp/032753ne/datadir/test_filters-zegiqok7/fileZ.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/subdir fileZ.txt 2024/04/26 03:28:04 INFO : fileZ.txt: Copied (new) 2024/04/26 03:28:04 (10) : test bisync with filters-file. path2-side fileZ.txt will be filtered. 2024/04/26 03:28:04 (11) : bisync filters-file=/tmp/032753ne/workdir/filtersfile.flt 2024/04/26 03:28:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:04 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/" 2024/04/26 03:28:04 INFO : Using filters file /tmp/032753ne/workdir/filtersfile.flt 2024/04/26 03:28:04 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:04 INFO : Path1 checking for diffs 2024/04/26 03:28:04 INFO : - Path1 File is new - subdir/fileZ.txt 2024/04/26 03:28:04 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:28:04 INFO : Path2 checking for diffs 2024/04/26 03:28:04 INFO : Applying changes 2024/04/26 03:28:04 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/subdir/fileZ.txt 2024/04/26 03:28:04 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:04 INFO : subdir/fileZ.txt: Copied (new) 2024/04/26 03:28:04 INFO : Updating listings 2024/04/26 03:28:04 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filters/path2/" 2024/04/26 03:28:04 INFO : Bisync successful bisync_test.go:553: TEST filters PASSED === RUN TestBisyncRemoteRemote/filtersfile_checks 2024/04/26 03:28:04 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:04 DEBUG : path1: Making directory 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:04 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1" 2024/04/26 03:28:04 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:04 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:04 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1" 2024/04/26 03:28:04 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:04 DEBUG : path2: Making directory 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:04 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2" 2024/04/26 03:28:04 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:04 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:04 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2" 2024/04/26 03:28:04 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_filtersfile_checks-rayifoj9" 2024/04/26 03:28:04 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : subdir: Making directory with metadata 2024/04/26 03:28:04 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:28:04 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:28:04 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:04 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:04 DEBUG : file2.txt.dazaviy6.partial: renamed to: file2.txt 2024/04/26 03:28:04 DEBUG : file1.txt.fuyodey8.partial: renamed to: file1.txt 2024/04/26 03:28:04 INFO : file2.txt: Copied (new) 2024/04/26 03:28:04 INFO : file1.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : Local file system at /tmp/032753ne/initdir/test_filtersfile_checks-rayifoj9: Waiting for checks to finish 2024/04/26 03:28:04 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:04 DEBUG : Local file system at /tmp/032753ne/initdir/test_filtersfile_checks-rayifoj9: Waiting for transfers to finish 2024/04/26 03:28:04 DEBUG : subdir/file20.txt.hahuzor9.partial: renamed to: subdir/file20.txt 2024/04/26 03:28:04 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:04 DEBUG : RCLONE_TEST.covihod3.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:04 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:28:04 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_filtersfile_checks-fobequs1" 2024/04/26 03:28:04 DEBUG : filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : filtersfile2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : Local file system at /tmp/032753ne/datadir/test_filtersfile_checks-fobequs1: Waiting for checks to finish 2024/04/26 03:28:04 DEBUG : Local file system at /tmp/032753ne/datadir/test_filtersfile_checks-fobequs1: Waiting for transfers to finish 2024/04/26 03:28:04 DEBUG : filtersfile.txt: md5 = cbf4389cb34d9e160689d1578eb5707f OK 2024/04/26 03:28:04 DEBUG : filtersfile.txt.jaxesor0.partial: renamed to: filtersfile.txt 2024/04/26 03:28:04 INFO : filtersfile.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : filtersfile2.txt: md5 = 95acc1e3b5beda465d9b2cb32808588c OK 2024/04/26 03:28:04 DEBUG : filtersfile2.txt.layiwiz8.partial: renamed to: filtersfile2.txt 2024/04/26 03:28:04 INFO : filtersfile2.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:28:04 DEBUG : hold.txt.zeyoqiv9.partial: renamed to: hold.txt 2024/04/26 03:28:04 INFO : hold.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1] 2024/04/26 03:28:04 ERROR : : error listing: directory not found 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2] 2024/04/26 03:28:04 ERROR : : error listing: directory not found 2024/04/26 03:28:04 checking initFs Local file system at /tmp/032753ne/initdir/test_filtersfile_checks-rayifoj9 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1] 2024/04/26 03:28:04 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : subdir: Making directory 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/subdir] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/RCLONE_TEST] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/file2.txt] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/file1.txt] 2024/04/26 03:28:04 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/subdir/file20.txt] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1: Waiting for checks to finish 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1: Waiting for transfers to finish 2024/04/26 03:28:04 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:04 INFO : file2.txt: Copied (new) 2024/04/26 03:28:04 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:04 INFO : file1.txt: Copied (new) 2024/04/26 03:28:04 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/subdir] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2] 2024/04/26 03:28:04 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : subdir: Making directory 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/subdir] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/RCLONE_TEST] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/file1.txt] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/file2.txt] 2024/04/26 03:28:04 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/subdir/file20.txt] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2: Waiting for checks to finish 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2: Waiting for transfers to finish 2024/04/26 03:28:04 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:04 INFO : file1.txt: Copied (new) 2024/04/26 03:28:04 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:04 INFO : file2.txt: Copied (new) 2024/04/26 03:28:04 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/subdir] 2024/04/26 03:28:04 (01) : test filtersfile-checks 2024/04/26 03:28:04 (02) : test initial bisync 2024/04/26 03:28:04 (03) : bisync resync 2024/04/26 03:28:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:04 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/" 2024/04/26 03:28:04 INFO : Copying Path2 files to Path1 2024/04/26 03:28:04 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:04 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:04 INFO : Resync updating listings 2024/04/26 03:28:04 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/" 2024/04/26 03:28:04 INFO : Bisync successful 2024/04/26 03:28:04 (04) : test 1. inject filters file in workdir. 2024/04/26 03:28:04 (05) : copy-file /tmp/032753ne/datadir/test_filtersfile_checks-fobequs1/filtersfile.txt /tmp/032753ne/workdir/ 2024/04/26 03:28:04 INFO : filtersfile.txt: Copied (new) 2024/04/26 03:28:04 (06) : test 2. run with filters-file but without md5. should abort. 2024/04/26 03:28:04 (07) : bisync filters-file=/tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:04 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/" 2024/04/26 03:28:04 INFO : Using filters file /tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 ERROR : Bisync critical error: filters file md5 hash not found (must run --resync): /tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:28:04 Bisync error: bisync aborted 2024/04/26 03:28:04 (08) : test 3. run without filters-file. should be blocked due to prior abort. 2024/04/26 03:28:04 (09) : bisync 2024/04/26 03:28:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:04 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/" 2024/04/26 03:28:04 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/032753ne/workdir/TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_filtersfile_checks_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_filtersfile_checks_path2.path1.lst Path2: /tmp/032753ne/workdir/TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_filtersfile_checks_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_filtersfile_checks_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/032753ne/workdir" 2024/04/26 03:28:04 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:28:04 Bisync error: bisync aborted 2024/04/26 03:28:04 (10) : test 4. run with filters-file and resync. 2024/04/26 03:28:04 (11) : bisync filters-file=/tmp/032753ne/workdir/filtersfile.txt resync 2024/04/26 03:28:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:04 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/" 2024/04/26 03:28:04 INFO : Using filters file /tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 INFO : Storing filters file hash to /tmp/032753ne/workdir/filtersfile.txt.md5 2024/04/26 03:28:04 INFO : Copying Path2 files to Path1 2024/04/26 03:28:04 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:04 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:04 INFO : Resync updating listings 2024/04/26 03:28:04 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/" 2024/04/26 03:28:04 INFO : Bisync successful 2024/04/26 03:28:04 (12) : test 5. run with filters-file alone. should run. 2024/04/26 03:28:04 (13) : bisync filters-file=/tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:04 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/" 2024/04/26 03:28:04 INFO : Using filters file /tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:04 INFO : Path1 checking for diffs 2024/04/26 03:28:04 INFO : Path2 checking for diffs 2024/04/26 03:28:04 INFO : No changes found 2024/04/26 03:28:04 INFO : Updating listings 2024/04/26 03:28:04 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/" 2024/04/26 03:28:04 INFO : Bisync successful 2024/04/26 03:28:04 (14) : test 6. push changed filters-file to workdir. 2024/04/26 03:28:04 (15) : copy-as /tmp/032753ne/datadir/test_filtersfile_checks-fobequs1/filtersfile2.txt /tmp/032753ne/workdir/ filtersfile.txt 2024/04/26 03:28:04 INFO : filtersfile2.txt: Copied (replaced existing) to: filtersfile.txt 2024/04/26 03:28:04 (16) : test 7. run with filters-file alone. should abort. 2024/04/26 03:28:04 (17) : bisync filters-file=/tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:04 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/" 2024/04/26 03:28:04 INFO : Using filters file /tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:28:04 Bisync error: bisync aborted 2024/04/26 03:28:04 (18) : test 8. run with filters-file and resync and dry-run. should do the dry-run but still cause next non-resync run to abort. 2024/04/26 03:28:04 (19) : bisync filters-file=/tmp/032753ne/workdir/filtersfile.txt resync dry-run 2024/04/26 03:28:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:04 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/" 2024/04/26 03:28:04 INFO : Using filters file /tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 INFO : Skipped storing filters file hash to /tmp/032753ne/workdir/filtersfile.txt.md5 as --dry-run is set 2024/04/26 03:28:04 INFO : Copying Path2 files to Path1 2024/04/26 03:28:04 NOTICE: - Path2 Resync is copying files to - Path1 2024/04/26 03:28:04 NOTICE: - Path1 Resync is copying files to - Path2 2024/04/26 03:28:04 INFO : Resync updating listings 2024/04/26 03:28:04 INFO : Bisync successful 2024/04/26 03:28:04 (20) : test 9. run with filters-file alone. should abort. 2024/04/26 03:28:04 (21) : bisync filters-file=/tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:04 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/filtersfile_checks/path2/" 2024/04/26 03:28:04 INFO : Using filters file /tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/032753ne/workdir/filtersfile.txt 2024/04/26 03:28:04 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:28:04 Bisync error: bisync aborted bisync_test.go:553: TEST filtersfile_checks PASSED === RUN TestBisyncRemoteRemote/ignorelistingchecksum 2024/04/26 03:28:04 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:04 DEBUG : path1: Making directory 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:04 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1" 2024/04/26 03:28:04 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:04 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:04 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1" 2024/04/26 03:28:04 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:04 DEBUG : path2: Making directory 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:04 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2" 2024/04/26 03:28:04 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:04 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:04 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2" 2024/04/26 03:28:04 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_ignorelistingchecksum-vocoviq8" 2024/04/26 03:28:04 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : subdir: Making directory with metadata 2024/04/26 03:28:04 INFO : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/04/26 03:28:04 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:28:04 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : Local file system at /tmp/032753ne/initdir/test_ignorelistingchecksum-vocoviq8: Waiting for checks to finish 2024/04/26 03:28:04 DEBUG : Local file system at /tmp/032753ne/initdir/test_ignorelistingchecksum-vocoviq8: Waiting for transfers to finish 2024/04/26 03:28:04 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:04 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:04 DEBUG : file1.copy1.txt.zareqam5.partial: renamed to: file1.copy1.txt 2024/04/26 03:28:04 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:04 DEBUG : file1.copy2.txt.yugahit5.partial: renamed to: file1.copy2.txt 2024/04/26 03:28:04 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:04 DEBUG : file1.copy3.txt.rebiwap5.partial: renamed to: file1.copy3.txt 2024/04/26 03:28:04 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : file1.copy4.txt.rijuyew3.partial: renamed to: file1.copy4.txt 2024/04/26 03:28:04 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:04 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:04 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:04 DEBUG : RCLONE_TEST.zumaqet4.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:04 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:04 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:04 DEBUG : subdir/file20.txt.fohosun2.partial: renamed to: subdir/file20.txt 2024/04/26 03:28:04 DEBUG : file1.txt.wovikaw5.partial: renamed to: file1.txt 2024/04/26 03:28:04 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:04 INFO : file1.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : file1.copy5.txt.qotibip5.partial: renamed to: file1.copy5.txt 2024/04/26 03:28:04 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:28:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:28:04 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_ignorelistingchecksum-fuxinul5" 2024/04/26 03:28:04 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : Local file system at /tmp/032753ne/datadir/test_ignorelistingchecksum-fuxinul5: Waiting for checks to finish 2024/04/26 03:28:04 DEBUG : Local file system at /tmp/032753ne/datadir/test_ignorelistingchecksum-fuxinul5: Waiting for transfers to finish 2024/04/26 03:28:04 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:04 DEBUG : file1.txt.jemekan0.partial: renamed to: file1.txt 2024/04/26 03:28:04 INFO : file1.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1] 2024/04/26 03:28:04 ERROR : : error listing: directory not found 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2] 2024/04/26 03:28:04 ERROR : : error listing: directory not found 2024/04/26 03:28:04 checking initFs Local file system at /tmp/032753ne/initdir/test_ignorelistingchecksum-vocoviq8 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1] 2024/04/26 03:28:04 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : subdir: Making directory 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/subdir] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/file1.copy1.txt] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/RCLONE_TEST] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/file1.copy2.txt] 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/file1.copy3.txt] 2024/04/26 03:28:04 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: Waiting for checks to finish 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: Waiting for transfers to finish 2024/04/26 03:28:04 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/file1.copy4.txt] 2024/04/26 03:28:04 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/file1.copy5.txt] 2024/04/26 03:28:04 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/file1.txt] 2024/04/26 03:28:04 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:28:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/subdir/file20.txt] 2024/04/26 03:28:04 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:28:04 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:28:05 INFO : file1.txt: Copied (new) 2024/04/26 03:28:05 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:05 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/subdir] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2] 2024/04/26 03:28:05 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/RCLONE_TEST] 2024/04/26 03:28:05 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : subdir: Making directory 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/subdir] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/file1.copy1.txt] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/file1.copy2.txt] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/file1.copy3.txt] 2024/04/26 03:28:05 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: Waiting for checks to finish 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: Waiting for transfers to finish 2024/04/26 03:28:05 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/file1.copy4.txt] 2024/04/26 03:28:05 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/file1.copy5.txt] 2024/04/26 03:28:05 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/file1.txt] 2024/04/26 03:28:05 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/subdir/file20.txt] 2024/04/26 03:28:05 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:28:05 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:28:05 INFO : file1.txt: Copied (new) 2024/04/26 03:28:05 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:05 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/subdir] 2024/04/26 03:28:05 (01) : test basic 2024/04/26 03:28:05 (02) : test initial bisync 2024/04/26 03:28:05 (03) : bisync resync 2024/04/26 03:28:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:05 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/" 2024/04/26 03:28:05 INFO : Copying Path2 files to Path1 2024/04/26 03:28:05 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:05 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:05 INFO : Resync updating listings 2024/04/26 03:28:05 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/" 2024/04/26 03:28:05 INFO : Bisync successful 2024/04/26 03:28:05 (04) : bisync resync ignore-listing-checksum 2024/04/26 03:28:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:05 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/" 2024/04/26 03:28:05 INFO : Copying Path2 files to Path1 2024/04/26 03:28:05 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:05 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:05 INFO : Resync updating listings 2024/04/26 03:28:05 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/" 2024/04/26 03:28:05 INFO : Bisync successful 2024/04/26 03:28:05 (05) : test place newer files on both paths 2024/04/26 03:28:05 (06) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_ignorelistingchecksum-fuxinul5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/ 2024/04/26 03:28:05 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:05 (07) : copy-as /tmp/032753ne/datadir/test_ignorelistingchecksum-fuxinul5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/subdir file20.txt 2024/04/26 03:28:05 INFO : file1.txt: Copied (replaced existing) to: file20.txt 2024/04/26 03:28:05 (08) : test bisync run 2024/04/26 03:28:05 (09) : bisync ignore-listing-checksum 2024/04/26 03:28:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:05 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/" 2024/04/26 03:28:05 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:05 INFO : Path1 checking for diffs 2024/04/26 03:28:05 INFO : - Path1 File changed: size (larger), time (newer) - subdir/file20.txt 2024/04/26 03:28:05 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:28:05 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:28:05 INFO : Path2 checking for diffs 2024/04/26 03:28:05 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:28:05 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:28:05 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:28:05 INFO : Applying changes 2024/04/26 03:28:05 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/subdir/file20.txt 2024/04/26 03:28:05 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/file1.txt 2024/04/26 03:28:05 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:05 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:05 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:05 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:28:05 INFO : Updating listings 2024/04/26 03:28:05 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/ignorelistingchecksum/path2/" 2024/04/26 03:28:05 INFO : Bisync successful bisync_test.go:553: TEST ignorelistingchecksum PASSED === RUN TestBisyncRemoteRemote/max_delete_path1 2024/04/26 03:28:05 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:05 DEBUG : path1: Making directory 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:05 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1" 2024/04/26 03:28:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:05 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1" 2024/04/26 03:28:05 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:05 DEBUG : path2: Making directory 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:05 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2" 2024/04/26 03:28:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:05 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2" 2024/04/26 03:28:05 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_max_delete_path1-jurizil6" 2024/04/26 03:28:05 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : Local file system at /tmp/032753ne/initdir/test_max_delete_path1-jurizil6: Waiting for checks to finish 2024/04/26 03:28:05 DEBUG : Local file system at /tmp/032753ne/initdir/test_max_delete_path1-jurizil6: Waiting for transfers to finish 2024/04/26 03:28:05 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file1.txt.kizoviv3.partial: renamed to: file1.txt 2024/04/26 03:28:05 INFO : file1.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file2.txt.zuhiyaj8.partial: renamed to: file2.txt 2024/04/26 03:28:05 INFO : file2.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file3.txt.lomosik2.partial: renamed to: file3.txt 2024/04/26 03:28:05 INFO : file3.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file4.txt.mirixed1.partial: renamed to: file4.txt 2024/04/26 03:28:05 INFO : file4.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file5.txt.xiziqor7.partial: renamed to: file5.txt 2024/04/26 03:28:05 INFO : file5.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file6.txt.yasekak9.partial: renamed to: file6.txt 2024/04/26 03:28:05 INFO : file6.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file7.txt.tovipel2.partial: renamed to: file7.txt 2024/04/26 03:28:05 INFO : file7.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file8.txt.munupud6.partial: renamed to: file8.txt 2024/04/26 03:28:05 INFO : file8.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:05 DEBUG : file9.txt.jedojak3.partial: renamed to: file9.txt 2024/04/26 03:28:05 INFO : file9.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_max_delete_path1-gisonat7" 2024/04/26 03:28:05 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : Local file system at /tmp/032753ne/datadir/test_max_delete_path1-gisonat7: Waiting for checks to finish 2024/04/26 03:28:05 DEBUG : Local file system at /tmp/032753ne/datadir/test_max_delete_path1-gisonat7: Waiting for transfers to finish 2024/04/26 03:28:05 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:28:05 DEBUG : hold.txt.turexog0.partial: renamed to: hold.txt 2024/04/26 03:28:05 INFO : hold.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1] 2024/04/26 03:28:05 ERROR : : error listing: directory not found 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2] 2024/04/26 03:28:05 ERROR : : error listing: directory not found 2024/04/26 03:28:05 checking initFs Local file system at /tmp/032753ne/initdir/test_max_delete_path1-jurizil6 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1] 2024/04/26 03:28:05 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file1.txt] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: Waiting for checks to finish 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: Waiting for transfers to finish 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file4.txt] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file2.txt] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file3.txt] 2024/04/26 03:28:05 INFO : file1.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file5.txt] 2024/04/26 03:28:05 INFO : file4.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file6.txt] 2024/04/26 03:28:05 INFO : file3.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file7.txt] 2024/04/26 03:28:05 INFO : file2.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file8.txt] 2024/04/26 03:28:05 INFO : file5.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file9.txt] 2024/04/26 03:28:05 INFO : file6.txt: Copied (new) 2024/04/26 03:28:05 INFO : file7.txt: Copied (new) 2024/04/26 03:28:05 INFO : file8.txt: Copied (new) 2024/04/26 03:28:05 INFO : file9.txt: Copied (new) 2024/04/26 03:28:05 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2] 2024/04/26 03:28:05 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file2.txt] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file1.txt] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: Waiting for checks to finish 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file4.txt] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: Waiting for transfers to finish 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file3.txt] 2024/04/26 03:28:05 INFO : file2.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file5.txt] 2024/04/26 03:28:05 INFO : file1.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file6.txt] 2024/04/26 03:28:05 INFO : file4.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file7.txt] 2024/04/26 03:28:05 INFO : file3.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file8.txt] 2024/04/26 03:28:05 INFO : file5.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file9.txt] 2024/04/26 03:28:05 INFO : file6.txt: Copied (new) 2024/04/26 03:28:05 INFO : file7.txt: Copied (new) 2024/04/26 03:28:05 INFO : file8.txt: Copied (new) 2024/04/26 03:28:05 INFO : file9.txt: Copied (new) 2024/04/26 03:28:05 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2] 2024/04/26 03:28:05 (01) : test max-delete-path1 2024/04/26 03:28:05 (02) : test initial bisync 2024/04/26 03:28:05 (03) : bisync resync 2024/04/26 03:28:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:05 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/" 2024/04/26 03:28:05 INFO : Copying Path2 files to Path1 2024/04/26 03:28:05 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:05 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:05 INFO : Resync updating listings 2024/04/26 03:28:05 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/" 2024/04/26 03:28:05 INFO : Bisync successful 2024/04/26 03:28:05 (04) : test delete >50% of local files 2024/04/26 03:28:05 (05) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file1.txt 2024/04/26 03:28:05 INFO : file1.txt: Deleted 2024/04/26 03:28:05 (06) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file2.txt 2024/04/26 03:28:05 INFO : file2.txt: Deleted 2024/04/26 03:28:05 (07) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file3.txt 2024/04/26 03:28:05 INFO : file3.txt: Deleted 2024/04/26 03:28:05 (08) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file4.txt 2024/04/26 03:28:05 INFO : file4.txt: Deleted 2024/04/26 03:28:05 (09) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/file5.txt 2024/04/26 03:28:05 INFO : file5.txt: Deleted 2024/04/26 03:28:05 (10) : test sync should fail due to too many local deletes 2024/04/26 03:28:05 (11) : bisync 2024/04/26 03:28:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:05 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/" 2024/04/26 03:28:05 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:05 INFO : Path1 checking for diffs 2024/04/26 03:28:05 INFO : - Path1 File was deleted - file1.txt 2024/04/26 03:28:05 INFO : - Path1 File was deleted - file2.txt 2024/04/26 03:28:05 INFO : - Path1 File was deleted - file3.txt 2024/04/26 03:28:05 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:28:05 INFO : - Path1 File was deleted - file5.txt 2024/04/26 03:28:05 INFO : Path1: 5 changes:  0 new,  0 modified,  5 deleted 2024/04/26 03:28:05 INFO : Path2 checking for diffs 2024/04/26 03:28:05 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/". Run with --force if desired. 2024/04/26 03:28:05 NOTICE: Bisync aborted. Please try again. 2024/04/26 03:28:05 Bisync error: too many deletes 2024/04/26 03:28:05 (12) : copy-listings initial-fail 2024/04/26 03:28:05 (13) : test change max-delete limit to 60%. sync should run. 2024/04/26 03:28:05 (14) : bisync max-delete=60 2024/04/26 03:28:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:05 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/" 2024/04/26 03:28:05 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:05 INFO : Path1 checking for diffs 2024/04/26 03:28:05 INFO : - Path1 File was deleted - file1.txt 2024/04/26 03:28:05 INFO : - Path1 File was deleted - file2.txt 2024/04/26 03:28:05 INFO : - Path1 File was deleted - file3.txt 2024/04/26 03:28:05 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:28:05 INFO : - Path1 File was deleted - file5.txt 2024/04/26 03:28:05 INFO : Path1: 5 changes:  0 new,  0 modified,  5 deleted 2024/04/26 03:28:05 INFO : Path2 checking for diffs 2024/04/26 03:28:05 INFO : Applying changes 2024/04/26 03:28:05 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file1.txt 2024/04/26 03:28:05 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file2.txt 2024/04/26 03:28:05 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file3.txt 2024/04/26 03:28:05 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file4.txt 2024/04/26 03:28:05 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/file5.txt 2024/04/26 03:28:05 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:05 INFO : file1.txt: Deleted 2024/04/26 03:28:05 INFO : file2.txt: Deleted 2024/04/26 03:28:05 INFO : file3.txt: Deleted 2024/04/26 03:28:05 INFO : file4.txt: Deleted 2024/04/26 03:28:05 INFO : file5.txt: Deleted 2024/04/26 03:28:05 INFO : Updating listings 2024/04/26 03:28:05 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path1/path2/" 2024/04/26 03:28:05 INFO : Bisync successful bisync_test.go:553: TEST max_delete_path1 PASSED === RUN TestBisyncRemoteRemote/max_delete_path2_force 2024/04/26 03:28:05 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:05 DEBUG : path1: Making directory 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:05 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1" 2024/04/26 03:28:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:05 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1" 2024/04/26 03:28:05 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:05 DEBUG : path2: Making directory 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:05 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2" 2024/04/26 03:28:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:05 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2" 2024/04/26 03:28:05 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_max_delete_path2_force-togecoy6" 2024/04/26 03:28:05 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : Local file system at /tmp/032753ne/initdir/test_max_delete_path2_force-togecoy6: Waiting for checks to finish 2024/04/26 03:28:05 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file1.txt.xaqasat4.partial: renamed to: file1.txt 2024/04/26 03:28:05 INFO : file1.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : Local file system at /tmp/032753ne/initdir/test_max_delete_path2_force-togecoy6: Waiting for transfers to finish 2024/04/26 03:28:05 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file3.txt.qeqarus0.partial: renamed to: file3.txt 2024/04/26 03:28:05 INFO : file3.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file2.txt.roqumaq2.partial: renamed to: file2.txt 2024/04/26 03:28:05 INFO : file2.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file5.txt.cizezex2.partial: renamed to: file5.txt 2024/04/26 03:28:05 INFO : file5.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file6.txt.dufozaf7.partial: renamed to: file6.txt 2024/04/26 03:28:05 INFO : file6.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:05 DEBUG : file7.txt.pixunoz6.partial: renamed to: file7.txt 2024/04/26 03:28:05 INFO : file7.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file4.txt.relumov2.partial: renamed to: file4.txt 2024/04/26 03:28:05 INFO : file4.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file8.txt.gigexuv1.partial: renamed to: file8.txt 2024/04/26 03:28:05 INFO : file8.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:05 DEBUG : file9.txt.kawobog3.partial: renamed to: file9.txt 2024/04/26 03:28:05 INFO : file9.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_max_delete_path2_force-karimot0" 2024/04/26 03:28:05 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : Local file system at /tmp/032753ne/datadir/test_max_delete_path2_force-karimot0: Waiting for checks to finish 2024/04/26 03:28:05 DEBUG : Local file system at /tmp/032753ne/datadir/test_max_delete_path2_force-karimot0: Waiting for transfers to finish 2024/04/26 03:28:05 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/04/26 03:28:05 DEBUG : hold.txt.zonobiv4.partial: renamed to: hold.txt 2024/04/26 03:28:05 INFO : hold.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1] 2024/04/26 03:28:05 ERROR : : error listing: directory not found 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2] 2024/04/26 03:28:05 ERROR : : error listing: directory not found 2024/04/26 03:28:05 checking initFs Local file system at /tmp/032753ne/initdir/test_max_delete_path2_force-togecoy6 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1] 2024/04/26 03:28:05 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file1.txt] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file2.txt] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file4.txt] 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: Waiting for checks to finish 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: Waiting for transfers to finish 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file3.txt] 2024/04/26 03:28:05 INFO : file1.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file5.txt] 2024/04/26 03:28:05 INFO : file2.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file6.txt] 2024/04/26 03:28:05 INFO : file4.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file7.txt] 2024/04/26 03:28:05 INFO : file3.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file8.txt] 2024/04/26 03:28:05 INFO : file5.txt: Copied (new) 2024/04/26 03:28:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file9.txt] 2024/04/26 03:28:05 INFO : file6.txt: Copied (new) 2024/04/26 03:28:06 INFO : file7.txt: Copied (new) 2024/04/26 03:28:06 INFO : file8.txt: Copied (new) 2024/04/26 03:28:06 INFO : file9.txt: Copied (new) 2024/04/26 03:28:06 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1] 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2] 2024/04/26 03:28:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file1.txt] 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: Waiting for checks to finish 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: Waiting for transfers to finish 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file3.txt] 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file2.txt] 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file4.txt] 2024/04/26 03:28:06 INFO : file1.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file5.txt] 2024/04/26 03:28:06 INFO : file3.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file6.txt] 2024/04/26 03:28:06 INFO : file2.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file7.txt] 2024/04/26 03:28:06 INFO : file4.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file8.txt] 2024/04/26 03:28:06 INFO : file5.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file9.txt] 2024/04/26 03:28:06 INFO : file6.txt: Copied (new) 2024/04/26 03:28:06 INFO : file7.txt: Copied (new) 2024/04/26 03:28:06 INFO : file8.txt: Copied (new) 2024/04/26 03:28:06 INFO : file9.txt: Copied (new) 2024/04/26 03:28:06 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2] 2024/04/26 03:28:06 (01) : test max-delete-path2-force 2024/04/26 03:28:06 (02) : test initial bisync 2024/04/26 03:28:06 (03) : bisync resync 2024/04/26 03:28:06 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:06 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/" 2024/04/26 03:28:06 INFO : Copying Path2 files to Path1 2024/04/26 03:28:06 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:06 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:06 INFO : Resync updating listings 2024/04/26 03:28:06 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/" 2024/04/26 03:28:06 INFO : Bisync successful 2024/04/26 03:28:06 (04) : test delete >50% of remote files 2024/04/26 03:28:06 (05) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file1.txt 2024/04/26 03:28:06 INFO : file1.txt: Deleted 2024/04/26 03:28:06 (06) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file2.txt 2024/04/26 03:28:06 INFO : file2.txt: Deleted 2024/04/26 03:28:06 (07) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file3.txt 2024/04/26 03:28:06 INFO : file3.txt: Deleted 2024/04/26 03:28:06 (08) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file4.txt 2024/04/26 03:28:06 INFO : file4.txt: Deleted 2024/04/26 03:28:06 (09) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/file5.txt 2024/04/26 03:28:06 INFO : file5.txt: Deleted 2024/04/26 03:28:06 (10) : test sync should fail due to too many path2 deletes 2024/04/26 03:28:06 (11) : bisync 2024/04/26 03:28:06 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:06 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/" 2024/04/26 03:28:06 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:06 INFO : Path1 checking for diffs 2024/04/26 03:28:06 INFO : Path2 checking for diffs 2024/04/26 03:28:06 INFO : - Path2 File was deleted - file1.txt 2024/04/26 03:28:06 INFO : - Path2 File was deleted - file2.txt 2024/04/26 03:28:06 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:28:06 INFO : - Path2 File was deleted - file4.txt 2024/04/26 03:28:06 INFO : - Path2 File was deleted - file5.txt 2024/04/26 03:28:06 INFO : Path2: 5 changes:  0 new,  0 modified,  5 deleted 2024/04/26 03:28:06 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/". Run with --force if desired. 2024/04/26 03:28:06 NOTICE: Bisync aborted. Please try again. 2024/04/26 03:28:06 Bisync error: too many deletes 2024/04/26 03:28:06 (12) : copy-listings initial-fail 2024/04/26 03:28:06 (13) : test apply force option. sync should run. 2024/04/26 03:28:06 (14) : bisync force 2024/04/26 03:28:06 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:06 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/" 2024/04/26 03:28:06 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:06 INFO : Path1 checking for diffs 2024/04/26 03:28:06 INFO : Path2 checking for diffs 2024/04/26 03:28:06 INFO : - Path2 File was deleted - file1.txt 2024/04/26 03:28:06 INFO : - Path2 File was deleted - file2.txt 2024/04/26 03:28:06 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:28:06 INFO : - Path2 File was deleted - file4.txt 2024/04/26 03:28:06 INFO : - Path2 File was deleted - file5.txt 2024/04/26 03:28:06 INFO : Path2: 5 changes:  0 new,  0 modified,  5 deleted 2024/04/26 03:28:06 INFO : Applying changes 2024/04/26 03:28:06 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file1.txt 2024/04/26 03:28:06 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file2.txt 2024/04/26 03:28:06 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file3.txt 2024/04/26 03:28:06 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file4.txt 2024/04/26 03:28:06 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/file5.txt 2024/04/26 03:28:06 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:06 INFO : file1.txt: Deleted 2024/04/26 03:28:06 INFO : file2.txt: Deleted 2024/04/26 03:28:06 INFO : file3.txt: Deleted 2024/04/26 03:28:06 INFO : file5.txt: Deleted 2024/04/26 03:28:06 INFO : file4.txt: Deleted 2024/04/26 03:28:06 INFO : Updating listings 2024/04/26 03:28:06 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/max_delete_path2_force/path2/" 2024/04/26 03:28:06 INFO : Bisync successful bisync_test.go:553: TEST max_delete_path2_force PASSED === RUN TestBisyncRemoteRemote/nomodtime 2024/04/26 03:28:06 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:06 DEBUG : path1: Making directory 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:06 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1" 2024/04/26 03:28:06 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:06 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:06 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:06 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:06 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:06 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:06 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1" 2024/04/26 03:28:06 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:06 DEBUG : path2: Making directory 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:06 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2" 2024/04/26 03:28:06 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:06 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:06 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:06 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:06 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:06 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:06 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2" 2024/04/26 03:28:06 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_nomodtime-livoyig4" 2024/04/26 03:28:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : Local file system at /tmp/032753ne/initdir/test_nomodtime-livoyig4: Waiting for checks to finish 2024/04/26 03:28:06 DEBUG : Local file system at /tmp/032753ne/initdir/test_nomodtime-livoyig4: Waiting for transfers to finish 2024/04/26 03:28:06 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:06 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:06 DEBUG : file2.txt.fugejef3.partial: renamed to: file2.txt 2024/04/26 03:28:06 INFO : file2.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : file3.txt.zalunas6.partial: renamed to: file3.txt 2024/04/26 03:28:06 INFO : file3.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:06 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:06 DEBUG : file1.txt.wetexiz1.partial: renamed to: file1.txt 2024/04/26 03:28:06 INFO : file1.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:06 DEBUG : file4.txt.peyepat4.partial: renamed to: file4.txt 2024/04/26 03:28:06 INFO : file4.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : file5.txt.sagitet7.partial: renamed to: file5.txt 2024/04/26 03:28:06 INFO : file5.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:06 DEBUG : file7.txt.qedugus6.partial: renamed to: file7.txt 2024/04/26 03:28:06 INFO : file7.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:06 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:06 DEBUG : RCLONE_TEST.tibenuq3.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:06 DEBUG : file8.txt.bigehow0.partial: renamed to: file8.txt 2024/04/26 03:28:06 INFO : file8.txt: Copied (new) 2024/04/26 03:28:06 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:06 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:06 DEBUG : file6.txt.wudazop9.partial: renamed to: file6.txt 2024/04/26 03:28:06 INFO : file6.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_nomodtime-pimokav6" 2024/04/26 03:28:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : Local file system at /tmp/032753ne/datadir/test_nomodtime-pimokav6: Waiting for checks to finish 2024/04/26 03:28:06 DEBUG : Local file system at /tmp/032753ne/datadir/test_nomodtime-pimokav6: Waiting for transfers to finish 2024/04/26 03:28:06 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:06 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:06 DEBUG : file10.txt.kugiqul5.partial: renamed to: file10.txt 2024/04/26 03:28:06 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:06 INFO : file10.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : file1.txt.yepomeh2.partial: renamed to: file1.txt 2024/04/26 03:28:06 INFO : file1.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : file11.txt.ragipaz5.partial: renamed to: file11.txt 2024/04/26 03:28:06 INFO : file11.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:28:06 DEBUG : file5L.txt.nikisuf9.partial: renamed to: file5L.txt 2024/04/26 03:28:06 INFO : file5L.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:28:06 DEBUG : file2.txt.nonihoz5.partial: renamed to: file2.txt 2024/04/26 03:28:06 INFO : file2.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:06 DEBUG : file6.txt.panuzeb5.partial: renamed to: file6.txt 2024/04/26 03:28:06 INFO : file6.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:28:06 DEBUG : file5R.txt.nufeluy2.partial: renamed to: file5R.txt 2024/04/26 03:28:06 INFO : file5R.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:06 DEBUG : file7.txt.kuliwin9.partial: renamed to: file7.txt 2024/04/26 03:28:06 INFO : file7.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1] 2024/04/26 03:28:06 ERROR : : error listing: directory not found 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2] 2024/04/26 03:28:06 ERROR : : error listing: directory not found 2024/04/26 03:28:06 checking initFs Local file system at /tmp/032753ne/initdir/test_nomodtime-livoyig4 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1] 2024/04/26 03:28:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/RCLONE_TEST] 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file1.txt] 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: Waiting for checks to finish 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: Waiting for transfers to finish 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file2.txt] 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file3.txt] 2024/04/26 03:28:06 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file4.txt] 2024/04/26 03:28:06 INFO : file1.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file5.txt] 2024/04/26 03:28:06 INFO : file2.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file6.txt] 2024/04/26 03:28:06 INFO : file3.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file7.txt] 2024/04/26 03:28:06 INFO : file4.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file8.txt] 2024/04/26 03:28:06 INFO : file5.txt: Copied (new) 2024/04/26 03:28:06 INFO : file6.txt: Copied (new) 2024/04/26 03:28:06 INFO : file7.txt: Copied (new) 2024/04/26 03:28:06 INFO : file8.txt: Copied (new) 2024/04/26 03:28:06 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1] 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2] 2024/04/26 03:28:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file1.txt] 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/RCLONE_TEST] 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file2.txt] 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: Waiting for checks to finish 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: Waiting for transfers to finish 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file3.txt] 2024/04/26 03:28:06 INFO : file1.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file4.txt] 2024/04/26 03:28:06 INFO : file2.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file5.txt] 2024/04/26 03:28:06 INFO : file3.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file6.txt] 2024/04/26 03:28:06 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file7.txt] 2024/04/26 03:28:06 INFO : file4.txt: Copied (new) 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file8.txt] 2024/04/26 03:28:06 INFO : file5.txt: Copied (new) 2024/04/26 03:28:06 INFO : file6.txt: Copied (new) 2024/04/26 03:28:06 INFO : file7.txt: Copied (new) 2024/04/26 03:28:06 INFO : file8.txt: Copied (new) 2024/04/26 03:28:06 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2 2024/04/26 03:28:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2] 2024/04/26 03:28:06 (01) : test changes 2024/04/26 03:28:06 (02) : test initial bisync 2024/04/26 03:28:06 (03) : bisync resync nomodtime 2024/04/26 03:28:06 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/04/26 03:28:06 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/" 2024/04/26 03:28:06 INFO : Copying Path2 files to Path1 2024/04/26 03:28:06 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:06 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:28:06 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:06 INFO : Resync updating listings 2024/04/26 03:28:06 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/" 2024/04/26 03:28:06 INFO : Bisync successful 2024/04/26 03:28:06 (04) : test make modifications on both paths 2024/04/26 03:28:06 (05) : test new on path2 - file10 2024/04/26 03:28:06 (06) : copy-file /tmp/032753ne/datadir/test_nomodtime-pimokav6/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/ 2024/04/26 03:28:06 INFO : file10.txt: Copied (new) 2024/04/26 03:28:06 (07) : test changed on path2 - file1 2024/04/26 03:28:06 (08) : copy-file /tmp/032753ne/datadir/test_nomodtime-pimokav6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/ 2024/04/26 03:28:06 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:06 (09) : test new on path1 - file11 2024/04/26 03:28:06 (10) : copy-file /tmp/032753ne/datadir/test_nomodtime-pimokav6/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/ 2024/04/26 03:28:06 INFO : file11.txt: Copied (new) 2024/04/26 03:28:06 (11) : test changed on path1 - file2 2024/04/26 03:28:06 (12) : copy-file /tmp/032753ne/datadir/test_nomodtime-pimokav6/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/ 2024/04/26 03:28:06 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:06 (13) : test deleted on path2 - file3 2024/04/26 03:28:06 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file3.txt 2024/04/26 03:28:06 INFO : file3.txt: Deleted 2024/04/26 03:28:06 (15) : test deleted on path1 - file4 2024/04/26 03:28:06 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file4.txt 2024/04/26 03:28:06 INFO : file4.txt: Deleted 2024/04/26 03:28:06 (17) : test deleted on both paths - file8 2024/04/26 03:28:06 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file8.txt 2024/04/26 03:28:06 INFO : file8.txt: Deleted 2024/04/26 03:28:06 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file8.txt 2024/04/26 03:28:06 INFO : file8.txt: Deleted 2024/04/26 03:28:06 (20) : test changed on both paths - file5 (file5R, file5L) 2024/04/26 03:28:06 (21) : copy-as /tmp/032753ne/datadir/test_nomodtime-pimokav6/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/ file5.txt 2024/04/26 03:28:06 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:28:06 (22) : copy-as /tmp/032753ne/datadir/test_nomodtime-pimokav6/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/ file5.txt 2024/04/26 03:28:06 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:28:06 (23) : test changed on path2 and deleted on path1 - file6 2024/04/26 03:28:06 (24) : copy-file /tmp/032753ne/datadir/test_nomodtime-pimokav6/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/ 2024/04/26 03:28:06 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:28:06 (25) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file6.txt 2024/04/26 03:28:06 INFO : file6.txt: Deleted 2024/04/26 03:28:06 (26) : test changed on path1 and deleted on path2 - file7 2024/04/26 03:28:06 (27) : copy-file /tmp/032753ne/datadir/test_nomodtime-pimokav6/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/ 2024/04/26 03:28:06 INFO : file7.txt: Copied (replaced existing) 2024/04/26 03:28:06 (28) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file7.txt 2024/04/26 03:28:06 INFO : file7.txt: Deleted 2024/04/26 03:28:06 (29) : test bisync run 2024/04/26 03:28:06 (30) : bisync nomodtime 2024/04/26 03:28:07 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/04/26 03:28:07 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/" 2024/04/26 03:28:07 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:07 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:28:07 INFO : Path1 checking for diffs 2024/04/26 03:28:07 INFO : - Path1 File changed: size (larger), hash - file2.txt 2024/04/26 03:28:07 INFO : - Path1 File was deleted - file4.txt 2024/04/26 03:28:07 INFO : - Path1 File changed: size (larger), hash - file5.txt 2024/04/26 03:28:07 INFO : - Path1 File was deleted - file6.txt 2024/04/26 03:28:07 INFO : - Path1 File changed: size (larger), hash - file7.txt 2024/04/26 03:28:07 INFO : - Path1 File was deleted - file8.txt 2024/04/26 03:28:07 INFO : - Path1 File is new - file11.txt 2024/04/26 03:28:07 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:28:07 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2024/04/26 03:28:07 INFO : Path2 checking for diffs 2024/04/26 03:28:07 INFO : - Path2 File changed: size (larger), hash - file1.txt 2024/04/26 03:28:07 INFO : - Path2 File was deleted - file3.txt 2024/04/26 03:28:07 INFO : - Path2 File changed: size (larger), hash - file5.txt 2024/04/26 03:28:07 INFO : - Path2 File changed: size (larger), hash - file6.txt 2024/04/26 03:28:07 INFO : - Path2 File was deleted - file7.txt 2024/04/26 03:28:07 INFO : - Path2 File was deleted - file8.txt 2024/04/26 03:28:07 INFO : - Path2 File is new - file10.txt 2024/04/26 03:28:07 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/04/26 03:28:07 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2024/04/26 03:28:07 INFO : Applying changes 2024/04/26 03:28:07 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file11.txt 2024/04/26 03:28:07 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file2.txt 2024/04/26 03:28:07 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file4.txt 2024/04/26 03:28:07 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/04/26 03:28:07 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file5.txt.conflict1 2024/04/26 03:28:07 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/04/26 03:28:07 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file5.txt.conflict1 2024/04/26 03:28:07 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file5.txt.conflict2 2024/04/26 03:28:07 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/04/26 03:28:07 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file5.txt.conflict2 2024/04/26 03:28:07 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file6.txt 2024/04/26 03:28:07 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/file7.txt 2024/04/26 03:28:07 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file1.txt 2024/04/26 03:28:07 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file10.txt 2024/04/26 03:28:07 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/file3.txt 2024/04/26 03:28:07 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:07 INFO : file10.txt: Copied (new) 2024/04/26 03:28:07 INFO : file5.txt.conflict2: Copied (new) 2024/04/26 03:28:07 INFO : file6.txt: Copied (new) 2024/04/26 03:28:07 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:07 INFO : file3.txt: Deleted 2024/04/26 03:28:07 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:07 INFO : file11.txt: Copied (new) 2024/04/26 03:28:07 INFO : file5.txt.conflict1: Copied (new) 2024/04/26 03:28:07 INFO : file7.txt: Copied (new) 2024/04/26 03:28:07 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:07 INFO : file4.txt: Deleted 2024/04/26 03:28:07 INFO : Updating listings 2024/04/26 03:28:07 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/nomodtime/path2/" 2024/04/26 03:28:07 INFO : Bisync successful bisync_test.go:553: TEST nomodtime PASSED === RUN TestBisyncRemoteRemote/normalization 2024/04/26 03:28:07 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:07 DEBUG : path1: Making directory 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:07 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1" 2024/04/26 03:28:07 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:07 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:07 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1" 2024/04/26 03:28:07 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:07 DEBUG : path2: Making directory 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:07 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2" 2024/04/26 03:28:07 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:07 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:07 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2" 2024/04/26 03:28:07 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_normalization-fupizox7" 2024/04/26 03:28:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory with metadata 2024/04/26 03:28:07 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/04/26 03:28:07 DEBUG : Added delayed dir = "測試_РуÑÑкий_ _ _Ä›_áñ", newDst=測試_РуÑÑкий_ _ _Ä›_áñ 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:07 DEBUG : file1.txt.nexumuv2.partial: renamed to: file1.txt 2024/04/26 03:28:07 INFO : file1.txt: Copied (new) 2024/04/26 03:28:07 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:07 DEBUG : RCLONE_TEST.xocadug8.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:07 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:07 DEBUG : Local file system at /tmp/032753ne/initdir/test_normalization-fupizox7: Waiting for checks to finish 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:28:07 DEBUG : Local file system at /tmp/032753ne/initdir/test_normalization-fupizox7: Waiting for transfers to finish 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt.kosaxik4.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt.secepep8.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt 2024/04/26 03:28:07 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:07 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file.rurureg3.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file 2024/04/26 03:28:07 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/04/26 03:28:07 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Set directory modification time (using SetModTime) 2024/04/26 03:28:07 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_normalization-zifenef6" 2024/04/26 03:28:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : Local file system at /tmp/032753ne/datadir/test_normalization-zifenef6: Waiting for checks to finish 2024/04/26 03:28:07 DEBUG : Local file system at /tmp/032753ne/datadir/test_normalization-zifenef6: Waiting for transfers to finish 2024/04/26 03:28:07 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:07 DEBUG : file1.txt.ruxuviw4.partial: renamed to: file1.txt 2024/04/26 03:28:07 INFO : file1.txt: Copied (new) 2024/04/26 03:28:07 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/04/26 03:28:07 DEBUG : 測試_filtersfile.txt.xosasiv9.partial: renamed to: 測試_filtersfile.txt 2024/04/26 03:28:07 INFO : 測試_filtersfile.txt: Copied (new) 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1] 2024/04/26 03:28:07 ERROR : : error listing: directory not found 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2] 2024/04/26 03:28:07 ERROR : : error listing: directory not found 2024/04/26 03:28:07 checking initFs Local file system at /tmp/032753ne/initdir/test_normalization-fupizox7 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1] 2024/04/26 03:28:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/RCLONE_TEST] 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/file1.txt] 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt] 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1: Waiting for checks to finish 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1: Waiting for transfers to finish 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt] 2024/04/26 03:28:07 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file] 2024/04/26 03:28:07 INFO : file1.txt: Copied (new) 2024/04/26 03:28:07 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:07 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:07 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/04/26 03:28:07 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1] 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2] 2024/04/26 03:28:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/RCLONE_TEST] 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/file1.txt] 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: Waiting for checks to finish 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt] 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: Waiting for transfers to finish 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt] 2024/04/26 03:28:07 INFO : file1.txt: Copied (new) 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file] 2024/04/26 03:28:07 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:07 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/04/26 03:28:07 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/04/26 03:28:07 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/04/26 03:28:07 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2] 2024/04/26 03:28:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/04/26 03:28:07 (01) : test normalization 2024/04/26 03:28:07 (02) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/ 2024/04/26 03:28:07 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:07 (03) : test initial bisync 2024/04/26 03:28:07 (04) : bisync resync 2024/04/26 03:28:07 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:28:07 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/04/26 03:28:07 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:07 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:07 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/" 2024/04/26 03:28:07 INFO : Copying Path2 files to Path1 2024/04/26 03:28:07 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:07 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:07 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:07 INFO : Resync updating listings 2024/04/26 03:28:07 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/" 2024/04/26 03:28:07 INFO : Bisync successful 2024/04/26 03:28:07 (05) : copy-as-NFC /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/測試_РуÑÑкий___eÌŒ_aÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö 測試_РуÑÑкий___eÌŒ_aÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö.txt 2024/04/26 03:28:07 INFO : file1.txt: Copied (new) to: 測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶.txt 2024/04/26 03:28:07 (06) : copy-as-NFC /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/folder eÌeÌeÌö.txt 2024/04/26 03:28:07 INFO : file1.txt: Copied (new) to: éééö.txt 2024/04/26 03:28:07 (07) : copy-as-NFC /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/folder HeLlO,wOrLd!.txt 2024/04/26 03:28:07 INFO : file1.txt: Copied (new) to: HeLlO,wOrLd!.txt 2024/04/26 03:28:07 (08) : touch-copy 2001-01-03 /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/ 2024/04/26 03:28:07 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:07 (09) : copy-as-NFD /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/folder eÌeÌeÌö.txt 2024/04/26 03:28:07 INFO : file1.txt: Copied (new) to: eÌeÌeÌö.txt 2024/04/26 03:28:07 (10) : copy-as-NFD /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/folder hello,WORLD!.txt 2024/04/26 03:28:07 INFO : file1.txt: Copied (new) to: hello,WORLD!.txt 2024/04/26 03:28:07 (11) : test bisync run with fix-case 2024/04/26 03:28:07 (12) : bisync fix-case 2024/04/26 03:28:07 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:28:07 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/04/26 03:28:07 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:07 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:07 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/" 2024/04/26 03:28:07 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:07 INFO : Path1 checking for diffs 2024/04/26 03:28:07 INFO : - Path1 File is new - folder/HeLlO,wOrLd!.txt 2024/04/26 03:28:07 INFO : - Path1 File is new - folder/éééö.txt 2024/04/26 03:28:07 INFO : - Path1 File is new - "測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö/測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö.txt" 2024/04/26 03:28:07 INFO : Path1: 3 changes:  3 new,  0 modified,  0 deleted 2024/04/26 03:28:07 INFO : Path2 checking for diffs 2024/04/26 03:28:07 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:28:07 INFO : - Path2 File is new - folder/eÌeÌeÌö.txt 2024/04/26 03:28:07 INFO : - Path2 File is new - folder/hello,WORLD!.txt 2024/04/26 03:28:07 INFO : Path2: 3 changes:  2 new,  1 modified,  0 deleted 2024/04/26 03:28:07 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:28:07 INFO : Applying changes 2024/04/26 03:28:07 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:07 INFO : Checking potential conflicts... 2024/04/26 03:28:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: 0 differences found 2024/04/26 03:28:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: 2 matching files 2024/04/26 03:28:07 INFO : Finished checking the potential conflicts. %!s() 2024/04/26 03:28:07 NOTICE: - WARNING New or changed in both paths - folder/HeLlO,wOrLd!.txt 2024/04/26 03:28:07 INFO : folder/hello,WORLD!.txt: Files are equal but will copy anyway to fix case to folder/HeLlO,wOrLd!.txt 2024/04/26 03:28:07 NOTICE: - WARNING New or changed in both paths - folder/éééö.txt 2024/04/26 03:28:07 INFO : folder/eÌeÌeÌö.txt: Files are equal but will copy anyway to fix case to folder/éééö.txt 2024/04/26 03:28:07 INFO : - Path1 Queue copy to Path2 - "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö/測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö.txt" 2024/04/26 03:28:07 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/file1.txt 2024/04/26 03:28:07 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:07 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:07 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:07 INFO : folder/hello,WORLD!.txt: Moved (server-side) to: folder/HeLlO,wOrLd!.txt 2024/04/26 03:28:07 INFO : folder/hello,WORLD!.txt: Fixed case by renaming to: folder/HeLlO,wOrLd!.txt 2024/04/26 03:28:07 INFO : folder/eÌeÌeÌö.txt: Moved (server-side) to: folder/éééö.txt 2024/04/26 03:28:07 INFO : folder/eÌeÌeÌö.txt: Fixed case by renaming to: folder/éééö.txt 2024/04/26 03:28:07 INFO : 測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶/測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶.txt: Copied (new) 2024/04/26 03:28:07 INFO : folder/HeLlO,wOrLd!.txt: Copied (replaced existing) 2024/04/26 03:28:07 INFO : folder/éééö.txt: Copied (replaced existing) 2024/04/26 03:28:07 INFO : Updating listings 2024/04/26 03:28:07 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/" 2024/04/26 03:28:07 INFO : Bisync successful 2024/04/26 03:28:07 (13) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/ 2024/04/26 03:28:07 (14) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/ 2024/04/26 03:28:07 (15) : touch-copy 2001-01-02 /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/ 2024/04/26 03:28:07 INFO : file1.txt: Copied (new) 2024/04/26 03:28:07 (16) : copy-as-NFC /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/ file2.txt 2024/04/26 03:28:07 INFO : file1.txt: Copied (new) to: file2.txt 2024/04/26 03:28:07 (17) : copy-as-NFC /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/ file3.txt 2024/04/26 03:28:07 INFO : file1.txt: Copied (new) to: file3.txt 2024/04/26 03:28:07 (18) : bisync resync 2024/04/26 03:28:07 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:28:08 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/04/26 03:28:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:08 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/" 2024/04/26 03:28:08 INFO : Copying Path2 files to Path1 2024/04/26 03:28:08 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:08 INFO : file1.txt: Copied (new) 2024/04/26 03:28:08 INFO : file2.txt: Copied (new) 2024/04/26 03:28:08 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:08 INFO : file3.txt: Copied (new) 2024/04/26 03:28:08 INFO : Resync updating listings 2024/04/26 03:28:08 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/" 2024/04/26 03:28:08 INFO : Bisync successful 2024/04/26 03:28:08 (19) : copy-as-NFC /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/測試_РуÑкий___eÌŒ_aÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö 測試_РуÑкий___eÌŒ_aÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö.txt 2024/04/26 03:28:08 INFO : file1.txt: Copied (new) to: 測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶.txt 2024/04/26 03:28:08 (20) : copy-as-NFC /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/newfolder eÌeÌeÌö.txt 2024/04/26 03:28:08 INFO : file1.txt: Copied (new) to: éééö.txt 2024/04/26 03:28:08 (21) : copy-as-NFC /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/newfolder HeLlO,wOrLd!.txt 2024/04/26 03:28:08 INFO : file1.txt: Copied (new) to: HeLlO,wOrLd!.txt 2024/04/26 03:28:08 (22) : touch-copy 2001-01-03 /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/ 2024/04/26 03:28:08 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:08 (23) : copy-as-NFD /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/newfolder eÌeÌeÌö.txt 2024/04/26 03:28:08 INFO : file1.txt: Copied (new) to: eÌeÌeÌö.txt 2024/04/26 03:28:08 (24) : copy-as-NFD /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/newfolder hello,WORLD!.txt 2024/04/26 03:28:08 INFO : file1.txt: Copied (new) to: hello,WORLD!.txt 2024/04/26 03:28:08 (25) : test bisync run with normalization 2024/04/26 03:28:08 (26) : bisync norm force 2024/04/26 03:28:08 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:28:08 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/04/26 03:28:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:08 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/" 2024/04/26 03:28:08 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:08 INFO : Path1 checking for diffs 2024/04/26 03:28:08 INFO : - Path1 File is new - newfolder/HeLlO,wOrLd!.txt 2024/04/26 03:28:08 INFO : - Path1 File is new - newfolder/éééö.txt 2024/04/26 03:28:08 INFO : - Path1 File is new - "測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö.txt" 2024/04/26 03:28:08 INFO : Path1: 3 changes:  3 new,  0 modified,  0 deleted 2024/04/26 03:28:08 INFO : Path2 checking for diffs 2024/04/26 03:28:08 INFO : - Path2 File changed: time (newer) - file1.txt 2024/04/26 03:28:08 INFO : - Path2 File is new - newfolder/eÌeÌeÌö.txt 2024/04/26 03:28:08 INFO : - Path2 File is new - newfolder/hello,WORLD!.txt 2024/04/26 03:28:08 INFO : Path2: 3 changes:  2 new,  1 modified,  0 deleted 2024/04/26 03:28:08 INFO : (Modified:  1 newer,  0 older) 2024/04/26 03:28:08 INFO : Applying changes 2024/04/26 03:28:08 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:08 INFO : Checking potential conflicts... 2024/04/26 03:28:08 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: 0 differences found 2024/04/26 03:28:08 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2: 2 matching files 2024/04/26 03:28:08 INFO : Finished checking the potential conflicts. %!s() 2024/04/26 03:28:08 NOTICE: - WARNING New or changed in both paths - newfolder/HeLlO,wOrLd!.txt 2024/04/26 03:28:08 INFO : newfolder/HeLlO,wOrLd!.txt: Files are equal but will copy anyway to update modtime (will not rename) 2024/04/26 03:28:08 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/newfolder/HeLlO,wOrLd!.txt 2024/04/26 03:28:08 NOTICE: - WARNING New or changed in both paths - newfolder/éééö.txt 2024/04/26 03:28:08 INFO : newfolder/éééö.txt: Files are equal but will copy anyway to update modtime (will not rename) 2024/04/26 03:28:08 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/newfolder/éééö.txt 2024/04/26 03:28:08 INFO : - Path1 Queue copy to Path2 - "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö.txt" 2024/04/26 03:28:08 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/file1.txt 2024/04/26 03:28:08 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:08 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:08 INFO : newfolder/eÌeÌeÌö.txt: Copied (replaced existing) to: newfolder/éééö.txt 2024/04/26 03:28:08 INFO : newfolder/hello,WORLD!.txt: Copied (replaced existing) to: newfolder/HeLlO,wOrLd!.txt 2024/04/26 03:28:08 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:08 INFO : 測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶.txt: Copied (new) 2024/04/26 03:28:08 INFO : Updating listings 2024/04/26 03:28:08 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/" 2024/04/26 03:28:08 INFO : Bisync successful 2024/04/26 03:28:08 (27) : test resync 2024/04/26 03:28:08 (28) : bisync resync norm 2024/04/26 03:28:08 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:28:08 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/04/26 03:28:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:08 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/" 2024/04/26 03:28:08 INFO : Copying Path2 files to Path1 2024/04/26 03:28:08 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:08 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:08 INFO : Resync updating listings 2024/04/26 03:28:08 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:08 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:08 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/" 2024/04/26 03:28:08 INFO : Bisync successful 2024/04/26 03:28:08 (29) : test changed on one path 2024/04/26 03:28:08 (30) : touch-copy 2001-01-05 /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/ 2024/04/26 03:28:08 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:08 (31) : copy-as-NFC /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/測試_РуÑкий___eÌŒ_aÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö 測試_РуÑкий___eÌŒ_aÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö.txt 2024/04/26 03:28:08 INFO : file1.txt: Copied (replaced existing) to: 測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶.txt 2024/04/26 03:28:08 (32) : copy-as-NFC /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/newfolder eÌeÌeÌö.txt 2024/04/26 03:28:08 INFO : file1.txt: Copied (replaced existing) to: éééö.txt 2024/04/26 03:28:08 (33) : copy-as-NFC /tmp/032753ne/datadir/test_normalization-zifenef6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/newfolder HeLlO,wOrLd!.txt 2024/04/26 03:28:08 INFO : file1.txt: Copied (replaced existing) to: HeLlO,wOrLd!.txt 2024/04/26 03:28:08 (34) : bisync norm 2024/04/26 03:28:08 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/04/26 03:28:08 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/04/26 03:28:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:08 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/" 2024/04/26 03:28:08 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:08 INFO : Path1 checking for diffs 2024/04/26 03:28:08 INFO : - Path1 File changed: time (newer) - newfolder/HeLlO,wOrLd!.txt 2024/04/26 03:28:08 INFO : - Path1 File changed: time (newer) - newfolder/éééö.txt 2024/04/26 03:28:08 INFO : - Path1 File changed: time (newer) - "測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö.txt" 2024/04/26 03:28:08 INFO : Path1: 3 changes:  0 new,  3 modified,  0 deleted 2024/04/26 03:28:08 INFO : (Modified:  3 newer,  0 older) 2024/04/26 03:28:08 INFO : Path2 checking for diffs 2024/04/26 03:28:08 INFO : - Path2 File changed: time (newer) - file1.txt 2024/04/26 03:28:08 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:28:08 INFO : (Modified:  1 newer,  0 older) 2024/04/26 03:28:08 INFO : Applying changes 2024/04/26 03:28:08 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/newfolder/hello,WORLD!.txt 2024/04/26 03:28:08 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/newfolder/eÌeÌeÌö.txt 2024/04/26 03:28:08 INFO : - Path1 Queue copy to Path2 - "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö.txt" 2024/04/26 03:28:08 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/file1.txt 2024/04/26 03:28:08 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:08 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:08 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:08 INFO : 測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶.txt: Copied (replaced existing) 2024/04/26 03:28:08 INFO : newfolder/HeLlO,wOrLd!.txt: Copied (replaced existing) to: newfolder/hello,WORLD!.txt 2024/04/26 03:28:08 INFO : newfolder/éééö.txt: Copied (replaced existing) to: newfolder/eÌeÌeÌö.txt 2024/04/26 03:28:08 INFO : Updating listings 2024/04/26 03:28:08 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/normalization/path2/" 2024/04/26 03:28:08 INFO : Bisync successful bisync_test.go:553: TEST normalization PASSED === RUN TestBisyncRemoteRemote/rclone_args 2024/04/26 03:28:08 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:08 DEBUG : path1: Making directory 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:08 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1" 2024/04/26 03:28:08 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:08 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:08 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:08 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:08 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:08 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:08 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1" 2024/04/26 03:28:08 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:08 DEBUG : path2: Making directory 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:08 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2" 2024/04/26 03:28:08 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:08 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:08 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:08 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:08 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:08 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:08 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2" 2024/04/26 03:28:08 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_rclone_args-coyonuz4" 2024/04/26 03:28:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : subdir: Making directory with metadata 2024/04/26 03:28:08 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:28:08 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:28:08 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : Local file system at /tmp/032753ne/initdir/test_rclone_args-coyonuz4: Waiting for checks to finish 2024/04/26 03:28:08 DEBUG : Local file system at /tmp/032753ne/initdir/test_rclone_args-coyonuz4: Waiting for transfers to finish 2024/04/26 03:28:08 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:08 DEBUG : subdir/file20.txt.yivoxiz0.partial: renamed to: subdir/file20.txt 2024/04/26 03:28:08 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:08 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2024/04/26 03:28:08 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:08 DEBUG : subdir/file21.txt.javejom6.partial: renamed to: subdir/file21.txt 2024/04/26 03:28:08 INFO : subdir/file21.txt: Copied (new) 2024/04/26 03:28:08 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:08 DEBUG : file1.txt.riligut1.partial: renamed to: file1.txt 2024/04/26 03:28:08 INFO : file1.txt: Copied (new) 2024/04/26 03:28:08 DEBUG : RCLONE_TEST.tirehib7.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:08 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:08 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:08 DEBUG : file2.txt.duzuyud4.partial: renamed to: file2.txt 2024/04/26 03:28:08 INFO : file2.txt: Copied (new) 2024/04/26 03:28:08 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:28:08 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_rclone_args-jinidox7" 2024/04/26 03:28:08 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : file21.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : Local file system at /tmp/032753ne/datadir/test_rclone_args-jinidox7: Waiting for checks to finish 2024/04/26 03:28:08 DEBUG : Local file system at /tmp/032753ne/datadir/test_rclone_args-jinidox7: Waiting for transfers to finish 2024/04/26 03:28:08 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:08 DEBUG : file2.txt.qiyofen9.partial: renamed to: file2.txt 2024/04/26 03:28:08 INFO : file2.txt: Copied (new) 2024/04/26 03:28:08 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:08 DEBUG : file21.txt.tapujub3.partial: renamed to: file21.txt 2024/04/26 03:28:08 INFO : file21.txt: Copied (new) 2024/04/26 03:28:08 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:08 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:08 DEBUG : file20.txt.woduqit7.partial: renamed to: file20.txt 2024/04/26 03:28:08 INFO : file20.txt: Copied (new) 2024/04/26 03:28:08 DEBUG : file1.txt.melejen4.partial: renamed to: file1.txt 2024/04/26 03:28:08 INFO : file1.txt: Copied (new) 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1] 2024/04/26 03:28:08 ERROR : : error listing: directory not found 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2] 2024/04/26 03:28:08 ERROR : : error listing: directory not found 2024/04/26 03:28:08 checking initFs Local file system at /tmp/032753ne/initdir/test_rclone_args-coyonuz4 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1] 2024/04/26 03:28:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : subdir: Making directory 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir] 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/RCLONE_TEST] 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/file1.txt] 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/file2.txt] 2024/04/26 03:28:08 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1: Waiting for checks to finish 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1: Waiting for transfers to finish 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir/file20.txt] 2024/04/26 03:28:08 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir/file21.txt] 2024/04/26 03:28:08 INFO : file2.txt: Copied (new) 2024/04/26 03:28:08 INFO : file1.txt: Copied (new) 2024/04/26 03:28:08 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:08 INFO : subdir/file21.txt: Copied (new) 2024/04/26 03:28:08 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1] 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir] 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2] 2024/04/26 03:28:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : subdir: Making directory 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/subdir] 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/RCLONE_TEST] 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/file2.txt] 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/file1.txt] 2024/04/26 03:28:08 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2: Waiting for checks to finish 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2: Waiting for transfers to finish 2024/04/26 03:28:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/subdir/file20.txt] 2024/04/26 03:28:09 INFO : file2.txt: Copied (new) 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/subdir/file21.txt] 2024/04/26 03:28:09 INFO : file1.txt: Copied (new) 2024/04/26 03:28:09 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:09 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:09 INFO : subdir/file21.txt: Copied (new) 2024/04/26 03:28:09 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2] 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/subdir] 2024/04/26 03:28:09 (01) : test rclone-args 2024/04/26 03:28:09 (02) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_rclone_args-jinidox7/ * 2024/04/26 03:28:09 (03) : test initial bisync 2024/04/26 03:28:09 (04) : bisync resync checksum 2024/04/26 03:28:09 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/04/26 03:28:09 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Copying Path2 files to Path1 2024/04/26 03:28:09 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:09 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:28:09 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:09 INFO : Resync updating listings 2024/04/26 03:28:09 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Bisync successful 2024/04/26 03:28:09 (05) : test place newer files on both paths 2024/04/26 03:28:09 (06) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/ 2024/04/26 03:28:09 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:09 (07) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/ 2024/04/26 03:28:09 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:09 (08) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir 2024/04/26 03:28:09 INFO : file20.txt: Copied (replaced existing) 2024/04/26 03:28:09 (09) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/subdir 2024/04/26 03:28:09 INFO : file21.txt: Copied (replaced existing) 2024/04/26 03:28:09 (10) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/ file1.txt 2024/04/26 03:28:09 (11) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/ file2.txt 2024/04/26 03:28:09 (12) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir/ file20.txt 2024/04/26 03:28:09 (13) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/subdir/ file21.txt 2024/04/26 03:28:09 (14) : test run bisync with custom options 2024/04/26 03:28:09 (15) : bisync checksum 2024/04/26 03:28:09 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/04/26 03:28:09 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:09 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:28:09 INFO : Path1 checking for diffs 2024/04/26 03:28:09 INFO : - Path1 File changed: hash - file1.txt 2024/04/26 03:28:09 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:28:09 INFO : (Modified:  1 hash differs) 2024/04/26 03:28:09 INFO : Path2 checking for diffs 2024/04/26 03:28:09 INFO : - Path2 File changed: size (larger), hash - file2.txt 2024/04/26 03:28:09 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:28:09 INFO : (Modified:  1 larger,  0 smaller,  1 hash differs) 2024/04/26 03:28:09 INFO : Applying changes 2024/04/26 03:28:09 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/file1.txt 2024/04/26 03:28:09 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/file2.txt 2024/04/26 03:28:09 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:09 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:09 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : Updating listings 2024/04/26 03:28:09 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Bisync successful 2024/04/26 03:28:09 (16) : touch-glob 2007-07-23 /tmp/032753ne/datadir/test_rclone_args-jinidox7/ * 2024/04/26 03:28:09 (17) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/ 2024/04/26 03:28:09 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:09 (18) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/ 2024/04/26 03:28:09 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:09 (19) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir 2024/04/26 03:28:09 INFO : file20.txt: Copied (replaced existing) 2024/04/26 03:28:09 (20) : copy-as /tmp/032753ne/datadir/test_rclone_args-jinidox7/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/ file1.txt 2024/04/26 03:28:09 INFO : file21.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:09 (21) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/ file1.txt 2024/04/26 03:28:09 (22) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/ file2.txt 2024/04/26 03:28:09 (23) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir/ file20.txt 2024/04/26 03:28:09 (24) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/subdir/ file21.txt 2024/04/26 03:28:09 (25) : bisync size-only 2024/04/26 03:28:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:09 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:09 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:09 INFO : Path1 checking for diffs 2024/04/26 03:28:09 INFO : Path2 checking for diffs 2024/04/26 03:28:09 INFO : - Path2 File changed: size (smaller) - file1.txt 2024/04/26 03:28:09 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:28:09 INFO : (Modified:  0 larger,  1 smaller) 2024/04/26 03:28:09 INFO : Applying changes 2024/04/26 03:28:09 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/file1.txt 2024/04/26 03:28:09 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:09 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : Updating listings 2024/04/26 03:28:09 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Bisync successful 2024/04/26 03:28:09 (26) : bisync resync 2024/04/26 03:28:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:09 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Copying Path2 files to Path1 2024/04/26 03:28:09 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:09 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:09 INFO : subdir/file21.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : Resync updating listings 2024/04/26 03:28:09 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Bisync successful 2024/04/26 03:28:09 (27) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/ 2024/04/26 03:28:09 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:09 (28) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/ 2024/04/26 03:28:09 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:09 (29) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir 2024/04/26 03:28:09 (30) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/subdir 2024/04/26 03:28:09 INFO : file21.txt: Copied (replaced existing) 2024/04/26 03:28:09 (31) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/ file1.txt 2024/04/26 03:28:09 (32) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/ file2.txt 2024/04/26 03:28:09 (33) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir/ file20.txt 2024/04/26 03:28:09 (34) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/subdir/ file21.txt 2024/04/26 03:28:09 (35) : bisync ignore-size 2024/04/26 03:28:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": false, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:09 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:09 INFO : Path1 checking for diffs 2024/04/26 03:28:09 INFO : Path2 checking for diffs 2024/04/26 03:28:09 INFO : - Path2 File changed: time (newer) - file2.txt 2024/04/26 03:28:09 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2024/04/26 03:28:09 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:28:09 INFO : (Modified:  2 newer,  0 older) 2024/04/26 03:28:09 INFO : Applying changes 2024/04/26 03:28:09 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/file2.txt 2024/04/26 03:28:09 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir/file21.txt 2024/04/26 03:28:09 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:09 INFO : subdir/file21.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : Updating listings 2024/04/26 03:28:09 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Bisync successful 2024/04/26 03:28:09 (36) : bisync resync compare-all 2024/04/26 03:28:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/04/26 03:28:09 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Copying Path2 files to Path1 2024/04/26 03:28:09 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:09 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:28:09 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:09 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : Resync updating listings 2024/04/26 03:28:09 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Bisync successful 2024/04/26 03:28:09 (37) : copy-as /tmp/032753ne/datadir/test_rclone_args-jinidox7/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/ file2.txt 2024/04/26 03:28:09 INFO : file21.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:28:09 (38) : touch-glob 2023-08-26 /tmp/032753ne/datadir/test_rclone_args-jinidox7/ * 2024/04/26 03:28:09 (39) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/ 2024/04/26 03:28:09 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:09 (40) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir 2024/04/26 03:28:09 INFO : file20.txt: Copied (replaced existing) 2024/04/26 03:28:09 (41) : copy-file /tmp/032753ne/datadir/test_rclone_args-jinidox7/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/subdir 2024/04/26 03:28:09 INFO : file21.txt: Copied (replaced existing) 2024/04/26 03:28:09 (42) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/ file2.txt 2024/04/26 03:28:09 (43) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/ file1.txt 2024/04/26 03:28:09 (44) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir/ file20.txt 2024/04/26 03:28:09 (45) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/subdir/ file21.txt 2024/04/26 03:28:09 (46) : bisync compare-all 2024/04/26 03:28:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/04/26 03:28:09 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:09 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/04/26 03:28:09 INFO : Path1 checking for diffs 2024/04/26 03:28:09 INFO : - Path1 File changed: time (newer) - file1.txt 2024/04/26 03:28:09 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2024/04/26 03:28:09 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:28:09 INFO : (Modified:  2 newer,  0 older) 2024/04/26 03:28:09 INFO : Path2 checking for diffs 2024/04/26 03:28:09 INFO : - Path2 File changed: size (smaller), hash - file2.txt 2024/04/26 03:28:09 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2024/04/26 03:28:09 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/04/26 03:28:09 INFO : (Modified:  1 newer,  0 older,  0 larger,  1 smaller,  1 hash differs) 2024/04/26 03:28:09 INFO : Applying changes 2024/04/26 03:28:09 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/file1.txt 2024/04/26 03:28:09 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/subdir/file20.txt 2024/04/26 03:28:09 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/file2.txt 2024/04/26 03:28:09 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/subdir/file21.txt 2024/04/26 03:28:09 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:09 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : subdir/file21.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:09 INFO : subdir/file20.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:09 INFO : Updating listings 2024/04/26 03:28:09 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rclone_args/path2/" 2024/04/26 03:28:09 INFO : Bisync successful bisync_test.go:553: TEST rclone_args PASSED === RUN TestBisyncRemoteRemote/resolve 2024/04/26 03:28:09 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:09 DEBUG : path1: Making directory 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:09 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1" 2024/04/26 03:28:09 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:09 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:09 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1" 2024/04/26 03:28:09 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:09 DEBUG : path2: Making directory 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:09 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2" 2024/04/26 03:28:09 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:09 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:09 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2" 2024/04/26 03:28:09 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_resolve-fufefec8" 2024/04/26 03:28:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:09 DEBUG : Local file system at /tmp/032753ne/initdir/test_resolve-fufefec8: Waiting for checks to finish 2024/04/26 03:28:09 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:09 DEBUG : Local file system at /tmp/032753ne/initdir/test_resolve-fufefec8: Waiting for transfers to finish 2024/04/26 03:28:09 DEBUG : file1.txt.hofubos5.partial: renamed to: file1.txt 2024/04/26 03:28:09 INFO : file1.txt: Copied (new) 2024/04/26 03:28:09 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:09 DEBUG : file2.txt.kebazig0.partial: renamed to: file2.txt 2024/04/26 03:28:09 INFO : file2.txt: Copied (new) 2024/04/26 03:28:09 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:09 DEBUG : RCLONE_TEST.wigotom8.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:09 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:09 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_resolve-zefumag1" 2024/04/26 03:28:09 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:09 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:09 DEBUG : Local file system at /tmp/032753ne/datadir/test_resolve-zefumag1: Waiting for checks to finish 2024/04/26 03:28:09 DEBUG : Local file system at /tmp/032753ne/datadir/test_resolve-zefumag1: Waiting for transfers to finish 2024/04/26 03:28:09 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK 2024/04/26 03:28:09 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/04/26 03:28:09 DEBUG : file1L.txt.qulutuc3.partial: renamed to: file1L.txt 2024/04/26 03:28:09 INFO : file1L.txt: Copied (new) 2024/04/26 03:28:09 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/04/26 03:28:09 DEBUG : file2.txt.pokurut6.partial: renamed to: file2.txt 2024/04/26 03:28:09 INFO : file2.txt: Copied (new) 2024/04/26 03:28:09 DEBUG : file1R.txt.xoquxiv4.partial: renamed to: file1R.txt 2024/04/26 03:28:09 INFO : file1R.txt: Copied (new) 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1] 2024/04/26 03:28:09 ERROR : : error listing: directory not found 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2] 2024/04/26 03:28:09 ERROR : : error listing: directory not found 2024/04/26 03:28:09 checking initFs Local file system at /tmp/032753ne/initdir/test_resolve-fufefec8 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1] 2024/04/26 03:28:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1: Waiting for checks to finish 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/file1.txt] 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1: Waiting for transfers to finish 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/file2.txt] 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/RCLONE_TEST] 2024/04/26 03:28:09 INFO : file1.txt: Copied (new) 2024/04/26 03:28:09 INFO : file2.txt: Copied (new) 2024/04/26 03:28:09 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:09 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1] 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2] 2024/04/26 03:28:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/RCLONE_TEST] 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/file1.txt] 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: Waiting for checks to finish 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: Waiting for transfers to finish 2024/04/26 03:28:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/file2.txt] 2024/04/26 03:28:10 INFO : file2.txt: Copied (new) 2024/04/26 03:28:10 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:10 INFO : file1.txt: Copied (new) 2024/04/26 03:28:10 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2] 2024/04/26 03:28:10 (01) : test resolve 2024/04/26 03:28:10 (02) : test initial bisync 2024/04/26 03:28:10 (03) : bisync resync 2024/04/26 03:28:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:10 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Copying Path2 files to Path1 2024/04/26 03:28:10 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:10 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:10 INFO : Resync updating listings 2024/04/26 03:28:10 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Bisync successful 2024/04/26 03:28:10 (04) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:28:10 (05) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_resolve-zefumag1/ file1R.txt 2024/04/26 03:28:10 (06) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/ file1.txt 2024/04/26 03:28:10 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:10 (07) : touch-glob 2001-03-04 /tmp/032753ne/datadir/test_resolve-zefumag1/ file1L.txt 2024/04/26 03:28:10 (08) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/ file1.txt 2024/04/26 03:28:10 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:10 (09) : test bisync run with --conflict-resolve=newer --conflict-loser=delete --conflict-suffix=potato 2024/04/26 03:28:10 (10) : bisync conflict-resolve=newer conflict-loser=delete conflict-suffix=potato 2024/04/26 03:28:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:10 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:10 INFO : Path1 checking for diffs 2024/04/26 03:28:10 INFO : - Path1 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:28:10 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:28:10 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:28:10 INFO : Path2 checking for diffs 2024/04/26 03:28:10 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/04/26 03:28:10 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:28:10 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:28:10 INFO : Applying changes 2024/04/26 03:28:10 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:10 INFO : Checking potential conflicts... 2024/04/26 03:28:10 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: 1 differences found 2024/04/26 03:28:10 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: 1 errors while checking 2024/04/26 03:28:10 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:28:10 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:28:10 INFO : file1.txt: Path1 is newer. Path1: 2001-03-04 00:00:00 +0000 UTC, Path2: 2001-01-02 00:00:00 +0000 UTC, Difference: 1464h0m0s 2024/04/26 03:28:10 INFO : file1.txt: The winner is: Path1 2024/04/26 03:28:10 NOTICE: - Path2 Deleting Path2 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/file1.txt 2024/04/26 03:28:10 INFO : file1.txt: Deleted 2024/04/26 03:28:10 INFO : - Path1 Queue copy to Path2 - file1.txt 2024/04/26 03:28:10 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:10 INFO : file1.txt: Copied (new) 2024/04/26 03:28:10 INFO : Updating listings 2024/04/26 03:28:10 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Bisync successful 2024/04/26 03:28:10 (11) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:28:10 (12) : touch-glob 2001-07-23 /tmp/032753ne/datadir/test_resolve-zefumag1/ file1R.txt 2024/04/26 03:28:10 (13) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/ file1.txt 2024/04/26 03:28:10 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:10 (14) : touch-glob 2001-08-26 /tmp/032753ne/datadir/test_resolve-zefumag1/ file1L.txt 2024/04/26 03:28:10 (15) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/ file1.txt 2024/04/26 03:28:10 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:10 (16) : test bisync run with --conflict-resolve=path2 --conflict-loser=num --conflict-suffix=dinosaur 2024/04/26 03:28:10 (17) : bisync conflict-resolve=path2 conflict-loser=num conflict-suffix=dinosaur 2024/04/26 03:28:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:10 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:10 INFO : Path1 checking for diffs 2024/04/26 03:28:10 INFO : - Path1 File changed: time (newer) - file1.txt 2024/04/26 03:28:10 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:28:10 INFO : (Modified:  1 newer,  0 older) 2024/04/26 03:28:10 INFO : Path2 checking for diffs 2024/04/26 03:28:10 INFO : - Path2 File changed: time (newer) - file1.txt 2024/04/26 03:28:10 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/04/26 03:28:10 INFO : (Modified:  1 newer,  0 older) 2024/04/26 03:28:10 INFO : Applying changes 2024/04/26 03:28:10 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:10 INFO : Checking potential conflicts... 2024/04/26 03:28:10 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: 1 differences found 2024/04/26 03:28:10 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: 1 errors while checking 2024/04/26 03:28:10 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:28:10 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:28:10 INFO : file1.txt: The winner is: Path2 2024/04/26 03:28:10 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/file1.txt.dinosaur1 2024/04/26 03:28:10 INFO : file1.txt: Moved (server-side) to: file1.txt.dinosaur1 2024/04/26 03:28:10 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/file1.txt.dinosaur1 2024/04/26 03:28:10 NOTICE: - Path2 Not renaming Path2 copy, as it was determined the winner - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/file1.txt 2024/04/26 03:28:10 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/file1.txt 2024/04/26 03:28:10 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:10 INFO : file1.txt: Copied (new) 2024/04/26 03:28:10 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:10 INFO : file1.txt.dinosaur1: Copied (new) 2024/04/26 03:28:10 INFO : Updating listings 2024/04/26 03:28:10 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Bisync successful 2024/04/26 03:28:10 (18) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:28:10 (19) : touch-glob 2002-07-23 /tmp/032753ne/datadir/test_resolve-zefumag1/ file1R.txt 2024/04/26 03:28:10 (20) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/ file1.txt 2024/04/26 03:28:10 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:10 (21) : touch-glob 2002-08-26 /tmp/032753ne/datadir/test_resolve-zefumag1/ file1L.txt 2024/04/26 03:28:10 (22) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/ file1.txt 2024/04/26 03:28:10 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:10 (23) : test bisync run with --conflict-resolve=larger --conflict-loser=num --conflict-suffix=apple 2024/04/26 03:28:10 (24) : bisync conflict-resolve=larger conflict-loser=num conflict-suffix=apple 2024/04/26 03:28:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:10 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:10 INFO : Path1 checking for diffs 2024/04/26 03:28:10 INFO : - Path1 File is new - file1.txt 2024/04/26 03:28:10 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:28:10 INFO : Path2 checking for diffs 2024/04/26 03:28:10 INFO : - Path2 File is new - file1.txt 2024/04/26 03:28:10 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:28:10 INFO : Applying changes 2024/04/26 03:28:10 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:10 INFO : Checking potential conflicts... 2024/04/26 03:28:10 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: 1 differences found 2024/04/26 03:28:10 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: 1 errors while checking 2024/04/26 03:28:10 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:28:10 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:28:10 INFO : file1.txt: Winner cannot be determined as sizes are equal. Path1: 33, Path2: 33, Difference: 0 2024/04/26 03:28:10 INFO : file1.txt: A winner could not be determined. 2024/04/26 03:28:10 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/file1.txt.apple1 2024/04/26 03:28:10 INFO : file1.txt: Moved (server-side) to: file1.txt.apple1 2024/04/26 03:28:10 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/file1.txt.apple1 2024/04/26 03:28:10 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/file1.txt.apple2 2024/04/26 03:28:10 INFO : file1.txt: Moved (server-side) to: file1.txt.apple2 2024/04/26 03:28:10 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/file1.txt.apple2 2024/04/26 03:28:10 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:10 INFO : file1.txt.apple2: Copied (new) 2024/04/26 03:28:10 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:10 INFO : file1.txt.apple1: Copied (new) 2024/04/26 03:28:10 INFO : Updating listings 2024/04/26 03:28:10 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Bisync successful 2024/04/26 03:28:10 (25) : test different suffixes 2024/04/26 03:28:10 (26) : touch-glob 2003-07-23 /tmp/032753ne/datadir/test_resolve-zefumag1/ file1R.txt 2024/04/26 03:28:10 (27) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/ file1.txt 2024/04/26 03:28:10 INFO : file1R.txt: Copied (new) to: file1.txt 2024/04/26 03:28:10 (28) : touch-glob 2003-07-23 /tmp/032753ne/datadir/test_resolve-zefumag1/ file1L.txt 2024/04/26 03:28:10 (29) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/ file1.txt 2024/04/26 03:28:10 INFO : file1L.txt: Copied (new) to: file1.txt 2024/04/26 03:28:10 (30) : test bisync run with --conflict-resolve=older --conflict-loser=num --conflict-suffix=cloud,local 2024/04/26 03:28:10 (31) : bisync conflict-resolve=older conflict-loser=num conflict-suffix=cloud,local 2024/04/26 03:28:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:10 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:10 INFO : Path1 checking for diffs 2024/04/26 03:28:10 INFO : - Path1 File is new - file1.txt 2024/04/26 03:28:10 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:28:10 INFO : Path2 checking for diffs 2024/04/26 03:28:10 INFO : - Path2 File is new - file1.txt 2024/04/26 03:28:10 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:28:10 INFO : Applying changes 2024/04/26 03:28:10 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:10 INFO : Checking potential conflicts... 2024/04/26 03:28:10 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: 1 differences found 2024/04/26 03:28:10 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: 1 errors while checking 2024/04/26 03:28:10 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:28:10 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:28:10 INFO : file1.txt: Winner cannot be determined as times are equal. Path1: 2003-07-23 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 0s 2024/04/26 03:28:10 INFO : file1.txt: A winner could not be determined. 2024/04/26 03:28:10 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/file1.txt.cloud1 2024/04/26 03:28:10 INFO : file1.txt: Moved (server-side) to: file1.txt.cloud1 2024/04/26 03:28:10 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/file1.txt.cloud1 2024/04/26 03:28:10 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/file1.txt.local1 2024/04/26 03:28:10 INFO : file1.txt: Moved (server-side) to: file1.txt.local1 2024/04/26 03:28:10 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/file1.txt.local1 2024/04/26 03:28:10 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:10 INFO : file1.txt.local1: Copied (new) 2024/04/26 03:28:10 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:10 INFO : file1.txt.cloud1: Copied (new) 2024/04/26 03:28:10 INFO : Updating listings 2024/04/26 03:28:10 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Bisync successful 2024/04/26 03:28:10 (32) : test legacy 2024/04/26 03:28:10 (33) : touch-glob 2004-07-23 /tmp/032753ne/datadir/test_resolve-zefumag1/ file1R.txt 2024/04/26 03:28:10 (34) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/ file1.txt 2024/04/26 03:28:10 INFO : file1R.txt: Copied (new) to: file1.txt 2024/04/26 03:28:10 (35) : touch-glob 2004-07-23 /tmp/032753ne/datadir/test_resolve-zefumag1/ file1L.txt 2024/04/26 03:28:10 (36) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/ file1.txt 2024/04/26 03:28:10 INFO : file1L.txt: Copied (new) to: file1.txt 2024/04/26 03:28:10 (37) : test bisync run with --conflict-resolve=none --conflict-loser=pathname --conflict-suffix=.path 2024/04/26 03:28:10 (38) : bisync conflict-resolve=none conflict-loser=pathname conflict-suffix=.path 2024/04/26 03:28:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:10 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:10 INFO : Path1 checking for diffs 2024/04/26 03:28:10 INFO : - Path1 File is new - file1.txt 2024/04/26 03:28:10 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:28:10 INFO : Path2 checking for diffs 2024/04/26 03:28:10 INFO : - Path2 File is new - file1.txt 2024/04/26 03:28:10 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/04/26 03:28:10 INFO : Applying changes 2024/04/26 03:28:10 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:10 INFO : Checking potential conflicts... 2024/04/26 03:28:10 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: 1 differences found 2024/04/26 03:28:10 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: 1 errors while checking 2024/04/26 03:28:10 INFO : Finished checking the potential conflicts. 1 differences found 2024/04/26 03:28:10 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:28:10 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/file1.txt..path1 2024/04/26 03:28:10 INFO : file1.txt: Moved (server-side) to: file1.txt..path1 2024/04/26 03:28:10 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/file1.txt..path1 2024/04/26 03:28:10 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/file1.txt..path2 2024/04/26 03:28:10 INFO : file1.txt: Moved (server-side) to: file1.txt..path2 2024/04/26 03:28:10 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/file1.txt..path2 2024/04/26 03:28:10 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:10 INFO : file1.txt..path2: Copied (new) 2024/04/26 03:28:10 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:10 INFO : file1.txt..path1: Copied (new) 2024/04/26 03:28:10 INFO : Updating listings 2024/04/26 03:28:10 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Bisync successful 2024/04/26 03:28:10 (39) : test deletes on both sides with default suffix 2024/04/26 03:28:10 (40) : touch-glob 2005-01-02 /tmp/032753ne/datadir/test_resolve-zefumag1/ file1R.txt 2024/04/26 03:28:10 (41) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/ file1.txt 2024/04/26 03:28:10 INFO : file1R.txt: Copied (new) to: file1.txt 2024/04/26 03:28:10 (42) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/ file2.txt 2024/04/26 03:28:10 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:28:10 (43) : touch-glob 2006-03-04 /tmp/032753ne/datadir/test_resolve-zefumag1/ file1L.txt 2024/04/26 03:28:10 (44) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/ file1.txt 2024/04/26 03:28:10 INFO : file1L.txt: Copied (new) to: file1.txt 2024/04/26 03:28:10 (45) : copy-as /tmp/032753ne/datadir/test_resolve-zefumag1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/ file2.txt 2024/04/26 03:28:10 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:28:10 (46) : test bisync run with --conflict-resolve=newer --conflict-loser=delete 2024/04/26 03:28:10 (47) : bisync conflict-resolve=newer conflict-loser=delete 2024/04/26 03:28:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:10 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:10 INFO : Path1 checking for diffs 2024/04/26 03:28:10 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:28:10 INFO : - Path1 File is new - file1.txt 2024/04/26 03:28:10 INFO : Path1: 2 changes:  1 new,  1 modified,  0 deleted 2024/04/26 03:28:10 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:28:10 INFO : Path2 checking for diffs 2024/04/26 03:28:10 INFO : - Path2 File changed: size (larger), time (newer) - file2.txt 2024/04/26 03:28:10 INFO : - Path2 File is new - file1.txt 2024/04/26 03:28:10 INFO : Path2: 2 changes:  1 new,  1 modified,  0 deleted 2024/04/26 03:28:10 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/04/26 03:28:10 INFO : Applying changes 2024/04/26 03:28:10 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:10 INFO : Checking potential conflicts... 2024/04/26 03:28:10 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: 2 differences found 2024/04/26 03:28:10 NOTICE: hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2: 2 errors while checking 2024/04/26 03:28:10 INFO : Finished checking the potential conflicts. 2 differences found 2024/04/26 03:28:10 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/04/26 03:28:10 INFO : file1.txt: Path1 is newer. Path1: 2006-03-04 00:00:00 +0000 UTC, Path2: 2005-01-02 00:00:00 +0000 UTC, Difference: 10224h0m0s 2024/04/26 03:28:10 INFO : file1.txt: The winner is: Path1 2024/04/26 03:28:10 NOTICE: - Path2 Deleting Path2 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/file1.txt 2024/04/26 03:28:10 INFO : file1.txt: Deleted 2024/04/26 03:28:10 INFO : - Path1 Queue copy to Path2 - file1.txt 2024/04/26 03:28:10 NOTICE: - WARNING New or changed in both paths - file2.txt 2024/04/26 03:28:10 INFO : file2.txt: Path2 is newer. Path1: 2005-01-02 00:00:00 +0000 UTC, Path2: 2006-03-04 00:00:00 +0000 UTC, Difference: 10224h0m0s 2024/04/26 03:28:10 INFO : file2.txt: The winner is: Path2 2024/04/26 03:28:10 NOTICE: - Path1 Deleting Path1 copy - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/file2.txt 2024/04/26 03:28:10 INFO : file2.txt: Deleted 2024/04/26 03:28:10 INFO : - Path2 Queue copy to Path1 - file2.txt 2024/04/26 03:28:10 INFO : - Path2 Do queued copies to - Path1 2024/04/26 03:28:10 INFO : file2.txt: Copied (new) 2024/04/26 03:28:10 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:10 INFO : file1.txt: Copied (new) 2024/04/26 03:28:10 INFO : Updating listings 2024/04/26 03:28:10 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/04/26 03:28:10 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resolve/path2/" 2024/04/26 03:28:10 INFO : Bisync successful bisync_test.go:553: TEST resolve PASSED === RUN TestBisyncRemoteRemote/resync 2024/04/26 03:28:10 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:10 DEBUG : path1: Making directory 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:10 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1" 2024/04/26 03:28:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:10 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1" 2024/04/26 03:28:10 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:10 DEBUG : path2: Making directory 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:10 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2" 2024/04/26 03:28:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:10 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2" 2024/04/26 03:28:10 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_resync-zagewuw0" 2024/04/26 03:28:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : Local file system at /tmp/032753ne/initdir/test_resync-zagewuw0: Waiting for checks to finish 2024/04/26 03:28:10 DEBUG : Local file system at /tmp/032753ne/initdir/test_resync-zagewuw0: Waiting for transfers to finish 2024/04/26 03:28:10 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:10 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:10 DEBUG : file2.txt.xihojem9.partial: renamed to: file2.txt 2024/04/26 03:28:10 INFO : file2.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : file1.txt.revohep3.partial: renamed to: file1.txt 2024/04/26 03:28:10 INFO : file1.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:10 DEBUG : file4.txt.figalax9.partial: renamed to: file4.txt 2024/04/26 03:28:10 INFO : file4.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:10 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:10 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:10 DEBUG : file5.txt.lahagac1.partial: renamed to: file5.txt 2024/04/26 03:28:10 INFO : file5.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : RCLONE_TEST.sesejoz4.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:10 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:10 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:10 DEBUG : file6.txt.safapuv6.partial: renamed to: file6.txt 2024/04/26 03:28:10 INFO : file6.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : file3.txt.sofalaj9.partial: renamed to: file3.txt 2024/04/26 03:28:10 INFO : file3.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:10 DEBUG : file7.txt.xutigiv3.partial: renamed to: file7.txt 2024/04/26 03:28:10 INFO : file7.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_resync-ponobul8" 2024/04/26 03:28:10 DEBUG : fileA.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : fileB.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : Local file system at /tmp/032753ne/datadir/test_resync-ponobul8: Waiting for checks to finish 2024/04/26 03:28:10 DEBUG : Local file system at /tmp/032753ne/datadir/test_resync-ponobul8: Waiting for transfers to finish 2024/04/26 03:28:10 DEBUG : fileA.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:10 DEBUG : fileB.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:10 DEBUG : fileA.txt.suwahos5.partial: renamed to: fileA.txt 2024/04/26 03:28:10 INFO : fileA.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : fileB.txt.limiqum6.partial: renamed to: fileB.txt 2024/04/26 03:28:10 INFO : fileB.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1] 2024/04/26 03:28:10 ERROR : : error listing: directory not found 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2] 2024/04/26 03:28:10 ERROR : : error listing: directory not found 2024/04/26 03:28:10 checking initFs Local file system at /tmp/032753ne/initdir/test_resync-zagewuw0 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1] 2024/04/26 03:28:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/file1.txt] 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/RCLONE_TEST] 2024/04/26 03:28:10 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: Waiting for checks to finish 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/file2.txt] 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: Waiting for transfers to finish 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/file3.txt] 2024/04/26 03:28:10 INFO : file1.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/file4.txt] 2024/04/26 03:28:10 INFO : file2.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/file5.txt] 2024/04/26 03:28:10 INFO : file3.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/file6.txt] 2024/04/26 03:28:10 INFO : file4.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/file7.txt] 2024/04/26 03:28:10 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:10 INFO : file5.txt: Copied (new) 2024/04/26 03:28:10 INFO : file6.txt: Copied (new) 2024/04/26 03:28:10 INFO : file7.txt: Copied (new) 2024/04/26 03:28:10 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1] 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2] 2024/04/26 03:28:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/file1.txt] 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/RCLONE_TEST] 2024/04/26 03:28:10 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/file3.txt] 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/file2.txt] 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: Waiting for checks to finish 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: Waiting for transfers to finish 2024/04/26 03:28:10 INFO : file1.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/file4.txt] 2024/04/26 03:28:10 INFO : file3.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/file5.txt] 2024/04/26 03:28:10 INFO : file2.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/file6.txt] 2024/04/26 03:28:10 INFO : file4.txt: Copied (new) 2024/04/26 03:28:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/file7.txt] 2024/04/26 03:28:10 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:10 INFO : file5.txt: Copied (new) 2024/04/26 03:28:10 INFO : file6.txt: Copied (new) 2024/04/26 03:28:11 INFO : file7.txt: Copied (new) 2024/04/26 03:28:11 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2] 2024/04/26 03:28:11 (01) : test resync 2024/04/26 03:28:11 (02) : test 1. resync with empty path1, resulting in copying all content from path2. 2024/04/26 03:28:11 (03) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/ 2024/04/26 03:28:11 (04) : bisync resync 2024/04/26 03:28:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:11 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/" 2024/04/26 03:28:11 INFO : Copying Path2 files to Path1 2024/04/26 03:28:11 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:11 INFO : file1.txt: Copied (new) 2024/04/26 03:28:11 INFO : file2.txt: Copied (new) 2024/04/26 03:28:11 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:11 INFO : file3.txt: Copied (new) 2024/04/26 03:28:11 INFO : file4.txt: Copied (new) 2024/04/26 03:28:11 INFO : file5.txt: Copied (new) 2024/04/26 03:28:11 INFO : file6.txt: Copied (new) 2024/04/26 03:28:11 INFO : file7.txt: Copied (new) 2024/04/26 03:28:11 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:11 INFO : Resync updating listings 2024/04/26 03:28:11 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/" 2024/04/26 03:28:11 INFO : Bisync successful 2024/04/26 03:28:11 (05) : move-listings empty-path1 2024/04/26 03:28:11 (06) : test 2. resync with empty path2, resulting in synching all content to path2. 2024/04/26 03:28:11 (07) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/ 2024/04/26 03:28:11 (08) : bisync resync 2024/04/26 03:28:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:11 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/" 2024/04/26 03:28:11 INFO : Copying Path2 files to Path1 2024/04/26 03:28:11 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:11 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:11 INFO : file2.txt: Copied (new) 2024/04/26 03:28:11 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:11 INFO : file1.txt: Copied (new) 2024/04/26 03:28:11 INFO : file3.txt: Copied (new) 2024/04/26 03:28:11 INFO : file4.txt: Copied (new) 2024/04/26 03:28:11 INFO : file5.txt: Copied (new) 2024/04/26 03:28:11 INFO : file6.txt: Copied (new) 2024/04/26 03:28:11 INFO : file7.txt: Copied (new) 2024/04/26 03:28:11 INFO : Resync updating listings 2024/04/26 03:28:11 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/" 2024/04/26 03:28:11 INFO : Bisync successful 2024/04/26 03:28:11 (09) : move-listings empty-path2 2024/04/26 03:28:11 (10) : test 3. exercise all of the various file difference scenarios during a resync. 2024/04/26 03:28:11 (11) : touch-glob 2002-02-02 /tmp/032753ne/datadir/test_resync-ponobul8/ fileA.txt 2024/04/26 03:28:11 (12) : touch-glob 1999-09-09 /tmp/032753ne/datadir/test_resync-ponobul8/ fileB.txt 2024/04/26 03:28:11 (13) : test = file - path1 - path2 - expected action - who wins 2024/04/26 03:28:11 (14) : test - file1.txt - exists - missing - sync path1 > path2 - path1 2024/04/26 03:28:11 (15) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/file1.txt 2024/04/26 03:28:11 INFO : file1.txt: Deleted 2024/04/26 03:28:11 (16) : test - file2.txt - missing - exists - copy path2 > path1 - path2 2024/04/26 03:28:11 (17) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/file2.txt 2024/04/26 03:28:11 INFO : file2.txt: Deleted 2024/04/26 03:28:11 (18) : test - file3.txt - exists - newer date - sync path1 > path2 - path1 2024/04/26 03:28:11 (19) : copy-as /tmp/032753ne/datadir/test_resync-ponobul8/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/ file3.txt 2024/04/26 03:28:11 INFO : fileA.txt: Copied (replaced existing) to: file3.txt 2024/04/26 03:28:11 (20) : test - file4.txt - missing - newer date - copy path2 > path1 - path2 2024/04/26 03:28:11 (21) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/file4.txt 2024/04/26 03:28:11 INFO : file4.txt: Deleted 2024/04/26 03:28:11 (22) : copy-as /tmp/032753ne/datadir/test_resync-ponobul8/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/ file4.txt 2024/04/26 03:28:11 INFO : fileA.txt: Copied (replaced existing) to: file4.txt 2024/04/26 03:28:11 (23) : test - file5.txt - exists - older date - sync path1 > path2 - path1 2024/04/26 03:28:11 (24) : copy-as /tmp/032753ne/datadir/test_resync-ponobul8/fileB.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/ file5.txt 2024/04/26 03:28:11 INFO : fileB.txt: Copied (replaced existing) to: file5.txt 2024/04/26 03:28:11 (25) : test - file6.txt - older date - newer date - sync path1 > path2 - path1 2024/04/26 03:28:11 (26) : copy-as /tmp/032753ne/datadir/test_resync-ponobul8/fileB.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/ file6.txt 2024/04/26 03:28:11 INFO : fileB.txt: Copied (replaced existing) to: file6.txt 2024/04/26 03:28:11 (27) : copy-as /tmp/032753ne/datadir/test_resync-ponobul8/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/ file6.txt 2024/04/26 03:28:11 INFO : fileA.txt: Copied (replaced existing) to: file6.txt 2024/04/26 03:28:11 (28) : test - file7.txt - exists - exists (same) - none - same 2024/04/26 03:28:11 (29) : test run bisync with resync 2024/04/26 03:28:11 (30) : bisync resync 2024/04/26 03:28:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:11 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/" 2024/04/26 03:28:11 INFO : Copying Path2 files to Path1 2024/04/26 03:28:11 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:11 INFO : file2.txt: Copied (new) 2024/04/26 03:28:11 INFO : file4.txt: Copied (new) 2024/04/26 03:28:11 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:11 INFO : file1.txt: Copied (new) 2024/04/26 03:28:11 INFO : file5.txt: Copied (replaced existing) 2024/04/26 03:28:11 INFO : file3.txt: Copied (replaced existing) 2024/04/26 03:28:11 INFO : file6.txt: Copied (replaced existing) 2024/04/26 03:28:11 INFO : Resync updating listings 2024/04/26 03:28:11 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/" 2024/04/26 03:28:11 INFO : Bisync successful 2024/04/26 03:28:11 (31) : copy-listings mixed-diffs 2024/04/26 03:28:11 (32) : test run normal bisync 2024/04/26 03:28:11 (33) : bisync 2024/04/26 03:28:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:11 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/" 2024/04/26 03:28:11 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:11 INFO : Path1 checking for diffs 2024/04/26 03:28:11 INFO : Path2 checking for diffs 2024/04/26 03:28:11 INFO : No changes found 2024/04/26 03:28:11 INFO : Updating listings 2024/04/26 03:28:11 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/" 2024/04/26 03:28:11 INFO : Bisync successful 2024/04/26 03:28:11 (34) : test 4. confirm critical error on normal sync of empty path. 2024/04/26 03:28:11 (35) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/ 2024/04/26 03:28:11 (36) : bisync 2024/04/26 03:28:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:11 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync/path2/" 2024/04/26 03:28:11 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:11 INFO : Path1 checking for diffs 2024/04/26 03:28:11 INFO : Path2 checking for diffs 2024/04/26 03:28:11 ERROR : Empty current Path2 listing. Cannot sync to an empty directory: /tmp/032753ne/workdir/TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_resync_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_resync_path2.path2.lst-new 2024/04/26 03:28:11 ERROR : Bisync critical error: empty current Path2 listing: /tmp/032753ne/workdir/TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_resync_path1..TestHdfs_rclone-test-xihadop0devojij8dukeboy5_032753ne_resync_path2.path2.lst-new 2024/04/26 03:28:11 ERROR : Bisync aborted. Must run --resync to recover. 2024/04/26 03:28:11 Bisync error: bisync aborted bisync_test.go:553: TEST resync PASSED === RUN TestBisyncRemoteRemote/resync_modes 2024/04/26 03:28:11 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:11 DEBUG : path1: Making directory 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:11 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1" 2024/04/26 03:28:11 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:11 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:11 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1" 2024/04/26 03:28:11 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:11 DEBUG : path2: Making directory 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:11 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2" 2024/04/26 03:28:11 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:11 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:11 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2" 2024/04/26 03:28:11 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_resync_modes-wigajab9" 2024/04/26 03:28:11 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:11 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:11 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:11 DEBUG : Local file system at /tmp/032753ne/initdir/test_resync_modes-wigajab9: Waiting for checks to finish 2024/04/26 03:28:11 DEBUG : Local file system at /tmp/032753ne/initdir/test_resync_modes-wigajab9: Waiting for transfers to finish 2024/04/26 03:28:11 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:11 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:11 DEBUG : file1.txt.zabojot1.partial: renamed to: file1.txt 2024/04/26 03:28:11 INFO : file1.txt: Copied (new) 2024/04/26 03:28:11 DEBUG : file2.txt.wixowik2.partial: renamed to: file2.txt 2024/04/26 03:28:11 INFO : file2.txt: Copied (new) 2024/04/26 03:28:11 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:11 DEBUG : RCLONE_TEST.zevexol4.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:11 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:11 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_resync_modes-jogamop6" 2024/04/26 03:28:11 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:11 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:11 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:11 DEBUG : Local file system at /tmp/032753ne/datadir/test_resync_modes-jogamop6: Waiting for checks to finish 2024/04/26 03:28:11 DEBUG : Local file system at /tmp/032753ne/datadir/test_resync_modes-jogamop6: Waiting for transfers to finish 2024/04/26 03:28:11 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/04/26 03:28:11 DEBUG : file2.txt.surikap5.partial: renamed to: file2.txt 2024/04/26 03:28:11 INFO : file2.txt: Copied (new) 2024/04/26 03:28:11 DEBUG : file1R.txt: md5 = 705bb3c0ef02925739e834ca98c099c3 OK 2024/04/26 03:28:11 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/04/26 03:28:11 DEBUG : file1R.txt.zorixem4.partial: renamed to: file1R.txt 2024/04/26 03:28:11 INFO : file1R.txt: Copied (new) 2024/04/26 03:28:11 DEBUG : file1L.txt.gajulib5.partial: renamed to: file1L.txt 2024/04/26 03:28:11 INFO : file1L.txt: Copied (new) 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1] 2024/04/26 03:28:11 ERROR : : error listing: directory not found 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2] 2024/04/26 03:28:11 ERROR : : error listing: directory not found 2024/04/26 03:28:11 checking initFs Local file system at /tmp/032753ne/initdir/test_resync_modes-wigajab9 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1] 2024/04/26 03:28:11 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:11 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:11 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/RCLONE_TEST] 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/file1.txt] 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1: Waiting for checks to finish 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/file2.txt] 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1: Waiting for transfers to finish 2024/04/26 03:28:11 INFO : file1.txt: Copied (new) 2024/04/26 03:28:11 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:11 INFO : file2.txt: Copied (new) 2024/04/26 03:28:11 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1] 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2] 2024/04/26 03:28:11 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:11 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:11 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2: Waiting for checks to finish 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/RCLONE_TEST] 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/file2.txt] 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/file1.txt] 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2: Waiting for transfers to finish 2024/04/26 03:28:11 INFO : file2.txt: Copied (new) 2024/04/26 03:28:11 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:11 INFO : file1.txt: Copied (new) 2024/04/26 03:28:11 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2 2024/04/26 03:28:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2] 2024/04/26 03:28:11 (01) : test resync-mode 2024/04/26 03:28:11 (02) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:28:11 (03) : touch-glob 2001-01-02 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1R.txt 2024/04/26 03:28:11 (04) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/ file1.txt 2024/04/26 03:28:11 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:11 (05) : touch-glob 2001-03-04 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1L.txt 2024/04/26 03:28:11 (06) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/ file1.txt 2024/04/26 03:28:11 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:11 (07) : test bisync run with --resync-mode=newer 2024/04/26 03:28:11 (08) : bisync resync resync-mode=newer 2024/04/26 03:28:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:11 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:11 INFO : Copying Path2 files to Path1 2024/04/26 03:28:11 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:11 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:11 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:11 INFO : Resync updating listings 2024/04/26 03:28:11 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:11 INFO : Bisync successful 2024/04/26 03:28:11 (09) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:28:11 (10) : touch-glob 2001-07-23 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1R.txt 2024/04/26 03:28:11 (11) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/ file1.txt 2024/04/26 03:28:11 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:11 (12) : touch-glob 2001-08-26 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1L.txt 2024/04/26 03:28:11 (13) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/ file1.txt 2024/04/26 03:28:11 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:11 (14) : test bisync run with --resync-mode=path2 2024/04/26 03:28:11 (15) : bisync resync resync-mode=path2 2024/04/26 03:28:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:11 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:11 INFO : Copying Path2 files to Path1 2024/04/26 03:28:11 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:12 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:12 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:12 INFO : Resync updating listings 2024/04/26 03:28:12 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:12 INFO : Bisync successful 2024/04/26 03:28:12 (16) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:28:12 (17) : touch-glob 2002-07-23 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1R.txt 2024/04/26 03:28:12 (18) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/ file1.txt 2024/04/26 03:28:12 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:12 (19) : touch-glob 2002-08-26 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1L.txt 2024/04/26 03:28:12 (20) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/ file1.txt 2024/04/26 03:28:12 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:12 (21) : test bisync run with --resync-mode=larger 2024/04/26 03:28:12 (22) : bisync resync resync-mode=larger 2024/04/26 03:28:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:12 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:12 INFO : Copying Path2 files to Path1 2024/04/26 03:28:12 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:12 INFO : file1.txt: Path2 is larger. Path1: 33, Path2: 42, Difference: 9 2024/04/26 03:28:12 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:12 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:12 INFO : Resync updating listings 2024/04/26 03:28:12 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:12 INFO : Bisync successful 2024/04/26 03:28:12 (23) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:28:12 (24) : touch-glob 2003-07-23 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1R.txt 2024/04/26 03:28:12 (25) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/ file1.txt 2024/04/26 03:28:12 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:12 (26) : touch-glob 2003-09-04 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1L.txt 2024/04/26 03:28:12 (27) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/ file1.txt 2024/04/26 03:28:12 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:12 (28) : test bisync run with --resync-mode=older 2024/04/26 03:28:12 (29) : bisync resync resync-mode=older 2024/04/26 03:28:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:12 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:12 INFO : Copying Path2 files to Path1 2024/04/26 03:28:12 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:12 INFO : file1.txt: Path2 is older. Path1: 2003-09-04 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 1032h0m0s 2024/04/26 03:28:12 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:12 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:12 INFO : Resync updating listings 2024/04/26 03:28:12 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:12 INFO : Bisync successful 2024/04/26 03:28:12 (30) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:28:12 (31) : touch-glob 2004-07-23 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1R.txt 2024/04/26 03:28:12 (32) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/ file1.txt 2024/04/26 03:28:12 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:12 (33) : touch-glob 2004-07-23 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1L.txt 2024/04/26 03:28:12 (34) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/ file1.txt 2024/04/26 03:28:12 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:12 (35) : test bisync run with --resync-mode=smaller 2024/04/26 03:28:12 (36) : bisync resync resync-mode=smaller 2024/04/26 03:28:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:12 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:12 INFO : Copying Path2 files to Path1 2024/04/26 03:28:12 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:12 INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9 2024/04/26 03:28:12 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:12 INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9 2024/04/26 03:28:12 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:12 INFO : Resync updating listings 2024/04/26 03:28:12 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:12 INFO : Bisync successful 2024/04/26 03:28:12 (37) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/04/26 03:28:12 (38) : touch-glob 2005-01-02 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1R.txt 2024/04/26 03:28:12 (39) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/ file1.txt 2024/04/26 03:28:12 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:12 (40) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/ file2.txt 2024/04/26 03:28:12 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:28:12 (41) : touch-glob 2006-03-04 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1L.txt 2024/04/26 03:28:12 (42) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/ file1.txt 2024/04/26 03:28:12 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:12 (43) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/ file2.txt 2024/04/26 03:28:12 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:28:12 (44) : test bisync run with --resync-mode=path1 2024/04/26 03:28:12 (45) : bisync resync resync-mode=path1 2024/04/26 03:28:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:12 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:12 INFO : Copying Path2 files to Path1 2024/04/26 03:28:12 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:12 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:12 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:12 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:12 INFO : Resync updating listings 2024/04/26 03:28:12 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:12 INFO : Bisync successful 2024/04/26 03:28:12 (46) : test no winner 2024/04/26 03:28:12 (47) : touch-glob 2022-02-22 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1R.txt 2024/04/26 03:28:12 (48) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/ file1.txt 2024/04/26 03:28:12 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:12 (49) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/ file2.txt 2024/04/26 03:28:12 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:28:12 (50) : touch-glob 2022-02-22 /tmp/032753ne/datadir/test_resync_modes-jogamop6/ file1L.txt 2024/04/26 03:28:12 (51) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/ file1.txt 2024/04/26 03:28:12 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/04/26 03:28:12 (52) : copy-as /tmp/032753ne/datadir/test_resync_modes-jogamop6/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/ file2.txt 2024/04/26 03:28:12 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/04/26 03:28:12 (53) : test bisync run with --resync-mode=newer 2024/04/26 03:28:12 (54) : bisync resync resync-mode=newer 2024/04/26 03:28:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:12 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:12 INFO : Copying Path2 files to Path1 2024/04/26 03:28:12 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:12 INFO : file1.txt: Copied (replaced existing) 2024/04/26 03:28:12 INFO : file2.txt: Copied (replaced existing) 2024/04/26 03:28:12 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:12 INFO : Resync updating listings 2024/04/26 03:28:12 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/resync_modes/path2/" 2024/04/26 03:28:12 INFO : Bisync successful bisync_test.go:553: TEST resync_modes PASSED === RUN TestBisyncRemoteRemote/rmdirs 2024/04/26 03:28:12 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:12 DEBUG : path1: Making directory 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:12 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1" 2024/04/26 03:28:12 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:12 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:12 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1" 2024/04/26 03:28:12 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:12 DEBUG : path2: Making directory 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:12 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2" 2024/04/26 03:28:12 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:12 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:12 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2" 2024/04/26 03:28:12 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_rmdirs-rihizuk2" 2024/04/26 03:28:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : subdir: Making directory with metadata 2024/04/26 03:28:12 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/04/26 03:28:12 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/04/26 03:28:12 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:12 DEBUG : file1.copy1.txt.gupinoj6.partial: renamed to: file1.copy1.txt 2024/04/26 03:28:12 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : Local file system at /tmp/032753ne/initdir/test_rmdirs-rihizuk2: Waiting for checks to finish 2024/04/26 03:28:12 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:12 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:12 DEBUG : file1.copy3.txt.bemizis6.partial: renamed to: file1.copy3.txt 2024/04/26 03:28:12 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:12 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:12 DEBUG : RCLONE_TEST.sobetob2.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:12 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:12 DEBUG : file1.copy2.txt.yomakud9.partial: renamed to: file1.copy2.txt 2024/04/26 03:28:12 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:12 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:12 DEBUG : file1.txt.hifosaj9.partial: renamed to: file1.txt 2024/04/26 03:28:12 INFO : file1.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : subdir/file20.txt.madenuy9.partial: renamed to: subdir/file20.txt 2024/04/26 03:28:12 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : Local file system at /tmp/032753ne/initdir/test_rmdirs-rihizuk2: Waiting for transfers to finish 2024/04/26 03:28:12 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:12 DEBUG : file1.copy5.txt.raxival3.partial: renamed to: file1.copy5.txt 2024/04/26 03:28:12 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : file1.copy4.txt.yivijas3.partial: renamed to: file1.copy4.txt 2024/04/26 03:28:12 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:28:12 INFO : subdir: Set directory modification time (using SetModTime) 2024/04/26 03:28:12 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_rmdirs-zakixot6" 2024/04/26 03:28:12 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : Local file system at /tmp/032753ne/datadir/test_rmdirs-zakixot6: Waiting for checks to finish 2024/04/26 03:28:12 DEBUG : Local file system at /tmp/032753ne/datadir/test_rmdirs-zakixot6: Waiting for transfers to finish 2024/04/26 03:28:12 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:12 DEBUG : file1.txt.qanamer8.partial: renamed to: file1.txt 2024/04/26 03:28:12 INFO : file1.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1] 2024/04/26 03:28:12 ERROR : : error listing: directory not found 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2] 2024/04/26 03:28:12 ERROR : : error listing: directory not found 2024/04/26 03:28:12 checking initFs Local file system at /tmp/032753ne/initdir/test_rmdirs-rihizuk2 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1] 2024/04/26 03:28:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : subdir: Making directory 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/file1.copy1.txt] 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/RCLONE_TEST] 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/file1.copy2.txt] 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/file1.copy3.txt] 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/subdir] 2024/04/26 03:28:12 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: Waiting for checks to finish 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: Waiting for transfers to finish 2024/04/26 03:28:12 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/file1.copy4.txt] 2024/04/26 03:28:12 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/file1.copy5.txt] 2024/04/26 03:28:12 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/file1.txt] 2024/04/26 03:28:12 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/subdir/file20.txt] 2024/04/26 03:28:12 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:28:12 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:28:12 INFO : file1.txt: Copied (new) 2024/04/26 03:28:12 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:12 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1] 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/subdir] 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2] 2024/04/26 03:28:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : subdir: Making directory 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/subdir] 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/RCLONE_TEST] 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/file1.copy2.txt] 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/file1.copy3.txt] 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/file1.copy1.txt] 2024/04/26 03:28:12 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: Waiting for checks to finish 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: Waiting for transfers to finish 2024/04/26 03:28:12 INFO : file1.copy2.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/file1.copy4.txt] 2024/04/26 03:28:12 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/file1.copy5.txt] 2024/04/26 03:28:12 INFO : file1.copy3.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/file1.txt] 2024/04/26 03:28:12 INFO : file1.copy1.txt: Copied (new) 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/subdir/file20.txt] 2024/04/26 03:28:12 INFO : file1.copy4.txt: Copied (new) 2024/04/26 03:28:12 INFO : file1.copy5.txt: Copied (new) 2024/04/26 03:28:12 INFO : file1.txt: Copied (new) 2024/04/26 03:28:12 INFO : subdir/file20.txt: Copied (new) 2024/04/26 03:28:12 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2] 2024/04/26 03:28:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/subdir] 2024/04/26 03:28:12 (01) : test rmdirs 2024/04/26 03:28:12 (02) : test initial bisync 2024/04/26 03:28:12 (03) : bisync resync 2024/04/26 03:28:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:12 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/" 2024/04/26 03:28:12 INFO : Copying Path2 files to Path1 2024/04/26 03:28:12 INFO : - Path2 Resync is copying files to - Path1 2024/04/26 03:28:12 INFO : - Path1 Resync is copying files to - Path2 2024/04/26 03:28:12 INFO : Resync updating listings 2024/04/26 03:28:12 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/" 2024/04/26 03:28:12 INFO : Bisync successful 2024/04/26 03:28:12 (04) : test 1. delete path1 subdir file 2024/04/26 03:28:12 (05) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/subdir/file20.txt 2024/04/26 03:28:12 INFO : file20.txt: Deleted 2024/04/26 03:28:12 (06) : test 2. run bisync without remove-empty-dirs 2024/04/26 03:28:12 (07) : bisync 2024/04/26 03:28:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:12 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/" 2024/04/26 03:28:12 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:12 INFO : Path1 checking for diffs 2024/04/26 03:28:12 INFO : - Path1 File was deleted - subdir/file20.txt 2024/04/26 03:28:12 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/04/26 03:28:12 INFO : Path2 checking for diffs 2024/04/26 03:28:12 INFO : Applying changes 2024/04/26 03:28:12 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/subdir/file20.txt 2024/04/26 03:28:12 INFO : - Path1 Do queued copies to - Path2 2024/04/26 03:28:12 INFO : subdir/file20.txt: Deleted 2024/04/26 03:28:12 INFO : Updating listings 2024/04/26 03:28:12 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/" 2024/04/26 03:28:12 INFO : Bisync successful 2024/04/26 03:28:12 (08) : test 3. confirm the subdir still exists on both paths 2024/04/26 03:28:12 (09) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/ 2024/04/26 03:28:12 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:28:12 (10) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/ 2024/04/26 03:28:12 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/04/26 03:28:12 (11) : test 4. run bisync with remove-empty-dirs 2024/04/26 03:28:12 (12) : bisync remove-empty-dirs 2024/04/26 03:28:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/04/26 03:28:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/04/26 03:28:12 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/" 2024/04/26 03:28:12 INFO : Building Path1 and Path2 listings 2024/04/26 03:28:12 INFO : Path1 checking for diffs 2024/04/26 03:28:12 INFO : Path2 checking for diffs 2024/04/26 03:28:12 INFO : No changes found 2024/04/26 03:28:12 INFO : Updating listings 2024/04/26 03:28:12 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/" 2024/04/26 03:28:12 INFO : Removing empty directories 2024/04/26 03:28:12 INFO : subdir: Removing directory 2024/04/26 03:28:12 INFO : subdir: Removing directory 2024/04/26 03:28:12 INFO : Bisync successful 2024/04/26 03:28:12 (13) : test 5. confirm the subdir has been removed on both paths 2024/04/26 03:28:12 (14) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path1/ 2024/04/26 03:28:12 (15) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-xihadop0devojij8dukeboy5/032753ne/rmdirs/path2/ bisync_test.go:553: TEST rmdirs PASSED === RUN TestBisyncRemoteRemote/volatile 2024/04/26 03:28:13 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:13 DEBUG : path1: Making directory 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path1] 2024/04/26 03:28:13 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1" 2024/04/26 03:28:13 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:13 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:13 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1" 2024/04/26 03:28:13 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne" for canonical name "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne" 2024/04/26 03:28:13 DEBUG : path2: Making directory 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne: mkdir [/rclone-test-xihadop0devojij8dukeboy5/032753ne/path2] 2024/04/26 03:28:13 DEBUG : Creating backend with remote "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2" 2024/04/26 03:28:13 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/04/26 03:28:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:13 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/04/26 03:28:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/04/26 03:28:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/04/26 03:28:13 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2" 2024/04/26 03:28:13 DEBUG : Creating backend with remote "/tmp/032753ne/initdir/test_volatile-vafegol9" 2024/04/26 03:28:13 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:13 DEBUG : file1.txt.hegapoc9.partial: renamed to: file1.txt 2024/04/26 03:28:13 INFO : file1.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:13 DEBUG : file2.txt.petagux3.partial: renamed to: file2.txt 2024/04/26 03:28:13 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:13 INFO : file2.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:13 DEBUG : Local file system at /tmp/032753ne/initdir/test_volatile-vafegol9: Waiting for checks to finish 2024/04/26 03:28:13 DEBUG : Local file system at /tmp/032753ne/initdir/test_volatile-vafegol9: Waiting for transfers to finish 2024/04/26 03:28:13 DEBUG : file3.txt.woficux8.partial: renamed to: file3.txt 2024/04/26 03:28:13 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/04/26 03:28:13 INFO : file3.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : RCLONE_TEST.pexuzey7.partial: renamed to: RCLONE_TEST 2024/04/26 03:28:13 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:13 DEBUG : file4.txt.jubaxev4.partial: renamed to: file4.txt 2024/04/26 03:28:13 INFO : file4.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:13 DEBUG : file6.txt.tumejav8.partial: renamed to: file6.txt 2024/04/26 03:28:13 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:13 INFO : file6.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : file7.txt.ninumuq1.partial: renamed to: file7.txt 2024/04/26 03:28:13 INFO : file7.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:13 DEBUG : file8.txt.boveyer8.partial: renamed to: file8.txt 2024/04/26 03:28:13 INFO : file8.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:13 DEBUG : file5.txt.dacijeg5.partial: renamed to: file5.txt 2024/04/26 03:28:13 INFO : file5.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : Creating backend with remote "/tmp/032753ne/datadir/test_volatile-qidayak8" 2024/04/26 03:28:13 DEBUG : dummy.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : dummy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/04/26 03:28:13 DEBUG : dummy.txt.kijaqiy1.partial: renamed to: dummy.txt 2024/04/26 03:28:13 INFO : dummy.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : Local file system at /tmp/032753ne/datadir/test_volatile-qidayak8: Waiting for checks to finish 2024/04/26 03:28:13 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:13 DEBUG : file1.txt.fixolan0.partial: renamed to: file1.txt 2024/04/26 03:28:13 INFO : file1.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : Local file system at /tmp/032753ne/datadir/test_volatile-qidayak8: Waiting for transfers to finish 2024/04/26 03:28:13 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:13 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:13 DEBUG : file10.txt.qiyowal9.partial: renamed to: file10.txt 2024/04/26 03:28:13 INFO : file10.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : file11.txt.kapinas4.partial: renamed to: file11.txt 2024/04/26 03:28:13 INFO : file11.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/04/26 03:28:13 DEBUG : file2.txt.cazesox8.partial: renamed to: file2.txt 2024/04/26 03:28:13 INFO : file2.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/04/26 03:28:13 DEBUG : file5L.txt.covijum3.partial: renamed to: file5L.txt 2024/04/26 03:28:13 INFO : file5L.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/04/26 03:28:13 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:13 DEBUG : file5R.txt.robupog5.partial: renamed to: file5R.txt 2024/04/26 03:28:13 INFO : file5R.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : file6.txt.sabumep1.partial: renamed to: file6.txt 2024/04/26 03:28:13 INFO : file6.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/04/26 03:28:13 DEBUG : file7.txt.lemocay3.partial: renamed to: file7.txt 2024/04/26 03:28:13 INFO : file7.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1] 2024/04/26 03:28:13 ERROR : : error listing: directory not found 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2] 2024/04/26 03:28:13 ERROR : : error listing: directory not found 2024/04/26 03:28:13 checking initFs Local file system at /tmp/032753ne/initdir/test_volatile-vafegol9 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1] 2024/04/26 03:28:13 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1/file1.txt] 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1/RCLONE_TEST] 2024/04/26 03:28:13 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: Waiting for checks to finish 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: Waiting for transfers to finish 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1/file2.txt] 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1/file3.txt] 2024/04/26 03:28:13 INFO : file1.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1/file4.txt] 2024/04/26 03:28:13 INFO : file4.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1/file5.txt] 2024/04/26 03:28:13 INFO : file2.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1/file6.txt] 2024/04/26 03:28:13 INFO : file3.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1/file7.txt] 2024/04/26 03:28:13 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1/file8.txt] 2024/04/26 03:28:13 INFO : file5.txt: Copied (new) 2024/04/26 03:28:13 INFO : file6.txt: Copied (new) 2024/04/26 03:28:13 INFO : file7.txt: Copied (new) 2024/04/26 03:28:13 INFO : file8.txt: Copied (new) 2024/04/26 03:28:13 checking Path1 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path1] 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2] 2024/04/26 03:28:13 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2/RCLONE_TEST] 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2/file2.txt] 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2/file1.txt] 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: Waiting for checks to finish 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2/file3.txt] 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: Waiting for transfers to finish 2024/04/26 03:28:13 INFO : file2.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2/file4.txt] 2024/04/26 03:28:13 INFO : RCLONE_TEST: Copied (new) 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2/file5.txt] 2024/04/26 03:28:13 INFO : file1.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2/file6.txt] 2024/04/26 03:28:13 INFO : file3.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2/file7.txt] 2024/04/26 03:28:13 INFO : file4.txt: Copied (new) 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: update [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2/file8.txt] 2024/04/26 03:28:13 INFO : file5.txt: Copied (new) 2024/04/26 03:28:13 INFO : file6.txt: Copied (new) 2024/04/26 03:28:13 INFO : file7.txt: Copied (new) 2024/04/26 03:28:13 INFO : file8.txt: Copied (new) 2024/04/26 03:28:13 checking path2 hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2: list [/rclone-test-xihadop0devojij8dukeboy5/032753ne/volatile/path2] 2024/04/26 03:28:13 (01) : test volatile 2024/04/26 03:28:13 (02) : test initial bisync 2024/04/26 03:28:13 (03) : bisync resync bisync_test.go:921: skipping 'volatile' test on non-local as it requires uploading 100 files 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5: Purge remote 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-xihadop0devojij8dukeboy5: purge [/rclone-test-xihadop0devojij8dukeboy5] --- PASS: TestBisyncRemoteRemote (20.03s) --- PASS: TestBisyncRemoteRemote/all_changed (0.83s) --- SKIP: TestBisyncRemoteRemote/backupdir (0.37s) --- PASS: TestBisyncRemoteRemote/basic (0.47s) --- PASS: TestBisyncRemoteRemote/changes (0.84s) --- PASS: TestBisyncRemoteRemote/check_access (0.67s) --- PASS: TestBisyncRemoteRemote/check_access_filters (1.39s) --- PASS: TestBisyncRemoteRemote/check_filename (0.52s) --- PASS: TestBisyncRemoteRemote/check_sync (0.63s) --- PASS: TestBisyncRemoteRemote/compare_all (0.85s) --- PASS: TestBisyncRemoteRemote/createemptysrcdirs (0.77s) --- PASS: TestBisyncRemoteRemote/dry_run (0.82s) --- PASS: TestBisyncRemoteRemote/equal (0.30s) --- PASS: TestBisyncRemoteRemote/ext_paths (0.83s) --- PASS: TestBisyncRemoteRemote/extended_filenames (1.31s) --- PASS: TestBisyncRemoteRemote/filters (0.50s) --- PASS: TestBisyncRemoteRemote/filtersfile_checks (0.41s) --- PASS: TestBisyncRemoteRemote/ignorelistingchecksum (0.48s) --- PASS: TestBisyncRemoteRemote/max_delete_path1 (0.51s) --- PASS: TestBisyncRemoteRemote/max_delete_path2_force (0.54s) --- PASS: TestBisyncRemoteRemote/nomodtime (0.89s) --- PASS: TestBisyncRemoteRemote/normalization (1.58s) --- PASS: TestBisyncRemoteRemote/rclone_args (1.01s) --- PASS: TestBisyncRemoteRemote/resolve (0.82s) --- PASS: TestBisyncRemoteRemote/resync (1.06s) --- PASS: TestBisyncRemoteRemote/resync_modes (0.77s) --- PASS: TestBisyncRemoteRemote/rmdirs (0.49s) --- SKIP: TestBisyncRemoteRemote/volatile (0.36s) PASS 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kagekuv4suwitix4qisubul7: Purge remote 2024/04/26 03:28:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kagekuv4suwitix4qisubul7: purge [/rclone-test-kagekuv4suwitix4qisubul7] 2024/04/26 03:28:13 purge failed: directory not found "./bisync.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose" - Finished OK in 44.953456235s (try 1/5)