"./bisync.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose" - Starting (try 1/5) 2024/05/06 06:07:49 DEBUG : Creating backend with remote "TestHdfs:rclone-test-suvebas7kodujiw1rewipej6" 2024/05/06 06:07:49 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/05/06 06:07:49 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:49 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:49 DEBUG : Creating backend with remote "/tmp/rclone2277485947" === RUN TestBisyncRemoteLocal 2024/05/06 06:07:49 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5" 2024/05/06 06:07:49 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:49 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:49 remote: TestHdfs:rclone-test-kodawez5zomoxog3hejadom5 === RUN TestBisyncRemoteLocal/all_changed 2024/05/06 06:07:49 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:49 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/05/06 06:07:49 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:49 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:49 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:49 DEBUG : path1: Making directory 2024/05/06 06:07:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:49 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1" 2024/05/06 06:07:49 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:49 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:49 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1" 2024/05/06 06:07:49 DEBUG : Creating backend with remote "/tmp/060749ce" 2024/05/06 06:07:49 DEBUG : Creating backend with remote "/tmp/060749ce/all_changed/path2" 2024/05/06 06:07:49 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_all_changed/initial" 2024/05/06 06:07:49 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_all_changed-xemobuj5" 2024/05/06 06:07:49 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:49 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:49 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:49 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:49 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:49 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:49 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:49 DEBUG : file1.copy1.txt.zomujed6.partial: renamed to: file1.copy1.txt 2024/05/06 06:07:49 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:07:49 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:49 DEBUG : file1.copy2.txt.xaquvub4.partial: renamed to: file1.copy2.txt 2024/05/06 06:07:49 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:07:49 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:49 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:49 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:49 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:49 DEBUG : RCLONE_TEST.jepomup3.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:49 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:49 DEBUG : file1.copy4.txt.tuqotem4.partial: renamed to: file1.copy4.txt 2024/05/06 06:07:49 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:49 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:07:49 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:49 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:49 DEBUG : file1.copy3.txt.yesofef8.partial: renamed to: file1.copy3.txt 2024/05/06 06:07:49 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:49 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:07:49 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:49 DEBUG : file1.copy5.txt.generix8.partial: renamed to: file1.copy5.txt 2024/05/06 06:07:49 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:07:49 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:49 DEBUG : file1.txt.sikomic0.partial: renamed to: file1.txt 2024/05/06 06:07:49 INFO : file1.txt: Copied (new) 2024/05/06 06:07:49 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:49 DEBUG : Local file system at /tmp/060749ce/initdir/test_all_changed-xemobuj5: Waiting for checks to finish 2024/05/06 06:07:49 DEBUG : subdir/file20.txt.gacuxuf9.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:49 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:49 DEBUG : Local file system at /tmp/060749ce/initdir/test_all_changed-xemobuj5: Waiting for transfers to finish 2024/05/06 06:07:49 INFO : subdir: Updated directory metadata 2024/05/06 06:07:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1] 2024/05/06 06:07:49 ERROR : : error listing: directory not found 2024/05/06 06:07:49 ERROR : : error listing: directory not found 2024/05/06 06:07:49 checking initFs Local file system at /tmp/060749ce/initdir/test_all_changed-xemobuj5 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1] 2024/05/06 06:07:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : subdir: Making directory 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/subdir] 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/RCLONE_TEST] 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/file1.copy1.txt] 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/file1.copy2.txt] 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/file1.copy3.txt] 2024/05/06 06:07:50 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: Waiting for checks to finish 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: Waiting for transfers to finish 2024/05/06 06:07:50 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/file1.copy4.txt] 2024/05/06 06:07:50 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/file1.copy5.txt] 2024/05/06 06:07:50 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/file1.txt] 2024/05/06 06:07:50 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/subdir/file20.txt] 2024/05/06 06:07:50 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:07:50 INFO : file1.txt: Copied (new) 2024/05/06 06:07:50 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/RCLONE_TEST: replication in progress) 2024/05/06 06:07:50 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/05/06 06:07:50 DEBUG : pacer: low level retry 2/10 (error create /rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/RCLONE_TEST: replication in progress) 2024/05/06 06:07:50 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2024/05/06 06:07:50 DEBUG : pacer: Reducing sleep to 60ms 2024/05/06 06:07:50 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:50 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1] 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/subdir] 2024/05/06 06:07:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:50 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:50 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:50 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : Local file system at /tmp/060749ce/all_changed/path2: Waiting for checks to finish 2024/05/06 06:07:50 DEBUG : Local file system at /tmp/060749ce/all_changed/path2: Waiting for transfers to finish 2024/05/06 06:07:50 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:50 DEBUG : file1.copy1.txt.zozutuz7.partial: renamed to: file1.copy1.txt 2024/05/06 06:07:50 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : RCLONE_TEST.wiritex3.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:50 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:50 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file1.copy3.txt.wokedol0.partial: renamed to: file1.copy3.txt 2024/05/06 06:07:50 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file1.copy2.txt.yutufuy0.partial: renamed to: file1.copy2.txt 2024/05/06 06:07:50 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file1.copy4.txt.howowim1.partial: renamed to: file1.copy4.txt 2024/05/06 06:07:50 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file1.txt.wemucox0.partial: renamed to: file1.txt 2024/05/06 06:07:50 INFO : file1.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : subdir/file20.txt.xiboxar2.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:50 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file1.copy5.txt.moneyob7.partial: renamed to: file1.copy5.txt 2024/05/06 06:07:50 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:07:50 INFO : subdir: Updated directory metadata 2024/05/06 06:07:50 checking path2 Local file system at /tmp/060749ce/all_changed/path2 2024/05/06 06:07:50 (01) : test all-changed 2024/05/06 06:07:50 (02) : test initial bisync 2024/05/06 06:07:50 (03) : bisync resync 2024/05/06 06:07:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:50 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:50 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:50 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/" with Path2 "/tmp/060749ce/all_changed/path2/" 2024/05/06 06:07:50 INFO : Copying Path2 files to Path1 2024/05/06 06:07:50 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:50 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:50 INFO : Resync updating listings 2024/05/06 06:07:50 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/" vs Path2 "/tmp/060749ce/all_changed/path2/" 2024/05/06 06:07:50 INFO : Bisync successful 2024/05/06 06:07:50 (04) : test change timestamp on all files except RCLONE_TEST 2024/05/06 06:07:50 (05) : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/ file* 2024/05/06 06:07:50 (06) : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/subdir file* 2024/05/06 06:07:50 (07) : test sync should pass 2024/05/06 06:07:50 (08) : bisync 2024/05/06 06:07:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:50 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:50 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:50 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/" with Path2 "/tmp/060749ce/all_changed/path2/" 2024/05/06 06:07:50 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:50 INFO : Path1 checking for diffs 2024/05/06 06:07:50 INFO : - Path1 File changed: time (newer) - file1.copy1.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (newer) - file1.copy2.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (newer) - file1.copy3.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (newer) - file1.copy4.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (newer) - file1.copy5.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (newer) - file1.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2024/05/06 06:07:50 INFO : Path1: 7 changes:  0 new,  7 modified,  0 deleted 2024/05/06 06:07:50 INFO : (Modified:  7 newer,  0 older) 2024/05/06 06:07:50 INFO : Path2 checking for diffs 2024/05/06 06:07:50 INFO : Applying changes 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/file1.copy1.txt 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/file1.copy2.txt 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/file1.copy3.txt 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/file1.copy4.txt 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/file1.copy5.txt 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/file1.txt 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/subdir/file20.txt 2024/05/06 06:07:50 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:50 INFO : file1.copy1.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : file1.copy5.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : file1.copy2.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : file1.copy3.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : file1.copy4.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:50 INFO : Updating listings 2024/05/06 06:07:50 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/" vs Path2 "/tmp/060749ce/all_changed/path2/" 2024/05/06 06:07:50 INFO : Bisync successful 2024/05/06 06:07:50 (09) : test change timestamp on all files including RCLONE_TEST 2024/05/06 06:07:50 (10) : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/ * 2024/05/06 06:07:50 (11) : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/subdir * 2024/05/06 06:07:50 (12) : test sync should fail 2024/05/06 06:07:50 (13) : bisync 2024/05/06 06:07:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:50 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:50 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:50 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/" with Path2 "/tmp/060749ce/all_changed/path2/" 2024/05/06 06:07:50 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:50 INFO : Path1 checking for diffs 2024/05/06 06:07:50 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - file1.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2024/05/06 06:07:50 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2024/05/06 06:07:50 INFO : (Modified:  1 newer,  7 older) 2024/05/06 06:07:50 INFO : Path2 checking for diffs 2024/05/06 06:07:50 ERROR : Safety abort: all files were changed on Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/". Run with --force if desired. 2024/05/06 06:07:50 NOTICE: Bisync aborted. Please try again. 2024/05/06 06:07:50 Bisync error: all files were changed 2024/05/06 06:07:50 (14) : test sync with force should pass 2024/05/06 06:07:50 (15) : bisync force 2024/05/06 06:07:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:50 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:50 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:50 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/" with Path2 "/tmp/060749ce/all_changed/path2/" 2024/05/06 06:07:50 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:50 INFO : Path1 checking for diffs 2024/05/06 06:07:50 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - file1.txt 2024/05/06 06:07:50 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2024/05/06 06:07:50 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2024/05/06 06:07:50 INFO : (Modified:  1 newer,  7 older) 2024/05/06 06:07:50 INFO : Path2 checking for diffs 2024/05/06 06:07:50 INFO : Applying changes 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/RCLONE_TEST 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/file1.copy1.txt 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/file1.copy2.txt 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/file1.copy3.txt 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/file1.copy4.txt 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/file1.copy5.txt 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/file1.txt 2024/05/06 06:07:50 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/all_changed/path2/subdir/file20.txt 2024/05/06 06:07:50 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:50 INFO : file1.copy2.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : file1.copy3.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : file1.copy1.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : file1.copy4.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : file1.copy5.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:07:50 INFO : RCLONE_TEST: Copied (replaced existing) 2024/05/06 06:07:50 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:50 INFO : Updating listings 2024/05/06 06:07:50 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/all_changed/path1/" vs Path2 "/tmp/060749ce/all_changed/path2/" 2024/05/06 06:07:50 INFO : Bisync successful bisync_test.go:555: TEST all_changed PASSED === RUN TestBisyncRemoteLocal/backupdir 2024/05/06 06:07:50 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:50 DEBUG : path1: Making directory 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:50 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1" 2024/05/06 06:07:50 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:50 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:50 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:50 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:50 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:50 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:50 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1" 2024/05/06 06:07:50 DEBUG : Creating backend with remote "/tmp/060749ce/backupdir/path2" 2024/05/06 06:07:50 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_backupdir/initial" 2024/05/06 06:07:50 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_backupdir-viweyel9" 2024/05/06 06:07:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : Local file system at /tmp/060749ce/initdir/test_backupdir-viweyel9: Waiting for checks to finish 2024/05/06 06:07:50 DEBUG : Local file system at /tmp/060749ce/initdir/test_backupdir-viweyel9: Waiting for transfers to finish 2024/05/06 06:07:50 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file1.txt.yorogin0.partial: renamed to: file1.txt 2024/05/06 06:07:50 INFO : file1.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file2.txt.qexayih3.partial: renamed to: file2.txt 2024/05/06 06:07:50 INFO : file2.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file3.txt.duqapez6.partial: renamed to: file3.txt 2024/05/06 06:07:50 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 INFO : file3.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file4.txt.yatadih0.partial: renamed to: file4.txt 2024/05/06 06:07:50 INFO : file4.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file5.txt.vidozun4.partial: renamed to: file5.txt 2024/05/06 06:07:50 INFO : file5.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file6.txt.vahoheh3.partial: renamed to: file6.txt 2024/05/06 06:07:50 INFO : file6.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file7.txt.sunuqoj1.partial: renamed to: file7.txt 2024/05/06 06:07:50 INFO : file7.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:50 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : RCLONE_TEST.quwumoz4.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:50 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:50 DEBUG : file8.txt.yeficor0.partial: renamed to: file8.txt 2024/05/06 06:07:50 INFO : file8.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_backupdir/modfiles" 2024/05/06 06:07:50 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_backupdir-hisoray0" 2024/05/06 06:07:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : Local file system at /tmp/060749ce/datadir/test_backupdir-hisoray0: Waiting for checks to finish 2024/05/06 06:07:50 DEBUG : Local file system at /tmp/060749ce/datadir/test_backupdir-hisoray0: Waiting for transfers to finish 2024/05/06 06:07:50 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:50 DEBUG : file1.txt.wewakuz5.partial: renamed to: file1.txt 2024/05/06 06:07:50 INFO : file1.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:50 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:07:50 DEBUG : file10.txt.zinotor1.partial: renamed to: file10.txt 2024/05/06 06:07:50 INFO : file10.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:50 DEBUG : file2.txt.kotajey9.partial: renamed to: file2.txt 2024/05/06 06:07:50 INFO : file2.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file11.txt.gunajom0.partial: renamed to: file11.txt 2024/05/06 06:07:50 INFO : file11.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:07:50 DEBUG : file5L.txt.bupuvan1.partial: renamed to: file5L.txt 2024/05/06 06:07:50 INFO : file5L.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:07:50 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:50 DEBUG : file5R.txt.fikasiz0.partial: renamed to: file5R.txt 2024/05/06 06:07:50 INFO : file5R.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:50 DEBUG : file7.txt.rexacin1.partial: renamed to: file7.txt 2024/05/06 06:07:50 INFO : file7.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file6.txt.qakilef8.partial: renamed to: file6.txt 2024/05/06 06:07:50 INFO : file6.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1] 2024/05/06 06:07:50 ERROR : : error listing: directory not found 2024/05/06 06:07:50 ERROR : : error listing: directory not found 2024/05/06 06:07:50 checking initFs Local file system at /tmp/060749ce/initdir/test_backupdir-viweyel9 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1] 2024/05/06 06:07:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1/RCLONE_TEST] 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: Waiting for checks to finish 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1/file2.txt] 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: Waiting for transfers to finish 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1/file3.txt] 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1/file1.txt] 2024/05/06 06:07:50 INFO : file2.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1/file4.txt] 2024/05/06 06:07:50 INFO : file3.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1/file5.txt] 2024/05/06 06:07:50 INFO : file1.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1/file6.txt] 2024/05/06 06:07:50 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1/file7.txt] 2024/05/06 06:07:50 INFO : file4.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1/file8.txt] 2024/05/06 06:07:50 INFO : file5.txt: Copied (new) 2024/05/06 06:07:50 INFO : file6.txt: Copied (new) 2024/05/06 06:07:50 INFO : file7.txt: Copied (new) 2024/05/06 06:07:50 INFO : file8.txt: Copied (new) 2024/05/06 06:07:50 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/backupdir/path1] 2024/05/06 06:07:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file1.txt.qiwuqeh0.partial: renamed to: file1.txt 2024/05/06 06:07:50 INFO : file1.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : Local file system at /tmp/060749ce/backupdir/path2: Waiting for checks to finish 2024/05/06 06:07:50 DEBUG : Local file system at /tmp/060749ce/backupdir/path2: Waiting for transfers to finish 2024/05/06 06:07:50 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file2.txt.cirugeb9.partial: renamed to: file2.txt 2024/05/06 06:07:50 INFO : file2.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:50 DEBUG : RCLONE_TEST.cayufuj0.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:50 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:50 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file5.txt.nojekec9.partial: renamed to: file5.txt 2024/05/06 06:07:50 INFO : file5.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file6.txt.diticuf8.partial: renamed to: file6.txt 2024/05/06 06:07:50 INFO : file6.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file7.txt.firuhuk9.partial: renamed to: file7.txt 2024/05/06 06:07:50 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 INFO : file7.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file8.txt.gocanid9.partial: renamed to: file8.txt 2024/05/06 06:07:50 INFO : file8.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file4.txt.wayoxoz4.partial: renamed to: file4.txt 2024/05/06 06:07:50 INFO : file4.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file3.txt.kipakum8.partial: renamed to: file3.txt 2024/05/06 06:07:50 INFO : file3.txt: Copied (new) 2024/05/06 06:07:50 checking path2 Local file system at /tmp/060749ce/backupdir/path2 2024/05/06 06:07:50 (01) : test backupdir 2024/05/06 06:07:50 (02) : test initial bisync 2024/05/06 06:07:50 (03) : bisync resync backupdir1=/tmp/060749ce/workdir/backupdirs/backupdir1 backupdir2=/tmp/060749ce/workdir/backupdirs/backupdir2 bisync_test.go:920: backupdir test currently only works on local (it uses the workdir) === RUN TestBisyncRemoteLocal/basic 2024/05/06 06:07:50 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:50 DEBUG : path1: Making directory 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:50 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1" 2024/05/06 06:07:50 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:50 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:50 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:50 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:50 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:50 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:50 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1" 2024/05/06 06:07:50 DEBUG : Creating backend with remote "/tmp/060749ce/basic/path2" 2024/05/06 06:07:50 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_basic/initial" 2024/05/06 06:07:50 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_basic-waditar8" 2024/05/06 06:07:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:50 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:50 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:50 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : Local file system at /tmp/060749ce/initdir/test_basic-waditar8: Waiting for checks to finish 2024/05/06 06:07:50 DEBUG : file1.copy2.txt.decuwoc1.partial: renamed to: file1.copy2.txt 2024/05/06 06:07:50 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : Local file system at /tmp/060749ce/initdir/test_basic-waditar8: Waiting for transfers to finish 2024/05/06 06:07:50 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file1.copy1.txt.repubav5.partial: renamed to: file1.copy1.txt 2024/05/06 06:07:50 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file1.copy3.txt.dafezum6.partial: renamed to: file1.copy3.txt 2024/05/06 06:07:50 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file1.copy4.txt.wezehiz9.partial: renamed to: file1.copy4.txt 2024/05/06 06:07:50 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file1.txt.gotohen0.partial: renamed to: file1.txt 2024/05/06 06:07:50 INFO : file1.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : subdir/file20.txt.yuqakub5.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:50 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:50 DEBUG : file1.copy5.txt.xibunap4.partial: renamed to: file1.copy5.txt 2024/05/06 06:07:50 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:50 DEBUG : RCLONE_TEST.sujafic9.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:50 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:50 INFO : subdir: Updated directory metadata 2024/05/06 06:07:50 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_basic/modfiles" 2024/05/06 06:07:50 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_basic-rodipuh3" 2024/05/06 06:07:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : Local file system at /tmp/060749ce/datadir/test_basic-rodipuh3: Waiting for checks to finish 2024/05/06 06:07:50 DEBUG : Local file system at /tmp/060749ce/datadir/test_basic-rodipuh3: Waiting for transfers to finish 2024/05/06 06:07:50 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:50 DEBUG : file1.txt.qujiloc4.partial: renamed to: file1.txt 2024/05/06 06:07:50 INFO : file1.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1] 2024/05/06 06:07:50 ERROR : : error listing: directory not found 2024/05/06 06:07:50 ERROR : : error listing: directory not found 2024/05/06 06:07:50 checking initFs Local file system at /tmp/060749ce/initdir/test_basic-waditar8 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1] 2024/05/06 06:07:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : subdir: Making directory 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/subdir] 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/RCLONE_TEST] 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/file1.copy2.txt] 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/file1.copy1.txt] 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/file1.copy3.txt] 2024/05/06 06:07:50 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: Waiting for checks to finish 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: Waiting for transfers to finish 2024/05/06 06:07:50 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/file1.copy4.txt] 2024/05/06 06:07:50 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/file1.copy5.txt] 2024/05/06 06:07:50 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/file1.txt] 2024/05/06 06:07:50 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/subdir/file20.txt] 2024/05/06 06:07:50 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:07:50 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:07:50 INFO : file1.txt: Copied (new) 2024/05/06 06:07:50 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:50 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1 2024/05/06 06:07:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1] 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/subdir] 2024/05/06 06:07:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file1.copy1.txt.nagekoq0.partial: renamed to: file1.copy1.txt 2024/05/06 06:07:51 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file1.copy2.txt.poyuquh6.partial: renamed to: file1.copy2.txt 2024/05/06 06:07:51 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:51 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:51 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:51 DEBUG : file1.copy3.txt.dogewec4.partial: renamed to: file1.copy3.txt 2024/05/06 06:07:51 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file1.copy4.txt.basivoh8.partial: renamed to: file1.copy4.txt 2024/05/06 06:07:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:51 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/basic/path2: Waiting for checks to finish 2024/05/06 06:07:51 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file1.txt.cawevun2.partial: renamed to: file1.txt 2024/05/06 06:07:51 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 INFO : file1.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : RCLONE_TEST.liweyup9.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:51 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/basic/path2: Waiting for transfers to finish 2024/05/06 06:07:51 DEBUG : file1.copy5.txt.lewuvoy2.partial: renamed to: file1.copy5.txt 2024/05/06 06:07:51 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : subdir/file20.txt.lutayut5.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:51 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:51 INFO : subdir: Updated directory metadata 2024/05/06 06:07:51 checking path2 Local file system at /tmp/060749ce/basic/path2 2024/05/06 06:07:51 (01) : test basic 2024/05/06 06:07:51 (02) : test initial bisync 2024/05/06 06:07:51 (03) : bisync resync 2024/05/06 06:07:51 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:51 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/" with Path2 "/tmp/060749ce/basic/path2/" 2024/05/06 06:07:51 INFO : Copying Path2 files to Path1 2024/05/06 06:07:51 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:51 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:51 INFO : Resync updating listings 2024/05/06 06:07:51 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/" vs Path2 "/tmp/060749ce/basic/path2/" 2024/05/06 06:07:51 INFO : Bisync successful 2024/05/06 06:07:51 (04) : test place newer files on both paths 2024/05/06 06:07:51 (05) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_basic-rodipuh3/file1.txt /tmp/060749ce/basic/path2/ 2024/05/06 06:07:51 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:51 (06) : copy-as /tmp/060749ce/datadir/test_basic-rodipuh3/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/subdir file20.txt 2024/05/06 06:07:51 INFO : file1.txt: Copied (replaced existing) to: file20.txt 2024/05/06 06:07:51 (07) : test bisync run 2024/05/06 06:07:51 (08) : bisync 2024/05/06 06:07:51 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:51 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/" with Path2 "/tmp/060749ce/basic/path2/" 2024/05/06 06:07:51 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:51 INFO : Path1 checking for diffs 2024/05/06 06:07:51 INFO : - Path1 File changed: size (larger), time (newer) - subdir/file20.txt 2024/05/06 06:07:51 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:07:51 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:07:51 INFO : Path2 checking for diffs 2024/05/06 06:07:51 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:07:51 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:07:51 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:07:51 INFO : Applying changes 2024/05/06 06:07:51 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/basic/path2/subdir/file20.txt 2024/05/06 06:07:51 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/file1.txt 2024/05/06 06:07:51 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:51 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:51 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:51 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:07:51 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:51 INFO : Updating listings 2024/05/06 06:07:51 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/basic/path1/" vs Path2 "/tmp/060749ce/basic/path2/" 2024/05/06 06:07:51 INFO : Bisync successful bisync_test.go:555: TEST basic PASSED === RUN TestBisyncRemoteLocal/changes 2024/05/06 06:07:51 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:51 DEBUG : path1: Making directory 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:51 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1" 2024/05/06 06:07:51 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:51 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:51 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1" 2024/05/06 06:07:51 DEBUG : Creating backend with remote "/tmp/060749ce/changes/path2" 2024/05/06 06:07:51 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_changes/initial" 2024/05/06 06:07:51 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_changes-vumimol3" 2024/05/06 06:07:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file1.txt.gakakam5.partial: renamed to: file1.txt 2024/05/06 06:07:51 INFO : file1.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/initdir/test_changes-vumimol3: Waiting for checks to finish 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/initdir/test_changes-vumimol3: Waiting for transfers to finish 2024/05/06 06:07:51 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file4.txt.heyikuk8.partial: renamed to: file4.txt 2024/05/06 06:07:51 INFO : file4.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file3.txt.molibud2.partial: renamed to: file3.txt 2024/05/06 06:07:51 INFO : file3.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file5.txt.voruzam1.partial: renamed to: file5.txt 2024/05/06 06:07:51 DEBUG : file2.txt.qudijus5.partial: renamed to: file2.txt 2024/05/06 06:07:51 INFO : file5.txt: Copied (new) 2024/05/06 06:07:51 INFO : file2.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file7.txt.zezecik4.partial: renamed to: file7.txt 2024/05/06 06:07:51 INFO : file7.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file6.txt.gipowiv9.partial: renamed to: file6.txt 2024/05/06 06:07:51 INFO : file6.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file8.txt.qapivom6.partial: renamed to: file8.txt 2024/05/06 06:07:51 INFO : file8.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:51 DEBUG : RCLONE_TEST.qenihav8.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:51 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:51 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_changes/modfiles" 2024/05/06 06:07:51 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_changes-rohewaw0" 2024/05/06 06:07:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/datadir/test_changes-rohewaw0: Waiting for checks to finish 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/datadir/test_changes-rohewaw0: Waiting for transfers to finish 2024/05/06 06:07:51 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:51 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:51 DEBUG : file1.txt.nahemer5.partial: renamed to: file1.txt 2024/05/06 06:07:51 INFO : file1.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file10.txt.cetolul7.partial: renamed to: file10.txt 2024/05/06 06:07:51 INFO : file10.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:51 DEBUG : file11.txt.yipezar1.partial: renamed to: file11.txt 2024/05/06 06:07:51 INFO : file11.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:07:51 DEBUG : file2.txt.fomoqoc4.partial: renamed to: file2.txt 2024/05/06 06:07:51 INFO : file2.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:07:51 DEBUG : file5L.txt.mifiyuq0.partial: renamed to: file5L.txt 2024/05/06 06:07:51 INFO : file5L.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:07:51 DEBUG : file5R.txt.folelov9.partial: renamed to: file5R.txt 2024/05/06 06:07:51 INFO : file5R.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:51 DEBUG : file7.txt.sunuyer7.partial: renamed to: file7.txt 2024/05/06 06:07:51 INFO : file7.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:51 DEBUG : file6.txt.famuker5.partial: renamed to: file6.txt 2024/05/06 06:07:51 INFO : file6.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1] 2024/05/06 06:07:51 ERROR : : error listing: directory not found 2024/05/06 06:07:51 ERROR : : error listing: directory not found 2024/05/06 06:07:51 checking initFs Local file system at /tmp/060749ce/initdir/test_changes-vumimol3 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1] 2024/05/06 06:07:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/RCLONE_TEST] 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file1.txt] 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file2.txt] 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file3.txt] 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: Waiting for checks to finish 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: Waiting for transfers to finish 2024/05/06 06:07:51 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file4.txt] 2024/05/06 06:07:51 INFO : file1.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file5.txt] 2024/05/06 06:07:51 INFO : file2.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file6.txt] 2024/05/06 06:07:51 INFO : file3.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file7.txt] 2024/05/06 06:07:51 INFO : file4.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file8.txt] 2024/05/06 06:07:51 INFO : file5.txt: Copied (new) 2024/05/06 06:07:51 INFO : file6.txt: Copied (new) 2024/05/06 06:07:51 INFO : file7.txt: Copied (new) 2024/05/06 06:07:51 INFO : file8.txt: Copied (new) 2024/05/06 06:07:51 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1] 2024/05/06 06:07:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/changes/path2: Waiting for checks to finish 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/changes/path2: Waiting for transfers to finish 2024/05/06 06:07:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:51 DEBUG : RCLONE_TEST.cadufom4.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file2.txt.mexulos0.partial: renamed to: file2.txt 2024/05/06 06:07:51 INFO : file2.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file1.txt.rocidex8.partial: renamed to: file1.txt 2024/05/06 06:07:51 INFO : file1.txt: Copied (new) 2024/05/06 06:07:51 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:51 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file3.txt.jehewaw8.partial: renamed to: file3.txt 2024/05/06 06:07:51 INFO : file3.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file4.txt.cibopih7.partial: renamed to: file4.txt 2024/05/06 06:07:51 INFO : file4.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file5.txt.picuroy5.partial: renamed to: file5.txt 2024/05/06 06:07:51 INFO : file5.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file6.txt.govekof0.partial: renamed to: file6.txt 2024/05/06 06:07:51 INFO : file6.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file7.txt.mecezex9.partial: renamed to: file7.txt 2024/05/06 06:07:51 INFO : file7.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file8.txt.gayojus9.partial: renamed to: file8.txt 2024/05/06 06:07:51 INFO : file8.txt: Copied (new) 2024/05/06 06:07:51 checking path2 Local file system at /tmp/060749ce/changes/path2 2024/05/06 06:07:51 (01) : test changes 2024/05/06 06:07:51 (02) : test initial bisync 2024/05/06 06:07:51 (03) : bisync resync 2024/05/06 06:07:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:51 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/" with Path2 "/tmp/060749ce/changes/path2/" 2024/05/06 06:07:51 INFO : Copying Path2 files to Path1 2024/05/06 06:07:51 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:51 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:51 INFO : Resync updating listings 2024/05/06 06:07:51 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/" vs Path2 "/tmp/060749ce/changes/path2/" 2024/05/06 06:07:51 INFO : Bisync successful 2024/05/06 06:07:51 (04) : test make modifications on both paths 2024/05/06 06:07:51 (05) : test new on path2 - file10 2024/05/06 06:07:51 (06) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_changes-rohewaw0/file10.txt /tmp/060749ce/changes/path2/ 2024/05/06 06:07:51 INFO : file10.txt: Copied (new) 2024/05/06 06:07:51 (07) : test newer on path2 - file1 2024/05/06 06:07:51 (08) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_changes-rohewaw0/file1.txt /tmp/060749ce/changes/path2/ 2024/05/06 06:07:51 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:51 (09) : test new on path1 - file11 2024/05/06 06:07:51 (10) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_changes-rohewaw0/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/ 2024/05/06 06:07:51 INFO : file11.txt: Copied (new) 2024/05/06 06:07:51 (11) : test newer on path1 - file2 2024/05/06 06:07:51 (12) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_changes-rohewaw0/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/ 2024/05/06 06:07:51 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:51 (13) : test deleted on path2 - file3 2024/05/06 06:07:51 (14) : delete-file /tmp/060749ce/changes/path2/file3.txt 2024/05/06 06:07:51 INFO : file3.txt: Deleted 2024/05/06 06:07:51 (15) : test deleted on path1 - file4 2024/05/06 06:07:51 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file4.txt 2024/05/06 06:07:51 INFO : file4.txt: Deleted 2024/05/06 06:07:51 (17) : test deleted on both paths - file8 2024/05/06 06:07:51 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file8.txt 2024/05/06 06:07:51 INFO : file8.txt: Deleted 2024/05/06 06:07:51 (19) : delete-file /tmp/060749ce/changes/path2/file8.txt 2024/05/06 06:07:51 INFO : file8.txt: Deleted 2024/05/06 06:07:51 (20) : test changed on both paths - file5 (file5R, file5L) 2024/05/06 06:07:51 (21) : touch-glob 2001-01-02 /tmp/060749ce/datadir/test_changes-rohewaw0/ file5R.txt 2024/05/06 06:07:51 (22) : copy-as /tmp/060749ce/datadir/test_changes-rohewaw0/file5R.txt /tmp/060749ce/changes/path2/ file5.txt 2024/05/06 06:07:51 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:07:51 (23) : touch-glob 2001-03-04 /tmp/060749ce/datadir/test_changes-rohewaw0/ file5L.txt 2024/05/06 06:07:51 (24) : copy-as /tmp/060749ce/datadir/test_changes-rohewaw0/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/ file5.txt 2024/05/06 06:07:51 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:07:51 (25) : test newer on path2 and deleted on path1 - file6 2024/05/06 06:07:51 (26) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_changes-rohewaw0/file6.txt /tmp/060749ce/changes/path2/ 2024/05/06 06:07:51 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:07:51 (27) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file6.txt 2024/05/06 06:07:51 INFO : file6.txt: Deleted 2024/05/06 06:07:51 (28) : test newer on path1 and deleted on path2 - file7 2024/05/06 06:07:51 (29) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_changes-rohewaw0/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/ 2024/05/06 06:07:51 INFO : file7.txt: Copied (replaced existing) 2024/05/06 06:07:51 (30) : delete-file /tmp/060749ce/changes/path2/file7.txt 2024/05/06 06:07:51 INFO : file7.txt: Deleted 2024/05/06 06:07:51 (31) : test bisync run 2024/05/06 06:07:51 (32) : bisync 2024/05/06 06:07:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:51 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/" with Path2 "/tmp/060749ce/changes/path2/" 2024/05/06 06:07:51 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:51 INFO : Path1 checking for diffs 2024/05/06 06:07:51 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:07:51 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:07:51 INFO : - Path1 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:07:51 INFO : - Path1 File was deleted - file6.txt 2024/05/06 06:07:51 INFO : - Path1 File changed: size (larger), time (newer) - file7.txt 2024/05/06 06:07:51 INFO : - Path1 File was deleted - file8.txt 2024/05/06 06:07:51 INFO : - Path1 File is new - file11.txt 2024/05/06 06:07:51 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:07:51 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:07:51 INFO : Path2 checking for diffs 2024/05/06 06:07:51 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:07:51 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:07:51 INFO : - Path2 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:07:51 INFO : - Path2 File changed: size (larger), time (newer) - file6.txt 2024/05/06 06:07:51 INFO : - Path2 File was deleted - file7.txt 2024/05/06 06:07:51 INFO : - Path2 File was deleted - file8.txt 2024/05/06 06:07:51 INFO : - Path2 File is new - file10.txt 2024/05/06 06:07:51 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:07:51 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:07:51 INFO : Applying changes 2024/05/06 06:07:51 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:07:51 INFO : Checking potential conflicts... 2024/05/06 06:07:51 NOTICE: Local file system at /tmp/060749ce/changes/path2: 1 differences found 2024/05/06 06:07:51 NOTICE: Local file system at /tmp/060749ce/changes/path2: 1 errors while checking 2024/05/06 06:07:51 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:07:51 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/changes/path2/file11.txt 2024/05/06 06:07:51 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/changes/path2/file2.txt 2024/05/06 06:07:51 INFO : - Path2 Queue delete - /tmp/060749ce/changes/path2/file4.txt 2024/05/06 06:07:51 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:07:51 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file5.txt.conflict1 2024/05/06 06:07:51 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/05/06 06:07:51 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/changes/path2/file5.txt.conflict1 2024/05/06 06:07:51 NOTICE: - Path2 Renaming Path2 copy - /tmp/060749ce/changes/path2/file5.txt.conflict2 2024/05/06 06:07:51 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/05/06 06:07:51 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file5.txt.conflict2 2024/05/06 06:07:51 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file6.txt 2024/05/06 06:07:51 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/changes/path2/file7.txt 2024/05/06 06:07:51 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file1.txt 2024/05/06 06:07:51 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file10.txt 2024/05/06 06:07:51 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/file3.txt 2024/05/06 06:07:51 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:51 INFO : file5.txt.conflict2: Copied (new) 2024/05/06 06:07:51 INFO : file10.txt: Copied (new) 2024/05/06 06:07:51 INFO : file6.txt: Copied (new) 2024/05/06 06:07:51 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:51 INFO : file3.txt: Deleted 2024/05/06 06:07:51 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:51 INFO : file11.txt: Copied (new) 2024/05/06 06:07:51 INFO : file7.txt: Copied (new) 2024/05/06 06:07:51 INFO : file5.txt.conflict1: Copied (new) 2024/05/06 06:07:51 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:51 INFO : file4.txt: Deleted 2024/05/06 06:07:51 INFO : Updating listings 2024/05/06 06:07:51 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/changes/path1/" vs Path2 "/tmp/060749ce/changes/path2/" 2024/05/06 06:07:51 INFO : Bisync successful bisync_test.go:555: TEST changes PASSED === RUN TestBisyncRemoteLocal/check_access 2024/05/06 06:07:51 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:51 DEBUG : path1: Making directory 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:51 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1" 2024/05/06 06:07:51 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:51 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:51 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1" 2024/05/06 06:07:51 DEBUG : Creating backend with remote "/tmp/060749ce/check_access/path2" 2024/05/06 06:07:51 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access/initial" 2024/05/06 06:07:51 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_check_access-zujozif6" 2024/05/06 06:07:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:51 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:51 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:51 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/initdir/test_check_access-zujozif6: Waiting for checks to finish 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/initdir/test_check_access-zujozif6: Waiting for transfers to finish 2024/05/06 06:07:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file1.txt.qawiner0.partial: renamed to: file1.txt 2024/05/06 06:07:51 INFO : file1.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file3.txt.wivoguq8.partial: renamed to: file3.txt 2024/05/06 06:07:51 INFO : file3.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file4.txt.xeluyoq7.partial: renamed to: file4.txt 2024/05/06 06:07:51 INFO : file4.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file2.txt.zifehiv1.partial: renamed to: file2.txt 2024/05/06 06:07:51 INFO : file2.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : subdir/file20.txt.hixicil5.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:51 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:51 DEBUG : RCLONE_TEST.filimal6.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:51 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:51 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:51 DEBUG : subdir/RCLONE_TEST.viguhij0.partial: renamed to: subdir/RCLONE_TEST 2024/05/06 06:07:51 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:07:51 INFO : subdir: Updated directory metadata 2024/05/06 06:07:51 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access/modfiles" 2024/05/06 06:07:51 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_check_access-bikocig1" 2024/05/06 06:07:51 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/datadir/test_check_access-bikocig1: Waiting for checks to finish 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/datadir/test_check_access-bikocig1: Waiting for transfers to finish 2024/05/06 06:07:51 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:07:51 DEBUG : hold.txt.qegacuk2.partial: renamed to: hold.txt 2024/05/06 06:07:51 INFO : hold.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1] 2024/05/06 06:07:51 ERROR : : error listing: directory not found 2024/05/06 06:07:51 ERROR : : error listing: directory not found 2024/05/06 06:07:51 checking initFs Local file system at /tmp/060749ce/initdir/test_check_access-zujozif6 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1] 2024/05/06 06:07:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : subdir: Making directory 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/subdir] 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/RCLONE_TEST] 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/file1.txt] 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/file2.txt] 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/file3.txt] 2024/05/06 06:07:51 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: Waiting for checks to finish 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: Waiting for transfers to finish 2024/05/06 06:07:51 INFO : file1.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/file4.txt] 2024/05/06 06:07:51 INFO : file2.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/subdir/RCLONE_TEST] 2024/05/06 06:07:51 INFO : file3.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/subdir/file20.txt] 2024/05/06 06:07:51 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:51 INFO : file4.txt: Copied (new) 2024/05/06 06:07:51 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:07:51 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:51 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1] 2024/05/06 06:07:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/subdir] 2024/05/06 06:07:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:51 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:51 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:51 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/check_access/path2: Waiting for checks to finish 2024/05/06 06:07:51 DEBUG : Local file system at /tmp/060749ce/check_access/path2: Waiting for transfers to finish 2024/05/06 06:07:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file1.txt.licoluk2.partial: renamed to: file1.txt 2024/05/06 06:07:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 INFO : file1.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file2.txt.koqiyet0.partial: renamed to: file2.txt 2024/05/06 06:07:51 INFO : file2.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file4.txt.mamukev9.partial: renamed to: file4.txt 2024/05/06 06:07:51 INFO : file4.txt: Copied (new) 2024/05/06 06:07:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:51 DEBUG : RCLONE_TEST.miloxih5.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:51 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:51 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:51 DEBUG : subdir/file20.txt.lefuxem3.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:51 DEBUG : subdir/RCLONE_TEST.gisixic5.partial: renamed to: subdir/RCLONE_TEST 2024/05/06 06:07:51 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:51 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:07:51 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:51 DEBUG : file3.txt.liganek1.partial: renamed to: file3.txt 2024/05/06 06:07:51 INFO : file3.txt: Copied (new) 2024/05/06 06:07:51 INFO : subdir: Updated directory metadata 2024/05/06 06:07:51 checking path2 Local file system at /tmp/060749ce/check_access/path2 2024/05/06 06:07:51 (01) : test check-access 2024/05/06 06:07:51 (02) : test initial bisync 2024/05/06 06:07:51 (03) : bisync resync 2024/05/06 06:07:51 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:51 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" with Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:51 INFO : Copying Path2 files to Path1 2024/05/06 06:07:51 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:51 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:51 INFO : Resync updating listings 2024/05/06 06:07:51 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" vs Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:51 INFO : Bisync successful 2024/05/06 06:07:51 (04) : test 1. see that check-access passes with the initial setup 2024/05/06 06:07:51 (05) : bisync check-access 2024/05/06 06:07:51 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:51 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" with Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:51 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:51 INFO : Path1 checking for diffs 2024/05/06 06:07:51 INFO : Path2 checking for diffs 2024/05/06 06:07:51 INFO : Checking access health 2024/05/06 06:07:51 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/05/06 06:07:51 INFO : No changes found 2024/05/06 06:07:51 INFO : Updating listings 2024/05/06 06:07:51 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" vs Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:51 INFO : Bisync successful 2024/05/06 06:07:51 (06) : test 2. delete the path2 subdir RCLONE_TEST and run sync. should fail critical. 2024/05/06 06:07:51 (07) : delete-file /tmp/060749ce/check_access/path2/subdir/RCLONE_TEST 2024/05/06 06:07:51 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:51 (08) : bisync check-access 2024/05/06 06:07:51 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:51 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" with Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:51 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:51 INFO : Path1 checking for diffs 2024/05/06 06:07:51 INFO : Path2 checking for diffs 2024/05/06 06:07:51 INFO : - Path2 File was deleted - subdir/RCLONE_TEST 2024/05/06 06:07:51 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:07:51 INFO : Checking access health 2024/05/06 06:07:51 ERROR : Access test failed: Path1 count 2, Path2 count 1 - RCLONE_TEST 2024/05/06 06:07:51 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/RCLONE_TEST 2024/05/06 06:07:51 ERROR : Bisync critical error: check file check failed 2024/05/06 06:07:51 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:51 Bisync error: bisync aborted 2024/05/06 06:07:51 (09) : copy-listings path2-missing 2024/05/06 06:07:51 (10) : test 3. put the path2 subdir RCLONE_TEST back, resync. 2024/05/06 06:07:51 (11) : copy-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/subdir/RCLONE_TEST /tmp/060749ce/check_access/path2/ 2024/05/06 06:07:51 (12) : bisync resync 2024/05/06 06:07:51 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:51 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:51 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:51 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" with Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:51 INFO : Copying Path2 files to Path1 2024/05/06 06:07:51 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:51 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:51 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:07:51 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:51 INFO : Resync updating listings 2024/05/06 06:07:52 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" vs Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:52 INFO : Bisync successful 2024/05/06 06:07:52 (13) : test 4. run sync with check-access. should pass. 2024/05/06 06:07:52 (14) : bisync check-access 2024/05/06 06:07:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:52 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" with Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:52 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:52 INFO : Path1 checking for diffs 2024/05/06 06:07:52 INFO : Path2 checking for diffs 2024/05/06 06:07:52 INFO : Checking access health 2024/05/06 06:07:52 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/05/06 06:07:52 INFO : No changes found 2024/05/06 06:07:52 INFO : Updating listings 2024/05/06 06:07:52 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" vs Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:52 INFO : Bisync successful 2024/05/06 06:07:52 (15) : test 5. delete path1 top level RCLONE_TEST, run sync. should fail critical. 2024/05/06 06:07:52 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/RCLONE_TEST 2024/05/06 06:07:52 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:52 (17) : bisync check-access 2024/05/06 06:07:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:52 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" with Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:52 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:52 INFO : Path1 checking for diffs 2024/05/06 06:07:52 INFO : - Path1 File was deleted - RCLONE_TEST 2024/05/06 06:07:52 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:07:52 INFO : Path2 checking for diffs 2024/05/06 06:07:52 INFO : Checking access health 2024/05/06 06:07:52 ERROR : Access test failed: Path1 count 1, Path2 count 2 - RCLONE_TEST 2024/05/06 06:07:52 ERROR : -  Access test failed: Path2 file not found in Path1 - RCLONE_TEST 2024/05/06 06:07:52 ERROR : Bisync critical error: check file check failed 2024/05/06 06:07:52 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:52 Bisync error: bisync aborted 2024/05/06 06:07:52 (18) : copy-listings path1-missing 2024/05/06 06:07:52 (19) : test 6. run again. should fail critical due to missing listings. 2024/05/06 06:07:52 (20) : bisync check-access 2024/05/06 06:07:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:52 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" with Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:52 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/060749ce/workdir/TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_check_access_path1..tmp_060749ce_check_access_path2.path1.lst Path2: /tmp/060749ce/workdir/TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_check_access_path1..tmp_060749ce_check_access_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/060749ce/workdir" 2024/05/06 06:07:52 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:52 Bisync error: bisync aborted 2024/05/06 06:07:52 (21) : move-listings missing-listings 2024/05/06 06:07:52 (22) : test 7. run resync, which will copy the path2 top level back to path1. 2024/05/06 06:07:52 (23) : bisync resync 2024/05/06 06:07:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:52 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" with Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:52 INFO : Copying Path2 files to Path1 2024/05/06 06:07:52 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:52 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:52 INFO : Resync updating listings 2024/05/06 06:07:52 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" vs Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:52 INFO : Bisync successful 2024/05/06 06:07:52 (24) : test 8. run sync with --check-access. should pass. 2024/05/06 06:07:52 (25) : bisync check-access 2024/05/06 06:07:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:52 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" with Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:52 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:52 INFO : Path1 checking for diffs 2024/05/06 06:07:52 INFO : Path2 checking for diffs 2024/05/06 06:07:52 INFO : Checking access health 2024/05/06 06:07:52 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/05/06 06:07:52 INFO : No changes found 2024/05/06 06:07:52 INFO : Updating listings 2024/05/06 06:07:52 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access/path1/" vs Path2 "/tmp/060749ce/check_access/path2/" 2024/05/06 06:07:52 INFO : Bisync successful bisync_test.go:555: TEST check_access PASSED === RUN TestBisyncRemoteLocal/check_access_filters 2024/05/06 06:07:52 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:52 DEBUG : path1: Making directory 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:52 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1" 2024/05/06 06:07:52 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:52 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:52 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:52 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:52 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:52 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:52 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1" 2024/05/06 06:07:52 DEBUG : Creating backend with remote "/tmp/060749ce/check_access_filters/path2" 2024/05/06 06:07:52 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/initial" 2024/05/06 06:07:52 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_check_access_filters-macisil9" 2024/05/06 06:07:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:52 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:52 DEBUG : subdir-not: Making directory with metadata 2024/05/06 06:07:52 INFO : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not 2024/05/06 06:07:52 DEBUG : subdirX: Making directory with metadata 2024/05/06 06:07:52 INFO : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdirX", newDst=subdirX 2024/05/06 06:07:52 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1: Making directory with metadata 2024/05/06 06:07:52 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2: Making directory with metadata 2024/05/06 06:07:52 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : file3.txt.tigomad7.partial: renamed to: file3.txt 2024/05/06 06:07:52 INFO : file3.txt: Copied (new) 2024/05/06 06:07:52 INFO : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirA: Making directory with metadata 2024/05/06 06:07:52 INFO : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA 2024/05/06 06:07:52 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdir/subdirB: Making directory with metadata 2024/05/06 06:07:52 DEBUG : file4.txt.walonit1.partial: renamed to: file4.txt 2024/05/06 06:07:52 INFO : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB 2024/05/06 06:07:52 INFO : file4.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : Local file system at /tmp/060749ce/initdir/test_check_access_filters-macisil9: Waiting for checks to finish 2024/05/06 06:07:52 DEBUG : Local file system at /tmp/060749ce/initdir/test_check_access_filters-macisil9: Waiting for transfers to finish 2024/05/06 06:07:52 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : file1.txt.vipuvug4.partial: renamed to: file1.txt 2024/05/06 06:07:52 INFO : file1.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : file2.txt.cuwenek1.partial: renamed to: file2.txt 2024/05/06 06:07:52 INFO : file2.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdirX/file20.txt.lidoxed3.partial: renamed to: subdirX/file20.txt 2024/05/06 06:07:52 INFO : subdirX/file20.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdir-not/file20.txt.naqofov5.partial: renamed to: subdir-not/file20.txt 2024/05/06 06:07:52 INFO : subdir-not/file20.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdirX/RCLONE_TEST.zufikej4.partial: renamed to: subdirX/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/file30.txt.cekanek1.partial: renamed to: subdirX/subdirX1/file30.txt 2024/05/06 06:07:52 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : RCLONE_TEST.saxuzul5.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:52 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdir-not/RCLONE_TEST.xokawit7.partial: renamed to: subdir-not/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/RCLONE_TEST.rofimaj3.partial: renamed to: subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdir/subdirB/RCLONE_TEST.gobudup8.partial: renamed to: subdir/subdirB/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdir/subdirB/file30.txt.gituhek7.partial: renamed to: subdir/subdirB/file30.txt 2024/05/06 06:07:52 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/RCLONE_TEST.kojivod4.partial: renamed to: subdir/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdir/subdirA/RCLONE_TEST.roqefox2.partial: renamed to: subdir/subdirA/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdir/subdirA/file30.txt.mebaqif2.partial: renamed to: subdir/subdirA/file30.txt 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/file30.txt.nehucik2.partial: renamed to: subdir-not/subdir-not2/file30.txt 2024/05/06 06:07:52 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/file20.txt.noneduf4.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:52 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.neforam9.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 INFO : subdir/subdirB: Updated directory metadata 2024/05/06 06:07:52 INFO : subdirX/subdirX1: Updated directory metadata 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2: Updated directory metadata 2024/05/06 06:07:52 INFO : subdir/subdirA: Updated directory metadata 2024/05/06 06:07:52 INFO : subdirX: Updated directory metadata 2024/05/06 06:07:52 INFO : subdir: Updated directory metadata 2024/05/06 06:07:52 INFO : subdir-not: Updated directory metadata 2024/05/06 06:07:52 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/modfiles" 2024/05/06 06:07:52 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_check_access_filters-riculew9" 2024/05/06 06:07:52 DEBUG : exclude-other-filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : include-other-filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : Local file system at /tmp/060749ce/datadir/test_check_access_filters-riculew9: Waiting for checks to finish 2024/05/06 06:07:52 DEBUG : Local file system at /tmp/060749ce/datadir/test_check_access_filters-riculew9: Waiting for transfers to finish 2024/05/06 06:07:52 DEBUG : exclude-other-filtersfile.txt: md5 = 5fcc6205d7df1c2e9ed3a15a1356b345 OK 2024/05/06 06:07:52 DEBUG : include-other-filtersfile.txt: md5 = 2ec13b2813141ed088e5978ef5a47b0e OK 2024/05/06 06:07:52 DEBUG : include-other-filtersfile.txt.xubatat7.partial: renamed to: include-other-filtersfile.txt 2024/05/06 06:07:52 INFO : include-other-filtersfile.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : exclude-other-filtersfile.txt.jisilib3.partial: renamed to: exclude-other-filtersfile.txt 2024/05/06 06:07:52 INFO : exclude-other-filtersfile.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1] 2024/05/06 06:07:52 ERROR : : error listing: directory not found 2024/05/06 06:07:52 ERROR : : error listing: directory not found 2024/05/06 06:07:52 checking initFs Local file system at /tmp/060749ce/initdir/test_check_access_filters-macisil9 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1] 2024/05/06 06:07:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir: Making directory 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir] 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/file2.txt] 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/RCLONE_TEST] 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/file1.txt] 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/file3.txt] 2024/05/06 06:07:52 DEBUG : subdir-not: Making directory 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir-not] 2024/05/06 06:07:52 DEBUG : subdirX: Making directory 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdirX] 2024/05/06 06:07:52 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1: Making directory 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdirX/subdirX1] 2024/05/06 06:07:52 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirA: Making directory 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir/subdirA] 2024/05/06 06:07:52 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2: Making directory 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir-not/subdir-not2] 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirB: Making directory 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir/subdirB] 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 INFO : file3.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/file4.txt] 2024/05/06 06:07:52 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: Waiting for checks to finish 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: Waiting for transfers to finish 2024/05/06 06:07:52 INFO : file1.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdirX/RCLONE_TEST] 2024/05/06 06:07:52 INFO : file2.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdirX/file20.txt] 2024/05/06 06:07:52 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir/RCLONE_TEST] 2024/05/06 06:07:52 INFO : file4.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir/file20.txt] 2024/05/06 06:07:52 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir-not/RCLONE_TEST] 2024/05/06 06:07:52 INFO : subdirX/file20.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir-not/file20.txt] 2024/05/06 06:07:52 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST] 2024/05/06 06:07:52 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdirX/subdirX1/file30.txt] 2024/05/06 06:07:52 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir-not/subdir-not2/RCLONE_TEST] 2024/05/06 06:07:52 INFO : subdir-not/file20.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir-not/subdir-not2/file30.txt] 2024/05/06 06:07:52 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir/subdirB/RCLONE_TEST] 2024/05/06 06:07:52 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir/subdirB/file30.txt] 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir/subdirA/RCLONE_TEST] 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir/subdirA/file30.txt] 2024/05/06 06:07:52 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/05/06 06:07:52 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/05/06 06:07:52 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1] 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdirX] 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir] 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir-not] 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdirX/subdirX1] 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir-not/subdir-not2] 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir/subdirB] 2024/05/06 06:07:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir/subdirA] 2024/05/06 06:07:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:52 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:52 DEBUG : subdir-not: Making directory with metadata 2024/05/06 06:07:52 INFO : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not 2024/05/06 06:07:52 DEBUG : subdirX: Making directory with metadata 2024/05/06 06:07:52 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 INFO : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : file1.txt.tixiwon0.partial: renamed to: file1.txt 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdirX", newDst=subdirX 2024/05/06 06:07:52 INFO : file1.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1: Making directory with metadata 2024/05/06 06:07:52 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : file3.txt.xuwuyuc7.partial: renamed to: file3.txt 2024/05/06 06:07:52 INFO : file3.txt: Copied (new) 2024/05/06 06:07:52 INFO : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1 2024/05/06 06:07:52 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirA: Making directory with metadata 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 INFO : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA 2024/05/06 06:07:52 DEBUG : subdir/subdirB: Making directory with metadata 2024/05/06 06:07:52 INFO : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB 2024/05/06 06:07:52 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2: Making directory with metadata 2024/05/06 06:07:52 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:52 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2 2024/05/06 06:07:52 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdirX/RCLONE_TEST.gasekel4.partial: renamed to: subdirX/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file2.txt.paqozin6.partial: renamed to: file2.txt 2024/05/06 06:07:52 INFO : file2.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : RCLONE_TEST.cinebak9.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:52 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdirX/file20.txt.yodixoq5.partial: renamed to: subdirX/file20.txt 2024/05/06 06:07:52 INFO : subdirX/file20.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:52 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : Local file system at /tmp/060749ce/check_access_filters/path2: Waiting for checks to finish 2024/05/06 06:07:52 DEBUG : Local file system at /tmp/060749ce/check_access_filters/path2: Waiting for transfers to finish 2024/05/06 06:07:52 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : file4.txt.hikucac1.partial: renamed to: file4.txt 2024/05/06 06:07:52 INFO : file4.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/file20.txt.daketax6.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:52 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/file30.txt.jefusom1.partial: renamed to: subdirX/subdirX1/file30.txt 2024/05/06 06:07:52 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/RCLONE_TEST.dilebiv3.partial: renamed to: subdir/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdir-not/RCLONE_TEST.lifipug8.partial: renamed to: subdir-not/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdir-not/file20.txt.zonaqal7.partial: renamed to: subdir-not/file20.txt 2024/05/06 06:07:52 INFO : subdir-not/file20.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdirX/subdirX1/RCLONE_TEST.senifaw3.partial: renamed to: subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:07:52 DEBUG : subdir/subdirA/file30.txt.vafuhid2.partial: renamed to: subdir/subdirA/file30.txt 2024/05/06 06:07:52 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/05/06 06:07:52 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdir/subdirA/RCLONE_TEST.vucuhak6.partial: renamed to: subdir/subdirA/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdir/subdirB/file30.txt.galubep5.partial: renamed to: subdir/subdirB/file30.txt 2024/05/06 06:07:52 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/file30.txt.muyifir0.partial: renamed to: subdir-not/subdir-not2/file30.txt 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdir/subdirB/RCLONE_TEST.vokobaj6.partial: renamed to: subdir/subdirB/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:52 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.sewedit9.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2: Updated directory metadata 2024/05/06 06:07:52 INFO : subdir/subdirA: Updated directory metadata 2024/05/06 06:07:52 INFO : subdirX/subdirX1: Updated directory metadata 2024/05/06 06:07:52 INFO : subdir/subdirB: Updated directory metadata 2024/05/06 06:07:52 INFO : subdirX: Updated directory metadata 2024/05/06 06:07:52 INFO : subdir: Updated directory metadata 2024/05/06 06:07:52 INFO : subdir-not: Updated directory metadata 2024/05/06 06:07:52 checking path2 Local file system at /tmp/060749ce/check_access_filters/path2 2024/05/06 06:07:52 (01) : test check-access-filters 2024/05/06 06:07:52 (02) : test EXCLUDE - OTHER TESTS 2024/05/06 06:07:52 (03) : copy-file /tmp/060749ce/datadir/test_check_access_filters-riculew9/exclude-other-filtersfile.txt /tmp/060749ce/workdir/ 2024/05/06 06:07:52 INFO : exclude-other-filtersfile.txt: Copied (new) 2024/05/06 06:07:52 (04) : test resync to get the filters file md5 built. 2024/05/06 06:07:52 (05) : bisync resync filters-file=/tmp/060749ce/workdir/exclude-other-filtersfile.txt 2024/05/06 06:07:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:52 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" with Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:52 INFO : Using filters file /tmp/060749ce/workdir/exclude-other-filtersfile.txt 2024/05/06 06:07:52 INFO : Storing filters file hash to /tmp/060749ce/workdir/exclude-other-filtersfile.txt.md5 2024/05/06 06:07:52 INFO : Copying Path2 files to Path1 2024/05/06 06:07:52 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:52 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:52 INFO : Resync updating listings 2024/05/06 06:07:52 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" vs Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:52 INFO : Bisync successful 2024/05/06 06:07:52 (06) : test EXCLUDE - test filters for check access 2024/05/06 06:07:52 (07) : bisync check-access filters-file=/tmp/060749ce/workdir/exclude-other-filtersfile.txt 2024/05/06 06:07:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:52 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" with Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:52 INFO : Using filters file /tmp/060749ce/workdir/exclude-other-filtersfile.txt 2024/05/06 06:07:52 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:52 INFO : Path1 checking for diffs 2024/05/06 06:07:52 INFO : Path2 checking for diffs 2024/05/06 06:07:52 INFO : Checking access health 2024/05/06 06:07:52 INFO : Found 3 matching "RCLONE_TEST" files on both paths 2024/05/06 06:07:52 INFO : No changes found 2024/05/06 06:07:52 INFO : Updating listings 2024/05/06 06:07:52 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" vs Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:52 INFO : Bisync successful 2024/05/06 06:07:52 (08) : copy-listings exclude-initial 2024/05/06 06:07:52 (09) : test EXCLUDE - delete RCLONE_TEST files in excluded directories 2024/05/06 06:07:52 (10) : delete-file /tmp/060749ce/check_access_filters/path2/subdir/subdirA/RCLONE_TEST 2024/05/06 06:07:52 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:52 (11) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir-not/RCLONE_TEST 2024/05/06 06:07:52 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:52 (12) : delete-file /tmp/060749ce/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST 2024/05/06 06:07:52 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:52 (13) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdirX/RCLONE_TEST 2024/05/06 06:07:52 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:52 (14) : test EXCLUDE - test should PASS 2024/05/06 06:07:52 (15) : bisync check-access filters-file=/tmp/060749ce/workdir/exclude-other-filtersfile.txt 2024/05/06 06:07:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:52 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" with Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:52 INFO : Using filters file /tmp/060749ce/workdir/exclude-other-filtersfile.txt 2024/05/06 06:07:52 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:52 INFO : Path1 checking for diffs 2024/05/06 06:07:52 INFO : Path2 checking for diffs 2024/05/06 06:07:52 INFO : Checking access health 2024/05/06 06:07:52 INFO : Found 3 matching "RCLONE_TEST" files on both paths 2024/05/06 06:07:52 INFO : No changes found 2024/05/06 06:07:52 INFO : Updating listings 2024/05/06 06:07:52 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" vs Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:52 INFO : Bisync successful 2024/05/06 06:07:52 (16) : copy-listings exclude-pass-run 2024/05/06 06:07:52 (17) : test EXCLUDE - delete RCLONE_TEST files in included directories 2024/05/06 06:07:52 (18) : delete-file /tmp/060749ce/check_access_filters/path2/RCLONE_TEST 2024/05/06 06:07:52 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:52 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir/RCLONE_TEST 2024/05/06 06:07:52 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:52 (20) : test EXCLUDE - test should ABORT 2024/05/06 06:07:52 (21) : bisync check-access filters-file=/tmp/060749ce/workdir/exclude-other-filtersfile.txt 2024/05/06 06:07:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:52 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" with Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:52 INFO : Using filters file /tmp/060749ce/workdir/exclude-other-filtersfile.txt 2024/05/06 06:07:52 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:52 INFO : Path1 checking for diffs 2024/05/06 06:07:52 INFO : - Path1 File was deleted - subdir/RCLONE_TEST 2024/05/06 06:07:52 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:07:52 INFO : Path2 checking for diffs 2024/05/06 06:07:52 INFO : - Path2 File was deleted - RCLONE_TEST 2024/05/06 06:07:52 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:07:52 INFO : Checking access health 2024/05/06 06:07:52 ERROR : -  Access test failed: Path1 file not found in Path2 - RCLONE_TEST 2024/05/06 06:07:52 ERROR : -  Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST 2024/05/06 06:07:52 ERROR : Bisync critical error: check file check failed 2024/05/06 06:07:52 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:52 Bisync error: bisync aborted 2024/05/06 06:07:52 (22) : move-listings exclude-error-run 2024/05/06 06:07:52 (23) : test INCLUDE - OTHER TESTS 2024/05/06 06:07:52 (24) : test reset to the initial state 2024/05/06 06:07:52 (25) : copy-dir /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/initial TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/ 2024/05/06 06:07:52 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 (26) : sync-dir TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/ /tmp/060749ce/check_access_filters/path2/ 2024/05/06 06:07:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/05/06 06:07:52 INFO : subdir/subdirA: Updated directory metadata 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2: Updated directory metadata 2024/05/06 06:07:52 INFO : subdir-not: Updated directory metadata 2024/05/06 06:07:52 INFO : subdir: Updated directory metadata 2024/05/06 06:07:52 (27) : copy-file /tmp/060749ce/datadir/test_check_access_filters-riculew9/include-other-filtersfile.txt /tmp/060749ce/workdir/ 2024/05/06 06:07:52 INFO : include-other-filtersfile.txt: Copied (new) 2024/05/06 06:07:52 (28) : bisync resync filters-file=/tmp/060749ce/workdir/include-other-filtersfile.txt 2024/05/06 06:07:52 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:07:52 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:52 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:52 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" with Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:52 INFO : Using filters file /tmp/060749ce/workdir/include-other-filtersfile.txt 2024/05/06 06:07:52 INFO : Storing filters file hash to /tmp/060749ce/workdir/include-other-filtersfile.txt.md5 2024/05/06 06:07:52 INFO : Copying Path2 files to Path1 2024/05/06 06:07:52 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:52 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:52 INFO : Resync updating listings 2024/05/06 06:07:52 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" vs Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:52 INFO : Bisync successful 2024/05/06 06:07:52 (29) : test INCLUDE - test include/exclude filters for check access 2024/05/06 06:07:52 (30) : bisync check-access filters-file=/tmp/060749ce/workdir/include-other-filtersfile.txt 2024/05/06 06:07:53 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" with Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:53 INFO : Using filters file /tmp/060749ce/workdir/include-other-filtersfile.txt 2024/05/06 06:07:53 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:53 INFO : Path1 checking for diffs 2024/05/06 06:07:53 INFO : Path2 checking for diffs 2024/05/06 06:07:53 INFO : Checking access health 2024/05/06 06:07:53 INFO : Found 5 matching "RCLONE_TEST" files on both paths 2024/05/06 06:07:53 INFO : No changes found 2024/05/06 06:07:53 INFO : Updating listings 2024/05/06 06:07:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" vs Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:53 INFO : Bisync successful 2024/05/06 06:07:53 (31) : copy-listings include-initial 2024/05/06 06:07:53 (32) : test INCLUDE - delete RCLONE_TEST files in excluded directories 2024/05/06 06:07:53 (33) : delete-file /tmp/060749ce/check_access_filters/path2/subdir/subdirA/RCLONE_TEST 2024/05/06 06:07:53 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:53 (34) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir-not/RCLONE_TEST 2024/05/06 06:07:53 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:53 (35) : delete-file /tmp/060749ce/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST 2024/05/06 06:07:53 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:53 (36) : test INCLUDE - test should PASS 2024/05/06 06:07:53 (37) : bisync check-access filters-file=/tmp/060749ce/workdir/include-other-filtersfile.txt 2024/05/06 06:07:53 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" with Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:53 INFO : Using filters file /tmp/060749ce/workdir/include-other-filtersfile.txt 2024/05/06 06:07:53 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:53 INFO : Path1 checking for diffs 2024/05/06 06:07:53 INFO : Path2 checking for diffs 2024/05/06 06:07:53 INFO : Checking access health 2024/05/06 06:07:53 INFO : Found 5 matching "RCLONE_TEST" files on both paths 2024/05/06 06:07:53 INFO : No changes found 2024/05/06 06:07:53 INFO : Updating listings 2024/05/06 06:07:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" vs Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:53 INFO : Bisync successful 2024/05/06 06:07:53 (38) : copy-listings include-pass-run 2024/05/06 06:07:53 (39) : test INCLUDE - delete RCLONE_TEST files in included directories 2024/05/06 06:07:53 (40) : delete-file /tmp/060749ce/check_access_filters/path2/RCLONE_TEST 2024/05/06 06:07:53 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:53 (41) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdir/RCLONE_TEST 2024/05/06 06:07:53 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:53 (42) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:07:53 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:53 (43) : test INCLUDE - test should ABORT 2024/05/06 06:07:53 (44) : bisync check-access filters-file=/tmp/060749ce/workdir/include-other-filtersfile.txt 2024/05/06 06:07:53 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_access_filters/path1/" with Path2 "/tmp/060749ce/check_access_filters/path2/" 2024/05/06 06:07:53 INFO : Using filters file /tmp/060749ce/workdir/include-other-filtersfile.txt 2024/05/06 06:07:53 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:53 INFO : Path1 checking for diffs 2024/05/06 06:07:53 INFO : - Path1 File was deleted - subdir/RCLONE_TEST 2024/05/06 06:07:53 INFO : - Path1 File was deleted - subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:07:53 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2024/05/06 06:07:53 INFO : Path2 checking for diffs 2024/05/06 06:07:53 INFO : - Path2 File was deleted - RCLONE_TEST 2024/05/06 06:07:53 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:07:53 INFO : Checking access health 2024/05/06 06:07:53 ERROR : Access test failed: Path1 count 3, Path2 count 4 - RCLONE_TEST 2024/05/06 06:07:53 ERROR : -  Access test failed: Path1 file not found in Path2 - RCLONE_TEST 2024/05/06 06:07:53 ERROR : -  Access test failed: Path2 file not found in Path1 - subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:07:53 ERROR : -  Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST 2024/05/06 06:07:53 ERROR : Bisync critical error: check file check failed 2024/05/06 06:07:53 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:53 Bisync error: bisync aborted 2024/05/06 06:07:53 (45) : move-listings include-error-run bisync_test.go:555: TEST check_access_filters PASSED === RUN TestBisyncRemoteLocal/check_filename 2024/05/06 06:07:53 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:53 DEBUG : path1: Making directory 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:53 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1" 2024/05/06 06:07:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:53 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1" 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/tmp/060749ce/check_filename/path2" 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_filename/initial" 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_check_filename-rubazob5" 2024/05/06 06:07:53 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:53 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:53 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:53 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/initdir/test_check_filename-rubazob5: Waiting for checks to finish 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/initdir/test_check_filename-rubazob5: Waiting for transfers to finish 2024/05/06 06:07:53 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file1.txt.yiziyom3.partial: renamed to: file1.txt 2024/05/06 06:07:53 INFO : file1.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file2.txt.xikulup9.partial: renamed to: file2.txt 2024/05/06 06:07:53 INFO : file2.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file4.txt.nakunep1.partial: renamed to: file4.txt 2024/05/06 06:07:53 INFO : file4.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file3.txt.jonojat8.partial: renamed to: file3.txt 2024/05/06 06:07:53 INFO : file3.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:53 DEBUG : .chk_file.napagin0.partial: renamed to: .chk_file 2024/05/06 06:07:53 INFO : .chk_file: Copied (new) 2024/05/06 06:07:53 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : subdir/file20.txt.zaxitav2.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:53 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:53 DEBUG : subdir/.chk_file.hobodan4.partial: renamed to: subdir/.chk_file 2024/05/06 06:07:53 INFO : subdir/.chk_file: Copied (new) 2024/05/06 06:07:53 INFO : subdir: Updated directory metadata 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_filename/modfiles" 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_check_filename-kujazuy9" 2024/05/06 06:07:53 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/datadir/test_check_filename-kujazuy9: Waiting for checks to finish 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/datadir/test_check_filename-kujazuy9: Waiting for transfers to finish 2024/05/06 06:07:53 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:07:53 DEBUG : hold.txt.fudiluc7.partial: renamed to: hold.txt 2024/05/06 06:07:53 INFO : hold.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1] 2024/05/06 06:07:53 ERROR : : error listing: directory not found 2024/05/06 06:07:53 ERROR : : error listing: directory not found 2024/05/06 06:07:53 checking initFs Local file system at /tmp/060749ce/initdir/test_check_filename-rubazob5 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1] 2024/05/06 06:07:53 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : subdir: Making directory 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/subdir] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/file1.txt] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/.chk_file] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/file2.txt] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/file3.txt] 2024/05/06 06:07:53 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: Waiting for checks to finish 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: Waiting for transfers to finish 2024/05/06 06:07:53 INFO : file1.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/file4.txt] 2024/05/06 06:07:53 INFO : file2.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/subdir/.chk_file] 2024/05/06 06:07:53 INFO : file3.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/subdir/file20.txt] 2024/05/06 06:07:53 INFO : file4.txt: Copied (new) 2024/05/06 06:07:53 INFO : .chk_file: Copied (new) 2024/05/06 06:07:53 INFO : subdir/.chk_file: Copied (new) 2024/05/06 06:07:53 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:53 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/subdir] 2024/05/06 06:07:53 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:53 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:53 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:53 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/check_filename/path2: Waiting for checks to finish 2024/05/06 06:07:53 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/check_filename/path2: Waiting for transfers to finish 2024/05/06 06:07:53 DEBUG : file2.txt.cozohed1.partial: renamed to: file2.txt 2024/05/06 06:07:53 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 INFO : file2.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file3.txt.bapogaf7.partial: renamed to: file3.txt 2024/05/06 06:07:53 INFO : file3.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file1.txt.riyajig7.partial: renamed to: file1.txt 2024/05/06 06:07:53 INFO : file1.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file4.txt.dimekuc2.partial: renamed to: file4.txt 2024/05/06 06:07:53 DEBUG : subdir/file20.txt.rosubol9.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:53 INFO : file4.txt: Copied (new) 2024/05/06 06:07:53 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:53 DEBUG : .chk_file.yofejeb3.partial: renamed to: .chk_file 2024/05/06 06:07:53 INFO : .chk_file: Copied (new) 2024/05/06 06:07:53 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:53 DEBUG : subdir/.chk_file.nojecat4.partial: renamed to: subdir/.chk_file 2024/05/06 06:07:53 INFO : subdir/.chk_file: Copied (new) 2024/05/06 06:07:53 INFO : subdir: Updated directory metadata 2024/05/06 06:07:53 checking path2 Local file system at /tmp/060749ce/check_filename/path2 2024/05/06 06:07:53 (01) : test check-filename 2024/05/06 06:07:53 (02) : test initial bisync 2024/05/06 06:07:53 (03) : bisync resync 2024/05/06 06:07:53 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/" with Path2 "/tmp/060749ce/check_filename/path2/" 2024/05/06 06:07:53 INFO : Copying Path2 files to Path1 2024/05/06 06:07:53 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:53 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:53 INFO : Resync updating listings 2024/05/06 06:07:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/" vs Path2 "/tmp/060749ce/check_filename/path2/" 2024/05/06 06:07:53 INFO : Bisync successful 2024/05/06 06:07:53 (04) : test 1. see that check-access passes with the initial setup 2024/05/06 06:07:53 (05) : bisync check-access check-filename=.chk_file 2024/05/06 06:07:53 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/" with Path2 "/tmp/060749ce/check_filename/path2/" 2024/05/06 06:07:53 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:53 INFO : Path1 checking for diffs 2024/05/06 06:07:53 INFO : Path2 checking for diffs 2024/05/06 06:07:53 INFO : Checking access health 2024/05/06 06:07:53 INFO : Found 2 matching ".chk_file" files on both paths 2024/05/06 06:07:53 INFO : No changes found 2024/05/06 06:07:53 INFO : Updating listings 2024/05/06 06:07:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/" vs Path2 "/tmp/060749ce/check_filename/path2/" 2024/05/06 06:07:53 INFO : Bisync successful 2024/05/06 06:07:53 (06) : copy-listings initial-pass 2024/05/06 06:07:53 (07) : test 2. delete the remote subdir .chk_file, run sync. should fail critical. 2024/05/06 06:07:53 (08) : delete-file /tmp/060749ce/check_filename/path2/subdir/.chk_file 2024/05/06 06:07:53 INFO : .chk_file: Deleted 2024/05/06 06:07:53 (09) : bisync check-access check-filename=.chk_file 2024/05/06 06:07:53 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/" with Path2 "/tmp/060749ce/check_filename/path2/" 2024/05/06 06:07:53 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:53 INFO : Path1 checking for diffs 2024/05/06 06:07:53 INFO : Path2 checking for diffs 2024/05/06 06:07:53 INFO : - Path2 File was deleted - subdir/.chk_file 2024/05/06 06:07:53 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:07:53 INFO : Checking access health 2024/05/06 06:07:53 ERROR : Access test failed: Path1 count 2, Path2 count 1 - .chk_file 2024/05/06 06:07:53 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/.chk_file 2024/05/06 06:07:53 ERROR : Bisync critical error: check file check failed 2024/05/06 06:07:53 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:53 Bisync error: bisync aborted 2024/05/06 06:07:53 (10) : move-listings path2-missing 2024/05/06 06:07:53 (11) : test 3. put the remote subdir .chk_file back, run resync. 2024/05/06 06:07:53 (12) : copy-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/subdir/.chk_file /tmp/060749ce/check_filename/path2/subdir/ 2024/05/06 06:07:53 INFO : .chk_file: Copied (new) 2024/05/06 06:07:53 (13) : bisync check-access resync check-filename=.chk_file 2024/05/06 06:07:53 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/" with Path2 "/tmp/060749ce/check_filename/path2/" 2024/05/06 06:07:53 INFO : Copying Path2 files to Path1 2024/05/06 06:07:53 INFO : Checking access health 2024/05/06 06:07:53 INFO : Found 2 matching ".chk_file" files on both paths 2024/05/06 06:07:53 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:53 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:53 INFO : Resync updating listings 2024/05/06 06:07:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/" vs Path2 "/tmp/060749ce/check_filename/path2/" 2024/05/06 06:07:53 INFO : Bisync successful 2024/05/06 06:07:53 (14) : test 4. run sync with check-access. should pass. 2024/05/06 06:07:53 (15) : bisync check-access check-filename=.chk_file 2024/05/06 06:07:53 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/" with Path2 "/tmp/060749ce/check_filename/path2/" 2024/05/06 06:07:53 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:53 INFO : Path1 checking for diffs 2024/05/06 06:07:53 INFO : Path2 checking for diffs 2024/05/06 06:07:53 INFO : Checking access health 2024/05/06 06:07:53 INFO : Found 2 matching ".chk_file" files on both paths 2024/05/06 06:07:53 INFO : No changes found 2024/05/06 06:07:53 INFO : Updating listings 2024/05/06 06:07:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_filename/path1/" vs Path2 "/tmp/060749ce/check_filename/path2/" 2024/05/06 06:07:53 INFO : Bisync successful bisync_test.go:555: TEST check_filename PASSED === RUN TestBisyncRemoteLocal/check_sync 2024/05/06 06:07:53 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:53 DEBUG : path1: Making directory 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:53 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1" 2024/05/06 06:07:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:53 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1" 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/tmp/060749ce/check_sync/path2" 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_sync/initial" 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_check_sync-burarop6" 2024/05/06 06:07:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/initdir/test_check_sync-burarop6: Waiting for checks to finish 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/initdir/test_check_sync-burarop6: Waiting for transfers to finish 2024/05/06 06:07:53 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file1.txt.nuyibaj6.partial: renamed to: file1.txt 2024/05/06 06:07:53 INFO : file1.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file3.txt.gufefaj1.partial: renamed to: file3.txt 2024/05/06 06:07:53 INFO : file3.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file4.txt.muzakiw6.partial: renamed to: file4.txt 2024/05/06 06:07:53 INFO : file4.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file5.txt.mecuhub8.partial: renamed to: file5.txt 2024/05/06 06:07:53 INFO : file5.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file6.txt.videviq1.partial: renamed to: file6.txt 2024/05/06 06:07:53 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:53 INFO : file6.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : RCLONE_TEST.vonovet0.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:53 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:53 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file2.txt.gocimuv1.partial: renamed to: file2.txt 2024/05/06 06:07:53 INFO : file2.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file8.txt.suliniq3.partial: renamed to: file8.txt 2024/05/06 06:07:53 INFO : file8.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file7.txt.tadefuz0.partial: renamed to: file7.txt 2024/05/06 06:07:53 INFO : file7.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_sync/modfiles" 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_check_sync-raxerab1" 2024/05/06 06:07:53 DEBUG : _testdir_path1.._testdir_path2.path1.lst: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : _testdir_path1.._testdir_path2.path2.lst: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/datadir/test_check_sync-raxerab1: Waiting for checks to finish 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/datadir/test_check_sync-raxerab1: Waiting for transfers to finish 2024/05/06 06:07:53 DEBUG : _testdir_path1.._testdir_path2.path2.lst: md5 = d6ce44a26af9c2110b1750fe88dc4b69 OK 2024/05/06 06:07:53 DEBUG : _testdir_path1.._testdir_path2.path1.lst: md5 = fdb18e0dff6961813e12c57227d2e854 OK 2024/05/06 06:07:53 DEBUG : _testdir_path1.._testdir_path2.path2.lst.yuyofig1.partial: renamed to: _testdir_path1.._testdir_path2.path2.lst 2024/05/06 06:07:53 INFO : _testdir_path1.._testdir_path2.path2.lst: Copied (new) 2024/05/06 06:07:53 DEBUG : _testdir_path1.._testdir_path2.path1.lst.gogirak0.partial: renamed to: _testdir_path1.._testdir_path2.path1.lst 2024/05/06 06:07:53 INFO : _testdir_path1.._testdir_path2.path1.lst: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1] 2024/05/06 06:07:53 ERROR : : error listing: directory not found 2024/05/06 06:07:53 ERROR : : error listing: directory not found 2024/05/06 06:07:53 checking initFs Local file system at /tmp/060749ce/initdir/test_check_sync-burarop6 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1] 2024/05/06 06:07:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/RCLONE_TEST] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/file1.txt] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/file2.txt] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/file3.txt] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: Waiting for checks to finish 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: Waiting for transfers to finish 2024/05/06 06:07:53 INFO : file1.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/file4.txt] 2024/05/06 06:07:53 INFO : file2.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/file5.txt] 2024/05/06 06:07:53 INFO : file3.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/file6.txt] 2024/05/06 06:07:53 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/file7.txt] 2024/05/06 06:07:53 INFO : file4.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/file8.txt] 2024/05/06 06:07:53 INFO : file5.txt: Copied (new) 2024/05/06 06:07:53 INFO : file6.txt: Copied (new) 2024/05/06 06:07:53 INFO : file7.txt: Copied (new) 2024/05/06 06:07:53 INFO : file8.txt: Copied (new) 2024/05/06 06:07:53 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1] 2024/05/06 06:07:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/check_sync/path2: Waiting for checks to finish 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/check_sync/path2: Waiting for transfers to finish 2024/05/06 06:07:53 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file2.txt.toyaciy9.partial: renamed to: file2.txt 2024/05/06 06:07:53 INFO : file2.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file3.txt.sanesuw7.partial: renamed to: file3.txt 2024/05/06 06:07:53 INFO : file3.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file1.txt.canunad8.partial: renamed to: file1.txt 2024/05/06 06:07:53 INFO : file1.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file4.txt.joroyam9.partial: renamed to: file4.txt 2024/05/06 06:07:53 INFO : file4.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file5.txt.yakeqet0.partial: renamed to: file5.txt 2024/05/06 06:07:53 INFO : file5.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file8.txt.zolosal6.partial: renamed to: file8.txt 2024/05/06 06:07:53 INFO : file8.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file7.txt.cazacoy0.partial: renamed to: file7.txt 2024/05/06 06:07:53 INFO : file7.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file6.txt.buxukaj1.partial: renamed to: file6.txt 2024/05/06 06:07:53 INFO : file6.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:53 DEBUG : RCLONE_TEST.luvijof3.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:53 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:53 checking path2 Local file system at /tmp/060749ce/check_sync/path2 2024/05/06 06:07:53 (01) : test check-sync 2024/05/06 06:07:53 (02) : test initial bisync 2024/05/06 06:07:53 (03) : bisync resync 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/" with Path2 "/tmp/060749ce/check_sync/path2/" 2024/05/06 06:07:53 INFO : Copying Path2 files to Path1 2024/05/06 06:07:53 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:53 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:53 INFO : Resync updating listings 2024/05/06 06:07:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/" vs Path2 "/tmp/060749ce/check_sync/path2/" 2024/05/06 06:07:53 INFO : Bisync successful 2024/05/06 06:07:53 (04) : test 1. run check-sync-only on a clean sync 2024/05/06 06:07:53 (05) : bisync check-sync-only 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/" vs Path2 "/tmp/060749ce/check_sync/path2/" 2024/05/06 06:07:53 INFO : Bisync successful 2024/05/06 06:07:53 (06) : test 2. inject modified listings into the workdir 2024/05/06 06:07:53 (07) : copy-as /tmp/060749ce/datadir/test_check_sync-raxerab1/_testdir_path1.._testdir_path2.path1.lst /tmp/060749ce/workdir/ TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_check_sync_path1..tmp_060749ce_check_sync_path2.path1.lst 2024/05/06 06:07:53 INFO : _testdir_path1.._testdir_path2.path1.lst: Copied (replaced existing) to: TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_check_sync_path1..tmp_060749ce_check_sync_path2.path1.lst 2024/05/06 06:07:53 (08) : copy-as /tmp/060749ce/datadir/test_check_sync-raxerab1/_testdir_path1.._testdir_path2.path2.lst /tmp/060749ce/workdir/ TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_check_sync_path1..tmp_060749ce_check_sync_path2.path2.lst 2024/05/06 06:07:53 INFO : _testdir_path1.._testdir_path2.path2.lst: Copied (replaced existing) to: TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_check_sync_path1..tmp_060749ce_check_sync_path2.path2.lst 2024/05/06 06:07:53 (09) : test 3. run check-sync-only on modified listings 2024/05/06 06:07:53 (10) : bisync check-sync-only 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/" vs Path2 "/tmp/060749ce/check_sync/path2/" 2024/05/06 06:07:53 ERROR : -  Path1 file not found in Path2 - file2.txt 2024/05/06 06:07:53 ERROR : -  Path2 file not found in Path1 - file1.txt 2024/05/06 06:07:53 ERROR : Bisync critical error: path1 and path2 are out of sync, run --resync to recover 2024/05/06 06:07:53 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:53 Bisync error: bisync aborted 2024/05/06 06:07:53 (11) : copy-listings check-sync-only 2024/05/06 06:07:53 (12) : test 4. run normal sync to check that it aborts 2024/05/06 06:07:53 (13) : bisync 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/" with Path2 "/tmp/060749ce/check_sync/path2/" 2024/05/06 06:07:53 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/060749ce/workdir/TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_check_sync_path1..tmp_060749ce_check_sync_path2.path1.lst Path2: /tmp/060749ce/workdir/TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_check_sync_path1..tmp_060749ce_check_sync_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/060749ce/workdir" 2024/05/06 06:07:53 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:53 Bisync error: bisync aborted 2024/05/06 06:07:53 (14) : test 5. prune failure listings after critical abort 2024/05/06 06:07:53 (15) : delete-glob /tmp/060749ce/workdir/ *.lst 2024/05/06 06:07:53 (16) : delete-glob /tmp/060749ce/workdir/ *.lst-err 2024/05/06 06:07:53 INFO : TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_check_sync_path1..tmp_060749ce_check_sync_path2.path1.lst-err: Deleted 2024/05/06 06:07:53 INFO : TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_check_sync_path1..tmp_060749ce_check_sync_path2.path2.lst-err: Deleted 2024/05/06 06:07:53 (17) : delete-glob /tmp/060749ce/workdir/ *.lst-new 2024/05/06 06:07:53 INFO : TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_check_sync_path1..tmp_060749ce_check_sync_path2.path1.lst-new: Deleted 2024/05/06 06:07:53 INFO : TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_check_sync_path1..tmp_060749ce_check_sync_path2.path2.lst-new: Deleted 2024/05/06 06:07:53 (18) : test 6. run resync 2024/05/06 06:07:53 (19) : bisync resync 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/" with Path2 "/tmp/060749ce/check_sync/path2/" 2024/05/06 06:07:53 INFO : Copying Path2 files to Path1 2024/05/06 06:07:53 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:53 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:53 INFO : Resync updating listings 2024/05/06 06:07:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/" vs Path2 "/tmp/060749ce/check_sync/path2/" 2024/05/06 06:07:53 INFO : Bisync successful 2024/05/06 06:07:53 (20) : test 7. run normal sync with check-sync enabled (default) 2024/05/06 06:07:53 (21) : bisync 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/" with Path2 "/tmp/060749ce/check_sync/path2/" 2024/05/06 06:07:53 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:53 INFO : Path1 checking for diffs 2024/05/06 06:07:53 INFO : Path2 checking for diffs 2024/05/06 06:07:53 INFO : No changes found 2024/05/06 06:07:53 INFO : Updating listings 2024/05/06 06:07:53 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/" vs Path2 "/tmp/060749ce/check_sync/path2/" 2024/05/06 06:07:53 INFO : Bisync successful 2024/05/06 06:07:53 (22) : test 8. run normal sync with no-check-sync 2024/05/06 06:07:53 (23) : bisync no-check-sync 2024/05/06 06:07:53 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:53 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:53 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/check_sync/path1/" with Path2 "/tmp/060749ce/check_sync/path2/" 2024/05/06 06:07:53 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:53 INFO : Path1 checking for diffs 2024/05/06 06:07:53 INFO : Path2 checking for diffs 2024/05/06 06:07:53 INFO : No changes found 2024/05/06 06:07:53 INFO : Updating listings 2024/05/06 06:07:53 INFO : Bisync successful bisync_test.go:555: TEST check_sync PASSED === RUN TestBisyncRemoteLocal/compare_all 2024/05/06 06:07:53 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:53 DEBUG : path1: Making directory 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:53 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1" 2024/05/06 06:07:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:53 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1" 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/tmp/060749ce/compare_all/path2" 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_compare_all/initial" 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_compare_all-jiwedof2" 2024/05/06 06:07:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/initdir/test_compare_all-jiwedof2: Waiting for checks to finish 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/initdir/test_compare_all-jiwedof2: Waiting for transfers to finish 2024/05/06 06:07:53 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file1.txt.ziwumow7.partial: renamed to: file1.txt 2024/05/06 06:07:53 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 INFO : file1.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file3.txt.nuyutat5.partial: renamed to: file3.txt 2024/05/06 06:07:53 INFO : file3.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file2.txt.wamuxiy2.partial: renamed to: file2.txt 2024/05/06 06:07:53 INFO : file2.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file4.txt.qemolaw5.partial: renamed to: file4.txt 2024/05/06 06:07:53 INFO : file4.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file5.txt.sopafuk5.partial: renamed to: file5.txt 2024/05/06 06:07:53 INFO : file5.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file6.txt.gavimup9.partial: renamed to: file6.txt 2024/05/06 06:07:53 DEBUG : file7.txt.narufom3.partial: renamed to: file7.txt 2024/05/06 06:07:53 INFO : file6.txt: Copied (new) 2024/05/06 06:07:53 INFO : file7.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:53 DEBUG : file8.txt.refifot0.partial: renamed to: file8.txt 2024/05/06 06:07:53 INFO : file8.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:53 DEBUG : RCLONE_TEST.ceqelux1.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:53 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_compare_all/modfiles" 2024/05/06 06:07:53 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_compare_all-wuricih4" 2024/05/06 06:07:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/datadir/test_compare_all-wuricih4: Waiting for checks to finish 2024/05/06 06:07:53 DEBUG : Local file system at /tmp/060749ce/datadir/test_compare_all-wuricih4: Waiting for transfers to finish 2024/05/06 06:07:53 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:53 DEBUG : file10.txt.yiholeg0.partial: renamed to: file10.txt 2024/05/06 06:07:53 INFO : file10.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:53 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:07:53 DEBUG : file1.txt.denakac9.partial: renamed to: file1.txt 2024/05/06 06:07:53 INFO : file1.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file2.txt.duzokur4.partial: renamed to: file2.txt 2024/05/06 06:07:53 INFO : file2.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:07:53 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:53 DEBUG : file5L.txt.kovoleb0.partial: renamed to: file5L.txt 2024/05/06 06:07:53 INFO : file5L.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file11.txt.tipenaf5.partial: renamed to: file11.txt 2024/05/06 06:07:53 INFO : file11.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:53 DEBUG : file6.txt.wizurin9.partial: renamed to: file6.txt 2024/05/06 06:07:53 INFO : file6.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:53 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:07:53 DEBUG : file7.txt.binehof2.partial: renamed to: file7.txt 2024/05/06 06:07:53 INFO : file7.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : file5R.txt.wuzakop7.partial: renamed to: file5R.txt 2024/05/06 06:07:53 INFO : file5R.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1] 2024/05/06 06:07:53 ERROR : : error listing: directory not found 2024/05/06 06:07:53 ERROR : : error listing: directory not found 2024/05/06 06:07:53 checking initFs Local file system at /tmp/060749ce/initdir/test_compare_all-jiwedof2 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1] 2024/05/06 06:07:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/RCLONE_TEST] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file2.txt] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file3.txt] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: Waiting for checks to finish 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file1.txt] 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: Waiting for transfers to finish 2024/05/06 06:07:53 INFO : file2.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file4.txt] 2024/05/06 06:07:53 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file5.txt] 2024/05/06 06:07:53 INFO : file3.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file6.txt] 2024/05/06 06:07:53 INFO : file1.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file7.txt] 2024/05/06 06:07:53 INFO : file4.txt: Copied (new) 2024/05/06 06:07:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file8.txt] 2024/05/06 06:07:53 INFO : file5.txt: Copied (new) 2024/05/06 06:07:54 INFO : file6.txt: Copied (new) 2024/05/06 06:07:54 INFO : file7.txt: Copied (new) 2024/05/06 06:07:54 INFO : file8.txt: Copied (new) 2024/05/06 06:07:54 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1] 2024/05/06 06:07:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : Local file system at /tmp/060749ce/compare_all/path2: Waiting for checks to finish 2024/05/06 06:07:54 DEBUG : Local file system at /tmp/060749ce/compare_all/path2: Waiting for transfers to finish 2024/05/06 06:07:54 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file2.txt.zocowik2.partial: renamed to: file2.txt 2024/05/06 06:07:54 INFO : file2.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file1.txt.wewuyop0.partial: renamed to: file1.txt 2024/05/06 06:07:54 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 INFO : file1.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file3.txt.zudejov5.partial: renamed to: file3.txt 2024/05/06 06:07:54 INFO : file3.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file4.txt.halugar5.partial: renamed to: file4.txt 2024/05/06 06:07:54 INFO : file4.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file7.txt.yeqayej7.partial: renamed to: file7.txt 2024/05/06 06:07:54 INFO : file7.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file6.txt.wuguyox1.partial: renamed to: file6.txt 2024/05/06 06:07:54 INFO : file6.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file8.txt.bagonij9.partial: renamed to: file8.txt 2024/05/06 06:07:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:54 INFO : file8.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : RCLONE_TEST.gudagop9.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:54 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:54 DEBUG : file5.txt.gicehap7.partial: renamed to: file5.txt 2024/05/06 06:07:54 INFO : file5.txt: Copied (new) 2024/05/06 06:07:54 checking path2 Local file system at /tmp/060749ce/compare_all/path2 2024/05/06 06:07:54 (01) : test changes compare-all 2024/05/06 06:07:54 (02) : test initial bisync 2024/05/06 06:07:54 (03) : bisync resync compare-all 2024/05/06 06:07:54 NOTICE: Local file system at /tmp/060749ce/compare_all/path2: will use md5 for same-side diffs on Path2 only 2024/05/06 06:07:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:07:54 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/" with Path2 "/tmp/060749ce/compare_all/path2/" 2024/05/06 06:07:54 INFO : Copying Path2 files to Path1 2024/05/06 06:07:54 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:54 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:07:54 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:54 INFO : Resync updating listings 2024/05/06 06:07:54 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/" vs Path2 "/tmp/060749ce/compare_all/path2/" 2024/05/06 06:07:54 INFO : Bisync successful 2024/05/06 06:07:54 (04) : test make modifications on both paths 2024/05/06 06:07:54 (05) : test new on path2 - file10 2024/05/06 06:07:54 (06) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_compare_all-wuricih4/file10.txt /tmp/060749ce/compare_all/path2/ 2024/05/06 06:07:54 INFO : file10.txt: Copied (new) 2024/05/06 06:07:54 (07) : test newer on path2 - file1 2024/05/06 06:07:54 (08) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_compare_all-wuricih4/file1.txt /tmp/060749ce/compare_all/path2/ 2024/05/06 06:07:54 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:54 (09) : test new on path1 - file11 2024/05/06 06:07:54 (10) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_compare_all-wuricih4/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/ 2024/05/06 06:07:54 INFO : file11.txt: Copied (new) 2024/05/06 06:07:54 (11) : test newer on path1 - file2 2024/05/06 06:07:54 (12) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_compare_all-wuricih4/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/ 2024/05/06 06:07:54 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:54 (13) : test deleted on path2 - file3 2024/05/06 06:07:54 (14) : delete-file /tmp/060749ce/compare_all/path2/file3.txt 2024/05/06 06:07:54 INFO : file3.txt: Deleted 2024/05/06 06:07:54 (15) : test deleted on path1 - file4 2024/05/06 06:07:54 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file4.txt 2024/05/06 06:07:54 INFO : file4.txt: Deleted 2024/05/06 06:07:54 (17) : test deleted on both paths - file8 2024/05/06 06:07:54 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file8.txt 2024/05/06 06:07:54 INFO : file8.txt: Deleted 2024/05/06 06:07:54 (19) : delete-file /tmp/060749ce/compare_all/path2/file8.txt 2024/05/06 06:07:54 INFO : file8.txt: Deleted 2024/05/06 06:07:54 (20) : test changed on both paths - file5 (file5R, file5L) 2024/05/06 06:07:54 (21) : touch-glob 2001-01-02 /tmp/060749ce/datadir/test_compare_all-wuricih4/ file5R.txt 2024/05/06 06:07:54 (22) : copy-as /tmp/060749ce/datadir/test_compare_all-wuricih4/file5R.txt /tmp/060749ce/compare_all/path2/ file5.txt 2024/05/06 06:07:54 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:07:54 (23) : touch-glob 2001-03-04 /tmp/060749ce/datadir/test_compare_all-wuricih4/ file5L.txt 2024/05/06 06:07:54 (24) : copy-as /tmp/060749ce/datadir/test_compare_all-wuricih4/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/ file5.txt 2024/05/06 06:07:54 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:07:54 (25) : test newer on path2 and deleted on path1 - file6 2024/05/06 06:07:54 (26) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_compare_all-wuricih4/file6.txt /tmp/060749ce/compare_all/path2/ 2024/05/06 06:07:54 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:07:54 (27) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file6.txt 2024/05/06 06:07:54 INFO : file6.txt: Deleted 2024/05/06 06:07:54 (28) : test newer on path1 and deleted on path2 - file7 2024/05/06 06:07:54 (29) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_compare_all-wuricih4/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/ 2024/05/06 06:07:54 INFO : file7.txt: Copied (replaced existing) 2024/05/06 06:07:54 (30) : delete-file /tmp/060749ce/compare_all/path2/file7.txt 2024/05/06 06:07:54 INFO : file7.txt: Deleted 2024/05/06 06:07:54 (31) : test bisync run 2024/05/06 06:07:54 (32) : bisync compare-all 2024/05/06 06:07:54 NOTICE: Local file system at /tmp/060749ce/compare_all/path2: will use md5 for same-side diffs on Path2 only 2024/05/06 06:07:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:07:54 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/" with Path2 "/tmp/060749ce/compare_all/path2/" 2024/05/06 06:07:54 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:54 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:07:54 INFO : Path1 checking for diffs 2024/05/06 06:07:54 INFO : - Path1 File changed: size (larger), time (newer), hash - file2.txt 2024/05/06 06:07:54 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:07:54 INFO : - Path1 File changed: size (larger), time (newer), hash - file5.txt 2024/05/06 06:07:54 INFO : - Path1 File was deleted - file6.txt 2024/05/06 06:07:54 INFO : - Path1 File changed: size (larger), time (newer), hash - file7.txt 2024/05/06 06:07:54 INFO : - Path1 File was deleted - file8.txt 2024/05/06 06:07:54 INFO : - Path1 File is new - file11.txt 2024/05/06 06:07:54 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:07:54 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2024/05/06 06:07:54 INFO : Path2 checking for diffs 2024/05/06 06:07:54 INFO : - Path2 File changed: size (larger), time (newer), hash - file1.txt 2024/05/06 06:07:54 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:07:54 INFO : - Path2 File changed: size (larger), time (newer), hash - file5.txt 2024/05/06 06:07:54 INFO : - Path2 File changed: size (larger), time (newer), hash - file6.txt 2024/05/06 06:07:54 INFO : - Path2 File was deleted - file7.txt 2024/05/06 06:07:54 INFO : - Path2 File was deleted - file8.txt 2024/05/06 06:07:54 INFO : - Path2 File is new - file10.txt 2024/05/06 06:07:54 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:07:54 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2024/05/06 06:07:54 INFO : Applying changes 2024/05/06 06:07:54 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/compare_all/path2/file11.txt 2024/05/06 06:07:54 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/compare_all/path2/file2.txt 2024/05/06 06:07:54 INFO : - Path2 Queue delete - /tmp/060749ce/compare_all/path2/file4.txt 2024/05/06 06:07:54 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:07:54 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file5.txt.conflict1 2024/05/06 06:07:54 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/05/06 06:07:54 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/compare_all/path2/file5.txt.conflict1 2024/05/06 06:07:54 NOTICE: - Path2 Renaming Path2 copy - /tmp/060749ce/compare_all/path2/file5.txt.conflict2 2024/05/06 06:07:54 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/05/06 06:07:54 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file5.txt.conflict2 2024/05/06 06:07:54 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file6.txt 2024/05/06 06:07:54 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/compare_all/path2/file7.txt 2024/05/06 06:07:54 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file1.txt 2024/05/06 06:07:54 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file10.txt 2024/05/06 06:07:54 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/file3.txt 2024/05/06 06:07:54 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:54 INFO : file10.txt: Copied (new) 2024/05/06 06:07:54 INFO : file5.txt.conflict2: Copied (new) 2024/05/06 06:07:54 INFO : file6.txt: Copied (new) 2024/05/06 06:07:54 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:54 INFO : file3.txt: Deleted 2024/05/06 06:07:54 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:54 INFO : file11.txt: Copied (new) 2024/05/06 06:07:54 INFO : file5.txt.conflict1: Copied (new) 2024/05/06 06:07:54 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:54 INFO : file7.txt: Copied (new) 2024/05/06 06:07:54 INFO : file4.txt: Deleted 2024/05/06 06:07:54 INFO : Updating listings 2024/05/06 06:07:54 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/compare_all/path1/" vs Path2 "/tmp/060749ce/compare_all/path2/" 2024/05/06 06:07:54 INFO : Bisync successful bisync_test.go:555: TEST compare_all PASSED === RUN TestBisyncRemoteLocal/createemptysrcdirs 2024/05/06 06:07:54 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:54 DEBUG : path1: Making directory 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:54 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1" 2024/05/06 06:07:54 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:54 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:54 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1" 2024/05/06 06:07:54 DEBUG : Creating backend with remote "/tmp/060749ce/createemptysrcdirs/path2" 2024/05/06 06:07:54 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_createemptysrcdirs/initial" 2024/05/06 06:07:54 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_createemptysrcdirs-niqucej2" 2024/05/06 06:07:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : Local file system at /tmp/060749ce/initdir/test_createemptysrcdirs-niqucej2: Waiting for checks to finish 2024/05/06 06:07:54 DEBUG : Local file system at /tmp/060749ce/initdir/test_createemptysrcdirs-niqucej2: Waiting for transfers to finish 2024/05/06 06:07:54 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.copy1.txt.sevosoz0.partial: renamed to: file1.copy1.txt 2024/05/06 06:07:54 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.copy2.txt.nonejol5.partial: renamed to: file1.copy2.txt 2024/05/06 06:07:54 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file1.copy3.txt.yesufer3.partial: renamed to: file1.copy3.txt 2024/05/06 06:07:54 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file1.copy4.txt.migehet3.partial: renamed to: file1.copy4.txt 2024/05/06 06:07:54 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:54 DEBUG : RCLONE_TEST.dequdul9.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:54 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.txt.nimivam6.partial: renamed to: file1.txt 2024/05/06 06:07:54 INFO : file1.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file1.copy5.txt.xacezar8.partial: renamed to: file1.copy5.txt 2024/05/06 06:07:54 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_createemptysrcdirs/modfiles" 2024/05/06 06:07:54 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6" 2024/05/06 06:07:54 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : Local file system at /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6: Waiting for checks to finish 2024/05/06 06:07:54 DEBUG : Local file system at /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6: Waiting for transfers to finish 2024/05/06 06:07:54 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : placeholder.txt.sikozeg5.partial: renamed to: placeholder.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1] 2024/05/06 06:07:54 ERROR : : error listing: directory not found 2024/05/06 06:07:54 ERROR : : error listing: directory not found 2024/05/06 06:07:54 checking initFs Local file system at /tmp/060749ce/initdir/test_createemptysrcdirs-niqucej2 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1] 2024/05/06 06:07:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/RCLONE_TEST] 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/file1.copy1.txt] 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1: Waiting for checks to finish 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1: Waiting for transfers to finish 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/file1.copy2.txt] 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/file1.copy3.txt] 2024/05/06 06:07:54 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/file1.copy4.txt] 2024/05/06 06:07:54 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/file1.copy5.txt] 2024/05/06 06:07:54 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/file1.txt] 2024/05/06 06:07:54 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:07:54 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:07:54 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:07:54 INFO : file1.txt: Copied (new) 2024/05/06 06:07:54 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1] 2024/05/06 06:07:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.copy2.txt.xeboduj3.partial: renamed to: file1.copy2.txt 2024/05/06 06:07:54 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : Local file system at /tmp/060749ce/createemptysrcdirs/path2: Waiting for checks to finish 2024/05/06 06:07:54 DEBUG : Local file system at /tmp/060749ce/createemptysrcdirs/path2: Waiting for transfers to finish 2024/05/06 06:07:54 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.copy1.txt.fucucij1.partial: renamed to: file1.copy1.txt 2024/05/06 06:07:54 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.copy3.txt.toxipot9.partial: renamed to: file1.copy3.txt 2024/05/06 06:07:54 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file1.copy5.txt.wubesay4.partial: renamed to: file1.copy5.txt 2024/05/06 06:07:54 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.copy4.txt.mipiwit2.partial: renamed to: file1.copy4.txt 2024/05/06 06:07:54 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file1.txt.wituvim3.partial: renamed to: file1.txt 2024/05/06 06:07:54 INFO : file1.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:54 DEBUG : RCLONE_TEST.xomodod5.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:54 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:54 checking path2 Local file system at /tmp/060749ce/createemptysrcdirs/path2 2024/05/06 06:07:54 (01) : test createemptysrcdirs 2024/05/06 06:07:54 (02) : test initial bisync 2024/05/06 06:07:54 (03) : touch-glob 2001-01-02 /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/ placeholder.txt 2024/05/06 06:07:54 (04) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:07:54 (05) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy1.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy1.txt 2024/05/06 06:07:54 (06) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy2.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy2.txt 2024/05/06 06:07:54 (07) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy3.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy3.txt 2024/05/06 06:07:54 (08) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy4.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy4.txt 2024/05/06 06:07:54 (09) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy5.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy5.txt 2024/05/06 06:07:54 (10) : bisync resync 2024/05/06 06:07:54 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:54 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" with Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Copying Path2 files to Path1 2024/05/06 06:07:54 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:54 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:54 INFO : file1.copy1.txt: Copied (replaced existing) 2024/05/06 06:07:54 INFO : file1.copy2.txt: Copied (replaced existing) 2024/05/06 06:07:54 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:54 INFO : file1.copy3.txt: Copied (replaced existing) 2024/05/06 06:07:54 INFO : file1.copy4.txt: Copied (replaced existing) 2024/05/06 06:07:54 INFO : file1.copy5.txt: Copied (replaced existing) 2024/05/06 06:07:54 INFO : Resync updating listings 2024/05/06 06:07:54 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" vs Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Bisync successful 2024/05/06 06:07:54 (11) : test 1. Create an empty dir on Path1 by creating subdir/placeholder.txt and then deleting the placeholder 2024/05/06 06:07:54 (12) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ subdir/placeholder.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: subdir/placeholder.txt 2024/05/06 06:07:54 (13) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ subdir 2024/05/06 06:07:54 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/subdir/placeholder.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Deleted 2024/05/06 06:07:54 (15) : test 2. Run bisync without --create-empty-src-dirs 2024/05/06 06:07:54 (16) : bisync 2024/05/06 06:07:54 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:54 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" with Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:54 INFO : Path1 checking for diffs 2024/05/06 06:07:54 INFO : Path2 checking for diffs 2024/05/06 06:07:54 INFO : No changes found 2024/05/06 06:07:54 INFO : Updating listings 2024/05/06 06:07:54 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" vs Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Bisync successful 2024/05/06 06:07:54 (17) : test 3. Confirm the subdir exists only on Path1 and not Path2 2024/05/06 06:07:54 (18) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ 2024/05/06 06:07:54 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:07:54 (19) : list-dirs /tmp/060749ce/createemptysrcdirs/path2/ 2024/05/06 06:07:54 (20) : test 4.Run bisync WITH --create-empty-src-dirs 2024/05/06 06:07:54 (21) : bisync create-empty-src-dirs 2024/05/06 06:07:54 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:54 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" with Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:54 INFO : Path1 checking for diffs 2024/05/06 06:07:54 INFO : - Path1 File is new - subdir 2024/05/06 06:07:54 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:07:54 INFO : Path2 checking for diffs 2024/05/06 06:07:54 INFO : Applying changes 2024/05/06 06:07:54 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/createemptysrcdirs/path2/subdir 2024/05/06 06:07:54 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:54 INFO : Updating listings 2024/05/06 06:07:54 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" vs Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Bisync successful 2024/05/06 06:07:54 (22) : test 5. Confirm the subdir exists on both paths 2024/05/06 06:07:54 (23) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ 2024/05/06 06:07:54 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:07:54 (24) : list-dirs /tmp/060749ce/createemptysrcdirs/path2/ 2024/05/06 06:07:54 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:07:54 (25) : test 6. Delete the empty dir on Path1 using purge-children (and also add files so the path isn't empty) 2024/05/06 06:07:54 (26) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ 2024/05/06 06:07:54 (27) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: file1.txt 2024/05/06 06:07:54 (28) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy1.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2024/05/06 06:07:54 (29) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy2.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2024/05/06 06:07:54 (30) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy3.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2024/05/06 06:07:54 (31) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy4.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2024/05/06 06:07:54 (32) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy5.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2024/05/06 06:07:54 (33) : test 7. Run bisync without --create-empty-src-dirs 2024/05/06 06:07:54 (34) : bisync 2024/05/06 06:07:54 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:54 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:54 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" with Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:54 INFO : Path1 checking for diffs 2024/05/06 06:07:54 INFO : - Path1 File was deleted - RCLONE_TEST 2024/05/06 06:07:54 INFO : - Path1 File was deleted - subdir 2024/05/06 06:07:54 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2024/05/06 06:07:54 INFO : Path2 checking for diffs 2024/05/06 06:07:54 INFO : - Path2 File was deleted - subdir 2024/05/06 06:07:54 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:07:54 INFO : Applying changes 2024/05/06 06:07:54 INFO : - Path2 Queue delete - /tmp/060749ce/createemptysrcdirs/path2/RCLONE_TEST 2024/05/06 06:07:54 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:54 INFO : RCLONE_TEST: Deleted 2024/05/06 06:07:54 INFO : Updating listings 2024/05/06 06:07:54 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" vs Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Bisync successful 2024/05/06 06:07:54 (35) : test 8. Confirm the subdir exists only on Path2 and not Path1 2024/05/06 06:07:54 (36) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ 2024/05/06 06:07:54 (37) : list-dirs /tmp/060749ce/createemptysrcdirs/path2/ 2024/05/06 06:07:54 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:07:54 (38) : test 9. Reset, do the delete again, and run bisync WITH --create-empty-src-dirs 2024/05/06 06:07:54 (39) : bisync resync create-empty-src-dirs 2024/05/06 06:07:54 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:54 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:54 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" with Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Copying Path2 files to Path1 2024/05/06 06:07:54 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:54 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:54 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:54 INFO : Resync updating listings 2024/05/06 06:07:54 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" vs Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Bisync successful 2024/05/06 06:07:54 (40) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ 2024/05/06 06:07:54 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:07:54 (41) : list-dirs /tmp/060749ce/createemptysrcdirs/path2/ 2024/05/06 06:07:54 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:07:54 (42) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ 2024/05/06 06:07:54 (43) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: file1.txt 2024/05/06 06:07:54 (44) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy1.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2024/05/06 06:07:54 (45) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy2.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2024/05/06 06:07:54 (46) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy3.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2024/05/06 06:07:54 (47) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy4.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2024/05/06 06:07:54 (48) : copy-as /tmp/060749ce/datadir/test_createemptysrcdirs-zebazik6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ file1.copy5.txt 2024/05/06 06:07:54 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2024/05/06 06:07:54 (49) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ 2024/05/06 06:07:54 (50) : list-dirs /tmp/060749ce/createemptysrcdirs/path2/ 2024/05/06 06:07:54 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:07:54 (51) : bisync create-empty-src-dirs 2024/05/06 06:07:54 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:54 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:54 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" with Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:54 INFO : Path1 checking for diffs 2024/05/06 06:07:54 INFO : - Path1 File was deleted - subdir 2024/05/06 06:07:54 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:07:54 INFO : Path2 checking for diffs 2024/05/06 06:07:54 INFO : Applying changes 2024/05/06 06:07:54 INFO : - Path2 Queue delete - /tmp/060749ce/createemptysrcdirs/path2/subdir 2024/05/06 06:07:54 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:54 INFO : subdir: Removing directory 2024/05/06 06:07:54 INFO : Updating listings 2024/05/06 06:07:54 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" vs Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Bisync successful 2024/05/06 06:07:54 (52) : test 10. Confirm the subdir has been removed on both paths 2024/05/06 06:07:54 (53) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/ 2024/05/06 06:07:54 (54) : list-dirs /tmp/060749ce/createemptysrcdirs/path2/ 2024/05/06 06:07:54 (55) : test 11. bisync again (because if we leave subdir in listings, test will fail due to mismatched modtime) 2024/05/06 06:07:54 (56) : bisync create-empty-src-dirs 2024/05/06 06:07:54 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:54 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:54 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" with Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:54 INFO : Path1 checking for diffs 2024/05/06 06:07:54 INFO : Path2 checking for diffs 2024/05/06 06:07:54 INFO : No changes found 2024/05/06 06:07:54 INFO : Updating listings 2024/05/06 06:07:54 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/createemptysrcdirs/path1/" vs Path2 "/tmp/060749ce/createemptysrcdirs/path2/" 2024/05/06 06:07:54 INFO : Bisync successful bisync_test.go:555: TEST createemptysrcdirs PASSED === RUN TestBisyncRemoteLocal/dry_run 2024/05/06 06:07:54 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:54 DEBUG : path1: Making directory 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:54 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1" 2024/05/06 06:07:54 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:54 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:54 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1" 2024/05/06 06:07:54 DEBUG : Creating backend with remote "/tmp/060749ce/dry_run/path2" 2024/05/06 06:07:54 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_dry_run/initial" 2024/05/06 06:07:54 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_dry_run-tutenub9" 2024/05/06 06:07:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : Local file system at /tmp/060749ce/initdir/test_dry_run-tutenub9: Waiting for checks to finish 2024/05/06 06:07:54 DEBUG : Local file system at /tmp/060749ce/initdir/test_dry_run-tutenub9: Waiting for transfers to finish 2024/05/06 06:07:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file1.txt.lufulos4.partial: renamed to: file1.txt 2024/05/06 06:07:54 INFO : file1.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file2.txt.cijosek3.partial: renamed to: file2.txt 2024/05/06 06:07:54 INFO : file2.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file3.txt.lawebob4.partial: renamed to: file3.txt 2024/05/06 06:07:54 INFO : file3.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file4.txt.kivedaj1.partial: renamed to: file4.txt 2024/05/06 06:07:54 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 INFO : file4.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file5.txt.roqemey5.partial: renamed to: file5.txt 2024/05/06 06:07:54 INFO : file5.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:54 DEBUG : RCLONE_TEST.tesayon3.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:54 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:54 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file6.txt.nozejas4.partial: renamed to: file6.txt 2024/05/06 06:07:54 INFO : file6.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:54 DEBUG : file7.txt.fiwoquz3.partial: renamed to: file7.txt 2024/05/06 06:07:54 INFO : file7.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_dry_run/modfiles" 2024/05/06 06:07:54 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_dry_run-qexosew0" 2024/05/06 06:07:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : Local file system at /tmp/060749ce/datadir/test_dry_run-qexosew0: Waiting for checks to finish 2024/05/06 06:07:54 DEBUG : Local file system at /tmp/060749ce/datadir/test_dry_run-qexosew0: Waiting for transfers to finish 2024/05/06 06:07:54 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:54 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:54 DEBUG : file1.txt.tikedur8.partial: renamed to: file1.txt 2024/05/06 06:07:54 INFO : file1.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file10.txt.batihih3.partial: renamed to: file10.txt 2024/05/06 06:07:54 INFO : file10.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:54 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:07:54 DEBUG : file11.txt.jamoxem0.partial: renamed to: file11.txt 2024/05/06 06:07:54 INFO : file11.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file2.txt.gidotew4.partial: renamed to: file2.txt 2024/05/06 06:07:54 INFO : file2.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:07:54 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:07:54 DEBUG : file5R.txt.pejovaw1.partial: renamed to: file5R.txt 2024/05/06 06:07:54 INFO : file5R.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file5L.txt.wobulux6.partial: renamed to: file5L.txt 2024/05/06 06:07:54 INFO : file5L.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:54 DEBUG : file6.txt.bolotot6.partial: renamed to: file6.txt 2024/05/06 06:07:54 INFO : file6.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:54 DEBUG : file7.txt.yipikiw1.partial: renamed to: file7.txt 2024/05/06 06:07:54 INFO : file7.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1] 2024/05/06 06:07:54 ERROR : : error listing: directory not found 2024/05/06 06:07:54 ERROR : : error listing: directory not found 2024/05/06 06:07:54 checking initFs Local file system at /tmp/060749ce/initdir/test_dry_run-tutenub9 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1] 2024/05/06 06:07:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file1.txt] 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file3.txt] 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: Waiting for checks to finish 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/RCLONE_TEST] 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: Waiting for transfers to finish 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file2.txt] 2024/05/06 06:07:54 INFO : file1.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file4.txt] 2024/05/06 06:07:54 INFO : file3.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file5.txt] 2024/05/06 06:07:54 INFO : file2.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file6.txt] 2024/05/06 06:07:54 INFO : file4.txt: Copied (new) 2024/05/06 06:07:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file7.txt] 2024/05/06 06:07:54 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:54 INFO : file5.txt: Copied (new) 2024/05/06 06:07:55 INFO : file6.txt: Copied (new) 2024/05/06 06:07:55 INFO : file7.txt: Copied (new) 2024/05/06 06:07:55 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1] 2024/05/06 06:07:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : file1.txt.fuviboq2.partial: renamed to: file1.txt 2024/05/06 06:07:55 INFO : file1.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : file4.txt.fonatis2.partial: renamed to: file4.txt 2024/05/06 06:07:55 INFO : file4.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/dry_run/path2: Waiting for checks to finish 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/dry_run/path2: Waiting for transfers to finish 2024/05/06 06:07:55 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:55 DEBUG : file5.txt.fugukun3.partial: renamed to: file5.txt 2024/05/06 06:07:55 INFO : file5.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : file3.txt.zipiday3.partial: renamed to: file3.txt 2024/05/06 06:07:55 INFO : file3.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : file2.txt.vaxihaj0.partial: renamed to: file2.txt 2024/05/06 06:07:55 INFO : file2.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : file6.txt.sedamed7.partial: renamed to: file6.txt 2024/05/06 06:07:55 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 INFO : file6.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : RCLONE_TEST.nonokeq6.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:55 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:55 DEBUG : file7.txt.koyogus4.partial: renamed to: file7.txt 2024/05/06 06:07:55 INFO : file7.txt: Copied (new) 2024/05/06 06:07:55 checking path2 Local file system at /tmp/060749ce/dry_run/path2 2024/05/06 06:07:55 (01) : test dry-run 2024/05/06 06:07:55 (02) : test initial bisync 2024/05/06 06:07:55 (03) : bisync resync 2024/05/06 06:07:55 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:55 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:55 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/" with Path2 "/tmp/060749ce/dry_run/path2/" 2024/05/06 06:07:55 INFO : Copying Path2 files to Path1 2024/05/06 06:07:55 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:55 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:55 INFO : Resync updating listings 2024/05/06 06:07:55 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/" vs Path2 "/tmp/060749ce/dry_run/path2/" 2024/05/06 06:07:55 INFO : Bisync successful 2024/05/06 06:07:55 (04) : test new on path2 - file10 2024/05/06 06:07:55 (05) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_dry_run-qexosew0/file10.txt /tmp/060749ce/dry_run/path2/ 2024/05/06 06:07:55 INFO : file10.txt: Copied (new) 2024/05/06 06:07:55 (06) : test newer on path2 - file1 2024/05/06 06:07:55 (07) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_dry_run-qexosew0/file1.txt /tmp/060749ce/dry_run/path2/ 2024/05/06 06:07:55 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:55 (08) : test new on path1 - file11 2024/05/06 06:07:55 (09) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_dry_run-qexosew0/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/ 2024/05/06 06:07:55 INFO : file11.txt: Copied (new) 2024/05/06 06:07:55 (10) : test newer on path1 - file2 2024/05/06 06:07:55 (11) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_dry_run-qexosew0/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/ 2024/05/06 06:07:55 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:55 (12) : test deleted on path2 - file3 2024/05/06 06:07:55 (13) : delete-file /tmp/060749ce/dry_run/path2/file3.txt 2024/05/06 06:07:55 INFO : file3.txt: Deleted 2024/05/06 06:07:55 (14) : test deleted on path1 - file4 2024/05/06 06:07:55 (15) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file4.txt 2024/05/06 06:07:55 INFO : file4.txt: Deleted 2024/05/06 06:07:55 (16) : test changed on path2 and on path1 - file5 (file5R, file5L) 2024/05/06 06:07:55 (17) : touch-glob 2001-01-02 /tmp/060749ce/datadir/test_dry_run-qexosew0/ file5R.txt 2024/05/06 06:07:55 (18) : copy-as /tmp/060749ce/datadir/test_dry_run-qexosew0/file5R.txt /tmp/060749ce/dry_run/path2/ file5.txt 2024/05/06 06:07:55 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:07:55 (19) : touch-glob 2001-03-04 /tmp/060749ce/datadir/test_dry_run-qexosew0/ file5L.txt 2024/05/06 06:07:55 (20) : copy-as /tmp/060749ce/datadir/test_dry_run-qexosew0/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/ file5.txt 2024/05/06 06:07:55 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:07:55 (21) : test newer on path2 and deleted on path1 - file6 2024/05/06 06:07:55 (22) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_dry_run-qexosew0/file6.txt /tmp/060749ce/dry_run/path2/ 2024/05/06 06:07:55 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:07:55 (23) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file6.txt 2024/05/06 06:07:55 INFO : file6.txt: Deleted 2024/05/06 06:07:55 (24) : test newer on path1 and deleted on path2 - file7 2024/05/06 06:07:55 (25) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_dry_run-qexosew0/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/ 2024/05/06 06:07:55 INFO : file7.txt: Copied (replaced existing) 2024/05/06 06:07:55 (26) : delete-file /tmp/060749ce/dry_run/path2/file7.txt 2024/05/06 06:07:55 INFO : file7.txt: Deleted 2024/05/06 06:07:55 (27) : test sync with dry-run and resync 2024/05/06 06:07:55 (28) : bisync dry-run resync 2024/05/06 06:07:55 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:55 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:55 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/" with Path2 "/tmp/060749ce/dry_run/path2/" 2024/05/06 06:07:55 INFO : Copying Path2 files to Path1 2024/05/06 06:07:55 NOTICE: - Path2 Resync is copying files to - Path1 2024/05/06 06:07:55 NOTICE: file4.txt: Skipped copy as --dry-run is set (size 0) 2024/05/06 06:07:55 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:07:55 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:07:55 NOTICE: - Path1 Resync is copying files to - Path2 2024/05/06 06:07:55 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:07:55 NOTICE: file3.txt: Skipped copy as --dry-run is set (size 0) 2024/05/06 06:07:55 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:07:55 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 0) 2024/05/06 06:07:55 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13) 2024/05/06 06:07:55 NOTICE: file5.txt: Skipped copy as --dry-run is set (size 39) 2024/05/06 06:07:55 INFO : Resync updating listings 2024/05/06 06:07:55 INFO : Bisync successful 2024/05/06 06:07:55 (29) : copy-listings dryrun-resync 2024/05/06 06:07:55 (30) : test sync with dry-run 2024/05/06 06:07:55 (31) : bisync dry-run 2024/05/06 06:07:55 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:55 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:55 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/" with Path2 "/tmp/060749ce/dry_run/path2/" 2024/05/06 06:07:55 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:55 INFO : Path1 checking for diffs 2024/05/06 06:07:55 NOTICE: - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:07:55 NOTICE: - Path1 File was deleted - file4.txt 2024/05/06 06:07:55 NOTICE: - Path1 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:07:55 NOTICE: - Path1 File was deleted - file6.txt 2024/05/06 06:07:55 NOTICE: - Path1 File changed: size (larger), time (newer) - file7.txt 2024/05/06 06:07:55 NOTICE: - Path1 File is new - file11.txt 2024/05/06 06:07:55 INFO : Path1: 6 changes:  1 new,  3 modified,  2 deleted 2024/05/06 06:07:55 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:07:55 INFO : Path2 checking for diffs 2024/05/06 06:07:55 NOTICE: - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:07:55 NOTICE: - Path2 File was deleted - file3.txt 2024/05/06 06:07:55 NOTICE: - Path2 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:07:55 NOTICE: - Path2 File changed: size (larger), time (newer) - file6.txt 2024/05/06 06:07:55 NOTICE: - Path2 File was deleted - file7.txt 2024/05/06 06:07:55 NOTICE: - Path2 File is new - file10.txt 2024/05/06 06:07:55 INFO : Path2: 6 changes:  1 new,  3 modified,  2 deleted 2024/05/06 06:07:55 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:07:55 INFO : Applying changes 2024/05/06 06:07:55 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:07:55 INFO : Checking potential conflicts... 2024/05/06 06:07:55 NOTICE: Local file system at /tmp/060749ce/dry_run/path2: 1 differences found 2024/05/06 06:07:55 NOTICE: Local file system at /tmp/060749ce/dry_run/path2: 1 errors while checking 2024/05/06 06:07:55 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:07:55 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/dry_run/path2/file11.txt 2024/05/06 06:07:55 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/dry_run/path2/file2.txt 2024/05/06 06:07:55 NOTICE: - Path2 Queue delete - /tmp/060749ce/dry_run/path2/file4.txt 2024/05/06 06:07:55 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:07:55 NOTICE: file5.txt: Skipped rename as --dry-run is set 2024/05/06 06:07:55 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/dry_run/path2/file5.txt.conflict1 2024/05/06 06:07:55 NOTICE: file5.txt: Skipped rename as --dry-run is set 2024/05/06 06:07:55 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file5.txt.conflict2 2024/05/06 06:07:55 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file6.txt 2024/05/06 06:07:55 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/dry_run/path2/file7.txt 2024/05/06 06:07:55 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file1.txt 2024/05/06 06:07:55 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file10.txt 2024/05/06 06:07:55 NOTICE: - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file3.txt 2024/05/06 06:07:55 NOTICE: - Path2 Do queued copies to - Path1 2024/05/06 06:07:55 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:07:55 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:07:55 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:07:55 NOTICE: file3.txt: Skipped delete as --dry-run is set (size 0) 2024/05/06 06:07:55 NOTICE: - Path1 Do queued copies to - Path2 2024/05/06 06:07:55 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:07:55 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:07:55 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13) 2024/05/06 06:07:55 NOTICE: file4.txt: Skipped delete as --dry-run is set (size 0) 2024/05/06 06:07:55 INFO : Updating listings 2024/05/06 06:07:55 INFO : Bisync successful 2024/05/06 06:07:55 (32) : copy-listings dryrun 2024/05/06 06:07:55 (33) : test sync without dry-run 2024/05/06 06:07:55 (34) : bisync 2024/05/06 06:07:55 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:55 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:55 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/" with Path2 "/tmp/060749ce/dry_run/path2/" 2024/05/06 06:07:55 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:55 INFO : Path1 checking for diffs 2024/05/06 06:07:55 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:07:55 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:07:55 INFO : - Path1 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:07:55 INFO : - Path1 File was deleted - file6.txt 2024/05/06 06:07:55 INFO : - Path1 File changed: size (larger), time (newer) - file7.txt 2024/05/06 06:07:55 INFO : - Path1 File is new - file11.txt 2024/05/06 06:07:55 INFO : Path1: 6 changes:  1 new,  3 modified,  2 deleted 2024/05/06 06:07:55 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:07:55 INFO : Path2 checking for diffs 2024/05/06 06:07:55 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:07:55 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:07:55 INFO : - Path2 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:07:55 INFO : - Path2 File changed: size (larger), time (newer) - file6.txt 2024/05/06 06:07:55 INFO : - Path2 File was deleted - file7.txt 2024/05/06 06:07:55 INFO : - Path2 File is new - file10.txt 2024/05/06 06:07:55 INFO : Path2: 6 changes:  1 new,  3 modified,  2 deleted 2024/05/06 06:07:55 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:07:55 INFO : Applying changes 2024/05/06 06:07:55 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:07:55 INFO : Checking potential conflicts... 2024/05/06 06:07:55 NOTICE: Local file system at /tmp/060749ce/dry_run/path2: 1 differences found 2024/05/06 06:07:55 NOTICE: Local file system at /tmp/060749ce/dry_run/path2: 1 errors while checking 2024/05/06 06:07:55 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:07:55 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/dry_run/path2/file11.txt 2024/05/06 06:07:55 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/dry_run/path2/file2.txt 2024/05/06 06:07:55 INFO : - Path2 Queue delete - /tmp/060749ce/dry_run/path2/file4.txt 2024/05/06 06:07:55 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:07:55 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file5.txt.conflict1 2024/05/06 06:07:55 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/05/06 06:07:55 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/dry_run/path2/file5.txt.conflict1 2024/05/06 06:07:55 NOTICE: - Path2 Renaming Path2 copy - /tmp/060749ce/dry_run/path2/file5.txt.conflict2 2024/05/06 06:07:55 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/05/06 06:07:55 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file5.txt.conflict2 2024/05/06 06:07:55 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file6.txt 2024/05/06 06:07:55 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/dry_run/path2/file7.txt 2024/05/06 06:07:55 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file1.txt 2024/05/06 06:07:55 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file10.txt 2024/05/06 06:07:55 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/file3.txt 2024/05/06 06:07:55 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:55 INFO : file10.txt: Copied (new) 2024/05/06 06:07:55 INFO : file6.txt: Copied (new) 2024/05/06 06:07:55 INFO : file5.txt.conflict2: Copied (new) 2024/05/06 06:07:55 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:55 INFO : file3.txt: Deleted 2024/05/06 06:07:55 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:55 INFO : file5.txt.conflict1: Copied (new) 2024/05/06 06:07:55 INFO : file7.txt: Copied (new) 2024/05/06 06:07:55 INFO : file11.txt: Copied (new) 2024/05/06 06:07:55 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:55 INFO : file4.txt: Deleted 2024/05/06 06:07:55 INFO : Updating listings 2024/05/06 06:07:55 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/dry_run/path1/" vs Path2 "/tmp/060749ce/dry_run/path2/" 2024/05/06 06:07:55 INFO : Bisync successful bisync_test.go:555: TEST dry_run PASSED === RUN TestBisyncRemoteLocal/equal 2024/05/06 06:07:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:55 DEBUG : path1: Making directory 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:55 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1" 2024/05/06 06:07:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:55 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1" 2024/05/06 06:07:55 DEBUG : Creating backend with remote "/tmp/060749ce/equal/path2" 2024/05/06 06:07:55 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_equal/initial" 2024/05/06 06:07:55 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_equal-fiheded1" 2024/05/06 06:07:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/initdir/test_equal-fiheded1: Waiting for checks to finish 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/initdir/test_equal-fiheded1: Waiting for transfers to finish 2024/05/06 06:07:55 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:55 DEBUG : file1.txt.haturil8.partial: renamed to: file1.txt 2024/05/06 06:07:55 DEBUG : file2.txt.caqezex6.partial: renamed to: file2.txt 2024/05/06 06:07:55 INFO : file1.txt: Copied (new) 2024/05/06 06:07:55 INFO : file2.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : RCLONE_TEST.pelevep4.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:55 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:55 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_equal/modfiles" 2024/05/06 06:07:55 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_equal-panedel6" 2024/05/06 06:07:55 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/datadir/test_equal-panedel6: Waiting for checks to finish 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/datadir/test_equal-panedel6: Waiting for transfers to finish 2024/05/06 06:07:55 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/05/06 06:07:55 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/05/06 06:07:55 DEBUG : file1L.txt.guyuzeb0.partial: renamed to: file1L.txt 2024/05/06 06:07:55 DEBUG : file2.txt.vujusaf1.partial: renamed to: file2.txt 2024/05/06 06:07:55 INFO : file1L.txt: Copied (new) 2024/05/06 06:07:55 INFO : file2.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK 2024/05/06 06:07:55 DEBUG : file1R.txt.vibuhiz9.partial: renamed to: file1R.txt 2024/05/06 06:07:55 INFO : file1R.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1] 2024/05/06 06:07:55 ERROR : : error listing: directory not found 2024/05/06 06:07:55 ERROR : : error listing: directory not found 2024/05/06 06:07:55 checking initFs Local file system at /tmp/060749ce/initdir/test_equal-fiheded1 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1] 2024/05/06 06:07:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1/RCLONE_TEST] 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1/file2.txt] 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1: Waiting for checks to finish 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1/file1.txt] 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1: Waiting for transfers to finish 2024/05/06 06:07:55 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:55 INFO : file2.txt: Copied (new) 2024/05/06 06:07:55 INFO : file1.txt: Copied (new) 2024/05/06 06:07:55 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1] 2024/05/06 06:07:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/equal/path2: Waiting for checks to finish 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/equal/path2: Waiting for transfers to finish 2024/05/06 06:07:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : file1.txt.decajud2.partial: renamed to: file1.txt 2024/05/06 06:07:55 INFO : file1.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : file2.txt.cahivoz0.partial: renamed to: file2.txt 2024/05/06 06:07:55 INFO : file2.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:55 DEBUG : RCLONE_TEST.xubomeq3.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:55 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:55 checking path2 Local file system at /tmp/060749ce/equal/path2 2024/05/06 06:07:55 (01) : test equal 2024/05/06 06:07:55 (02) : test initial bisync 2024/05/06 06:07:55 (03) : bisync resync 2024/05/06 06:07:55 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:55 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:55 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1/" with Path2 "/tmp/060749ce/equal/path2/" 2024/05/06 06:07:55 INFO : Copying Path2 files to Path1 2024/05/06 06:07:55 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:55 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:55 INFO : Resync updating listings 2024/05/06 06:07:55 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1/" vs Path2 "/tmp/060749ce/equal/path2/" 2024/05/06 06:07:55 INFO : Bisync successful 2024/05/06 06:07:55 (04) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:07:55 (05) : touch-glob 2001-01-02 /tmp/060749ce/datadir/test_equal-panedel6/ file1R.txt 2024/05/06 06:07:55 (06) : copy-as /tmp/060749ce/datadir/test_equal-panedel6/file1R.txt /tmp/060749ce/equal/path2/ file1.txt 2024/05/06 06:07:55 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:07:55 (07) : touch-glob 2001-03-04 /tmp/060749ce/datadir/test_equal-panedel6/ file1L.txt 2024/05/06 06:07:55 (08) : copy-as /tmp/060749ce/datadir/test_equal-panedel6/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1/ file1.txt 2024/05/06 06:07:55 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:07:55 (09) : test changed on both paths and identical - file2 2024/05/06 06:07:55 (10) : touch-glob 2001-01-02 /tmp/060749ce/datadir/test_equal-panedel6/ file2.txt 2024/05/06 06:07:55 (11) : copy-as /tmp/060749ce/datadir/test_equal-panedel6/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1/ file2.txt 2024/05/06 06:07:55 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:55 (12) : copy-as /tmp/060749ce/datadir/test_equal-panedel6/file2.txt /tmp/060749ce/equal/path2/ file2.txt 2024/05/06 06:07:55 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:55 (13) : test bisync run 2024/05/06 06:07:55 (14) : bisync 2024/05/06 06:07:55 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:55 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:55 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1/" with Path2 "/tmp/060749ce/equal/path2/" 2024/05/06 06:07:55 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:55 INFO : Path1 checking for diffs 2024/05/06 06:07:55 INFO : - Path1 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:07:55 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:07:55 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:07:55 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/05/06 06:07:55 INFO : Path2 checking for diffs 2024/05/06 06:07:55 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:07:55 INFO : - Path2 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:07:55 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:07:55 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/05/06 06:07:55 INFO : Applying changes 2024/05/06 06:07:55 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:07:55 INFO : Checking potential conflicts... 2024/05/06 06:07:55 NOTICE: Local file system at /tmp/060749ce/equal/path2: 1 differences found 2024/05/06 06:07:55 NOTICE: Local file system at /tmp/060749ce/equal/path2: 1 errors while checking 2024/05/06 06:07:55 NOTICE: Local file system at /tmp/060749ce/equal/path2: 1 matching files 2024/05/06 06:07:55 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:07:55 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:07:55 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1/file1.txt.conflict1 2024/05/06 06:07:55 INFO : file1.txt: Moved (server-side) to: file1.txt.conflict1 2024/05/06 06:07:55 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/equal/path2/file1.txt.conflict1 2024/05/06 06:07:55 NOTICE: - Path2 Renaming Path2 copy - /tmp/060749ce/equal/path2/file1.txt.conflict2 2024/05/06 06:07:55 INFO : file1.txt: Moved (server-side) to: file1.txt.conflict2 2024/05/06 06:07:55 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1/file1.txt.conflict2 2024/05/06 06:07:55 NOTICE: - WARNING New or changed in both paths - file2.txt 2024/05/06 06:07:55 INFO : Files are equal! Skipping: file2.txt 2024/05/06 06:07:55 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:55 INFO : file1.txt.conflict2: Copied (new) 2024/05/06 06:07:55 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:55 INFO : file1.txt.conflict1: Copied (new) 2024/05/06 06:07:55 INFO : Updating listings 2024/05/06 06:07:55 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:07:55 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:07:55 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/equal/path1/" vs Path2 "/tmp/060749ce/equal/path2/" 2024/05/06 06:07:55 INFO : Bisync successful bisync_test.go:555: TEST equal PASSED === RUN TestBisyncRemoteLocal/ext_paths 2024/05/06 06:07:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:55 DEBUG : path1: Making directory 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:55 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1" 2024/05/06 06:07:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:55 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1" 2024/05/06 06:07:55 DEBUG : Creating backend with remote "/tmp/060749ce/ext_paths/path2" 2024/05/06 06:07:55 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_ext_paths/initial" 2024/05/06 06:07:55 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_ext_paths-pidogel5" 2024/05/06 06:07:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ: Making directory with metadata 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z) 2024/05/06 06:07:55 DEBUG : Added delayed dir = "測試РуÑÑкий ěáñ", newDst=測試РуÑÑкий ěáñ 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : file1.txt.zexemap8.partial: renamed to: file1.txt 2024/05/06 06:07:55 INFO : file1.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : file_enconde_mañana_funcionará.txt.kosoday5.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/05/06 06:07:55 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/initdir/test_ext_paths-pidogel5: Waiting for checks to finish 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/initdir/test_ext_paths-pidogel5: Waiting for transfers to finish 2024/05/06 06:07:55 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:55 DEBUG : RCLONE_TEST.sebiliw3.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:55 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:55 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : РуÑÑкий.txt.zanunif3.partial: renamed to: РуÑÑкий.txt 2024/05/06 06:07:55 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:55 DEBUG : filename_contains_ࢺ_.txt.coroyoc3.partial: renamed to: filename_contains_ࢺ_.txt 2024/05/06 06:07:55 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : 測試_check file.raqehoz6.partial: renamed to: 測試_check file 2024/05/06 06:07:55 INFO : 測試_check file: Copied (new) 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/測試_check file.zujopag6.partial: renamed to: 測試РуÑÑкий ěáñ/測試_check file 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:55 DEBUG : filename_contains_Ä›_.txt.ginisob8.partial: renamed to: filename_contains_Ä›_.txt 2024/05/06 06:07:55 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt.wifayof6.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt.rejutey1.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ: Updated directory metadata 2024/05/06 06:07:55 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_ext_paths/modfiles" 2024/05/06 06:07:55 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_ext_paths-citenig7" 2024/05/06 06:07:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/datadir/test_ext_paths-citenig7: Waiting for checks to finish 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/datadir/test_ext_paths-citenig7: Waiting for transfers to finish 2024/05/06 06:07:55 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/05/06 06:07:55 DEBUG : 測試_filtersfile.txt.watuhup8.partial: renamed to: 測試_filtersfile.txt 2024/05/06 06:07:55 INFO : 測試_filtersfile.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:55 DEBUG : file1.txt.tofeput9.partial: renamed to: file1.txt 2024/05/06 06:07:55 INFO : file1.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1] 2024/05/06 06:07:55 ERROR : : error listing: directory not found 2024/05/06 06:07:55 ERROR : : error listing: directory not found 2024/05/06 06:07:55 checking initFs Local file system at /tmp/060749ce/initdir/test_ext_paths-pidogel5 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1] 2024/05/06 06:07:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ: Making directory 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ] 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/RCLONE_TEST] 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/file_enconde_mañana_funcionará.txt] 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/file1.txt] 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/filename_contains_Ä›_.txt] 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: Waiting for checks to finish 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: Waiting for transfers to finish 2024/05/06 06:07:55 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/filename_contains_ࢺ_.txt] 2024/05/06 06:07:55 INFO : file1.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/РуÑÑкий.txt] 2024/05/06 06:07:55 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試_check file] 2024/05/06 06:07:55 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt] 2024/05/06 06:07:55 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt] 2024/05/06 06:07:55 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ/測試_check file] 2024/05/06 06:07:55 INFO : 測試_check file: Copied (new) 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/05/06 06:07:55 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1] 2024/05/06 06:07:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ] 2024/05/06 06:07:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ: Making directory with metadata 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z) 2024/05/06 06:07:55 DEBUG : Added delayed dir = "測試РуÑÑкий ěáñ", newDst=測試РуÑÑкий ěáñ 2024/05/06 06:07:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : file1.txt.fazomuq0.partial: renamed to: file1.txt 2024/05/06 06:07:55 INFO : file1.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:07:55 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : file_enconde_mañana_funcionará.txt.lesoded0.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/05/06 06:07:55 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/ext_paths/path2: Waiting for checks to finish 2024/05/06 06:07:55 DEBUG : Local file system at /tmp/060749ce/ext_paths/path2: Waiting for transfers to finish 2024/05/06 06:07:55 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : РуÑÑкий.txt.vedokag4.partial: renamed to: РуÑÑкий.txt 2024/05/06 06:07:55 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:55 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : RCLONE_TEST.suhucod3.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:55 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:55 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:55 DEBUG : filename_contains_ࢺ_.txt.voqideb7.partial: renamed to: filename_contains_ࢺ_.txt 2024/05/06 06:07:55 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : 測試_check file.xeqaped5.partial: renamed to: 測試_check file 2024/05/06 06:07:55 INFO : 測試_check file: Copied (new) 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/測試_check file.zaqofuy3.partial: renamed to: 測試РуÑÑкий ěáñ/測試_check file 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt.bihajik4.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:55 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt.zozoriw4.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:55 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:55 DEBUG : filename_contains_Ä›_.txt.yidazem5.partial: renamed to: filename_contains_Ä›_.txt 2024/05/06 06:07:55 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:55 INFO : 測試РуÑÑкий ěáñ: Updated directory metadata 2024/05/06 06:07:55 checking path2 Local file system at /tmp/060749ce/ext_paths/path2 2024/05/06 06:07:55 (01) : test extended-char-paths 2024/05/06 06:07:55 (02) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/ 2024/05/06 06:07:56 ERROR : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-hufutuk6: Server side directory move failed: rename /rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий eÌŒaÌñ: file does not exist 2024/05/06 06:07:56 INFO : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ/: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2024/05/06 06:07:56 ERROR : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-hufutuk6: error reading source root directory: directory not found 2024/05/06 06:07:56 (03) : fix-names /tmp/060749ce/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/ 2024/05/06 06:07:56 ERROR : Local file system at /tmp/060749ce/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-jegefeh2: Server side directory move failed: rename /tmp/060749ce/ext_paths/path2/測試РуÑÑкий eÌŒaÌñ /tmp/060749ce/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-jegefeh2: no such file or directory 2024/05/06 06:07:56 INFO : Local file system at /tmp/060749ce/ext_paths/path2/測試РуÑÑкий ěáñ: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2024/05/06 06:07:56 ERROR : Local file system at /tmp/060749ce/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-jegefeh2: error reading source root directory: directory not found 2024/05/06 06:07:56 (04) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:07:56 (05) : fix-names /tmp/060749ce/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:07:56 (06) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/filename_contains_Ä›_.txt 2024/05/06 06:07:56 (07) : fix-names /tmp/060749ce/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/filename_contains_Ä›_.txt 2024/05/06 06:07:56 (08) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試_check{spc}file 2024/05/06 06:07:56 (09) : fix-names /tmp/060749ce/ext_paths/path2/測試_check{spc}file 2024/05/06 06:07:56 (10) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:07:56 (11) : fix-names /tmp/060749ce/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:07:56 (12) : test resync subdirs with extended chars 2024/05/06 06:07:56 (13) : bisync subdir=測試РуÑÑкий{spc}{spc}ěáñ resync 2024/05/06 06:07:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ/" with Path2 "/tmp/060749ce/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/05/06 06:07:56 INFO : Copying Path2 files to Path1 2024/05/06 06:07:56 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:56 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:56 INFO : Resync updating listings 2024/05/06 06:07:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ/" vs Path2 "/tmp/060749ce/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/05/06 06:07:56 INFO : Bisync successful 2024/05/06 06:07:56 (14) : copy-listings resync 2024/05/06 06:07:56 (15) : test place new files with extended chars on each side 2024/05/06 06:07:56 (16) : touch-glob 2001-01-02 /tmp/060749ce/datadir/test_ext_paths-citenig7/ file1.txt 2024/05/06 06:07:56 (17) : copy-as /tmp/060749ce/datadir/test_ext_paths-citenig7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ 測試_file1p1 2024/05/06 06:07:56 INFO : file1.txt: Copied (new) to: 測試_file1p1 2024/05/06 06:07:56 (18) : copy-as /tmp/060749ce/datadir/test_ext_paths-citenig7/file1.txt /tmp/060749ce/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ 測試_file1p2 2024/05/06 06:07:56 INFO : file1.txt: Copied (new) to: 測試_file1p2 2024/05/06 06:07:56 (19) : test normal sync of subdirs with extended chars 2024/05/06 06:07:56 (20) : bisync subdir=測試РуÑÑкий{spc}{spc}ěáñ 2024/05/06 06:07:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ/" with Path2 "/tmp/060749ce/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/05/06 06:07:56 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:56 INFO : Path1 checking for diffs 2024/05/06 06:07:56 INFO : - Path1 File is new - 測試_file1p1 2024/05/06 06:07:56 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:07:56 INFO : Path2 checking for diffs 2024/05/06 06:07:56 INFO : - Path2 File is new - 測試_file1p2 2024/05/06 06:07:56 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:07:56 INFO : Applying changes 2024/05/06 06:07:56 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/ext_paths/path2/測試РуÑÑкий ěáñ/測試_file1p1 2024/05/06 06:07:56 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ/測試_file1p2 2024/05/06 06:07:56 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:56 INFO : 測試_file1p2: Copied (new) 2024/05/06 06:07:56 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:56 INFO : 測試_file1p1: Copied (new) 2024/05/06 06:07:56 INFO : Updating listings 2024/05/06 06:07:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий ěáñ/" vs Path2 "/tmp/060749ce/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/05/06 06:07:56 INFO : Bisync successful 2024/05/06 06:07:56 (21) : move-listings normal-sync 2024/05/06 06:07:56 (22) : test check-filename with extended chars. check should fail. 2024/05/06 06:07:56 (23) : bisync resync 2024/05/06 06:07:56 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/05/06 06:07:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/" with Path2 "/tmp/060749ce/ext_paths/path2/" 2024/05/06 06:07:56 INFO : Copying Path2 files to Path1 2024/05/06 06:07:56 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:56 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:56 INFO : Resync updating listings 2024/05/06 06:07:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/" vs Path2 "/tmp/060749ce/ext_paths/path2/" 2024/05/06 06:07:56 INFO : Bisync successful 2024/05/06 06:07:56 (24) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:07:56 INFO : 測試_check file: Deleted 2024/05/06 06:07:56 (25) : bisync check-access check-filename=測試_check{spc}file 2024/05/06 06:07:56 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/05/06 06:07:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/" with Path2 "/tmp/060749ce/ext_paths/path2/" 2024/05/06 06:07:56 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:56 INFO : Path1 checking for diffs 2024/05/06 06:07:56 INFO : - Path1 File was deleted - 測試РуÑÑкий ěáñ/測試_check file 2024/05/06 06:07:56 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:07:56 INFO : Path2 checking for diffs 2024/05/06 06:07:56 INFO : Checking access health 2024/05/06 06:07:56 ERROR : Access test failed: Path1 count 1, Path2 count 2 - 測試_check file 2024/05/06 06:07:56 ERROR : -  Access test failed: Path2 file not found in Path1 - 測試РуÑÑкий ěáñ/測試_check file 2024/05/06 06:07:56 ERROR : Bisync critical error: check file check failed 2024/05/06 06:07:56 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:56 Bisync error: bisync aborted 2024/05/06 06:07:56 (26) : copy-listings check-access-fail 2024/05/06 06:07:56 (27) : test check-filename with extended chars. check should pass. 2024/05/06 06:07:56 (28) : bisync resync 2024/05/06 06:07:56 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/05/06 06:07:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/" with Path2 "/tmp/060749ce/ext_paths/path2/" 2024/05/06 06:07:56 INFO : Copying Path2 files to Path1 2024/05/06 06:07:56 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:56 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/05/06 06:07:56 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:56 INFO : Resync updating listings 2024/05/06 06:07:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/" vs Path2 "/tmp/060749ce/ext_paths/path2/" 2024/05/06 06:07:56 INFO : Bisync successful 2024/05/06 06:07:56 (29) : bisync check-access check-filename=測試_check{spc}file 2024/05/06 06:07:56 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/05/06 06:07:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/" with Path2 "/tmp/060749ce/ext_paths/path2/" 2024/05/06 06:07:56 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:56 INFO : Path1 checking for diffs 2024/05/06 06:07:56 INFO : Path2 checking for diffs 2024/05/06 06:07:56 INFO : Checking access health 2024/05/06 06:07:56 INFO : Found 2 matching "測試_check file" files on both paths 2024/05/06 06:07:56 INFO : No changes found 2024/05/06 06:07:56 INFO : Updating listings 2024/05/06 06:07:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/" vs Path2 "/tmp/060749ce/ext_paths/path2/" 2024/05/06 06:07:56 INFO : Bisync successful 2024/05/06 06:07:56 (30) : move-listings check-access-pass 2024/05/06 06:07:56 (31) : test filters-file path with extended chars - masks /fileZ.txt 2024/05/06 06:07:56 (32) : copy-file /tmp/060749ce/datadir/test_ext_paths-citenig7/測試_filtersfile.txt /tmp/060749ce/workdir/ 2024/05/06 06:07:56 INFO : 測試_filtersfile.txt: Copied (new) 2024/05/06 06:07:56 (33) : bisync filters-file=/tmp/060749ce/workdir/測試_filtersfile.txt resync 2024/05/06 06:07:56 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/05/06 06:07:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/" with Path2 "/tmp/060749ce/ext_paths/path2/" 2024/05/06 06:07:56 INFO : Using filters file /tmp/060749ce/workdir/測試_filtersfile.txt 2024/05/06 06:07:56 INFO : Storing filters file hash to /tmp/060749ce/workdir/測試_filtersfile.txt.md5 2024/05/06 06:07:56 INFO : Copying Path2 files to Path1 2024/05/06 06:07:56 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:56 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:56 INFO : Resync updating listings 2024/05/06 06:07:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/" vs Path2 "/tmp/060749ce/ext_paths/path2/" 2024/05/06 06:07:56 INFO : Bisync successful 2024/05/06 06:07:56 (34) : copy-as /tmp/060749ce/datadir/test_ext_paths-citenig7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/ fileZ.txt 2024/05/06 06:07:56 INFO : file1.txt: Copied (new) to: fileZ.txt 2024/05/06 06:07:56 (35) : bisync filters-file=/tmp/060749ce/workdir/測試_filtersfile.txt 2024/05/06 06:07:56 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/05/06 06:07:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/" with Path2 "/tmp/060749ce/ext_paths/path2/" 2024/05/06 06:07:56 INFO : Using filters file /tmp/060749ce/workdir/測試_filtersfile.txt 2024/05/06 06:07:56 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:56 INFO : Path1 checking for diffs 2024/05/06 06:07:56 INFO : Path2 checking for diffs 2024/05/06 06:07:56 INFO : No changes found 2024/05/06 06:07:56 INFO : Updating listings 2024/05/06 06:07:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ext_paths/path1/" vs Path2 "/tmp/060749ce/ext_paths/path2/" 2024/05/06 06:07:56 INFO : Bisync successful bisync_test.go:555: TEST ext_paths PASSED === RUN TestBisyncRemoteLocal/extended_filenames 2024/05/06 06:07:56 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:56 DEBUG : path1: Making directory 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:56 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1" 2024/05/06 06:07:56 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:56 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:56 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1" 2024/05/06 06:07:56 DEBUG : Creating backend with remote "/tmp/060749ce/extended_filenames/path2" 2024/05/06 06:07:56 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_extended_filenames/initial" 2024/05/06 06:07:56 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_extended_filenames-vabalod5" 2024/05/06 06:07:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_: Making directory with metadata 2024/05/06 06:07:56 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file1 - Copy (2).txt.silisin4.partial: renamed to: file1 - Copy (2).txt 2024/05/06 06:07:56 INFO : file1 - Copy (2).txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file1 - Copy.txt.dotahey6.partial: renamed to: file1 - Copy.txt 2024/05/06 06:07:56 INFO : file1 - Copy.txt: Copied (new) 2024/05/06 06:07:56 INFO : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:56 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_ 2024/05/06 06:07:56 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file1.txt.bovefur5.partial: renamed to: file1.txt 2024/05/06 06:07:56 INFO : file1.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : Local file system at /tmp/060749ce/initdir/test_extended_filenames-vabalod5: Waiting for checks to finish 2024/05/06 06:07:56 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:56 DEBUG : file_enconde_mañana_funcionará.txt.xewaxaq6.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/05/06 06:07:56 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : RCLONE_TEST.bitibud7.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:56 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:56 DEBUG : Local file system at /tmp/060749ce/initdir/test_extended_filenames-vabalod5: Waiting for transfers to finish 2024/05/06 06:07:56 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:56 DEBUG : filename_contains_Ä›_.txt.bicasap1.partial: renamed to: filename_contains_Ä›_.txt 2024/05/06 06:07:56 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : РуÑÑкий.txt.goluxup7.partial: renamed to: РуÑÑкий.txt 2024/05/06 06:07:56 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:56 DEBUG : filename_contains_ࢺ_.txt.pokazid9.partial: renamed to: filename_contains_ࢺ_.txt 2024/05/06 06:07:56 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt.tojuxip5.partial: renamed to: subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:07:56 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.bunanaj7.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt 2024/05/06 06:07:56 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:56 INFO : subdir_with_ࢺ_: Updated directory metadata 2024/05/06 06:07:56 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_extended_filenames/modfiles" 2024/05/06 06:07:56 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_extended_filenames-sasawos4" 2024/05/06 06:07:56 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : Local file system at /tmp/060749ce/datadir/test_extended_filenames-sasawos4: Waiting for checks to finish 2024/05/06 06:07:56 DEBUG : Local file system at /tmp/060749ce/datadir/test_extended_filenames-sasawos4: Waiting for transfers to finish 2024/05/06 06:07:56 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:56 DEBUG : file1.txt.cananiv9.partial: renamed to: file1.txt 2024/05/06 06:07:56 INFO : file1.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file2.txt: md5 = 40b811fb5009223b6da573f169619d8e OK 2024/05/06 06:07:56 DEBUG : file2.txt.nolecug8.partial: renamed to: file2.txt 2024/05/06 06:07:56 INFO : file2.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1] 2024/05/06 06:07:56 ERROR : : error listing: directory not found 2024/05/06 06:07:56 ERROR : : error listing: directory not found 2024/05/06 06:07:56 checking initFs Local file system at /tmp/060749ce/initdir/test_extended_filenames-vabalod5 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1] 2024/05/06 06:07:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_: Making directory 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/subdir_with_ࢺ_] 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/RCLONE_TEST] 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/file1 - Copy (2).txt] 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/file1 - Copy.txt] 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/file1.txt] 2024/05/06 06:07:56 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: Waiting for checks to finish 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: Waiting for transfers to finish 2024/05/06 06:07:56 INFO : file1 - Copy (2).txt: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/file_enconde_mañana_funcionará.txt] 2024/05/06 06:07:56 INFO : file1 - Copy.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/filename_contains_Ä›_.txt] 2024/05/06 06:07:56 INFO : file1.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/filename_contains_ࢺ_.txt] 2024/05/06 06:07:56 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/РуÑÑкий.txt] 2024/05/06 06:07:56 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_Ä›_.txt] 2024/05/06 06:07:56 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ࢺ_.txt] 2024/05/06 06:07:56 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:56 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:07:56 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:56 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:56 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1] 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/subdir_with_ࢺ_] 2024/05/06 06:07:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_: Making directory with metadata 2024/05/06 06:07:56 INFO : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:56 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_ 2024/05/06 06:07:56 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : Local file system at /tmp/060749ce/extended_filenames/path2: Waiting for checks to finish 2024/05/06 06:07:56 DEBUG : Local file system at /tmp/060749ce/extended_filenames/path2: Waiting for transfers to finish 2024/05/06 06:07:56 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file1 - Copy (2).txt.cerosep4.partial: renamed to: file1 - Copy (2).txt 2024/05/06 06:07:56 INFO : file1 - Copy (2).txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file1 - Copy.txt.jatofuz0.partial: renamed to: file1 - Copy.txt 2024/05/06 06:07:56 INFO : file1 - Copy.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file1.txt.juhasib6.partial: renamed to: file1.txt 2024/05/06 06:07:56 INFO : file1.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:56 DEBUG : filename_contains_Ä›_.txt.zuxibuy1.partial: renamed to: filename_contains_Ä›_.txt 2024/05/06 06:07:56 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:56 DEBUG : RCLONE_TEST.lelupar4.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:56 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:56 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:56 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : filename_contains_ࢺ_.txt.nedeqef2.partial: renamed to: filename_contains_ࢺ_.txt 2024/05/06 06:07:56 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt.bojuyeb3.partial: renamed to: subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:07:56 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file_enconde_mañana_funcionará.txt.surodaf2.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/05/06 06:07:56 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : РуÑÑкий.txt.jaduzir9.partial: renamed to: РуÑÑкий.txt 2024/05/06 06:07:56 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:56 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.wugopoq9.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt 2024/05/06 06:07:56 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:56 INFO : subdir_with_ࢺ_: Updated directory metadata 2024/05/06 06:07:56 checking path2 Local file system at /tmp/060749ce/extended_filenames/path2 2024/05/06 06:07:56 (01) : test extended-filenames 2024/05/06 06:07:56 (02) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/subdir_with_ࢺ_/ 2024/05/06 06:07:56 (03) : fix-names /tmp/060749ce/extended_filenames/path2/subdir_with_ࢺ_/ 2024/05/06 06:07:56 (04) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:07:56 (05) : fix-names /tmp/060749ce/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:07:56 (06) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/РуÑÑкий.txt 2024/05/06 06:07:56 (07) : fix-names /tmp/060749ce/extended_filenames/path2/РуÑÑкий.txt 2024/05/06 06:07:56 (08) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1/file_enconde_mañana_funcionará.txt 2024/05/06 06:07:56 (09) : fix-names /tmp/060749ce/extended_filenames/path2/file_enconde_mañana_funcionará.txt 2024/05/06 06:07:56 (10) : test initial bisync 2024/05/06 06:07:56 (11) : bisync resync 2024/05/06 06:07:56 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:07:56 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/05/06 06:07:56 NOTICE: Local file system at /tmp/060749ce/extended_filenames/path2: Replacing invalid UTF-8 characters in "eÌŒ\x81\xfe aÌñhࢺ_測試РуÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬eÌö" 2024/05/06 06:07:56 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:07:56 NOTICE: Local file system at /tmp/060749ce/extended_filenames/path2: Replacing invalid UTF-8 characters in "Ä›\x81\xfe áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö" 2024/05/06 06:07:56 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) bisync_test.go:1014: Fs is incapable of running test as the paths produce different results, skipping: extended_filenames (path1: РуÑÑкий.txtÄ›þ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶ (NFC) path2: file1 - Copy (2).txtfile1 - Copy (2).txt (file1 - Copy (2).txtfile1 - Copy (2).txt)) (fs1: hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/extended_filenames/path1 fs2: Local file system at /tmp/060749ce/extended_filenames/path2) @@ -1 +1 @@ -РуÑÑкий.txtÄ›þ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶+file1 - Copy (2).txtfile1 - Copy (2).txt === RUN TestBisyncRemoteLocal/filters 2024/05/06 06:07:56 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:56 DEBUG : path1: Making directory 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:56 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1" 2024/05/06 06:07:56 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:56 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:56 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1" 2024/05/06 06:07:56 DEBUG : Creating backend with remote "/tmp/060749ce/filters/path2" 2024/05/06 06:07:56 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filters/initial" 2024/05/06 06:07:56 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_filters-yuxuref1" 2024/05/06 06:07:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file1.txt.kadariv7.partial: renamed to: file1.txt 2024/05/06 06:07:56 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:56 INFO : file1.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : RCLONE_TEST.maselal2.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:56 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:56 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file2.txt.buturop4.partial: renamed to: file2.txt 2024/05/06 06:07:56 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 INFO : file2.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file3.txt.ponaruc4.partial: renamed to: file3.txt 2024/05/06 06:07:56 INFO : file3.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file4.txt.fotakit8.partial: renamed to: file4.txt 2024/05/06 06:07:56 INFO : file4.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file5.txt.xekatos4.partial: renamed to: file5.txt 2024/05/06 06:07:56 INFO : file5.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:56 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:56 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:56 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file7.txt.jogucir9.partial: renamed to: file7.txt 2024/05/06 06:07:56 INFO : file7.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : Local file system at /tmp/060749ce/initdir/test_filters-yuxuref1: Waiting for checks to finish 2024/05/06 06:07:56 DEBUG : Local file system at /tmp/060749ce/initdir/test_filters-yuxuref1: Waiting for transfers to finish 2024/05/06 06:07:56 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : subdir/file20.txt.qimalir7.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:56 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file6.txt.zupowoc6.partial: renamed to: file6.txt 2024/05/06 06:07:56 INFO : file6.txt: Copied (new) 2024/05/06 06:07:56 INFO : subdir: Updated directory metadata 2024/05/06 06:07:56 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filters/modfiles" 2024/05/06 06:07:56 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_filters-bawamol2" 2024/05/06 06:07:56 DEBUG : fileZ.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : filtersfile.flt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : Local file system at /tmp/060749ce/datadir/test_filters-bawamol2: Waiting for checks to finish 2024/05/06 06:07:56 DEBUG : Local file system at /tmp/060749ce/datadir/test_filters-bawamol2: Waiting for transfers to finish 2024/05/06 06:07:56 DEBUG : filtersfile.flt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/05/06 06:07:56 DEBUG : fileZ.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:56 DEBUG : filtersfile.flt.wiquduc8.partial: renamed to: filtersfile.flt 2024/05/06 06:07:56 DEBUG : fileZ.txt.haxixuh4.partial: renamed to: fileZ.txt 2024/05/06 06:07:56 INFO : filtersfile.flt: Copied (new) 2024/05/06 06:07:56 INFO : fileZ.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1] 2024/05/06 06:07:56 ERROR : : error listing: directory not found 2024/05/06 06:07:56 ERROR : : error listing: directory not found 2024/05/06 06:07:56 checking initFs Local file system at /tmp/060749ce/initdir/test_filters-yuxuref1 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1] 2024/05/06 06:07:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : subdir: Making directory 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/subdir] 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/RCLONE_TEST] 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/file1.txt] 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/file2.txt] 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/file3.txt] 2024/05/06 06:07:56 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: Waiting for checks to finish 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: Waiting for transfers to finish 2024/05/06 06:07:56 INFO : file1.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/file4.txt] 2024/05/06 06:07:56 INFO : file2.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/file5.txt] 2024/05/06 06:07:56 INFO : file3.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/file6.txt] 2024/05/06 06:07:56 INFO : file4.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/file7.txt] 2024/05/06 06:07:56 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/subdir/file20.txt] 2024/05/06 06:07:56 INFO : file5.txt: Copied (new) 2024/05/06 06:07:56 INFO : file6.txt: Copied (new) 2024/05/06 06:07:56 INFO : file7.txt: Copied (new) 2024/05/06 06:07:56 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:56 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1] 2024/05/06 06:07:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/subdir] 2024/05/06 06:07:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:56 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:56 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:56 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:56 DEBUG : Local file system at /tmp/060749ce/filters/path2: Waiting for checks to finish 2024/05/06 06:07:56 DEBUG : Local file system at /tmp/060749ce/filters/path2: Waiting for transfers to finish 2024/05/06 06:07:56 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file1.txt.ruwifuh5.partial: renamed to: file1.txt 2024/05/06 06:07:56 INFO : file1.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file3.txt.kabesaj2.partial: renamed to: file3.txt 2024/05/06 06:07:56 INFO : file3.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file4.txt.wosomim9.partial: renamed to: file4.txt 2024/05/06 06:07:56 INFO : file4.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:56 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : RCLONE_TEST.hotimoh2.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:56 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:56 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file5.txt.fewojuz4.partial: renamed to: file5.txt 2024/05/06 06:07:56 INFO : file5.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : subdir/file20.txt.riwuhaj5.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:56 DEBUG : file7.txt.reluduk5.partial: renamed to: file7.txt 2024/05/06 06:07:56 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:56 INFO : file7.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file6.txt.powamun5.partial: renamed to: file6.txt 2024/05/06 06:07:56 INFO : file6.txt: Copied (new) 2024/05/06 06:07:56 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:56 DEBUG : file2.txt.jafuziz0.partial: renamed to: file2.txt 2024/05/06 06:07:56 INFO : file2.txt: Copied (new) 2024/05/06 06:07:56 INFO : subdir: Updated directory metadata 2024/05/06 06:07:56 checking path2 Local file system at /tmp/060749ce/filters/path2 2024/05/06 06:07:56 (01) : test filters 2024/05/06 06:07:56 (02) : copy-file /tmp/060749ce/datadir/test_filters-bawamol2/filtersfile.flt /tmp/060749ce/workdir/ 2024/05/06 06:07:56 INFO : filtersfile.flt: Copied (new) 2024/05/06 06:07:56 (03) : test resync to force building of the filters md5 hash 2024/05/06 06:07:56 (04) : bisync filters-file=/tmp/060749ce/workdir/filtersfile.flt resync 2024/05/06 06:07:56 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/" with Path2 "/tmp/060749ce/filters/path2/" 2024/05/06 06:07:56 INFO : Using filters file /tmp/060749ce/workdir/filtersfile.flt 2024/05/06 06:07:56 INFO : Storing filters file hash to /tmp/060749ce/workdir/filtersfile.flt.md5 2024/05/06 06:07:56 INFO : Copying Path2 files to Path1 2024/05/06 06:07:56 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:56 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:56 INFO : Resync updating listings 2024/05/06 06:07:56 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/" vs Path2 "/tmp/060749ce/filters/path2/" 2024/05/06 06:07:56 INFO : Bisync successful 2024/05/06 06:07:56 (05) : copy-listings resync 2024/05/06 06:07:56 (06) : test place new files on the remote 2024/05/06 06:07:56 (07) : touch-glob 2001-01-02 /tmp/060749ce/datadir/test_filters-bawamol2/ fileZ.txt 2024/05/06 06:07:56 (08) : copy-as /tmp/060749ce/datadir/test_filters-bawamol2/fileZ.txt /tmp/060749ce/filters/path2/ fileZ.txt 2024/05/06 06:07:56 INFO : fileZ.txt: Copied (new) 2024/05/06 06:07:56 (09) : copy-as /tmp/060749ce/datadir/test_filters-bawamol2/fileZ.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/subdir fileZ.txt 2024/05/06 06:07:56 INFO : fileZ.txt: Copied (new) 2024/05/06 06:07:56 (10) : test bisync with filters-file. path2-side fileZ.txt will be filtered. 2024/05/06 06:07:56 (11) : bisync filters-file=/tmp/060749ce/workdir/filtersfile.flt 2024/05/06 06:07:56 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:56 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:56 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:56 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/" with Path2 "/tmp/060749ce/filters/path2/" 2024/05/06 06:07:56 INFO : Using filters file /tmp/060749ce/workdir/filtersfile.flt 2024/05/06 06:07:56 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:56 INFO : Path1 checking for diffs 2024/05/06 06:07:56 INFO : - Path1 File is new - subdir/fileZ.txt 2024/05/06 06:07:56 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:07:56 INFO : Path2 checking for diffs 2024/05/06 06:07:56 INFO : Applying changes 2024/05/06 06:07:56 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/filters/path2/subdir/fileZ.txt 2024/05/06 06:07:56 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:57 INFO : subdir/fileZ.txt: Copied (new) 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Updating listings 2024/05/06 06:07:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filters/path1/" vs Path2 "/tmp/060749ce/filters/path2/" 2024/05/06 06:07:57 INFO : Bisync successful bisync_test.go:555: TEST filters PASSED === RUN TestBisyncRemoteLocal/filtersfile_checks 2024/05/06 06:07:57 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:57 DEBUG : path1: Making directory 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:57 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1" 2024/05/06 06:07:57 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:57 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:57 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1" 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/tmp/060749ce/filtersfile_checks/path2" 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filtersfile_checks/initial" 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_filtersfile_checks-kivufem7" 2024/05/06 06:07:57 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:57 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:57 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:57 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/initdir/test_filtersfile_checks-kivufem7: Waiting for checks to finish 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/initdir/test_filtersfile_checks-kivufem7: Waiting for transfers to finish 2024/05/06 06:07:57 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : subdir/file20.txt.deweqej5.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:57 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.txt.zeyojih0.partial: renamed to: file1.txt 2024/05/06 06:07:57 INFO : file1.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file2.txt.masujol2.partial: renamed to: file2.txt 2024/05/06 06:07:57 INFO : file2.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:57 DEBUG : RCLONE_TEST.tivuduy6.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:57 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:57 INFO : subdir: Updated directory metadata 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filtersfile_checks/modfiles" 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_filtersfile_checks-vadatip8" 2024/05/06 06:07:57 DEBUG : filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : filtersfile2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/datadir/test_filtersfile_checks-vadatip8: Waiting for checks to finish 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/datadir/test_filtersfile_checks-vadatip8: Waiting for transfers to finish 2024/05/06 06:07:57 DEBUG : filtersfile2.txt: md5 = 95acc1e3b5beda465d9b2cb32808588c OK 2024/05/06 06:07:57 DEBUG : filtersfile2.txt.vipetoj9.partial: renamed to: filtersfile2.txt 2024/05/06 06:07:57 DEBUG : filtersfile.txt: md5 = cbf4389cb34d9e160689d1578eb5707f OK 2024/05/06 06:07:57 INFO : filtersfile2.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : filtersfile.txt.kikisar3.partial: renamed to: filtersfile.txt 2024/05/06 06:07:57 INFO : filtersfile.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:07:57 DEBUG : hold.txt.keguzur7.partial: renamed to: hold.txt 2024/05/06 06:07:57 INFO : hold.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1] 2024/05/06 06:07:57 ERROR : : error listing: directory not found 2024/05/06 06:07:57 ERROR : : error listing: directory not found 2024/05/06 06:07:57 checking initFs Local file system at /tmp/060749ce/initdir/test_filtersfile_checks-kivufem7 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1] 2024/05/06 06:07:57 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : subdir: Making directory 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/file1.txt] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/RCLONE_TEST] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/file2.txt] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/subdir] 2024/05/06 06:07:57 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/subdir/file20.txt] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1: Waiting for checks to finish 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1: Waiting for transfers to finish 2024/05/06 06:07:57 INFO : file1.txt: Copied (new) 2024/05/06 06:07:57 INFO : file2.txt: Copied (new) 2024/05/06 06:07:57 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:57 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:57 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/subdir] 2024/05/06 06:07:57 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:57 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:57 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:57 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.txt.rimelaj0.partial: renamed to: file1.txt 2024/05/06 06:07:57 INFO : file1.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/filtersfile_checks/path2: Waiting for checks to finish 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/filtersfile_checks/path2: Waiting for transfers to finish 2024/05/06 06:07:57 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:57 DEBUG : subdir/file20.txt.hibepak3.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:57 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : RCLONE_TEST.buwozan9.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:57 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:57 DEBUG : file2.txt.rijesag7.partial: renamed to: file2.txt 2024/05/06 06:07:57 INFO : file2.txt: Copied (new) 2024/05/06 06:07:57 INFO : subdir: Updated directory metadata 2024/05/06 06:07:57 checking path2 Local file system at /tmp/060749ce/filtersfile_checks/path2 2024/05/06 06:07:57 (01) : test filtersfile-checks 2024/05/06 06:07:57 (02) : test initial bisync 2024/05/06 06:07:57 (03) : bisync resync 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/" with Path2 "/tmp/060749ce/filtersfile_checks/path2/" 2024/05/06 06:07:57 INFO : Copying Path2 files to Path1 2024/05/06 06:07:57 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:57 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:57 INFO : Resync updating listings 2024/05/06 06:07:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/" vs Path2 "/tmp/060749ce/filtersfile_checks/path2/" 2024/05/06 06:07:57 INFO : Bisync successful 2024/05/06 06:07:57 (04) : test 1. inject filters file in workdir. 2024/05/06 06:07:57 (05) : copy-file /tmp/060749ce/datadir/test_filtersfile_checks-vadatip8/filtersfile.txt /tmp/060749ce/workdir/ 2024/05/06 06:07:57 INFO : filtersfile.txt: Copied (new) 2024/05/06 06:07:57 (06) : test 2. run with filters-file but without md5. should abort. 2024/05/06 06:07:57 (07) : bisync filters-file=/tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/" with Path2 "/tmp/060749ce/filtersfile_checks/path2/" 2024/05/06 06:07:57 INFO : Using filters file /tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 ERROR : Bisync critical error: filters file md5 hash not found (must run --resync): /tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:57 Bisync error: bisync aborted 2024/05/06 06:07:57 (08) : test 3. run without filters-file. should be blocked due to prior abort. 2024/05/06 06:07:57 (09) : bisync 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/" with Path2 "/tmp/060749ce/filtersfile_checks/path2/" 2024/05/06 06:07:57 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/060749ce/workdir/TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_filtersfile_checks_path1..tmp_060749ce_filtersfile_checks_path2.path1.lst Path2: /tmp/060749ce/workdir/TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_filtersfile_checks_path1..tmp_060749ce_filtersfile_checks_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/060749ce/workdir" 2024/05/06 06:07:57 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:57 Bisync error: bisync aborted 2024/05/06 06:07:57 (10) : test 4. run with filters-file and resync. 2024/05/06 06:07:57 (11) : bisync filters-file=/tmp/060749ce/workdir/filtersfile.txt resync 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/" with Path2 "/tmp/060749ce/filtersfile_checks/path2/" 2024/05/06 06:07:57 INFO : Using filters file /tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 INFO : Storing filters file hash to /tmp/060749ce/workdir/filtersfile.txt.md5 2024/05/06 06:07:57 INFO : Copying Path2 files to Path1 2024/05/06 06:07:57 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:57 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:57 INFO : Resync updating listings 2024/05/06 06:07:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/" vs Path2 "/tmp/060749ce/filtersfile_checks/path2/" 2024/05/06 06:07:57 INFO : Bisync successful 2024/05/06 06:07:57 (12) : test 5. run with filters-file alone. should run. 2024/05/06 06:07:57 (13) : bisync filters-file=/tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/" with Path2 "/tmp/060749ce/filtersfile_checks/path2/" 2024/05/06 06:07:57 INFO : Using filters file /tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:57 INFO : Path1 checking for diffs 2024/05/06 06:07:57 INFO : Path2 checking for diffs 2024/05/06 06:07:57 INFO : No changes found 2024/05/06 06:07:57 INFO : Updating listings 2024/05/06 06:07:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/" vs Path2 "/tmp/060749ce/filtersfile_checks/path2/" 2024/05/06 06:07:57 INFO : Bisync successful 2024/05/06 06:07:57 (14) : test 6. push changed filters-file to workdir. 2024/05/06 06:07:57 (15) : copy-as /tmp/060749ce/datadir/test_filtersfile_checks-vadatip8/filtersfile2.txt /tmp/060749ce/workdir/ filtersfile.txt 2024/05/06 06:07:57 INFO : filtersfile2.txt: Copied (replaced existing) to: filtersfile.txt 2024/05/06 06:07:57 (16) : test 7. run with filters-file alone. should abort. 2024/05/06 06:07:57 (17) : bisync filters-file=/tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/" with Path2 "/tmp/060749ce/filtersfile_checks/path2/" 2024/05/06 06:07:57 INFO : Using filters file /tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:57 Bisync error: bisync aborted 2024/05/06 06:07:57 (18) : test 8. run with filters-file and resync and dry-run. should do the dry-run but still cause next non-resync run to abort. 2024/05/06 06:07:57 (19) : bisync filters-file=/tmp/060749ce/workdir/filtersfile.txt resync dry-run 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/" with Path2 "/tmp/060749ce/filtersfile_checks/path2/" 2024/05/06 06:07:57 INFO : Using filters file /tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 INFO : Skipped storing filters file hash to /tmp/060749ce/workdir/filtersfile.txt.md5 as --dry-run is set 2024/05/06 06:07:57 INFO : Copying Path2 files to Path1 2024/05/06 06:07:57 NOTICE: - Path2 Resync is copying files to - Path1 2024/05/06 06:07:57 NOTICE: - Path1 Resync is copying files to - Path2 2024/05/06 06:07:57 INFO : Resync updating listings 2024/05/06 06:07:57 INFO : Bisync successful 2024/05/06 06:07:57 (20) : test 9. run with filters-file alone. should abort. 2024/05/06 06:07:57 (21) : bisync filters-file=/tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/filtersfile_checks/path1/" with Path2 "/tmp/060749ce/filtersfile_checks/path2/" 2024/05/06 06:07:57 INFO : Using filters file /tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/060749ce/workdir/filtersfile.txt 2024/05/06 06:07:57 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:07:57 Bisync error: bisync aborted bisync_test.go:555: TEST filtersfile_checks PASSED === RUN TestBisyncRemoteLocal/ignorelistingchecksum 2024/05/06 06:07:57 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:57 DEBUG : path1: Making directory 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:57 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1" 2024/05/06 06:07:57 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:57 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:57 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1" 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/tmp/060749ce/ignorelistingchecksum/path2" 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_ignorelistingchecksum/initial" 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_ignorelistingchecksum-xohagun1" 2024/05/06 06:07:57 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.copy1.txt.hitehat1.partial: renamed to: file1.copy1.txt 2024/05/06 06:07:57 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file1.copy2.txt.musazul2.partial: renamed to: file1.copy2.txt 2024/05/06 06:07:57 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:57 INFO : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/05/06 06:07:57 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:57 DEBUG : file1.copy5.txt.xiwidid6.partial: renamed to: file1.copy5.txt 2024/05/06 06:07:57 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file1.copy3.txt.vifufed6.partial: renamed to: file1.copy3.txt 2024/05/06 06:07:57 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy4.txt.dadezot3.partial: renamed to: file1.copy4.txt 2024/05/06 06:07:57 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:57 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : RCLONE_TEST.kasosen7.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:57 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/initdir/test_ignorelistingchecksum-xohagun1: Waiting for checks to finish 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/initdir/test_ignorelistingchecksum-xohagun1: Waiting for transfers to finish 2024/05/06 06:07:57 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.txt.hiqojor8.partial: renamed to: file1.txt 2024/05/06 06:07:57 INFO : file1.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : subdir/file20.txt.halojik7.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:57 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:57 INFO : subdir: Updated directory metadata 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_ignorelistingchecksum/modfiles" 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_ignorelistingchecksum-kitupeh4" 2024/05/06 06:07:57 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/datadir/test_ignorelistingchecksum-kitupeh4: Waiting for checks to finish 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/datadir/test_ignorelistingchecksum-kitupeh4: Waiting for transfers to finish 2024/05/06 06:07:57 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:57 DEBUG : file1.txt.ducocos3.partial: renamed to: file1.txt 2024/05/06 06:07:57 INFO : file1.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1] 2024/05/06 06:07:57 ERROR : : error listing: directory not found 2024/05/06 06:07:57 ERROR : : error listing: directory not found 2024/05/06 06:07:57 checking initFs Local file system at /tmp/060749ce/initdir/test_ignorelistingchecksum-xohagun1 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1] 2024/05/06 06:07:57 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : subdir: Making directory 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/subdir] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/RCLONE_TEST] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/file1.copy2.txt] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/file1.copy3.txt] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/file1.copy1.txt] 2024/05/06 06:07:57 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: Waiting for checks to finish 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: Waiting for transfers to finish 2024/05/06 06:07:57 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/file1.copy4.txt] 2024/05/06 06:07:57 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/file1.copy5.txt] 2024/05/06 06:07:57 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/file1.txt] 2024/05/06 06:07:57 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/subdir/file20.txt] 2024/05/06 06:07:57 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:07:57 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:07:57 INFO : file1.txt: Copied (new) 2024/05/06 06:07:57 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:57 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/subdir] 2024/05/06 06:07:57 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:57 INFO : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/05/06 06:07:57 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:57 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/ignorelistingchecksum/path2: Waiting for checks to finish 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/ignorelistingchecksum/path2: Waiting for transfers to finish 2024/05/06 06:07:57 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.copy1.txt.lixiwaz2.partial: renamed to: file1.copy1.txt 2024/05/06 06:07:57 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file1.copy2.txt.gicelip8.partial: renamed to: file1.copy2.txt 2024/05/06 06:07:57 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file1.copy3.txt.wajowah1.partial: renamed to: file1.copy3.txt 2024/05/06 06:07:57 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.copy4.txt.pozegim9.partial: renamed to: file1.copy4.txt 2024/05/06 06:07:57 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.copy5.txt.yodibur3.partial: renamed to: file1.copy5.txt 2024/05/06 06:07:57 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : subdir/file20.txt.bijedoz9.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:57 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.txt.posiveb0.partial: renamed to: file1.txt 2024/05/06 06:07:57 INFO : file1.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:57 DEBUG : RCLONE_TEST.roqiyeg1.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:57 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:57 INFO : subdir: Updated directory metadata 2024/05/06 06:07:57 checking path2 Local file system at /tmp/060749ce/ignorelistingchecksum/path2 2024/05/06 06:07:57 (01) : test basic 2024/05/06 06:07:57 (02) : test initial bisync 2024/05/06 06:07:57 (03) : bisync resync 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/" with Path2 "/tmp/060749ce/ignorelistingchecksum/path2/" 2024/05/06 06:07:57 INFO : Copying Path2 files to Path1 2024/05/06 06:07:57 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:57 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:57 INFO : Resync updating listings 2024/05/06 06:07:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/" vs Path2 "/tmp/060749ce/ignorelistingchecksum/path2/" 2024/05/06 06:07:57 INFO : Bisync successful 2024/05/06 06:07:57 (04) : bisync resync ignore-listing-checksum 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/" with Path2 "/tmp/060749ce/ignorelistingchecksum/path2/" 2024/05/06 06:07:57 INFO : Copying Path2 files to Path1 2024/05/06 06:07:57 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:57 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:57 INFO : Resync updating listings 2024/05/06 06:07:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/" vs Path2 "/tmp/060749ce/ignorelistingchecksum/path2/" 2024/05/06 06:07:57 INFO : Bisync successful 2024/05/06 06:07:57 (05) : test place newer files on both paths 2024/05/06 06:07:57 (06) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_ignorelistingchecksum-kitupeh4/file1.txt /tmp/060749ce/ignorelistingchecksum/path2/ 2024/05/06 06:07:57 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:57 (07) : copy-as /tmp/060749ce/datadir/test_ignorelistingchecksum-kitupeh4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/subdir file20.txt 2024/05/06 06:07:57 INFO : file1.txt: Copied (replaced existing) to: file20.txt 2024/05/06 06:07:57 (08) : test bisync run 2024/05/06 06:07:57 (09) : bisync ignore-listing-checksum 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/" with Path2 "/tmp/060749ce/ignorelistingchecksum/path2/" 2024/05/06 06:07:57 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:57 INFO : Path1 checking for diffs 2024/05/06 06:07:57 INFO : - Path1 File changed: size (larger), time (newer) - subdir/file20.txt 2024/05/06 06:07:57 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:07:57 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:07:57 INFO : Path2 checking for diffs 2024/05/06 06:07:57 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:07:57 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:07:57 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:07:57 INFO : Applying changes 2024/05/06 06:07:57 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/ignorelistingchecksum/path2/subdir/file20.txt 2024/05/06 06:07:57 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/file1.txt 2024/05/06 06:07:57 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:57 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:57 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:57 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:07:57 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:57 INFO : Updating listings 2024/05/06 06:07:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/ignorelistingchecksum/path1/" vs Path2 "/tmp/060749ce/ignorelistingchecksum/path2/" 2024/05/06 06:07:57 INFO : Bisync successful bisync_test.go:555: TEST ignorelistingchecksum PASSED === RUN TestBisyncRemoteLocal/max_delete_path1 2024/05/06 06:07:57 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:57 DEBUG : path1: Making directory 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:57 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1" 2024/05/06 06:07:57 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:57 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:57 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1" 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/tmp/060749ce/max_delete_path1/path2" 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_max_delete_path1/initial" 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_max_delete_path1-tohunip4" 2024/05/06 06:07:57 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.txt.kefetel1.partial: renamed to: file1.txt 2024/05/06 06:07:57 INFO : file1.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file3.txt.xojakos5.partial: renamed to: file3.txt 2024/05/06 06:07:57 INFO : file3.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file5.txt.kosuyev1.partial: renamed to: file5.txt 2024/05/06 06:07:57 INFO : file5.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file2.txt.kogadab7.partial: renamed to: file2.txt 2024/05/06 06:07:57 DEBUG : file7.txt.civeqaf2.partial: renamed to: file7.txt 2024/05/06 06:07:57 INFO : file2.txt: Copied (new) 2024/05/06 06:07:57 INFO : file7.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file4.txt.qaruqih1.partial: renamed to: file4.txt 2024/05/06 06:07:57 INFO : file4.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file6.txt.fegecuk8.partial: renamed to: file6.txt 2024/05/06 06:07:57 INFO : file6.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/initdir/test_max_delete_path1-tohunip4: Waiting for checks to finish 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/initdir/test_max_delete_path1-tohunip4: Waiting for transfers to finish 2024/05/06 06:07:57 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file8.txt.sizalah5.partial: renamed to: file8.txt 2024/05/06 06:07:57 INFO : file8.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:57 DEBUG : file9.txt.debihig8.partial: renamed to: file9.txt 2024/05/06 06:07:57 INFO : file9.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_max_delete_path1/modfiles" 2024/05/06 06:07:57 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_max_delete_path1-fegasip4" 2024/05/06 06:07:57 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/datadir/test_max_delete_path1-fegasip4: Waiting for checks to finish 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/datadir/test_max_delete_path1-fegasip4: Waiting for transfers to finish 2024/05/06 06:07:57 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:07:57 DEBUG : hold.txt.zanimoy3.partial: renamed to: hold.txt 2024/05/06 06:07:57 INFO : hold.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1] 2024/05/06 06:07:57 ERROR : : error listing: directory not found 2024/05/06 06:07:57 ERROR : : error listing: directory not found 2024/05/06 06:07:57 checking initFs Local file system at /tmp/060749ce/initdir/test_max_delete_path1-tohunip4 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1] 2024/05/06 06:07:57 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: Waiting for checks to finish 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file1.txt] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file2.txt] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file3.txt] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file4.txt] 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: Waiting for transfers to finish 2024/05/06 06:07:57 INFO : file4.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file5.txt] 2024/05/06 06:07:57 INFO : file1.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file6.txt] 2024/05/06 06:07:57 INFO : file2.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file7.txt] 2024/05/06 06:07:57 INFO : file3.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file8.txt] 2024/05/06 06:07:57 INFO : file5.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file9.txt] 2024/05/06 06:07:57 INFO : file6.txt: Copied (new) 2024/05/06 06:07:57 INFO : file7.txt: Copied (new) 2024/05/06 06:07:57 INFO : file8.txt: Copied (new) 2024/05/06 06:07:57 INFO : file9.txt: Copied (new) 2024/05/06 06:07:57 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1 2024/05/06 06:07:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1] 2024/05/06 06:07:57 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file1.txt.bofavay5.partial: renamed to: file1.txt 2024/05/06 06:07:57 INFO : file1.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file2.txt.gikacok2.partial: renamed to: file2.txt 2024/05/06 06:07:57 INFO : file2.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:57 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file3.txt.wesamol4.partial: renamed to: file3.txt 2024/05/06 06:07:57 INFO : file3.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/max_delete_path1/path2: Waiting for checks to finish 2024/05/06 06:07:57 DEBUG : file6.txt.begidud9.partial: renamed to: file6.txt 2024/05/06 06:07:57 INFO : file6.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : Local file system at /tmp/060749ce/max_delete_path1/path2: Waiting for transfers to finish 2024/05/06 06:07:57 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file5.txt.xuhituk4.partial: renamed to: file5.txt 2024/05/06 06:07:57 INFO : file5.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file4.txt.deqofof8.partial: renamed to: file4.txt 2024/05/06 06:07:57 INFO : file4.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:57 DEBUG : file8.txt.riyiram8.partial: renamed to: file8.txt 2024/05/06 06:07:57 INFO : file8.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file7.txt.telodot6.partial: renamed to: file7.txt 2024/05/06 06:07:57 INFO : file7.txt: Copied (new) 2024/05/06 06:07:57 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:57 DEBUG : file9.txt.lemetut9.partial: renamed to: file9.txt 2024/05/06 06:07:57 INFO : file9.txt: Copied (new) 2024/05/06 06:07:57 checking path2 Local file system at /tmp/060749ce/max_delete_path1/path2 2024/05/06 06:07:57 (01) : test max-delete-path1 2024/05/06 06:07:57 (02) : test initial bisync 2024/05/06 06:07:57 (03) : bisync resync 2024/05/06 06:07:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/" with Path2 "/tmp/060749ce/max_delete_path1/path2/" 2024/05/06 06:07:57 INFO : Copying Path2 files to Path1 2024/05/06 06:07:57 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:57 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:57 INFO : Resync updating listings 2024/05/06 06:07:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/" vs Path2 "/tmp/060749ce/max_delete_path1/path2/" 2024/05/06 06:07:57 INFO : Bisync successful 2024/05/06 06:07:57 (04) : test delete >50% of local files 2024/05/06 06:07:57 (05) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file1.txt 2024/05/06 06:07:57 INFO : file1.txt: Deleted 2024/05/06 06:07:57 (06) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file2.txt 2024/05/06 06:07:57 INFO : file2.txt: Deleted 2024/05/06 06:07:57 (07) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file3.txt 2024/05/06 06:07:57 INFO : file3.txt: Deleted 2024/05/06 06:07:57 (08) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file4.txt 2024/05/06 06:07:57 INFO : file4.txt: Deleted 2024/05/06 06:07:57 (09) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/file5.txt 2024/05/06 06:07:57 INFO : file5.txt: Deleted 2024/05/06 06:07:57 (10) : test sync should fail due to too many local deletes 2024/05/06 06:07:57 (11) : bisync 2024/05/06 06:07:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/" with Path2 "/tmp/060749ce/max_delete_path1/path2/" 2024/05/06 06:07:57 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:57 INFO : Path1 checking for diffs 2024/05/06 06:07:57 INFO : - Path1 File was deleted - file1.txt 2024/05/06 06:07:57 INFO : - Path1 File was deleted - file2.txt 2024/05/06 06:07:57 INFO : - Path1 File was deleted - file3.txt 2024/05/06 06:07:57 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:07:57 INFO : - Path1 File was deleted - file5.txt 2024/05/06 06:07:57 INFO : Path1: 5 changes:  0 new,  0 modified,  5 deleted 2024/05/06 06:07:57 INFO : Path2 checking for diffs 2024/05/06 06:07:57 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/". Run with --force if desired. 2024/05/06 06:07:57 NOTICE: Bisync aborted. Please try again. 2024/05/06 06:07:57 Bisync error: too many deletes 2024/05/06 06:07:57 (12) : copy-listings initial-fail 2024/05/06 06:07:57 (13) : test change max-delete limit to 60%. sync should run. 2024/05/06 06:07:57 (14) : bisync max-delete=60 2024/05/06 06:07:57 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:57 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:57 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/" with Path2 "/tmp/060749ce/max_delete_path1/path2/" 2024/05/06 06:07:57 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:57 INFO : Path1 checking for diffs 2024/05/06 06:07:57 INFO : - Path1 File was deleted - file1.txt 2024/05/06 06:07:57 INFO : - Path1 File was deleted - file2.txt 2024/05/06 06:07:57 INFO : - Path1 File was deleted - file3.txt 2024/05/06 06:07:57 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:07:57 INFO : - Path1 File was deleted - file5.txt 2024/05/06 06:07:57 INFO : Path1: 5 changes:  0 new,  0 modified,  5 deleted 2024/05/06 06:07:57 INFO : Path2 checking for diffs 2024/05/06 06:07:57 INFO : Applying changes 2024/05/06 06:07:57 INFO : - Path2 Queue delete - /tmp/060749ce/max_delete_path1/path2/file1.txt 2024/05/06 06:07:57 INFO : - Path2 Queue delete - /tmp/060749ce/max_delete_path1/path2/file2.txt 2024/05/06 06:07:57 INFO : - Path2 Queue delete - /tmp/060749ce/max_delete_path1/path2/file3.txt 2024/05/06 06:07:57 INFO : - Path2 Queue delete - /tmp/060749ce/max_delete_path1/path2/file4.txt 2024/05/06 06:07:57 INFO : - Path2 Queue delete - /tmp/060749ce/max_delete_path1/path2/file5.txt 2024/05/06 06:07:57 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:57 INFO : file4.txt: Deleted 2024/05/06 06:07:57 INFO : file3.txt: Deleted 2024/05/06 06:07:57 INFO : file1.txt: Deleted 2024/05/06 06:07:57 INFO : file5.txt: Deleted 2024/05/06 06:07:57 INFO : file2.txt: Deleted 2024/05/06 06:07:57 INFO : Updating listings 2024/05/06 06:07:57 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path1/path1/" vs Path2 "/tmp/060749ce/max_delete_path1/path2/" 2024/05/06 06:07:57 INFO : Bisync successful bisync_test.go:555: TEST max_delete_path1 PASSED === RUN TestBisyncRemoteLocal/max_delete_path2_force 2024/05/06 06:07:58 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:58 DEBUG : path1: Making directory 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:58 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1" 2024/05/06 06:07:58 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:58 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:58 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1" 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/tmp/060749ce/max_delete_path2_force/path2" 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_max_delete_path2_force/initial" 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_max_delete_path2_force-huhunaj5" 2024/05/06 06:07:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/initdir/test_max_delete_path2_force-huhunaj5: Waiting for checks to finish 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/initdir/test_max_delete_path2_force-huhunaj5: Waiting for transfers to finish 2024/05/06 06:07:58 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file1.txt.cezemag5.partial: renamed to: file1.txt 2024/05/06 06:07:58 DEBUG : file3.txt.revifay2.partial: renamed to: file3.txt 2024/05/06 06:07:58 INFO : file1.txt: Copied (new) 2024/05/06 06:07:58 INFO : file3.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file2.txt.kekiqal7.partial: renamed to: file2.txt 2024/05/06 06:07:58 INFO : file2.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file5.txt.teqamuf8.partial: renamed to: file5.txt 2024/05/06 06:07:58 INFO : file5.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file6.txt.ziwiwuv7.partial: renamed to: file6.txt 2024/05/06 06:07:58 INFO : file6.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file4.txt.daneduk9.partial: renamed to: file4.txt 2024/05/06 06:07:58 INFO : file4.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file7.txt.jodobah6.partial: renamed to: file7.txt 2024/05/06 06:07:58 INFO : file7.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file8.txt.ruloyem8.partial: renamed to: file8.txt 2024/05/06 06:07:58 INFO : file8.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:58 DEBUG : file9.txt.homobet0.partial: renamed to: file9.txt 2024/05/06 06:07:58 INFO : file9.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_max_delete_path2_force/modfiles" 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_max_delete_path2_force-reveviy4" 2024/05/06 06:07:58 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/datadir/test_max_delete_path2_force-reveviy4: Waiting for checks to finish 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/datadir/test_max_delete_path2_force-reveviy4: Waiting for transfers to finish 2024/05/06 06:07:58 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:07:58 DEBUG : hold.txt.toqitay9.partial: renamed to: hold.txt 2024/05/06 06:07:58 INFO : hold.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1] 2024/05/06 06:07:58 ERROR : : error listing: directory not found 2024/05/06 06:07:58 ERROR : : error listing: directory not found 2024/05/06 06:07:58 checking initFs Local file system at /tmp/060749ce/initdir/test_max_delete_path2_force-huhunaj5 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1] 2024/05/06 06:07:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file1.txt] 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file2.txt] 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file3.txt] 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file4.txt] 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: Waiting for checks to finish 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: Waiting for transfers to finish 2024/05/06 06:07:58 INFO : file1.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file5.txt] 2024/05/06 06:07:58 INFO : file2.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file6.txt] 2024/05/06 06:07:58 INFO : file3.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file7.txt] 2024/05/06 06:07:58 INFO : file4.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file8.txt] 2024/05/06 06:07:58 INFO : file5.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file9.txt] 2024/05/06 06:07:58 INFO : file6.txt: Copied (new) 2024/05/06 06:07:58 INFO : file7.txt: Copied (new) 2024/05/06 06:07:58 INFO : file8.txt: Copied (new) 2024/05/06 06:07:58 INFO : file9.txt: Copied (new) 2024/05/06 06:07:58 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1] 2024/05/06 06:07:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/max_delete_path2_force/path2: Waiting for checks to finish 2024/05/06 06:07:58 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/max_delete_path2_force/path2: Waiting for transfers to finish 2024/05/06 06:07:58 DEBUG : file3.txt.bugovih7.partial: renamed to: file3.txt 2024/05/06 06:07:58 INFO : file3.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file1.txt.qikuciz0.partial: renamed to: file1.txt 2024/05/06 06:07:58 INFO : file1.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file2.txt.tumarif5.partial: renamed to: file2.txt 2024/05/06 06:07:58 INFO : file2.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file5.txt.vakanup5.partial: renamed to: file5.txt 2024/05/06 06:07:58 DEBUG : file6.txt.yajudis9.partial: renamed to: file6.txt 2024/05/06 06:07:58 INFO : file5.txt: Copied (new) 2024/05/06 06:07:58 INFO : file6.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file7.txt.pefewiy3.partial: renamed to: file7.txt 2024/05/06 06:07:58 INFO : file7.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file4.txt.kebopow4.partial: renamed to: file4.txt 2024/05/06 06:07:58 INFO : file4.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file8.txt.mekeyof1.partial: renamed to: file8.txt 2024/05/06 06:07:58 INFO : file8.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:58 DEBUG : file9.txt.vuficav9.partial: renamed to: file9.txt 2024/05/06 06:07:58 INFO : file9.txt: Copied (new) 2024/05/06 06:07:58 checking path2 Local file system at /tmp/060749ce/max_delete_path2_force/path2 2024/05/06 06:07:58 (01) : test max-delete-path2-force 2024/05/06 06:07:58 (02) : test initial bisync 2024/05/06 06:07:58 (03) : bisync resync 2024/05/06 06:07:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/" with Path2 "/tmp/060749ce/max_delete_path2_force/path2/" 2024/05/06 06:07:58 INFO : Copying Path2 files to Path1 2024/05/06 06:07:58 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:58 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:58 INFO : Resync updating listings 2024/05/06 06:07:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/" vs Path2 "/tmp/060749ce/max_delete_path2_force/path2/" 2024/05/06 06:07:58 INFO : Bisync successful 2024/05/06 06:07:58 (04) : test delete >50% of remote files 2024/05/06 06:07:58 (05) : delete-file /tmp/060749ce/max_delete_path2_force/path2/file1.txt 2024/05/06 06:07:58 INFO : file1.txt: Deleted 2024/05/06 06:07:58 (06) : delete-file /tmp/060749ce/max_delete_path2_force/path2/file2.txt 2024/05/06 06:07:58 INFO : file2.txt: Deleted 2024/05/06 06:07:58 (07) : delete-file /tmp/060749ce/max_delete_path2_force/path2/file3.txt 2024/05/06 06:07:58 INFO : file3.txt: Deleted 2024/05/06 06:07:58 (08) : delete-file /tmp/060749ce/max_delete_path2_force/path2/file4.txt 2024/05/06 06:07:58 INFO : file4.txt: Deleted 2024/05/06 06:07:58 (09) : delete-file /tmp/060749ce/max_delete_path2_force/path2/file5.txt 2024/05/06 06:07:58 INFO : file5.txt: Deleted 2024/05/06 06:07:58 (10) : test sync should fail due to too many path2 deletes 2024/05/06 06:07:58 (11) : bisync 2024/05/06 06:07:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/" with Path2 "/tmp/060749ce/max_delete_path2_force/path2/" 2024/05/06 06:07:58 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:58 INFO : Path1 checking for diffs 2024/05/06 06:07:58 INFO : Path2 checking for diffs 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file1.txt 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file2.txt 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file4.txt 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file5.txt 2024/05/06 06:07:58 INFO : Path2: 5 changes:  0 new,  0 modified,  5 deleted 2024/05/06 06:07:58 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path2 "/tmp/060749ce/max_delete_path2_force/path2/". Run with --force if desired. 2024/05/06 06:07:58 NOTICE: Bisync aborted. Please try again. 2024/05/06 06:07:58 Bisync error: too many deletes 2024/05/06 06:07:58 (12) : copy-listings initial-fail 2024/05/06 06:07:58 (13) : test apply force option. sync should run. 2024/05/06 06:07:58 (14) : bisync force 2024/05/06 06:07:58 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:58 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/" with Path2 "/tmp/060749ce/max_delete_path2_force/path2/" 2024/05/06 06:07:58 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:58 INFO : Path1 checking for diffs 2024/05/06 06:07:58 INFO : Path2 checking for diffs 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file1.txt 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file2.txt 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file4.txt 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file5.txt 2024/05/06 06:07:58 INFO : Path2: 5 changes:  0 new,  0 modified,  5 deleted 2024/05/06 06:07:58 INFO : Applying changes 2024/05/06 06:07:58 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file1.txt 2024/05/06 06:07:58 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file2.txt 2024/05/06 06:07:58 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file3.txt 2024/05/06 06:07:58 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file4.txt 2024/05/06 06:07:58 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/file5.txt 2024/05/06 06:07:58 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:58 INFO : file5.txt: Deleted 2024/05/06 06:07:58 INFO : file3.txt: Deleted 2024/05/06 06:07:58 INFO : file1.txt: Deleted 2024/05/06 06:07:58 INFO : file2.txt: Deleted 2024/05/06 06:07:58 INFO : file4.txt: Deleted 2024/05/06 06:07:58 INFO : Updating listings 2024/05/06 06:07:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/max_delete_path2_force/path1/" vs Path2 "/tmp/060749ce/max_delete_path2_force/path2/" 2024/05/06 06:07:58 INFO : Bisync successful bisync_test.go:555: TEST max_delete_path2_force PASSED === RUN TestBisyncRemoteLocal/nomodtime 2024/05/06 06:07:58 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:58 DEBUG : path1: Making directory 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:58 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1" 2024/05/06 06:07:58 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:58 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:58 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1" 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/tmp/060749ce/nomodtime/path2" 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_nomodtime/initial" 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_nomodtime-xoxokip8" 2024/05/06 06:07:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/initdir/test_nomodtime-xoxokip8: Waiting for checks to finish 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/initdir/test_nomodtime-xoxokip8: Waiting for transfers to finish 2024/05/06 06:07:58 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file1.txt.gasosaj0.partial: renamed to: file1.txt 2024/05/06 06:07:58 INFO : file1.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file4.txt.xipecez3.partial: renamed to: file4.txt 2024/05/06 06:07:58 INFO : file4.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file5.txt.xogataz5.partial: renamed to: file5.txt 2024/05/06 06:07:58 INFO : file5.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file2.txt.tafocap4.partial: renamed to: file2.txt 2024/05/06 06:07:58 INFO : file2.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file3.txt.jimuhux2.partial: renamed to: file3.txt 2024/05/06 06:07:58 DEBUG : file6.txt.gazilel9.partial: renamed to: file6.txt 2024/05/06 06:07:58 INFO : file6.txt: Copied (new) 2024/05/06 06:07:58 INFO : file3.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file8.txt.sorecir7.partial: renamed to: file8.txt 2024/05/06 06:07:58 INFO : file8.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file7.txt.rukibir4.partial: renamed to: file7.txt 2024/05/06 06:07:58 INFO : file7.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:58 DEBUG : RCLONE_TEST.wijagod4.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:58 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_nomodtime/modfiles" 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_nomodtime-jovubop2" 2024/05/06 06:07:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/datadir/test_nomodtime-jovubop2: Waiting for checks to finish 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/datadir/test_nomodtime-jovubop2: Waiting for transfers to finish 2024/05/06 06:07:58 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:58 DEBUG : file10.txt.jetimuj5.partial: renamed to: file10.txt 2024/05/06 06:07:58 INFO : file10.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:58 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:58 DEBUG : file1.txt.mexewaw1.partial: renamed to: file1.txt 2024/05/06 06:07:58 INFO : file1.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file11.txt.talalus5.partial: renamed to: file11.txt 2024/05/06 06:07:58 INFO : file11.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:07:58 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:07:58 DEBUG : file2.txt.yobifuc5.partial: renamed to: file2.txt 2024/05/06 06:07:58 INFO : file2.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file5L.txt.lohuroc8.partial: renamed to: file5L.txt 2024/05/06 06:07:58 INFO : file5L.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:58 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:07:58 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:58 DEBUG : file6.txt.xezojos6.partial: renamed to: file6.txt 2024/05/06 06:07:58 INFO : file6.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file5R.txt.reyupal9.partial: renamed to: file5R.txt 2024/05/06 06:07:58 INFO : file5R.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file7.txt.hoqimid8.partial: renamed to: file7.txt 2024/05/06 06:07:58 INFO : file7.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1] 2024/05/06 06:07:58 ERROR : : error listing: directory not found 2024/05/06 06:07:58 ERROR : : error listing: directory not found 2024/05/06 06:07:58 checking initFs Local file system at /tmp/060749ce/initdir/test_nomodtime-xoxokip8 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1] 2024/05/06 06:07:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/RCLONE_TEST] 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file1.txt] 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file2.txt] 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: Waiting for checks to finish 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: Waiting for transfers to finish 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file3.txt] 2024/05/06 06:07:58 INFO : file3.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file4.txt] 2024/05/06 06:07:58 INFO : file2.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file5.txt] 2024/05/06 06:07:58 INFO : file1.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file6.txt] 2024/05/06 06:07:58 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file7.txt] 2024/05/06 06:07:58 INFO : file4.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file8.txt] 2024/05/06 06:07:58 INFO : file5.txt: Copied (new) 2024/05/06 06:07:58 INFO : file6.txt: Copied (new) 2024/05/06 06:07:58 INFO : file7.txt: Copied (new) 2024/05/06 06:07:58 INFO : file8.txt: Copied (new) 2024/05/06 06:07:58 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1] 2024/05/06 06:07:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/nomodtime/path2: Waiting for checks to finish 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/nomodtime/path2: Waiting for transfers to finish 2024/05/06 06:07:58 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file2.txt.wasoqef9.partial: renamed to: file2.txt 2024/05/06 06:07:58 INFO : file2.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file1.txt.darizot1.partial: renamed to: file1.txt 2024/05/06 06:07:58 INFO : file1.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file3.txt.cagaqir1.partial: renamed to: file3.txt 2024/05/06 06:07:58 DEBUG : file4.txt.roruyex0.partial: renamed to: file4.txt 2024/05/06 06:07:58 INFO : file3.txt: Copied (new) 2024/05/06 06:07:58 INFO : file4.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file5.txt.bamugiz0.partial: renamed to: file5.txt 2024/05/06 06:07:58 INFO : file5.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:58 DEBUG : file6.txt.losiniv8.partial: renamed to: file6.txt 2024/05/06 06:07:58 INFO : file6.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : RCLONE_TEST.seriqas3.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:58 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file7.txt.qipakiq8.partial: renamed to: file7.txt 2024/05/06 06:07:58 INFO : file7.txt: Copied (new) 2024/05/06 06:07:58 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:58 DEBUG : file8.txt.bedaqug0.partial: renamed to: file8.txt 2024/05/06 06:07:58 INFO : file8.txt: Copied (new) 2024/05/06 06:07:58 checking path2 Local file system at /tmp/060749ce/nomodtime/path2 2024/05/06 06:07:58 (01) : test changes 2024/05/06 06:07:58 (02) : test initial bisync 2024/05/06 06:07:58 (03) : bisync resync nomodtime 2024/05/06 06:07:58 NOTICE: Local file system at /tmp/060749ce/nomodtime/path2: will use md5 for same-side diffs on Path2 only 2024/05/06 06:07:58 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:07:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/" with Path2 "/tmp/060749ce/nomodtime/path2/" 2024/05/06 06:07:58 INFO : Copying Path2 files to Path1 2024/05/06 06:07:58 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:58 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:07:58 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:58 INFO : Resync updating listings 2024/05/06 06:07:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/" vs Path2 "/tmp/060749ce/nomodtime/path2/" 2024/05/06 06:07:58 INFO : Bisync successful 2024/05/06 06:07:58 (04) : test make modifications on both paths 2024/05/06 06:07:58 (05) : test new on path2 - file10 2024/05/06 06:07:58 (06) : copy-file /tmp/060749ce/datadir/test_nomodtime-jovubop2/file10.txt /tmp/060749ce/nomodtime/path2/ 2024/05/06 06:07:58 INFO : file10.txt: Copied (new) 2024/05/06 06:07:58 (07) : test changed on path2 - file1 2024/05/06 06:07:58 (08) : copy-file /tmp/060749ce/datadir/test_nomodtime-jovubop2/file1.txt /tmp/060749ce/nomodtime/path2/ 2024/05/06 06:07:58 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:58 (09) : test new on path1 - file11 2024/05/06 06:07:58 (10) : copy-file /tmp/060749ce/datadir/test_nomodtime-jovubop2/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/ 2024/05/06 06:07:58 INFO : file11.txt: Copied (new) 2024/05/06 06:07:58 (11) : test changed on path1 - file2 2024/05/06 06:07:58 (12) : copy-file /tmp/060749ce/datadir/test_nomodtime-jovubop2/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/ 2024/05/06 06:07:58 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:58 (13) : test deleted on path2 - file3 2024/05/06 06:07:58 (14) : delete-file /tmp/060749ce/nomodtime/path2/file3.txt 2024/05/06 06:07:58 INFO : file3.txt: Deleted 2024/05/06 06:07:58 (15) : test deleted on path1 - file4 2024/05/06 06:07:58 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file4.txt 2024/05/06 06:07:58 INFO : file4.txt: Deleted 2024/05/06 06:07:58 (17) : test deleted on both paths - file8 2024/05/06 06:07:58 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file8.txt 2024/05/06 06:07:58 INFO : file8.txt: Deleted 2024/05/06 06:07:58 (19) : delete-file /tmp/060749ce/nomodtime/path2/file8.txt 2024/05/06 06:07:58 INFO : file8.txt: Deleted 2024/05/06 06:07:58 (20) : test changed on both paths - file5 (file5R, file5L) 2024/05/06 06:07:58 (21) : copy-as /tmp/060749ce/datadir/test_nomodtime-jovubop2/file5R.txt /tmp/060749ce/nomodtime/path2/ file5.txt 2024/05/06 06:07:58 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:07:58 (22) : copy-as /tmp/060749ce/datadir/test_nomodtime-jovubop2/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/ file5.txt 2024/05/06 06:07:58 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:07:58 (23) : test changed on path2 and deleted on path1 - file6 2024/05/06 06:07:58 (24) : copy-file /tmp/060749ce/datadir/test_nomodtime-jovubop2/file6.txt /tmp/060749ce/nomodtime/path2/ 2024/05/06 06:07:58 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:07:58 (25) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file6.txt 2024/05/06 06:07:58 INFO : file6.txt: Deleted 2024/05/06 06:07:58 (26) : test changed on path1 and deleted on path2 - file7 2024/05/06 06:07:58 (27) : copy-file /tmp/060749ce/datadir/test_nomodtime-jovubop2/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/ 2024/05/06 06:07:58 INFO : file7.txt: Copied (replaced existing) 2024/05/06 06:07:58 (28) : delete-file /tmp/060749ce/nomodtime/path2/file7.txt 2024/05/06 06:07:58 INFO : file7.txt: Deleted 2024/05/06 06:07:58 (29) : test bisync run 2024/05/06 06:07:58 (30) : bisync nomodtime 2024/05/06 06:07:58 NOTICE: Local file system at /tmp/060749ce/nomodtime/path2: will use md5 for same-side diffs on Path2 only 2024/05/06 06:07:58 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:07:58 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/" with Path2 "/tmp/060749ce/nomodtime/path2/" 2024/05/06 06:07:58 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:58 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:07:58 INFO : Path1 checking for diffs 2024/05/06 06:07:58 INFO : - Path1 File changed: size (larger), hash - file2.txt 2024/05/06 06:07:58 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:07:58 INFO : - Path1 File changed: size (larger), hash - file5.txt 2024/05/06 06:07:58 INFO : - Path1 File was deleted - file6.txt 2024/05/06 06:07:58 INFO : - Path1 File changed: size (larger), hash - file7.txt 2024/05/06 06:07:58 INFO : - Path1 File was deleted - file8.txt 2024/05/06 06:07:58 INFO : - Path1 File is new - file11.txt 2024/05/06 06:07:58 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:07:58 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2024/05/06 06:07:58 INFO : Path2 checking for diffs 2024/05/06 06:07:58 INFO : - Path2 File changed: size (larger), hash - file1.txt 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:07:58 INFO : - Path2 File changed: size (larger), hash - file5.txt 2024/05/06 06:07:58 INFO : - Path2 File changed: size (larger), hash - file6.txt 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file7.txt 2024/05/06 06:07:58 INFO : - Path2 File was deleted - file8.txt 2024/05/06 06:07:58 INFO : - Path2 File is new - file10.txt 2024/05/06 06:07:58 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:07:58 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2024/05/06 06:07:58 INFO : Applying changes 2024/05/06 06:07:58 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/nomodtime/path2/file11.txt 2024/05/06 06:07:58 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/nomodtime/path2/file2.txt 2024/05/06 06:07:58 INFO : - Path2 Queue delete - /tmp/060749ce/nomodtime/path2/file4.txt 2024/05/06 06:07:58 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:07:58 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file5.txt.conflict1 2024/05/06 06:07:58 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/05/06 06:07:58 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/nomodtime/path2/file5.txt.conflict1 2024/05/06 06:07:58 NOTICE: - Path2 Renaming Path2 copy - /tmp/060749ce/nomodtime/path2/file5.txt.conflict2 2024/05/06 06:07:58 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/05/06 06:07:58 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file5.txt.conflict2 2024/05/06 06:07:58 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file6.txt 2024/05/06 06:07:58 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/nomodtime/path2/file7.txt 2024/05/06 06:07:58 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file1.txt 2024/05/06 06:07:58 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file10.txt 2024/05/06 06:07:58 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/file3.txt 2024/05/06 06:07:58 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:58 INFO : file10.txt: Copied (new) 2024/05/06 06:07:58 INFO : file5.txt.conflict2: Copied (new) 2024/05/06 06:07:58 INFO : file6.txt: Copied (new) 2024/05/06 06:07:58 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:58 INFO : file3.txt: Deleted 2024/05/06 06:07:58 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:58 INFO : file11.txt: Copied (new) 2024/05/06 06:07:58 INFO : file5.txt.conflict1: Copied (new) 2024/05/06 06:07:58 INFO : file7.txt: Copied (new) 2024/05/06 06:07:58 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:58 INFO : file4.txt: Deleted 2024/05/06 06:07:58 INFO : Updating listings 2024/05/06 06:07:58 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/nomodtime/path1/" vs Path2 "/tmp/060749ce/nomodtime/path2/" 2024/05/06 06:07:58 INFO : Bisync successful bisync_test.go:555: TEST nomodtime PASSED === RUN TestBisyncRemoteLocal/normalization 2024/05/06 06:07:58 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:58 DEBUG : path1: Making directory 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:58 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1" 2024/05/06 06:07:58 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:58 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:58 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1" 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/tmp/060749ce/normalization/path2" 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_normalization/initial" 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_normalization-kulokok0" 2024/05/06 06:07:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory with metadata 2024/05/06 06:07:58 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/05/06 06:07:58 DEBUG : Added delayed dir = "測試_РуÑÑкий_ _ _Ä›_áñ", newDst=測試_РуÑÑкий_ _ _Ä›_áñ 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/initdir/test_normalization-kulokok0: Waiting for checks to finish 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/initdir/test_normalization-kulokok0: Waiting for transfers to finish 2024/05/06 06:07:58 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:58 DEBUG : RCLONE_TEST.tejazew1.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:58 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt.tusakub7.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt 2024/05/06 06:07:58 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt.zapozup1.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt 2024/05/06 06:07:58 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file.fohemiy9.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file 2024/05/06 06:07:58 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/05/06 06:07:58 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:58 DEBUG : file1.txt.rukokeg2.partial: renamed to: file1.txt 2024/05/06 06:07:58 INFO : file1.txt: Copied (new) 2024/05/06 06:07:58 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Updated directory metadata 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_normalization/modfiles" 2024/05/06 06:07:58 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_normalization-caradev4" 2024/05/06 06:07:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/datadir/test_normalization-caradev4: Waiting for checks to finish 2024/05/06 06:07:58 DEBUG : Local file system at /tmp/060749ce/datadir/test_normalization-caradev4: Waiting for transfers to finish 2024/05/06 06:07:58 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:58 DEBUG : file1.txt.zocadac7.partial: renamed to: file1.txt 2024/05/06 06:07:58 INFO : file1.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/05/06 06:07:58 DEBUG : 測試_filtersfile.txt.lecewig7.partial: renamed to: 測試_filtersfile.txt 2024/05/06 06:07:58 INFO : 測試_filtersfile.txt: Copied (new) 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1] 2024/05/06 06:07:58 ERROR : : error listing: directory not found 2024/05/06 06:07:58 ERROR : : error listing: directory not found 2024/05/06 06:07:58 checking initFs Local file system at /tmp/060749ce/initdir/test_normalization-kulokok0 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1] 2024/05/06 06:07:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1/RCLONE_TEST] 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1/file1.txt] 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1: Waiting for checks to finish 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt] 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt] 2024/05/06 06:07:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1: Waiting for transfers to finish 2024/05/06 06:07:59 INFO : file1.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file] 2024/05/06 06:07:59 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:59 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:59 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:59 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/05/06 06:07:59 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1] 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/05/06 06:07:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory with metadata 2024/05/06 06:07:59 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/05/06 06:07:59 DEBUG : Added delayed dir = "測試_РуÑÑкий_ _ _Ä›_áñ", newDst=測試_РуÑÑкий_ _ _Ä›_áñ 2024/05/06 06:07:59 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:59 DEBUG : file1.txt.tadodul6.partial: renamed to: file1.txt 2024/05/06 06:07:59 INFO : file1.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : Local file system at /tmp/060749ce/normalization/path2: Waiting for checks to finish 2024/05/06 06:07:59 DEBUG : Local file system at /tmp/060749ce/normalization/path2: Waiting for transfers to finish 2024/05/06 06:07:59 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:59 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file.xenifow3.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file 2024/05/06 06:07:59 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/05/06 06:07:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:59 DEBUG : RCLONE_TEST.tifuqiy1.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:59 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:59 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:59 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:07:59 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt.novobih7.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt 2024/05/06 06:07:59 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt.lanotud0.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt 2024/05/06 06:07:59 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:07:59 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:07:59 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Updated directory metadata 2024/05/06 06:07:59 checking path2 Local file system at /tmp/060749ce/normalization/path2 2024/05/06 06:07:59 (01) : test normalization 2024/05/06 06:07:59 (02) : touch-copy 2001-01-02 /tmp/060749ce/datadir/test_normalization-caradev4/file1.txt /tmp/060749ce/normalization/path2/ 2024/05/06 06:07:59 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:59 (03) : test initial bisync 2024/05/06 06:07:59 (04) : bisync resync 2024/05/06 06:07:59 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:07:59 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/05/06 06:07:59 NOTICE: Local file system at /tmp/060749ce/normalization/path2: Replacing invalid UTF-8 characters in "eÌŒ\x81\xfe aÌñhࢺ_測試РуÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬eÌö" 2024/05/06 06:07:59 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:07:59 NOTICE: Local file system at /tmp/060749ce/normalization/path2: Replacing invalid UTF-8 characters in "Ä›\x81\xfe áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö" 2024/05/06 06:07:59 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) bisync_test.go:1014: Fs is incapable of running test as the paths produce different results, skipping: normalization (path1: 測試_РуÑÑкий_ _ _Ä›_áñěþ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶ (NFC) path2: 測試_РуÑÑкий_ _ _Ä›_áñ測試_РуÑÑкий_ _ _Ä›_áñ (測試_РуÑÑкий_ _ _Ä›_áñ測試_РуÑÑкий_ _ _Ä›_áñ)) (fs1: hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/normalization/path1 fs2: Local file system at /tmp/060749ce/normalization/path2) @@ -1 +1 @@ -測試_РуÑÑкий_ _ _Ä›_áñěþ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶+測試_РуÑÑкий_ _ _Ä›_áñ測試_РуÑÑкий_ _ _Ä›_áñ === RUN TestBisyncRemoteLocal/rclone_args 2024/05/06 06:07:59 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:07:59 DEBUG : path1: Making directory 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:07:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1" 2024/05/06 06:07:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:07:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:07:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:07:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:07:59 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1" 2024/05/06 06:07:59 DEBUG : Creating backend with remote "/tmp/060749ce/rclone_args/path2" 2024/05/06 06:07:59 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rclone_args/initial" 2024/05/06 06:07:59 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_rclone_args-heyalij5" 2024/05/06 06:07:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:59 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:59 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:59 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:59 DEBUG : file2.txt.delidiy8.partial: renamed to: file2.txt 2024/05/06 06:07:59 INFO : file2.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : Local file system at /tmp/060749ce/initdir/test_rclone_args-heyalij5: Waiting for checks to finish 2024/05/06 06:07:59 DEBUG : Local file system at /tmp/060749ce/initdir/test_rclone_args-heyalij5: Waiting for transfers to finish 2024/05/06 06:07:59 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:59 DEBUG : subdir/file21.txt.sevenen5.partial: renamed to: subdir/file21.txt 2024/05/06 06:07:59 INFO : subdir/file21.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:59 DEBUG : RCLONE_TEST.kupihac3.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:59 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:59 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:59 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2024/05/06 06:07:59 DEBUG : file1.txt.tidomat9.partial: renamed to: file1.txt 2024/05/06 06:07:59 INFO : file1.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : subdir/file20.txt.cidenet5.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:59 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:59 INFO : subdir: Updated directory metadata 2024/05/06 06:07:59 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rclone_args/modfiles" 2024/05/06 06:07:59 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_rclone_args-yafobif1" 2024/05/06 06:07:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file21.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : Local file system at /tmp/060749ce/datadir/test_rclone_args-yafobif1: Waiting for checks to finish 2024/05/06 06:07:59 DEBUG : Local file system at /tmp/060749ce/datadir/test_rclone_args-yafobif1: Waiting for transfers to finish 2024/05/06 06:07:59 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:59 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:07:59 DEBUG : file1.txt.jizajos5.partial: renamed to: file1.txt 2024/05/06 06:07:59 INFO : file1.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : file2.txt.zuqovap9.partial: renamed to: file2.txt 2024/05/06 06:07:59 INFO : file2.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:59 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:59 DEBUG : file21.txt.muwixih3.partial: renamed to: file21.txt 2024/05/06 06:07:59 INFO : file21.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : file20.txt.jixuqoh2.partial: renamed to: file20.txt 2024/05/06 06:07:59 INFO : file20.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1] 2024/05/06 06:07:59 ERROR : : error listing: directory not found 2024/05/06 06:07:59 ERROR : : error listing: directory not found 2024/05/06 06:07:59 checking initFs Local file system at /tmp/060749ce/initdir/test_rclone_args-heyalij5 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1] 2024/05/06 06:07:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : subdir: Making directory 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir] 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/RCLONE_TEST] 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/file1.txt] 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/file2.txt] 2024/05/06 06:07:59 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1: Waiting for checks to finish 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir/file20.txt] 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1: Waiting for transfers to finish 2024/05/06 06:07:59 INFO : file2.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir/file21.txt] 2024/05/06 06:07:59 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:59 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:59 INFO : file1.txt: Copied (new) 2024/05/06 06:07:59 INFO : subdir/file21.txt: Copied (new) 2024/05/06 06:07:59 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1] 2024/05/06 06:07:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir] 2024/05/06 06:07:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : subdir: Making directory with metadata 2024/05/06 06:07:59 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:07:59 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:07:59 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/05/06 06:07:59 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2024/05/06 06:07:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:07:59 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:59 DEBUG : RCLONE_TEST.gesawun3.partial: renamed to: RCLONE_TEST 2024/05/06 06:07:59 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:07:59 DEBUG : file1.txt.giqazen2.partial: renamed to: file1.txt 2024/05/06 06:07:59 INFO : file1.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : Local file system at /tmp/060749ce/rclone_args/path2: Waiting for checks to finish 2024/05/06 06:07:59 DEBUG : Local file system at /tmp/060749ce/rclone_args/path2: Waiting for transfers to finish 2024/05/06 06:07:59 DEBUG : file2.txt.cujuxef6.partial: renamed to: file2.txt 2024/05/06 06:07:59 INFO : file2.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:59 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:07:59 DEBUG : subdir/file21.txt.vegemif4.partial: renamed to: subdir/file21.txt 2024/05/06 06:07:59 INFO : subdir/file21.txt: Copied (new) 2024/05/06 06:07:59 DEBUG : subdir/file20.txt.mopapaf1.partial: renamed to: subdir/file20.txt 2024/05/06 06:07:59 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:07:59 INFO : subdir: Updated directory metadata 2024/05/06 06:07:59 checking path2 Local file system at /tmp/060749ce/rclone_args/path2 2024/05/06 06:07:59 (01) : test rclone-args 2024/05/06 06:07:59 (02) : touch-glob 2001-01-02 /tmp/060749ce/datadir/test_rclone_args-yafobif1/ * 2024/05/06 06:07:59 (03) : test initial bisync 2024/05/06 06:07:59 (04) : bisync resync checksum 2024/05/06 06:07:59 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:59 NOTICE: Local file system at /tmp/060749ce/rclone_args/path2: will use md5 for same-side diffs on Path2 only 2024/05/06 06:07:59 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:07:59 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" with Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Copying Path2 files to Path1 2024/05/06 06:07:59 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:59 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:07:59 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:59 INFO : Resync updating listings 2024/05/06 06:07:59 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" vs Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Bisync successful 2024/05/06 06:07:59 (05) : test place newer files on both paths 2024/05/06 06:07:59 (06) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/ 2024/05/06 06:07:59 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:59 (07) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file2.txt /tmp/060749ce/rclone_args/path2/ 2024/05/06 06:07:59 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:59 (08) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir 2024/05/06 06:07:59 INFO : file20.txt: Copied (replaced existing) 2024/05/06 06:07:59 (09) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file21.txt /tmp/060749ce/rclone_args/path2/subdir 2024/05/06 06:07:59 INFO : file21.txt: Updated modification time in destination 2024/05/06 06:07:59 (10) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/ file1.txt 2024/05/06 06:07:59 (11) : touch-glob 2001-01-02 /tmp/060749ce/rclone_args/path2/ file2.txt 2024/05/06 06:07:59 (12) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir/ file20.txt 2024/05/06 06:07:59 (13) : touch-glob 2001-01-02 /tmp/060749ce/rclone_args/path2/subdir/ file21.txt 2024/05/06 06:07:59 (14) : test run bisync with custom options 2024/05/06 06:07:59 (15) : bisync checksum 2024/05/06 06:07:59 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:59 NOTICE: Local file system at /tmp/060749ce/rclone_args/path2: will use md5 for same-side diffs on Path2 only 2024/05/06 06:07:59 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:07:59 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" with Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:59 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:07:59 INFO : Path1 checking for diffs 2024/05/06 06:07:59 INFO : - Path1 File changed: hash - file1.txt 2024/05/06 06:07:59 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:07:59 INFO : (Modified:  1 hash differs) 2024/05/06 06:07:59 INFO : Path2 checking for diffs 2024/05/06 06:07:59 INFO : - Path2 File changed: size (larger), hash - file2.txt 2024/05/06 06:07:59 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:07:59 INFO : (Modified:  1 larger,  0 smaller,  1 hash differs) 2024/05/06 06:07:59 INFO : Applying changes 2024/05/06 06:07:59 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/rclone_args/path2/file1.txt 2024/05/06 06:07:59 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/file2.txt 2024/05/06 06:07:59 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:59 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:59 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:07:59 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:59 INFO : Updating listings 2024/05/06 06:07:59 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" vs Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Bisync successful 2024/05/06 06:07:59 (16) : touch-glob 2007-07-23 /tmp/060749ce/datadir/test_rclone_args-yafobif1/ * 2024/05/06 06:07:59 (17) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/ 2024/05/06 06:07:59 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:59 (18) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file2.txt /tmp/060749ce/rclone_args/path2/ 2024/05/06 06:07:59 INFO : file2.txt: Updated modification time in destination 2024/05/06 06:07:59 (19) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir 2024/05/06 06:07:59 INFO : file20.txt: Copied (replaced existing) 2024/05/06 06:07:59 (20) : copy-as /tmp/060749ce/datadir/test_rclone_args-yafobif1/file21.txt /tmp/060749ce/rclone_args/path2/ file1.txt 2024/05/06 06:07:59 INFO : file21.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:07:59 (21) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/ file1.txt 2024/05/06 06:07:59 (22) : touch-glob 2007-07-23 /tmp/060749ce/rclone_args/path2/ file2.txt 2024/05/06 06:07:59 (23) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir/ file20.txt 2024/05/06 06:07:59 (24) : touch-glob 2007-07-23 /tmp/060749ce/rclone_args/path2/subdir/ file21.txt 2024/05/06 06:07:59 (25) : bisync size-only 2024/05/06 06:07:59 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:59 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:59 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:59 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" with Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:59 INFO : Path1 checking for diffs 2024/05/06 06:07:59 INFO : Path2 checking for diffs 2024/05/06 06:07:59 INFO : - Path2 File changed: size (smaller) - file1.txt 2024/05/06 06:07:59 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:07:59 INFO : (Modified:  0 larger,  1 smaller) 2024/05/06 06:07:59 INFO : Applying changes 2024/05/06 06:07:59 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/file1.txt 2024/05/06 06:07:59 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:59 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:59 INFO : Updating listings 2024/05/06 06:07:59 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" vs Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Bisync successful 2024/05/06 06:07:59 (26) : bisync resync 2024/05/06 06:07:59 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:59 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:59 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:59 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" with Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Copying Path2 files to Path1 2024/05/06 06:07:59 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:59 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:59 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:07:59 INFO : subdir/file21.txt: Copied (replaced existing) 2024/05/06 06:07:59 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:59 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:59 INFO : Resync updating listings 2024/05/06 06:07:59 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" vs Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Bisync successful 2024/05/06 06:07:59 (27) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/ 2024/05/06 06:07:59 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:59 (28) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file2.txt /tmp/060749ce/rclone_args/path2/ 2024/05/06 06:07:59 INFO : file2.txt: Updated modification time in destination 2024/05/06 06:07:59 (29) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir 2024/05/06 06:07:59 (30) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file21.txt /tmp/060749ce/rclone_args/path2/subdir 2024/05/06 06:07:59 INFO : file21.txt: Updated modification time in destination 2024/05/06 06:07:59 (31) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/ file1.txt 2024/05/06 06:07:59 (32) : touch-glob 2007-07-23 /tmp/060749ce/rclone_args/path2/ file2.txt 2024/05/06 06:07:59 (33) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir/ file20.txt 2024/05/06 06:07:59 (34) : touch-glob 2007-07-23 /tmp/060749ce/rclone_args/path2/subdir/ file21.txt 2024/05/06 06:07:59 (35) : bisync ignore-size 2024/05/06 06:07:59 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:59 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:07:59 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": false, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:07:59 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" with Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:59 INFO : Path1 checking for diffs 2024/05/06 06:07:59 INFO : Path2 checking for diffs 2024/05/06 06:07:59 INFO : - Path2 File changed: time (newer) - file2.txt 2024/05/06 06:07:59 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2024/05/06 06:07:59 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:07:59 INFO : (Modified:  2 newer,  0 older) 2024/05/06 06:07:59 INFO : Applying changes 2024/05/06 06:07:59 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/file2.txt 2024/05/06 06:07:59 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir/file21.txt 2024/05/06 06:07:59 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:59 INFO : subdir/file21.txt: Copied (replaced existing) 2024/05/06 06:07:59 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:59 INFO : Updating listings 2024/05/06 06:07:59 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" vs Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Bisync successful 2024/05/06 06:07:59 (36) : bisync resync compare-all 2024/05/06 06:07:59 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:59 NOTICE: Local file system at /tmp/060749ce/rclone_args/path2: will use md5 for same-side diffs on Path2 only 2024/05/06 06:07:59 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:07:59 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" with Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Copying Path2 files to Path1 2024/05/06 06:07:59 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:07:59 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:07:59 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:07:59 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:59 INFO : Resync updating listings 2024/05/06 06:07:59 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" vs Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Bisync successful 2024/05/06 06:07:59 (37) : copy-as /tmp/060749ce/datadir/test_rclone_args-yafobif1/file21.txt /tmp/060749ce/rclone_args/path2/ file2.txt 2024/05/06 06:07:59 INFO : file21.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:07:59 (38) : touch-glob 2023-08-26 /tmp/060749ce/datadir/test_rclone_args-yafobif1/ * 2024/05/06 06:07:59 (39) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/ 2024/05/06 06:07:59 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:07:59 (40) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir 2024/05/06 06:07:59 INFO : file20.txt: Copied (replaced existing) 2024/05/06 06:07:59 (41) : copy-file /tmp/060749ce/datadir/test_rclone_args-yafobif1/file21.txt /tmp/060749ce/rclone_args/path2/subdir 2024/05/06 06:07:59 INFO : file21.txt: Updated modification time in destination 2024/05/06 06:07:59 (42) : touch-glob 2007-07-23 /tmp/060749ce/rclone_args/path2/ file2.txt 2024/05/06 06:07:59 (43) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/ file1.txt 2024/05/06 06:07:59 (44) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir/ file20.txt 2024/05/06 06:07:59 (45) : touch-glob 2023-08-26 /tmp/060749ce/rclone_args/path2/subdir/ file21.txt 2024/05/06 06:07:59 (46) : bisync compare-all 2024/05/06 06:07:59 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:07:59 NOTICE: Local file system at /tmp/060749ce/rclone_args/path2: will use md5 for same-side diffs on Path2 only 2024/05/06 06:07:59 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 1, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:07:59 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" with Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:07:59 INFO : Building Path1 and Path2 listings 2024/05/06 06:07:59 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:07:59 INFO : Path1 checking for diffs 2024/05/06 06:07:59 INFO : - Path1 File changed: time (newer) - file1.txt 2024/05/06 06:07:59 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2024/05/06 06:07:59 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:07:59 INFO : (Modified:  2 newer,  0 older) 2024/05/06 06:07:59 INFO : Path2 checking for diffs 2024/05/06 06:07:59 INFO : - Path2 File changed: size (smaller), hash - file2.txt 2024/05/06 06:07:59 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2024/05/06 06:07:59 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:07:59 INFO : (Modified:  1 newer,  0 older,  0 larger,  1 smaller,  1 hash differs) 2024/05/06 06:07:59 INFO : Applying changes 2024/05/06 06:07:59 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/rclone_args/path2/file1.txt 2024/05/06 06:07:59 INFO : - Path1 Queue copy to Path2 - /tmp/060749ce/rclone_args/path2/subdir/file20.txt 2024/05/06 06:07:59 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/file2.txt 2024/05/06 06:07:59 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/subdir/file21.txt 2024/05/06 06:07:59 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:07:59 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:07:59 INFO : subdir/file21.txt: Copied (replaced existing) 2024/05/06 06:07:59 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:00 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:00 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:00 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:00 INFO : Updating listings 2024/05/06 06:08:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rclone_args/path1/" vs Path2 "/tmp/060749ce/rclone_args/path2/" 2024/05/06 06:08:00 INFO : Bisync successful bisync_test.go:555: TEST rclone_args PASSED === RUN TestBisyncRemoteLocal/resolve 2024/05/06 06:08:00 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:08:00 DEBUG : path1: Making directory 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:08:00 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1" 2024/05/06 06:08:00 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:00 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:00 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1" 2024/05/06 06:08:00 DEBUG : Creating backend with remote "/tmp/060749ce/resolve/path2" 2024/05/06 06:08:00 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resolve/initial" 2024/05/06 06:08:00 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_resolve-nequsuy1" 2024/05/06 06:08:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : file1.txt.puvuwex6.partial: renamed to: file1.txt 2024/05/06 06:08:00 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 INFO : file1.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : Local file system at /tmp/060749ce/initdir/test_resolve-nequsuy1: Waiting for checks to finish 2024/05/06 06:08:00 DEBUG : Local file system at /tmp/060749ce/initdir/test_resolve-nequsuy1: Waiting for transfers to finish 2024/05/06 06:08:00 DEBUG : file2.txt.nojeziy9.partial: renamed to: file2.txt 2024/05/06 06:08:00 INFO : file2.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:00 DEBUG : RCLONE_TEST.midahin0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:00 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:00 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resolve/modfiles" 2024/05/06 06:08:00 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_resolve-vakonib0" 2024/05/06 06:08:00 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : Local file system at /tmp/060749ce/datadir/test_resolve-vakonib0: Waiting for checks to finish 2024/05/06 06:08:00 DEBUG : Local file system at /tmp/060749ce/datadir/test_resolve-vakonib0: Waiting for transfers to finish 2024/05/06 06:08:00 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/05/06 06:08:00 DEBUG : file1L.txt.xacurom7.partial: renamed to: file1L.txt 2024/05/06 06:08:00 INFO : file1L.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK 2024/05/06 06:08:00 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/05/06 06:08:00 DEBUG : file1R.txt.fixupuz0.partial: renamed to: file1R.txt 2024/05/06 06:08:00 INFO : file1R.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : file2.txt.vuruneg0.partial: renamed to: file2.txt 2024/05/06 06:08:00 INFO : file2.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1] 2024/05/06 06:08:00 ERROR : : error listing: directory not found 2024/05/06 06:08:00 ERROR : : error listing: directory not found 2024/05/06 06:08:00 checking initFs Local file system at /tmp/060749ce/initdir/test_resolve-nequsuy1 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1] 2024/05/06 06:08:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/RCLONE_TEST] 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/file1.txt] 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1: Waiting for checks to finish 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1: Waiting for transfers to finish 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/file2.txt] 2024/05/06 06:08:00 INFO : file1.txt: Copied (new) 2024/05/06 06:08:00 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:00 INFO : file2.txt: Copied (new) 2024/05/06 06:08:00 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1] 2024/05/06 06:08:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : Local file system at /tmp/060749ce/resolve/path2: Waiting for checks to finish 2024/05/06 06:08:00 DEBUG : Local file system at /tmp/060749ce/resolve/path2: Waiting for transfers to finish 2024/05/06 06:08:00 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:00 DEBUG : RCLONE_TEST.xegegey0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:00 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:00 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : file2.txt.gefilir1.partial: renamed to: file2.txt 2024/05/06 06:08:00 INFO : file2.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : file1.txt.vanibis4.partial: renamed to: file1.txt 2024/05/06 06:08:00 INFO : file1.txt: Copied (new) 2024/05/06 06:08:00 checking path2 Local file system at /tmp/060749ce/resolve/path2 2024/05/06 06:08:00 (01) : test resolve 2024/05/06 06:08:00 (02) : test initial bisync 2024/05/06 06:08:00 (03) : bisync resync 2024/05/06 06:08:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" with Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Copying Path2 files to Path1 2024/05/06 06:08:00 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:00 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:00 INFO : Resync updating listings 2024/05/06 06:08:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" vs Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Bisync successful 2024/05/06 06:08:00 (04) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:00 (05) : touch-glob 2001-01-02 /tmp/060749ce/datadir/test_resolve-vakonib0/ file1R.txt 2024/05/06 06:08:00 (06) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1R.txt /tmp/060749ce/resolve/path2/ file1.txt 2024/05/06 06:08:00 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:00 (07) : touch-glob 2001-03-04 /tmp/060749ce/datadir/test_resolve-vakonib0/ file1L.txt 2024/05/06 06:08:00 (08) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/ file1.txt 2024/05/06 06:08:00 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:00 (09) : test bisync run with --conflict-resolve=newer --conflict-loser=delete --conflict-suffix=potato 2024/05/06 06:08:00 (10) : bisync conflict-resolve=newer conflict-loser=delete conflict-suffix=potato 2024/05/06 06:08:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" with Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:00 INFO : Path1 checking for diffs 2024/05/06 06:08:00 INFO : - Path1 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:00 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:00 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:00 INFO : Path2 checking for diffs 2024/05/06 06:08:00 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:00 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:00 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:00 INFO : Applying changes 2024/05/06 06:08:00 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:00 INFO : Checking potential conflicts... 2024/05/06 06:08:00 NOTICE: Local file system at /tmp/060749ce/resolve/path2: 1 differences found 2024/05/06 06:08:00 NOTICE: Local file system at /tmp/060749ce/resolve/path2: 1 errors while checking 2024/05/06 06:08:00 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:00 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:00 INFO : file1.txt: Path1 is newer. Path1: 2001-03-04 00:00:00 +0000 UTC, Path2: 2001-01-02 00:00:00 +0000 UTC, Difference: 1464h0m0s 2024/05/06 06:08:00 INFO : file1.txt: The winner is: Path1 2024/05/06 06:08:00 NOTICE: - Path2 Deleting Path2 copy - /tmp/060749ce/resolve/path2/file1.txt 2024/05/06 06:08:00 INFO : file1.txt: Deleted 2024/05/06 06:08:00 INFO : - Path1 Queue copy to Path2 - file1.txt 2024/05/06 06:08:00 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:00 INFO : file1.txt: Copied (new) 2024/05/06 06:08:00 INFO : Updating listings 2024/05/06 06:08:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" vs Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Bisync successful 2024/05/06 06:08:00 (11) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:00 (12) : touch-glob 2001-07-23 /tmp/060749ce/datadir/test_resolve-vakonib0/ file1R.txt 2024/05/06 06:08:00 (13) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1R.txt /tmp/060749ce/resolve/path2/ file1.txt 2024/05/06 06:08:00 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:00 (14) : touch-glob 2001-08-26 /tmp/060749ce/datadir/test_resolve-vakonib0/ file1L.txt 2024/05/06 06:08:00 (15) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/ file1.txt 2024/05/06 06:08:00 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:00 (16) : test bisync run with --conflict-resolve=path2 --conflict-loser=num --conflict-suffix=dinosaur 2024/05/06 06:08:00 (17) : bisync conflict-resolve=path2 conflict-loser=num conflict-suffix=dinosaur 2024/05/06 06:08:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" with Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:00 INFO : Path1 checking for diffs 2024/05/06 06:08:00 INFO : - Path1 File changed: time (newer) - file1.txt 2024/05/06 06:08:00 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:00 INFO : (Modified:  1 newer,  0 older) 2024/05/06 06:08:00 INFO : Path2 checking for diffs 2024/05/06 06:08:00 INFO : - Path2 File changed: time (newer) - file1.txt 2024/05/06 06:08:00 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:00 INFO : (Modified:  1 newer,  0 older) 2024/05/06 06:08:00 INFO : Applying changes 2024/05/06 06:08:00 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:00 INFO : Checking potential conflicts... 2024/05/06 06:08:00 NOTICE: Local file system at /tmp/060749ce/resolve/path2: 1 differences found 2024/05/06 06:08:00 NOTICE: Local file system at /tmp/060749ce/resolve/path2: 1 errors while checking 2024/05/06 06:08:00 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:00 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:00 INFO : file1.txt: The winner is: Path2 2024/05/06 06:08:00 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/file1.txt.dinosaur1 2024/05/06 06:08:00 INFO : file1.txt: Moved (server-side) to: file1.txt.dinosaur1 2024/05/06 06:08:00 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/resolve/path2/file1.txt.dinosaur1 2024/05/06 06:08:00 NOTICE: - Path2 Not renaming Path2 copy, as it was determined the winner - /tmp/060749ce/resolve/path2/file1.txt 2024/05/06 06:08:00 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/file1.txt 2024/05/06 06:08:00 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:00 INFO : file1.txt: Copied (new) 2024/05/06 06:08:00 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:00 INFO : file1.txt.dinosaur1: Copied (new) 2024/05/06 06:08:00 INFO : Updating listings 2024/05/06 06:08:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" vs Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Bisync successful 2024/05/06 06:08:00 (18) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:00 (19) : touch-glob 2002-07-23 /tmp/060749ce/datadir/test_resolve-vakonib0/ file1R.txt 2024/05/06 06:08:00 (20) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1R.txt /tmp/060749ce/resolve/path2/ file1.txt 2024/05/06 06:08:00 INFO : file1R.txt: Updated modification time in destination 2024/05/06 06:08:00 (21) : touch-glob 2002-08-26 /tmp/060749ce/datadir/test_resolve-vakonib0/ file1L.txt 2024/05/06 06:08:00 (22) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/ file1.txt 2024/05/06 06:08:00 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:00 (23) : test bisync run with --conflict-resolve=larger --conflict-loser=num --conflict-suffix=apple 2024/05/06 06:08:00 (24) : bisync conflict-resolve=larger conflict-loser=num conflict-suffix=apple 2024/05/06 06:08:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" with Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:00 INFO : Path1 checking for diffs 2024/05/06 06:08:00 INFO : - Path1 File is new - file1.txt 2024/05/06 06:08:00 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:00 INFO : Path2 checking for diffs 2024/05/06 06:08:00 INFO : - Path2 File is new - file1.txt 2024/05/06 06:08:00 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:00 INFO : Applying changes 2024/05/06 06:08:00 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:00 INFO : Checking potential conflicts... 2024/05/06 06:08:00 NOTICE: Local file system at /tmp/060749ce/resolve/path2: 1 differences found 2024/05/06 06:08:00 NOTICE: Local file system at /tmp/060749ce/resolve/path2: 1 errors while checking 2024/05/06 06:08:00 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:00 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:00 INFO : file1.txt: Winner cannot be determined as sizes are equal. Path1: 33, Path2: 33, Difference: 0 2024/05/06 06:08:00 INFO : file1.txt: A winner could not be determined. 2024/05/06 06:08:00 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/file1.txt.apple1 2024/05/06 06:08:00 INFO : file1.txt: Moved (server-side) to: file1.txt.apple1 2024/05/06 06:08:00 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/resolve/path2/file1.txt.apple1 2024/05/06 06:08:00 NOTICE: - Path2 Renaming Path2 copy - /tmp/060749ce/resolve/path2/file1.txt.apple2 2024/05/06 06:08:00 INFO : file1.txt: Moved (server-side) to: file1.txt.apple2 2024/05/06 06:08:00 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/file1.txt.apple2 2024/05/06 06:08:00 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:00 INFO : file1.txt.apple2: Copied (new) 2024/05/06 06:08:00 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:00 INFO : file1.txt.apple1: Copied (new) 2024/05/06 06:08:00 INFO : Updating listings 2024/05/06 06:08:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" vs Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Bisync successful 2024/05/06 06:08:00 (25) : test different suffixes 2024/05/06 06:08:00 (26) : touch-glob 2003-07-23 /tmp/060749ce/datadir/test_resolve-vakonib0/ file1R.txt 2024/05/06 06:08:00 (27) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1R.txt /tmp/060749ce/resolve/path2/ file1.txt 2024/05/06 06:08:00 INFO : file1R.txt: Copied (new) to: file1.txt 2024/05/06 06:08:00 (28) : touch-glob 2003-07-23 /tmp/060749ce/datadir/test_resolve-vakonib0/ file1L.txt 2024/05/06 06:08:00 (29) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/ file1.txt 2024/05/06 06:08:00 INFO : file1L.txt: Copied (new) to: file1.txt 2024/05/06 06:08:00 (30) : test bisync run with --conflict-resolve=older --conflict-loser=num --conflict-suffix=cloud,local 2024/05/06 06:08:00 (31) : bisync conflict-resolve=older conflict-loser=num conflict-suffix=cloud,local 2024/05/06 06:08:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" with Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:00 INFO : Path1 checking for diffs 2024/05/06 06:08:00 INFO : - Path1 File is new - file1.txt 2024/05/06 06:08:00 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:00 INFO : Path2 checking for diffs 2024/05/06 06:08:00 INFO : - Path2 File is new - file1.txt 2024/05/06 06:08:00 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:00 INFO : Applying changes 2024/05/06 06:08:00 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:00 INFO : Checking potential conflicts... 2024/05/06 06:08:00 NOTICE: Local file system at /tmp/060749ce/resolve/path2: 1 differences found 2024/05/06 06:08:00 NOTICE: Local file system at /tmp/060749ce/resolve/path2: 1 errors while checking 2024/05/06 06:08:00 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:00 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:00 INFO : file1.txt: Winner cannot be determined as times are equal. Path1: 2003-07-23 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 0s 2024/05/06 06:08:00 INFO : file1.txt: A winner could not be determined. 2024/05/06 06:08:00 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/file1.txt.cloud1 2024/05/06 06:08:00 INFO : file1.txt: Moved (server-side) to: file1.txt.cloud1 2024/05/06 06:08:00 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/resolve/path2/file1.txt.cloud1 2024/05/06 06:08:00 NOTICE: - Path2 Renaming Path2 copy - /tmp/060749ce/resolve/path2/file1.txt.local1 2024/05/06 06:08:00 INFO : file1.txt: Moved (server-side) to: file1.txt.local1 2024/05/06 06:08:00 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/file1.txt.local1 2024/05/06 06:08:00 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:00 INFO : file1.txt.local1: Copied (new) 2024/05/06 06:08:00 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:00 INFO : file1.txt.cloud1: Copied (new) 2024/05/06 06:08:00 INFO : Updating listings 2024/05/06 06:08:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" vs Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Bisync successful 2024/05/06 06:08:00 (32) : test legacy 2024/05/06 06:08:00 (33) : touch-glob 2004-07-23 /tmp/060749ce/datadir/test_resolve-vakonib0/ file1R.txt 2024/05/06 06:08:00 (34) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1R.txt /tmp/060749ce/resolve/path2/ file1.txt 2024/05/06 06:08:00 INFO : file1R.txt: Copied (new) to: file1.txt 2024/05/06 06:08:00 (35) : touch-glob 2004-07-23 /tmp/060749ce/datadir/test_resolve-vakonib0/ file1L.txt 2024/05/06 06:08:00 (36) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/ file1.txt 2024/05/06 06:08:00 INFO : file1L.txt: Copied (new) to: file1.txt 2024/05/06 06:08:00 (37) : test bisync run with --conflict-resolve=none --conflict-loser=pathname --conflict-suffix=.path 2024/05/06 06:08:00 (38) : bisync conflict-resolve=none conflict-loser=pathname conflict-suffix=.path 2024/05/06 06:08:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" with Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:00 INFO : Path1 checking for diffs 2024/05/06 06:08:00 INFO : - Path1 File is new - file1.txt 2024/05/06 06:08:00 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:00 INFO : Path2 checking for diffs 2024/05/06 06:08:00 INFO : - Path2 File is new - file1.txt 2024/05/06 06:08:00 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:00 INFO : Applying changes 2024/05/06 06:08:00 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:00 INFO : Checking potential conflicts... 2024/05/06 06:08:00 NOTICE: Local file system at /tmp/060749ce/resolve/path2: 1 differences found 2024/05/06 06:08:00 NOTICE: Local file system at /tmp/060749ce/resolve/path2: 1 errors while checking 2024/05/06 06:08:00 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:00 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:00 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/file1.txt..path1 2024/05/06 06:08:00 INFO : file1.txt: Moved (server-side) to: file1.txt..path1 2024/05/06 06:08:00 NOTICE: - Path1 Queue copy to Path2 - /tmp/060749ce/resolve/path2/file1.txt..path1 2024/05/06 06:08:00 NOTICE: - Path2 Renaming Path2 copy - /tmp/060749ce/resolve/path2/file1.txt..path2 2024/05/06 06:08:00 INFO : file1.txt: Moved (server-side) to: file1.txt..path2 2024/05/06 06:08:00 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/file1.txt..path2 2024/05/06 06:08:00 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:00 INFO : file1.txt..path2: Copied (new) 2024/05/06 06:08:00 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:00 INFO : file1.txt..path1: Copied (new) 2024/05/06 06:08:00 INFO : Updating listings 2024/05/06 06:08:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" vs Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Bisync successful 2024/05/06 06:08:00 (39) : test deletes on both sides with default suffix 2024/05/06 06:08:00 (40) : touch-glob 2005-01-02 /tmp/060749ce/datadir/test_resolve-vakonib0/ file1R.txt 2024/05/06 06:08:00 (41) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1R.txt /tmp/060749ce/resolve/path2/ file1.txt 2024/05/06 06:08:00 INFO : file1R.txt: Copied (new) to: file1.txt 2024/05/06 06:08:00 (42) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/ file2.txt 2024/05/06 06:08:00 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:00 (43) : touch-glob 2006-03-04 /tmp/060749ce/datadir/test_resolve-vakonib0/ file1L.txt 2024/05/06 06:08:00 (44) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/ file1.txt 2024/05/06 06:08:00 INFO : file1L.txt: Copied (new) to: file1.txt 2024/05/06 06:08:00 (45) : copy-as /tmp/060749ce/datadir/test_resolve-vakonib0/file1L.txt /tmp/060749ce/resolve/path2/ file2.txt 2024/05/06 06:08:00 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:00 (46) : test bisync run with --conflict-resolve=newer --conflict-loser=delete 2024/05/06 06:08:00 (47) : bisync conflict-resolve=newer conflict-loser=delete 2024/05/06 06:08:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" with Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:00 INFO : Path1 checking for diffs 2024/05/06 06:08:00 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:00 INFO : - Path1 File is new - file1.txt 2024/05/06 06:08:00 INFO : Path1: 2 changes:  1 new,  1 modified,  0 deleted 2024/05/06 06:08:00 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:00 INFO : Path2 checking for diffs 2024/05/06 06:08:00 INFO : - Path2 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:00 INFO : - Path2 File is new - file1.txt 2024/05/06 06:08:00 INFO : Path2: 2 changes:  1 new,  1 modified,  0 deleted 2024/05/06 06:08:00 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:00 INFO : Applying changes 2024/05/06 06:08:00 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:00 INFO : Checking potential conflicts... 2024/05/06 06:08:00 NOTICE: Local file system at /tmp/060749ce/resolve/path2: 2 differences found 2024/05/06 06:08:00 NOTICE: Local file system at /tmp/060749ce/resolve/path2: 2 errors while checking 2024/05/06 06:08:00 INFO : Finished checking the potential conflicts. 2 differences found 2024/05/06 06:08:00 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:00 INFO : file1.txt: Path1 is newer. Path1: 2006-03-04 00:00:00 +0000 UTC, Path2: 2005-01-02 00:00:00 +0000 UTC, Difference: 10224h0m0s 2024/05/06 06:08:00 INFO : file1.txt: The winner is: Path1 2024/05/06 06:08:00 NOTICE: - Path2 Deleting Path2 copy - /tmp/060749ce/resolve/path2/file1.txt 2024/05/06 06:08:00 INFO : file1.txt: Deleted 2024/05/06 06:08:00 INFO : - Path1 Queue copy to Path2 - file1.txt 2024/05/06 06:08:00 NOTICE: - WARNING New or changed in both paths - file2.txt 2024/05/06 06:08:00 INFO : file2.txt: Path2 is newer. Path1: 2005-01-02 00:00:00 +0000 UTC, Path2: 2006-03-04 00:00:00 +0000 UTC, Difference: 10224h0m0s 2024/05/06 06:08:00 INFO : file2.txt: The winner is: Path2 2024/05/06 06:08:00 NOTICE: - Path1 Deleting Path1 copy - TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/file2.txt 2024/05/06 06:08:00 INFO : file2.txt: Deleted 2024/05/06 06:08:00 INFO : - Path2 Queue copy to Path1 - file2.txt 2024/05/06 06:08:00 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:00 INFO : file2.txt: Copied (new) 2024/05/06 06:08:00 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:00 INFO : file1.txt: Copied (new) 2024/05/06 06:08:00 INFO : Updating listings 2024/05/06 06:08:00 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:00 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resolve/path1/" vs Path2 "/tmp/060749ce/resolve/path2/" 2024/05/06 06:08:00 INFO : Bisync successful bisync_test.go:555: TEST resolve PASSED === RUN TestBisyncRemoteLocal/resync 2024/05/06 06:08:00 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:08:00 DEBUG : path1: Making directory 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:08:00 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1" 2024/05/06 06:08:00 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:00 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:00 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1" 2024/05/06 06:08:00 DEBUG : Creating backend with remote "/tmp/060749ce/resync/path2" 2024/05/06 06:08:00 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resync/initial" 2024/05/06 06:08:00 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_resync-seripek8" 2024/05/06 06:08:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : Local file system at /tmp/060749ce/initdir/test_resync-seripek8: Waiting for checks to finish 2024/05/06 06:08:00 DEBUG : Local file system at /tmp/060749ce/initdir/test_resync-seripek8: Waiting for transfers to finish 2024/05/06 06:08:00 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : file2.txt.vivuxan2.partial: renamed to: file2.txt 2024/05/06 06:08:00 DEBUG : file1.txt.daperod3.partial: renamed to: file1.txt 2024/05/06 06:08:00 INFO : file2.txt: Copied (new) 2024/05/06 06:08:00 INFO : file1.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : file3.txt.nadeleg7.partial: renamed to: file3.txt 2024/05/06 06:08:00 INFO : file3.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : file6.txt.qawofac8.partial: renamed to: file6.txt 2024/05/06 06:08:00 INFO : file6.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:00 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : file5.txt.cuzepul6.partial: renamed to: file5.txt 2024/05/06 06:08:00 INFO : file5.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : file4.txt.pukafez2.partial: renamed to: file4.txt 2024/05/06 06:08:00 INFO : file4.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : RCLONE_TEST.hasicow3.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:00 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:00 DEBUG : file7.txt.finoyin7.partial: renamed to: file7.txt 2024/05/06 06:08:00 INFO : file7.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resync/modfiles" 2024/05/06 06:08:00 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_resync-vuxavov3" 2024/05/06 06:08:00 DEBUG : fileA.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : fileB.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : Local file system at /tmp/060749ce/datadir/test_resync-vuxavov3: Waiting for checks to finish 2024/05/06 06:08:00 DEBUG : Local file system at /tmp/060749ce/datadir/test_resync-vuxavov3: Waiting for transfers to finish 2024/05/06 06:08:00 DEBUG : fileB.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:00 DEBUG : fileB.txt.difuwup0.partial: renamed to: fileB.txt 2024/05/06 06:08:00 INFO : fileB.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : fileA.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:00 DEBUG : fileA.txt.qucadep2.partial: renamed to: fileA.txt 2024/05/06 06:08:00 INFO : fileA.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1] 2024/05/06 06:08:00 ERROR : : error listing: directory not found 2024/05/06 06:08:00 ERROR : : error listing: directory not found 2024/05/06 06:08:00 checking initFs Local file system at /tmp/060749ce/initdir/test_resync-seripek8 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1] 2024/05/06 06:08:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/RCLONE_TEST] 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/file1.txt] 2024/05/06 06:08:00 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/file2.txt] 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: Waiting for checks to finish 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: Waiting for transfers to finish 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/file3.txt] 2024/05/06 06:08:00 INFO : file1.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/file4.txt] 2024/05/06 06:08:00 INFO : file2.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/file5.txt] 2024/05/06 06:08:00 INFO : file3.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/file6.txt] 2024/05/06 06:08:00 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/file7.txt] 2024/05/06 06:08:00 INFO : file4.txt: Copied (new) 2024/05/06 06:08:00 INFO : file5.txt: Copied (new) 2024/05/06 06:08:00 INFO : file6.txt: Copied (new) 2024/05/06 06:08:00 INFO : file7.txt: Copied (new) 2024/05/06 06:08:00 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1 2024/05/06 06:08:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1] 2024/05/06 06:08:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:00 DEBUG : Local file system at /tmp/060749ce/resync/path2: Waiting for checks to finish 2024/05/06 06:08:00 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : Local file system at /tmp/060749ce/resync/path2: Waiting for transfers to finish 2024/05/06 06:08:00 DEBUG : file1.txt.qupojol6.partial: renamed to: file1.txt 2024/05/06 06:08:00 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 INFO : file1.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : file3.txt.gaqamaq9.partial: renamed to: file3.txt 2024/05/06 06:08:00 INFO : file3.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : file2.txt.keguhif9.partial: renamed to: file2.txt 2024/05/06 06:08:00 DEBUG : file5.txt.kojaged6.partial: renamed to: file5.txt 2024/05/06 06:08:00 INFO : file2.txt: Copied (new) 2024/05/06 06:08:00 INFO : file5.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:00 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : RCLONE_TEST.fogifat3.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:00 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:00 DEBUG : file7.txt.dilahux3.partial: renamed to: file7.txt 2024/05/06 06:08:00 INFO : file7.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:00 DEBUG : file4.txt.xesalen0.partial: renamed to: file4.txt 2024/05/06 06:08:00 INFO : file4.txt: Copied (new) 2024/05/06 06:08:00 DEBUG : file6.txt.zedewes2.partial: renamed to: file6.txt 2024/05/06 06:08:00 INFO : file6.txt: Copied (new) 2024/05/06 06:08:00 checking path2 Local file system at /tmp/060749ce/resync/path2 2024/05/06 06:08:00 (01) : test resync 2024/05/06 06:08:00 (02) : test 1. resync with empty path1, resulting in copying all content from path2. 2024/05/06 06:08:00 (03) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/ 2024/05/06 06:08:00 (04) : bisync resync 2024/05/06 06:08:00 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:00 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:00 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/" with Path2 "/tmp/060749ce/resync/path2/" 2024/05/06 06:08:00 INFO : Copying Path2 files to Path1 2024/05/06 06:08:00 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:00 INFO : file1.txt: Copied (new) 2024/05/06 06:08:01 INFO : file2.txt: Copied (new) 2024/05/06 06:08:01 INFO : file3.txt: Copied (new) 2024/05/06 06:08:01 INFO : file4.txt: Copied (new) 2024/05/06 06:08:01 INFO : file5.txt: Copied (new) 2024/05/06 06:08:01 INFO : file6.txt: Copied (new) 2024/05/06 06:08:01 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:01 INFO : file7.txt: Copied (new) 2024/05/06 06:08:01 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:01 INFO : Resync updating listings 2024/05/06 06:08:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/" vs Path2 "/tmp/060749ce/resync/path2/" 2024/05/06 06:08:01 INFO : Bisync successful 2024/05/06 06:08:01 (05) : move-listings empty-path1 2024/05/06 06:08:01 (06) : test 2. resync with empty path2, resulting in synching all content to path2. 2024/05/06 06:08:01 (07) : purge-children /tmp/060749ce/resync/path2/ 2024/05/06 06:08:01 (08) : bisync resync 2024/05/06 06:08:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/" with Path2 "/tmp/060749ce/resync/path2/" 2024/05/06 06:08:01 INFO : Copying Path2 files to Path1 2024/05/06 06:08:01 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:01 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:01 INFO : file1.txt: Copied (new) 2024/05/06 06:08:01 INFO : file2.txt: Copied (new) 2024/05/06 06:08:01 INFO : file3.txt: Copied (new) 2024/05/06 06:08:01 INFO : file4.txt: Copied (new) 2024/05/06 06:08:01 INFO : file5.txt: Copied (new) 2024/05/06 06:08:01 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:01 INFO : file6.txt: Copied (new) 2024/05/06 06:08:01 INFO : file7.txt: Copied (new) 2024/05/06 06:08:01 INFO : Resync updating listings 2024/05/06 06:08:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/" vs Path2 "/tmp/060749ce/resync/path2/" 2024/05/06 06:08:01 INFO : Bisync successful 2024/05/06 06:08:01 (09) : move-listings empty-path2 2024/05/06 06:08:01 (10) : test 3. exercise all of the various file difference scenarios during a resync. 2024/05/06 06:08:01 (11) : touch-glob 2002-02-02 /tmp/060749ce/datadir/test_resync-vuxavov3/ fileA.txt 2024/05/06 06:08:01 (12) : touch-glob 1999-09-09 /tmp/060749ce/datadir/test_resync-vuxavov3/ fileB.txt 2024/05/06 06:08:01 (13) : test = file - path1 - path2 - expected action - who wins 2024/05/06 06:08:01 (14) : test - file1.txt - exists - missing - sync path1 > path2 - path1 2024/05/06 06:08:01 (15) : delete-file /tmp/060749ce/resync/path2/file1.txt 2024/05/06 06:08:01 INFO : file1.txt: Deleted 2024/05/06 06:08:01 (16) : test - file2.txt - missing - exists - copy path2 > path1 - path2 2024/05/06 06:08:01 (17) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/file2.txt 2024/05/06 06:08:01 INFO : file2.txt: Deleted 2024/05/06 06:08:01 (18) : test - file3.txt - exists - newer date - sync path1 > path2 - path1 2024/05/06 06:08:01 (19) : copy-as /tmp/060749ce/datadir/test_resync-vuxavov3/fileA.txt /tmp/060749ce/resync/path2/ file3.txt 2024/05/06 06:08:01 INFO : fileA.txt: Copied (replaced existing) to: file3.txt 2024/05/06 06:08:01 (20) : test - file4.txt - missing - newer date - copy path2 > path1 - path2 2024/05/06 06:08:01 (21) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/file4.txt 2024/05/06 06:08:01 INFO : file4.txt: Deleted 2024/05/06 06:08:01 (22) : copy-as /tmp/060749ce/datadir/test_resync-vuxavov3/fileA.txt /tmp/060749ce/resync/path2/ file4.txt 2024/05/06 06:08:01 INFO : fileA.txt: Copied (replaced existing) to: file4.txt 2024/05/06 06:08:01 (23) : test - file5.txt - exists - older date - sync path1 > path2 - path1 2024/05/06 06:08:01 (24) : copy-as /tmp/060749ce/datadir/test_resync-vuxavov3/fileB.txt /tmp/060749ce/resync/path2/ file5.txt 2024/05/06 06:08:01 INFO : fileB.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:01 (25) : test - file6.txt - older date - newer date - sync path1 > path2 - path1 2024/05/06 06:08:01 (26) : copy-as /tmp/060749ce/datadir/test_resync-vuxavov3/fileB.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/ file6.txt 2024/05/06 06:08:01 INFO : fileB.txt: Copied (replaced existing) to: file6.txt 2024/05/06 06:08:01 (27) : copy-as /tmp/060749ce/datadir/test_resync-vuxavov3/fileA.txt /tmp/060749ce/resync/path2/ file6.txt 2024/05/06 06:08:01 INFO : fileA.txt: Copied (replaced existing) to: file6.txt 2024/05/06 06:08:01 (28) : test - file7.txt - exists - exists (same) - none - same 2024/05/06 06:08:01 (29) : test run bisync with resync 2024/05/06 06:08:01 (30) : bisync resync 2024/05/06 06:08:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/" with Path2 "/tmp/060749ce/resync/path2/" 2024/05/06 06:08:01 INFO : Copying Path2 files to Path1 2024/05/06 06:08:01 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:01 INFO : file2.txt: Copied (new) 2024/05/06 06:08:01 INFO : file4.txt: Copied (new) 2024/05/06 06:08:01 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:01 INFO : file1.txt: Copied (new) 2024/05/06 06:08:01 INFO : file3.txt: Copied (replaced existing) 2024/05/06 06:08:01 INFO : file5.txt: Copied (replaced existing) 2024/05/06 06:08:01 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:08:01 INFO : Resync updating listings 2024/05/06 06:08:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/" vs Path2 "/tmp/060749ce/resync/path2/" 2024/05/06 06:08:01 INFO : Bisync successful 2024/05/06 06:08:01 (31) : copy-listings mixed-diffs 2024/05/06 06:08:01 (32) : test run normal bisync 2024/05/06 06:08:01 (33) : bisync 2024/05/06 06:08:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/" with Path2 "/tmp/060749ce/resync/path2/" 2024/05/06 06:08:01 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:01 INFO : Path1 checking for diffs 2024/05/06 06:08:01 INFO : Path2 checking for diffs 2024/05/06 06:08:01 INFO : No changes found 2024/05/06 06:08:01 INFO : Updating listings 2024/05/06 06:08:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/" vs Path2 "/tmp/060749ce/resync/path2/" 2024/05/06 06:08:01 INFO : Bisync successful 2024/05/06 06:08:01 (34) : test 4. confirm critical error on normal sync of empty path. 2024/05/06 06:08:01 (35) : purge-children /tmp/060749ce/resync/path2/ 2024/05/06 06:08:01 (36) : bisync 2024/05/06 06:08:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync/path1/" with Path2 "/tmp/060749ce/resync/path2/" 2024/05/06 06:08:01 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:01 INFO : Path1 checking for diffs 2024/05/06 06:08:01 INFO : Path2 checking for diffs 2024/05/06 06:08:01 ERROR : Empty current Path2 listing. Cannot sync to an empty directory: /tmp/060749ce/workdir/TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_resync_path1..tmp_060749ce_resync_path2.path2.lst-new 2024/05/06 06:08:01 ERROR : Bisync critical error: empty current Path2 listing: /tmp/060749ce/workdir/TestHdfs_rclone-test-kodawez5zomoxog3hejadom5_060749ce_resync_path1..tmp_060749ce_resync_path2.path2.lst-new 2024/05/06 06:08:01 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:01 Bisync error: bisync aborted bisync_test.go:555: TEST resync PASSED === RUN TestBisyncRemoteLocal/resync_modes 2024/05/06 06:08:01 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:08:01 DEBUG : path1: Making directory 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:08:01 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1" 2024/05/06 06:08:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:01 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1" 2024/05/06 06:08:01 DEBUG : Creating backend with remote "/tmp/060749ce/resync_modes/path2" 2024/05/06 06:08:01 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resync_modes/initial" 2024/05/06 06:08:01 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_resync_modes-havojay5" 2024/05/06 06:08:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : Local file system at /tmp/060749ce/initdir/test_resync_modes-havojay5: Waiting for checks to finish 2024/05/06 06:08:01 DEBUG : Local file system at /tmp/060749ce/initdir/test_resync_modes-havojay5: Waiting for transfers to finish 2024/05/06 06:08:01 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:01 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:01 DEBUG : file1.txt.rasipaw1.partial: renamed to: file1.txt 2024/05/06 06:08:01 INFO : file1.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : file2.txt.yumoxex2.partial: renamed to: file2.txt 2024/05/06 06:08:01 INFO : file2.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:01 DEBUG : RCLONE_TEST.jehusuj7.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:01 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:01 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resync_modes/modfiles" 2024/05/06 06:08:01 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_resync_modes-qivuvis9" 2024/05/06 06:08:01 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : Local file system at /tmp/060749ce/datadir/test_resync_modes-qivuvis9: Waiting for checks to finish 2024/05/06 06:08:01 DEBUG : Local file system at /tmp/060749ce/datadir/test_resync_modes-qivuvis9: Waiting for transfers to finish 2024/05/06 06:08:01 DEBUG : file1R.txt: md5 = 705bb3c0ef02925739e834ca98c099c3 OK 2024/05/06 06:08:01 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/05/06 06:08:01 DEBUG : file1L.txt.babekec3.partial: renamed to: file1L.txt 2024/05/06 06:08:01 INFO : file1L.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : file1R.txt.zovolug3.partial: renamed to: file1R.txt 2024/05/06 06:08:01 INFO : file1R.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/05/06 06:08:01 DEBUG : file2.txt.marenil9.partial: renamed to: file2.txt 2024/05/06 06:08:01 INFO : file2.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1] 2024/05/06 06:08:01 ERROR : : error listing: directory not found 2024/05/06 06:08:01 ERROR : : error listing: directory not found 2024/05/06 06:08:01 checking initFs Local file system at /tmp/060749ce/initdir/test_resync_modes-havojay5 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1] 2024/05/06 06:08:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1: Waiting for checks to finish 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/RCLONE_TEST] 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1: Waiting for transfers to finish 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/file1.txt] 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/file2.txt] 2024/05/06 06:08:01 INFO : file1.txt: Copied (new) 2024/05/06 06:08:01 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:01 INFO : file2.txt: Copied (new) 2024/05/06 06:08:01 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1] 2024/05/06 06:08:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : Local file system at /tmp/060749ce/resync_modes/path2: Waiting for checks to finish 2024/05/06 06:08:01 DEBUG : Local file system at /tmp/060749ce/resync_modes/path2: Waiting for transfers to finish 2024/05/06 06:08:01 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:01 DEBUG : file1.txt.sojigel4.partial: renamed to: file1.txt 2024/05/06 06:08:01 INFO : file1.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:01 DEBUG : file2.txt.quvohed4.partial: renamed to: file2.txt 2024/05/06 06:08:01 INFO : file2.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:01 DEBUG : RCLONE_TEST.socumuw6.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:01 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:01 checking path2 Local file system at /tmp/060749ce/resync_modes/path2 2024/05/06 06:08:01 (01) : test resync-mode 2024/05/06 06:08:01 (02) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:01 (03) : touch-glob 2001-01-02 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1R.txt 2024/05/06 06:08:01 (04) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1R.txt /tmp/060749ce/resync_modes/path2/ file1.txt 2024/05/06 06:08:01 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:01 (05) : touch-glob 2001-03-04 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1L.txt 2024/05/06 06:08:01 (06) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/ file1.txt 2024/05/06 06:08:01 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:01 (07) : test bisync run with --resync-mode=newer 2024/05/06 06:08:01 (08) : bisync resync resync-mode=newer 2024/05/06 06:08:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" with Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Copying Path2 files to Path1 2024/05/06 06:08:01 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:01 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:01 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:01 INFO : Resync updating listings 2024/05/06 06:08:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" vs Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Bisync successful 2024/05/06 06:08:01 (09) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:01 (10) : touch-glob 2001-07-23 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1R.txt 2024/05/06 06:08:01 (11) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1R.txt /tmp/060749ce/resync_modes/path2/ file1.txt 2024/05/06 06:08:01 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:01 (12) : touch-glob 2001-08-26 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1L.txt 2024/05/06 06:08:01 (13) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/ file1.txt 2024/05/06 06:08:01 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:01 (14) : test bisync run with --resync-mode=path2 2024/05/06 06:08:01 (15) : bisync resync resync-mode=path2 2024/05/06 06:08:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" with Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Copying Path2 files to Path1 2024/05/06 06:08:01 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:01 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:01 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:01 INFO : Resync updating listings 2024/05/06 06:08:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" vs Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Bisync successful 2024/05/06 06:08:01 (16) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:01 (17) : touch-glob 2002-07-23 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1R.txt 2024/05/06 06:08:01 (18) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1R.txt /tmp/060749ce/resync_modes/path2/ file1.txt 2024/05/06 06:08:01 INFO : file1R.txt: Updated modification time in destination 2024/05/06 06:08:01 (19) : touch-glob 2002-08-26 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1L.txt 2024/05/06 06:08:01 (20) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/ file1.txt 2024/05/06 06:08:01 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:01 (21) : test bisync run with --resync-mode=larger 2024/05/06 06:08:01 (22) : bisync resync resync-mode=larger 2024/05/06 06:08:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" with Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Copying Path2 files to Path1 2024/05/06 06:08:01 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:01 INFO : file1.txt: Path2 is larger. Path1: 33, Path2: 42, Difference: 9 2024/05/06 06:08:01 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:01 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:01 INFO : Resync updating listings 2024/05/06 06:08:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" vs Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Bisync successful 2024/05/06 06:08:01 (23) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:01 (24) : touch-glob 2003-07-23 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1R.txt 2024/05/06 06:08:01 (25) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1R.txt /tmp/060749ce/resync_modes/path2/ file1.txt 2024/05/06 06:08:01 INFO : file1R.txt: Updated modification time in destination 2024/05/06 06:08:01 (26) : touch-glob 2003-09-04 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1L.txt 2024/05/06 06:08:01 (27) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/ file1.txt 2024/05/06 06:08:01 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:01 (28) : test bisync run with --resync-mode=older 2024/05/06 06:08:01 (29) : bisync resync resync-mode=older 2024/05/06 06:08:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" with Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Copying Path2 files to Path1 2024/05/06 06:08:01 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:01 INFO : file1.txt: Path2 is older. Path1: 2003-09-04 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 1032h0m0s 2024/05/06 06:08:01 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:01 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:01 INFO : Resync updating listings 2024/05/06 06:08:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" vs Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Bisync successful 2024/05/06 06:08:01 (30) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:01 (31) : touch-glob 2004-07-23 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1R.txt 2024/05/06 06:08:01 (32) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1R.txt /tmp/060749ce/resync_modes/path2/ file1.txt 2024/05/06 06:08:01 INFO : file1R.txt: Updated modification time in destination 2024/05/06 06:08:01 (33) : touch-glob 2004-07-23 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1L.txt 2024/05/06 06:08:01 (34) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/ file1.txt 2024/05/06 06:08:01 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:01 (35) : test bisync run with --resync-mode=smaller 2024/05/06 06:08:01 (36) : bisync resync resync-mode=smaller 2024/05/06 06:08:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" with Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Copying Path2 files to Path1 2024/05/06 06:08:01 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:01 INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9 2024/05/06 06:08:01 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:01 INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9 2024/05/06 06:08:01 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:01 INFO : Resync updating listings 2024/05/06 06:08:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" vs Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Bisync successful 2024/05/06 06:08:01 (37) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:01 (38) : touch-glob 2005-01-02 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1R.txt 2024/05/06 06:08:01 (39) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1R.txt /tmp/060749ce/resync_modes/path2/ file1.txt 2024/05/06 06:08:01 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:01 (40) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/ file2.txt 2024/05/06 06:08:01 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:01 (41) : touch-glob 2006-03-04 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1L.txt 2024/05/06 06:08:01 (42) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/ file1.txt 2024/05/06 06:08:01 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:01 (43) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1L.txt /tmp/060749ce/resync_modes/path2/ file2.txt 2024/05/06 06:08:01 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:01 (44) : test bisync run with --resync-mode=path1 2024/05/06 06:08:01 (45) : bisync resync resync-mode=path1 2024/05/06 06:08:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" with Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Copying Path2 files to Path1 2024/05/06 06:08:01 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:01 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:01 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:01 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:01 INFO : Resync updating listings 2024/05/06 06:08:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" vs Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Bisync successful 2024/05/06 06:08:01 (46) : test no winner 2024/05/06 06:08:01 (47) : touch-glob 2022-02-22 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1R.txt 2024/05/06 06:08:01 (48) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1R.txt /tmp/060749ce/resync_modes/path2/ file1.txt 2024/05/06 06:08:01 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:01 (49) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/ file2.txt 2024/05/06 06:08:01 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:01 (50) : touch-glob 2022-02-22 /tmp/060749ce/datadir/test_resync_modes-qivuvis9/ file1L.txt 2024/05/06 06:08:01 (51) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/ file1.txt 2024/05/06 06:08:01 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:01 (52) : copy-as /tmp/060749ce/datadir/test_resync_modes-qivuvis9/file1L.txt /tmp/060749ce/resync_modes/path2/ file2.txt 2024/05/06 06:08:01 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:01 (53) : test bisync run with --resync-mode=newer 2024/05/06 06:08:01 (54) : bisync resync resync-mode=newer 2024/05/06 06:08:01 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:01 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:01 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" with Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Copying Path2 files to Path1 2024/05/06 06:08:01 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:01 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:01 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:01 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:01 INFO : Resync updating listings 2024/05/06 06:08:01 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/resync_modes/path1/" vs Path2 "/tmp/060749ce/resync_modes/path2/" 2024/05/06 06:08:01 INFO : Bisync successful bisync_test.go:555: TEST resync_modes PASSED === RUN TestBisyncRemoteLocal/rmdirs 2024/05/06 06:08:01 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:08:01 DEBUG : path1: Making directory 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:08:01 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1" 2024/05/06 06:08:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:01 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1" 2024/05/06 06:08:01 DEBUG : Creating backend with remote "/tmp/060749ce/rmdirs/path2" 2024/05/06 06:08:01 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rmdirs/initial" 2024/05/06 06:08:01 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_rmdirs-fixeyic5" 2024/05/06 06:08:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:01 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:01 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:01 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : Local file system at /tmp/060749ce/initdir/test_rmdirs-fixeyic5: Waiting for checks to finish 2024/05/06 06:08:01 DEBUG : Local file system at /tmp/060749ce/initdir/test_rmdirs-fixeyic5: Waiting for transfers to finish 2024/05/06 06:08:01 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:01 DEBUG : file1.copy1.txt.miqimav4.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:01 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:01 DEBUG : file1.copy2.txt.fuvixof7.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:01 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:01 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:01 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:01 DEBUG : file1.copy4.txt.hanejov5.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:01 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : file1.copy5.txt.lodurek9.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:01 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:01 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : file1.copy3.txt.hohapoj5.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:01 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:01 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:01 DEBUG : RCLONE_TEST.dezamay5.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:01 DEBUG : subdir/file20.txt.seropux5.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:01 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:01 DEBUG : file1.txt.nukazol3.partial: renamed to: file1.txt 2024/05/06 06:08:01 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:01 INFO : file1.txt: Copied (new) 2024/05/06 06:08:01 INFO : subdir: Updated directory metadata 2024/05/06 06:08:01 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rmdirs/modfiles" 2024/05/06 06:08:01 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_rmdirs-fujehix8" 2024/05/06 06:08:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : Local file system at /tmp/060749ce/datadir/test_rmdirs-fujehix8: Waiting for checks to finish 2024/05/06 06:08:01 DEBUG : Local file system at /tmp/060749ce/datadir/test_rmdirs-fujehix8: Waiting for transfers to finish 2024/05/06 06:08:01 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:01 DEBUG : file1.txt.hasilac1.partial: renamed to: file1.txt 2024/05/06 06:08:01 INFO : file1.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1] 2024/05/06 06:08:01 ERROR : : error listing: directory not found 2024/05/06 06:08:01 ERROR : : error listing: directory not found 2024/05/06 06:08:01 checking initFs Local file system at /tmp/060749ce/initdir/test_rmdirs-fixeyic5 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1] 2024/05/06 06:08:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/RCLONE_TEST] 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/file1.copy2.txt] 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/file1.copy1.txt] 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/file1.copy3.txt] 2024/05/06 06:08:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : subdir: Making directory 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/subdir] 2024/05/06 06:08:01 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: Waiting for checks to finish 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: Waiting for transfers to finish 2024/05/06 06:08:01 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/file1.copy4.txt] 2024/05/06 06:08:01 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/file1.copy5.txt] 2024/05/06 06:08:01 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/file1.txt] 2024/05/06 06:08:01 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/subdir/file20.txt] 2024/05/06 06:08:01 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:01 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:02 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/subdir] 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:02 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:02 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:02 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060749ce/rmdirs/path2: Waiting for checks to finish 2024/05/06 06:08:02 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060749ce/rmdirs/path2: Waiting for transfers to finish 2024/05/06 06:08:02 DEBUG : file1.copy1.txt.rexutuy6.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:02 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.copy2.txt.muyozeq5.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:02 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.copy4.txt.rokomiw1.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:02 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.copy5.txt.jubeyah0.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:02 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.copy3.txt.zarelur2.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:02 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.txt.hoyafay4.partial: renamed to: file1.txt 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : subdir/file20.txt.vacofuk6.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:02 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:02 DEBUG : RCLONE_TEST.poxibol3.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:02 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:02 INFO : subdir: Updated directory metadata 2024/05/06 06:08:02 checking path2 Local file system at /tmp/060749ce/rmdirs/path2 2024/05/06 06:08:02 (01) : test rmdirs 2024/05/06 06:08:02 (02) : test initial bisync 2024/05/06 06:08:02 (03) : bisync resync 2024/05/06 06:08:02 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:02 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/" with Path2 "/tmp/060749ce/rmdirs/path2/" 2024/05/06 06:08:02 INFO : Copying Path2 files to Path1 2024/05/06 06:08:02 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:02 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:02 INFO : Resync updating listings 2024/05/06 06:08:02 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/" vs Path2 "/tmp/060749ce/rmdirs/path2/" 2024/05/06 06:08:02 INFO : Bisync successful 2024/05/06 06:08:02 (04) : test 1. delete path1 subdir file 2024/05/06 06:08:02 (05) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/subdir/file20.txt 2024/05/06 06:08:02 INFO : file20.txt: Deleted 2024/05/06 06:08:02 (06) : test 2. run bisync without remove-empty-dirs 2024/05/06 06:08:02 (07) : bisync 2024/05/06 06:08:02 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:02 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/" with Path2 "/tmp/060749ce/rmdirs/path2/" 2024/05/06 06:08:02 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:02 INFO : Path1 checking for diffs 2024/05/06 06:08:02 INFO : - Path1 File was deleted - subdir/file20.txt 2024/05/06 06:08:02 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:02 INFO : Path2 checking for diffs 2024/05/06 06:08:02 INFO : Applying changes 2024/05/06 06:08:02 INFO : - Path2 Queue delete - /tmp/060749ce/rmdirs/path2/subdir/file20.txt 2024/05/06 06:08:02 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:02 INFO : subdir/file20.txt: Deleted 2024/05/06 06:08:02 INFO : Updating listings 2024/05/06 06:08:02 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/" vs Path2 "/tmp/060749ce/rmdirs/path2/" 2024/05/06 06:08:02 INFO : Bisync successful 2024/05/06 06:08:02 (08) : test 3. confirm the subdir still exists on both paths 2024/05/06 06:08:02 (09) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/ 2024/05/06 06:08:02 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:02 (10) : list-dirs /tmp/060749ce/rmdirs/path2/ 2024/05/06 06:08:02 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:02 (11) : test 4. run bisync with remove-empty-dirs 2024/05/06 06:08:02 (12) : bisync remove-empty-dirs 2024/05/06 06:08:02 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:02 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/" with Path2 "/tmp/060749ce/rmdirs/path2/" 2024/05/06 06:08:02 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:02 INFO : Path1 checking for diffs 2024/05/06 06:08:02 INFO : Path2 checking for diffs 2024/05/06 06:08:02 INFO : No changes found 2024/05/06 06:08:02 INFO : Updating listings 2024/05/06 06:08:02 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/" vs Path2 "/tmp/060749ce/rmdirs/path2/" 2024/05/06 06:08:02 INFO : Removing empty directories 2024/05/06 06:08:02 INFO : subdir: Removing directory 2024/05/06 06:08:02 INFO : subdir: Removing directory 2024/05/06 06:08:02 INFO : Bisync successful 2024/05/06 06:08:02 (13) : test 5. confirm the subdir has been removed on both paths 2024/05/06 06:08:02 (14) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-kodawez5zomoxog3hejadom5/060749ce/rmdirs/path1/ 2024/05/06 06:08:02 (15) : list-dirs /tmp/060749ce/rmdirs/path2/ bisync_test.go:555: TEST rmdirs PASSED === RUN TestBisyncRemoteLocal/volatile 2024/05/06 06:08:02 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce" for canonical name "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce" 2024/05/06 06:08:02 DEBUG : path1: Making directory 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce: mkdir [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/path1] 2024/05/06 06:08:02 DEBUG : Creating backend with remote "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1" 2024/05/06 06:08:02 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:02 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:02 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1" 2024/05/06 06:08:02 DEBUG : Creating backend with remote "/tmp/060749ce/volatile/path2" 2024/05/06 06:08:02 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_volatile/initial" 2024/05/06 06:08:02 DEBUG : Creating backend with remote "/tmp/060749ce/initdir/test_volatile-qajonur0" 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060749ce/initdir/test_volatile-qajonur0: Waiting for checks to finish 2024/05/06 06:08:02 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:02 DEBUG : file1.txt.heyinuz8.partial: renamed to: file1.txt 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : RCLONE_TEST.pexanof7.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:02 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:02 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file2.txt.vaxosuv1.partial: renamed to: file2.txt 2024/05/06 06:08:02 INFO : file2.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file3.txt.gaminic9.partial: renamed to: file3.txt 2024/05/06 06:08:02 INFO : file3.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060749ce/initdir/test_volatile-qajonur0: Waiting for transfers to finish 2024/05/06 06:08:02 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file7.txt.yugohiv3.partial: renamed to: file7.txt 2024/05/06 06:08:02 INFO : file7.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file4.txt.yirenot7.partial: renamed to: file4.txt 2024/05/06 06:08:02 INFO : file4.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file5.txt.fosaqex2.partial: renamed to: file5.txt 2024/05/06 06:08:02 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 INFO : file5.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file8.txt.wakajeh8.partial: renamed to: file8.txt 2024/05/06 06:08:02 INFO : file8.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file6.txt.sudemod5.partial: renamed to: file6.txt 2024/05/06 06:08:02 INFO : file6.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_volatile/modfiles" 2024/05/06 06:08:02 DEBUG : Creating backend with remote "/tmp/060749ce/datadir/test_volatile-kivotin4" 2024/05/06 06:08:02 DEBUG : dummy.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:02 DEBUG : file11.txt.nicovuf3.partial: renamed to: file11.txt 2024/05/06 06:08:02 INFO : file11.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : dummy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : dummy.txt.guwuhut8.partial: renamed to: dummy.txt 2024/05/06 06:08:02 INFO : dummy.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060749ce/datadir/test_volatile-kivotin4: Waiting for checks to finish 2024/05/06 06:08:02 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:02 DEBUG : file1.txt.gakajip5.partial: renamed to: file1.txt 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:02 DEBUG : file10.txt.xerujus9.partial: renamed to: file10.txt 2024/05/06 06:08:02 INFO : file10.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:02 DEBUG : file5L.txt.kaxavey0.partial: renamed to: file5L.txt 2024/05/06 06:08:02 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060749ce/datadir/test_volatile-kivotin4: Waiting for transfers to finish 2024/05/06 06:08:02 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:02 DEBUG : file6.txt.jeqeboc6.partial: renamed to: file6.txt 2024/05/06 06:08:02 INFO : file6.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:02 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:02 DEBUG : file7.txt.kuqecow3.partial: renamed to: file7.txt 2024/05/06 06:08:02 INFO : file7.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file2.txt.yawawos2.partial: renamed to: file2.txt 2024/05/06 06:08:02 INFO : file2.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:02 DEBUG : file5R.txt.ravozaf5.partial: renamed to: file5R.txt 2024/05/06 06:08:02 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1] 2024/05/06 06:08:02 ERROR : : error listing: directory not found 2024/05/06 06:08:02 ERROR : : error listing: directory not found 2024/05/06 06:08:02 checking initFs Local file system at /tmp/060749ce/initdir/test_volatile-qajonur0 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1] 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1/RCLONE_TEST] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1/file1.txt] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1/file3.txt] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1/file2.txt] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: Waiting for checks to finish 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: Waiting for transfers to finish 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1/file4.txt] 2024/05/06 06:08:02 INFO : file2.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1/file5.txt] 2024/05/06 06:08:02 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1/file6.txt] 2024/05/06 06:08:02 INFO : file3.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1/file7.txt] 2024/05/06 06:08:02 INFO : file4.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: update [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1/file8.txt] 2024/05/06 06:08:02 INFO : file5.txt: Copied (new) 2024/05/06 06:08:02 INFO : file6.txt: Copied (new) 2024/05/06 06:08:02 INFO : file7.txt: Copied (new) 2024/05/06 06:08:02 INFO : file8.txt: Copied (new) 2024/05/06 06:08:02 checking Path1 hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1: list [/rclone-test-kodawez5zomoxog3hejadom5/060749ce/volatile/path1] 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060749ce/volatile/path2: Waiting for checks to finish 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060749ce/volatile/path2: Waiting for transfers to finish 2024/05/06 06:08:02 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file2.txt.jilolip4.partial: renamed to: file2.txt 2024/05/06 06:08:02 INFO : file2.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file3.txt.racasiq0.partial: renamed to: file3.txt 2024/05/06 06:08:02 INFO : file3.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.txt.qedosed5.partial: renamed to: file1.txt 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file4.txt.cesedep1.partial: renamed to: file4.txt 2024/05/06 06:08:02 INFO : file4.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file6.txt.serixif3.partial: renamed to: file6.txt 2024/05/06 06:08:02 INFO : file6.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file5.txt.jeqegag2.partial: renamed to: file5.txt 2024/05/06 06:08:02 INFO : file5.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:02 DEBUG : file7.txt.lohexeb5.partial: renamed to: file7.txt 2024/05/06 06:08:02 INFO : file7.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : RCLONE_TEST.haxafak1.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:02 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:02 DEBUG : file8.txt.qananeb6.partial: renamed to: file8.txt 2024/05/06 06:08:02 INFO : file8.txt: Copied (new) 2024/05/06 06:08:02 checking path2 Local file system at /tmp/060749ce/volatile/path2 2024/05/06 06:08:02 (01) : test volatile 2024/05/06 06:08:02 (02) : test initial bisync 2024/05/06 06:08:02 (03) : bisync resync bisync_test.go:923: skipping 'volatile' test on non-local as it requires uploading 100 files 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5: Purge remote 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-kodawez5zomoxog3hejadom5: purge [/rclone-test-kodawez5zomoxog3hejadom5] --- PASS: TestBisyncRemoteLocal (12.40s) --- PASS: TestBisyncRemoteLocal/all_changed (0.64s) --- SKIP: TestBisyncRemoteLocal/backupdir (0.21s) --- PASS: TestBisyncRemoteLocal/basic (0.33s) --- PASS: TestBisyncRemoteLocal/changes (0.55s) --- PASS: TestBisyncRemoteLocal/check_access (0.56s) --- PASS: TestBisyncRemoteLocal/check_access_filters (0.91s) --- PASS: TestBisyncRemoteLocal/check_filename (0.32s) --- PASS: TestBisyncRemoteLocal/check_sync (0.38s) --- PASS: TestBisyncRemoteLocal/compare_all (0.45s) --- PASS: TestBisyncRemoteLocal/createemptysrcdirs (0.53s) --- PASS: TestBisyncRemoteLocal/dry_run (0.65s) --- PASS: TestBisyncRemoteLocal/equal (0.24s) --- PASS: TestBisyncRemoteLocal/ext_paths (0.61s) --- SKIP: TestBisyncRemoteLocal/extended_filenames (0.37s) --- PASS: TestBisyncRemoteLocal/filters (0.30s) --- PASS: TestBisyncRemoteLocal/filtersfile_checks (0.30s) --- PASS: TestBisyncRemoteLocal/ignorelistingchecksum (0.34s) --- PASS: TestBisyncRemoteLocal/max_delete_path1 (0.34s) --- PASS: TestBisyncRemoteLocal/max_delete_path2_force (0.34s) --- PASS: TestBisyncRemoteLocal/nomodtime (0.60s) --- SKIP: TestBisyncRemoteLocal/normalization (0.28s) --- PASS: TestBisyncRemoteLocal/rclone_args (0.85s) --- PASS: TestBisyncRemoteLocal/resolve (0.64s) --- PASS: TestBisyncRemoteLocal/resync (0.68s) --- PASS: TestBisyncRemoteLocal/resync_modes (0.45s) --- PASS: TestBisyncRemoteLocal/rmdirs (0.29s) --- SKIP: TestBisyncRemoteLocal/volatile (0.20s) === RUN TestBisyncLocalRemote 2024/05/06 06:08:02 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7" 2024/05/06 06:08:02 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:02 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:02 remote: TestHdfs:rclone-test-yagozel7lusazib1yuramux7 === RUN TestBisyncLocalRemote/all_changed 2024/05/06 06:08:02 DEBUG : Creating backend with remote "/tmp/060802gi" 2024/05/06 06:08:02 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/05/06 06:08:02 DEBUG : Creating backend with remote "/tmp/060802gi/all_changed/path1" 2024/05/06 06:08:02 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:02 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:02 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:02 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:02 DEBUG : path2: Making directory 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:02 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2" 2024/05/06 06:08:02 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:02 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:02 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2" 2024/05/06 06:08:02 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_all_changed-molinow2" 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:02 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:02 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:02 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060802gi/initdir/test_all_changed-molinow2: Waiting for checks to finish 2024/05/06 06:08:02 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060802gi/initdir/test_all_changed-molinow2: Waiting for transfers to finish 2024/05/06 06:08:02 DEBUG : file1.copy1.txt.jigurid3.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:02 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.copy4.txt.yulexap1.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:02 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.copy2.txt.nopinol2.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:02 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:02 DEBUG : RCLONE_TEST.zafiqub4.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:02 DEBUG : file1.copy3.txt.bucolez5.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:02 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:02 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.copy5.txt.xolojor2.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:02 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.txt.maxotig3.partial: renamed to: file1.txt 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : subdir/file20.txt.ceziruw7.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:02 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:02 INFO : subdir: Updated directory metadata 2024/05/06 06:08:02 ERROR : : error listing: directory not found 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2] 2024/05/06 06:08:02 ERROR : : error listing: directory not found 2024/05/06 06:08:02 checking initFs Local file system at /tmp/060802gi/initdir/test_all_changed-molinow2 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:02 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:02 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:02 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.copy1.txt.waxifez7.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:02 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.copy4.txt.wohixut0.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:02 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.copy2.txt.wibemax5.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:02 DEBUG : file1.copy5.txt.natudip5.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:02 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:02 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:02 DEBUG : file1.copy3.txt.vijotid7.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:02 DEBUG : RCLONE_TEST.wohokiz3.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:02 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:02 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.txt.wabobiq0.partial: renamed to: file1.txt 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060802gi/all_changed/path1: Waiting for checks to finish 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060802gi/all_changed/path1: Waiting for transfers to finish 2024/05/06 06:08:02 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : subdir/file20.txt.sijokax0.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:02 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:02 INFO : subdir: Updated directory metadata 2024/05/06 06:08:02 checking Path1 Local file system at /tmp/060802gi/all_changed/path1 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2] 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : subdir: Making directory 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/subdir] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/RCLONE_TEST] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy1.txt] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy2.txt] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy3.txt] 2024/05/06 06:08:02 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: Waiting for checks to finish 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: Waiting for transfers to finish 2024/05/06 06:08:02 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy4.txt] 2024/05/06 06:08:02 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy5.txt] 2024/05/06 06:08:02 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.txt] 2024/05/06 06:08:02 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/subdir/file20.txt] 2024/05/06 06:08:02 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:02 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:02 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/subdir] 2024/05/06 06:08:02 (01) : test all-changed 2024/05/06 06:08:02 (02) : test initial bisync 2024/05/06 06:08:02 (03) : bisync resync 2024/05/06 06:08:02 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:02 INFO : Synching Path1 "/tmp/060802gi/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/" 2024/05/06 06:08:02 INFO : Copying Path2 files to Path1 2024/05/06 06:08:02 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:02 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:02 INFO : Resync updating listings 2024/05/06 06:08:02 INFO : Validating listings for Path1 "/tmp/060802gi/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/" 2024/05/06 06:08:02 INFO : Bisync successful 2024/05/06 06:08:02 (04) : test change timestamp on all files except RCLONE_TEST 2024/05/06 06:08:02 (05) : touch-glob 2005-01-02 /tmp/060802gi/all_changed/path1/ file* 2024/05/06 06:08:02 (06) : touch-glob 2005-01-02 /tmp/060802gi/all_changed/path1/subdir file* 2024/05/06 06:08:02 (07) : test sync should pass 2024/05/06 06:08:02 (08) : bisync 2024/05/06 06:08:02 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:02 INFO : Synching Path1 "/tmp/060802gi/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/" 2024/05/06 06:08:02 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:02 INFO : Path1 checking for diffs 2024/05/06 06:08:02 INFO : - Path1 File changed: time (newer) - file1.copy1.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (newer) - file1.copy2.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (newer) - file1.copy3.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (newer) - file1.copy4.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (newer) - file1.copy5.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (newer) - file1.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2024/05/06 06:08:02 INFO : Path1: 7 changes:  0 new,  7 modified,  0 deleted 2024/05/06 06:08:02 INFO : (Modified:  7 newer,  0 older) 2024/05/06 06:08:02 INFO : Path2 checking for diffs 2024/05/06 06:08:02 INFO : Applying changes 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy1.txt 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy2.txt 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy3.txt 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy4.txt 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy5.txt 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.txt 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/subdir/file20.txt 2024/05/06 06:08:02 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:02 INFO : file1.copy1.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : file1.copy2.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : file1.copy3.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : file1.copy4.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : file1.copy5.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : Updating listings 2024/05/06 06:08:02 INFO : Validating listings for Path1 "/tmp/060802gi/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/" 2024/05/06 06:08:02 INFO : Bisync successful 2024/05/06 06:08:02 (09) : test change timestamp on all files including RCLONE_TEST 2024/05/06 06:08:02 (10) : touch-glob 2004-01-02 /tmp/060802gi/all_changed/path1/ * 2024/05/06 06:08:02 (11) : touch-glob 2004-01-02 /tmp/060802gi/all_changed/path1/subdir * 2024/05/06 06:08:02 (12) : test sync should fail 2024/05/06 06:08:02 (13) : bisync 2024/05/06 06:08:02 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:02 INFO : Synching Path1 "/tmp/060802gi/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/" 2024/05/06 06:08:02 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:02 INFO : Path1 checking for diffs 2024/05/06 06:08:02 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - file1.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2024/05/06 06:08:02 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2024/05/06 06:08:02 INFO : (Modified:  1 newer,  7 older) 2024/05/06 06:08:02 INFO : Path2 checking for diffs 2024/05/06 06:08:02 ERROR : Safety abort: all files were changed on Path1 "/tmp/060802gi/all_changed/path1/". Run with --force if desired. 2024/05/06 06:08:02 NOTICE: Bisync aborted. Please try again. 2024/05/06 06:08:02 Bisync error: all files were changed 2024/05/06 06:08:02 (14) : test sync with force should pass 2024/05/06 06:08:02 (15) : bisync force 2024/05/06 06:08:02 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:02 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:02 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:02 INFO : Synching Path1 "/tmp/060802gi/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/" 2024/05/06 06:08:02 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:02 INFO : Path1 checking for diffs 2024/05/06 06:08:02 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - file1.txt 2024/05/06 06:08:02 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2024/05/06 06:08:02 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2024/05/06 06:08:02 INFO : (Modified:  1 newer,  7 older) 2024/05/06 06:08:02 INFO : Path2 checking for diffs 2024/05/06 06:08:02 INFO : Applying changes 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/RCLONE_TEST 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy1.txt 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy2.txt 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy3.txt 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy4.txt 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.copy5.txt 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/file1.txt 2024/05/06 06:08:02 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/subdir/file20.txt 2024/05/06 06:08:02 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:02 INFO : file1.copy3.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : file1.copy1.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : RCLONE_TEST: Copied (replaced existing) 2024/05/06 06:08:02 INFO : file1.copy2.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : file1.copy4.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : file1.copy5.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:02 INFO : Updating listings 2024/05/06 06:08:02 INFO : Validating listings for Path1 "/tmp/060802gi/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/all_changed/path2/" 2024/05/06 06:08:02 INFO : Bisync successful bisync_test.go:555: TEST all_changed PASSED === RUN TestBisyncLocalRemote/backupdir 2024/05/06 06:08:02 DEBUG : Creating backend with remote "/tmp/060802gi/backupdir/path1" 2024/05/06 06:08:02 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:02 DEBUG : path2: Making directory 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:02 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2" 2024/05/06 06:08:02 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:02 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:02 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2" 2024/05/06 06:08:02 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_backupdir-foleyuh5" 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060802gi/initdir/test_backupdir-foleyuh5: Waiting for checks to finish 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060802gi/initdir/test_backupdir-foleyuh5: Waiting for transfers to finish 2024/05/06 06:08:02 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.txt.wojasox9.partial: renamed to: file1.txt 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file2.txt.xakabon8.partial: renamed to: file2.txt 2024/05/06 06:08:02 INFO : file2.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file4.txt.gorinef1.partial: renamed to: file4.txt 2024/05/06 06:08:02 INFO : file4.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file3.txt.nurulox2.partial: renamed to: file3.txt 2024/05/06 06:08:02 INFO : file3.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file6.txt.cuguheb8.partial: renamed to: file6.txt 2024/05/06 06:08:02 INFO : file6.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:02 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : RCLONE_TEST.yudonej8.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:02 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:02 DEBUG : file5.txt.dadaxoc1.partial: renamed to: file5.txt 2024/05/06 06:08:02 INFO : file5.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file7.txt.pogozuy0.partial: renamed to: file7.txt 2024/05/06 06:08:02 INFO : file7.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file8.txt.hetoqav3.partial: renamed to: file8.txt 2024/05/06 06:08:02 INFO : file8.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_backupdir-tatihig6" 2024/05/06 06:08:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:02 DEBUG : file11.txt.wutuwin0.partial: renamed to: file11.txt 2024/05/06 06:08:02 INFO : file11.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060802gi/datadir/test_backupdir-tatihig6: Waiting for checks to finish 2024/05/06 06:08:02 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:02 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:02 DEBUG : file2.txt.julavec4.partial: renamed to: file2.txt 2024/05/06 06:08:02 INFO : file2.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file1.txt.ruvulet1.partial: renamed to: file1.txt 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060802gi/datadir/test_backupdir-tatihig6: Waiting for transfers to finish 2024/05/06 06:08:02 DEBUG : file10.txt.gafacet6.partial: renamed to: file10.txt 2024/05/06 06:08:02 INFO : file10.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:02 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:02 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:02 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:02 DEBUG : file7.txt.yeginek0.partial: renamed to: file7.txt 2024/05/06 06:08:02 INFO : file7.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file5L.txt.gihoret5.partial: renamed to: file5L.txt 2024/05/06 06:08:02 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file5R.txt.jazivaq8.partial: renamed to: file5R.txt 2024/05/06 06:08:02 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file6.txt.lofubun3.partial: renamed to: file6.txt 2024/05/06 06:08:02 INFO : file6.txt: Copied (new) 2024/05/06 06:08:02 ERROR : : error listing: directory not found 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2] 2024/05/06 06:08:02 ERROR : : error listing: directory not found 2024/05/06 06:08:02 checking initFs Local file system at /tmp/060802gi/initdir/test_backupdir-foleyuh5 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060802gi/backupdir/path1: Waiting for checks to finish 2024/05/06 06:08:02 DEBUG : Local file system at /tmp/060802gi/backupdir/path1: Waiting for transfers to finish 2024/05/06 06:08:02 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file1.txt.rosedom0.partial: renamed to: file1.txt 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file2.txt.lexuquk7.partial: renamed to: file2.txt 2024/05/06 06:08:02 DEBUG : file3.txt.vivudal7.partial: renamed to: file3.txt 2024/05/06 06:08:02 INFO : file3.txt: Copied (new) 2024/05/06 06:08:02 INFO : file2.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file4.txt.hoqobuy6.partial: renamed to: file4.txt 2024/05/06 06:08:02 INFO : file4.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file5.txt.cubapij5.partial: renamed to: file5.txt 2024/05/06 06:08:02 INFO : file5.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:02 DEBUG : file6.txt.natibez6.partial: renamed to: file6.txt 2024/05/06 06:08:02 INFO : file6.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : RCLONE_TEST.miyirit6.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:02 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:02 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:02 DEBUG : file7.txt.hocebed5.partial: renamed to: file7.txt 2024/05/06 06:08:02 INFO : file7.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : file8.txt.kezivaw5.partial: renamed to: file8.txt 2024/05/06 06:08:02 INFO : file8.txt: Copied (new) 2024/05/06 06:08:02 checking Path1 Local file system at /tmp/060802gi/backupdir/path1 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2] 2024/05/06 06:08:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2/RCLONE_TEST] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2/file1.txt] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2/file2.txt] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: Waiting for checks to finish 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2/file3.txt] 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: Waiting for transfers to finish 2024/05/06 06:08:02 INFO : file1.txt: Copied (new) 2024/05/06 06:08:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2/file4.txt] 2024/05/06 06:08:03 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2/file5.txt] 2024/05/06 06:08:03 INFO : file2.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2/file6.txt] 2024/05/06 06:08:03 INFO : file3.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2/file7.txt] 2024/05/06 06:08:03 INFO : file4.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2/file8.txt] 2024/05/06 06:08:03 INFO : file5.txt: Copied (new) 2024/05/06 06:08:03 INFO : file6.txt: Copied (new) 2024/05/06 06:08:03 INFO : file7.txt: Copied (new) 2024/05/06 06:08:03 INFO : file8.txt: Copied (new) 2024/05/06 06:08:03 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/backupdir/path2] 2024/05/06 06:08:03 (01) : test backupdir 2024/05/06 06:08:03 (02) : test initial bisync 2024/05/06 06:08:03 (03) : bisync resync backupdir1=/tmp/060802gi/workdir/backupdirs/backupdir1 backupdir2=/tmp/060802gi/workdir/backupdirs/backupdir2 bisync_test.go:920: backupdir test currently only works on local (it uses the workdir) === RUN TestBisyncLocalRemote/basic 2024/05/06 06:08:03 DEBUG : Creating backend with remote "/tmp/060802gi/basic/path1" 2024/05/06 06:08:03 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:03 DEBUG : path2: Making directory 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:03 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2" 2024/05/06 06:08:03 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:03 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:03 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:03 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:03 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:03 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:03 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2" 2024/05/06 06:08:03 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_basic-sufozeh7" 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:03 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:03 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:03 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.copy2.txt.nukoquy1.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:03 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/initdir/test_basic-sufozeh7: Waiting for checks to finish 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/initdir/test_basic-sufozeh7: Waiting for transfers to finish 2024/05/06 06:08:03 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.copy4.txt.zuxewin2.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:03 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:03 DEBUG : file1.copy3.txt.pivoluc0.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:03 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : RCLONE_TEST.feloqis0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:03 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:03 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.copy5.txt.tiyirif7.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:03 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.copy1.txt.menaros4.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:03 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file1.txt.muwuxex5.partial: renamed to: file1.txt 2024/05/06 06:08:03 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 INFO : file1.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : subdir/file20.txt.baneyif3.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:03 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:03 INFO : subdir: Updated directory metadata 2024/05/06 06:08:03 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_basic-yozaxev3" 2024/05/06 06:08:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/datadir/test_basic-yozaxev3: Waiting for checks to finish 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/datadir/test_basic-yozaxev3: Waiting for transfers to finish 2024/05/06 06:08:03 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:03 DEBUG : file1.txt.cilecuw8.partial: renamed to: file1.txt 2024/05/06 06:08:03 INFO : file1.txt: Copied (new) 2024/05/06 06:08:03 ERROR : : error listing: directory not found 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2] 2024/05/06 06:08:03 ERROR : : error listing: directory not found 2024/05/06 06:08:03 checking initFs Local file system at /tmp/060802gi/initdir/test_basic-sufozeh7 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:03 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:03 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:03 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/basic/path1: Waiting for checks to finish 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/basic/path1: Waiting for transfers to finish 2024/05/06 06:08:03 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.copy1.txt.teteday1.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:03 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file1.copy2.txt.yereyas0.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:03 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.copy4.txt.lexovez1.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:03 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.copy3.txt.rewubef9.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:03 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.txt.mitanij6.partial: renamed to: file1.txt 2024/05/06 06:08:03 INFO : file1.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file1.copy5.txt.qosipop5.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:03 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : subdir/file20.txt.kalacox2.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:03 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:03 DEBUG : RCLONE_TEST.qiguxep5.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:03 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:03 INFO : subdir: Updated directory metadata 2024/05/06 06:08:03 checking Path1 Local file system at /tmp/060802gi/basic/path1 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2] 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : subdir: Making directory 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/subdir] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/file1.copy1.txt] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/file1.copy2.txt] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/file1.copy3.txt] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/RCLONE_TEST] 2024/05/06 06:08:03 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: Waiting for checks to finish 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: Waiting for transfers to finish 2024/05/06 06:08:03 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/file1.copy4.txt] 2024/05/06 06:08:03 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/file1.copy5.txt] 2024/05/06 06:08:03 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/file1.txt] 2024/05/06 06:08:03 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/subdir/file20.txt] 2024/05/06 06:08:03 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:03 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:03 INFO : file1.txt: Copied (new) 2024/05/06 06:08:03 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:03 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/subdir] 2024/05/06 06:08:03 (01) : test basic 2024/05/06 06:08:03 (02) : test initial bisync 2024/05/06 06:08:03 (03) : bisync resync 2024/05/06 06:08:03 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:03 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:03 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:03 INFO : Synching Path1 "/tmp/060802gi/basic/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/" 2024/05/06 06:08:03 INFO : Copying Path2 files to Path1 2024/05/06 06:08:03 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:03 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:03 INFO : Resync updating listings 2024/05/06 06:08:03 INFO : Validating listings for Path1 "/tmp/060802gi/basic/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/" 2024/05/06 06:08:03 INFO : Bisync successful 2024/05/06 06:08:03 (04) : test place newer files on both paths 2024/05/06 06:08:03 (05) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_basic-yozaxev3/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/ 2024/05/06 06:08:03 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:03 (06) : copy-as /tmp/060802gi/datadir/test_basic-yozaxev3/file1.txt /tmp/060802gi/basic/path1/subdir file20.txt 2024/05/06 06:08:03 INFO : file1.txt: Copied (replaced existing) to: file20.txt 2024/05/06 06:08:03 (07) : test bisync run 2024/05/06 06:08:03 (08) : bisync 2024/05/06 06:08:03 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:03 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:03 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:03 INFO : Synching Path1 "/tmp/060802gi/basic/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/" 2024/05/06 06:08:03 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:03 INFO : Path1 checking for diffs 2024/05/06 06:08:03 INFO : - Path1 File changed: size (larger), time (newer) - subdir/file20.txt 2024/05/06 06:08:03 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:03 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:03 INFO : Path2 checking for diffs 2024/05/06 06:08:03 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:03 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:03 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:03 INFO : Applying changes 2024/05/06 06:08:03 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/subdir/file20.txt 2024/05/06 06:08:03 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/basic/path1/file1.txt 2024/05/06 06:08:03 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:03 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:03 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:03 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:03 INFO : Updating listings 2024/05/06 06:08:03 INFO : Validating listings for Path1 "/tmp/060802gi/basic/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/basic/path2/" 2024/05/06 06:08:03 INFO : Bisync successful bisync_test.go:555: TEST basic PASSED === RUN TestBisyncLocalRemote/changes 2024/05/06 06:08:03 DEBUG : Creating backend with remote "/tmp/060802gi/changes/path1" 2024/05/06 06:08:03 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:03 DEBUG : path2: Making directory 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:03 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2" 2024/05/06 06:08:03 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:03 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:03 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:03 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:03 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:03 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:03 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2" 2024/05/06 06:08:03 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_changes-tuxiyes8" 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/initdir/test_changes-tuxiyes8: Waiting for checks to finish 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/initdir/test_changes-tuxiyes8: Waiting for transfers to finish 2024/05/06 06:08:03 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.txt.nafavit8.partial: renamed to: file1.txt 2024/05/06 06:08:03 INFO : file1.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file2.txt.digikuj9.partial: renamed to: file2.txt 2024/05/06 06:08:03 INFO : file2.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file3.txt.pimizux2.partial: renamed to: file3.txt 2024/05/06 06:08:03 INFO : file3.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file5.txt.tixonig1.partial: renamed to: file5.txt 2024/05/06 06:08:03 INFO : file5.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:03 DEBUG : RCLONE_TEST.rovicat5.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:03 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:03 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file6.txt.riqavak8.partial: renamed to: file6.txt 2024/05/06 06:08:03 INFO : file6.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file8.txt.buhivib0.partial: renamed to: file8.txt 2024/05/06 06:08:03 DEBUG : file4.txt.lunenor0.partial: renamed to: file4.txt 2024/05/06 06:08:03 INFO : file8.txt: Copied (new) 2024/05/06 06:08:03 INFO : file4.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file7.txt.manafil1.partial: renamed to: file7.txt 2024/05/06 06:08:03 INFO : file7.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_changes-zoteluj8" 2024/05/06 06:08:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/datadir/test_changes-zoteluj8: Waiting for checks to finish 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/datadir/test_changes-zoteluj8: Waiting for transfers to finish 2024/05/06 06:08:03 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:03 DEBUG : file10.txt.dazupam9.partial: renamed to: file10.txt 2024/05/06 06:08:03 INFO : file10.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:03 DEBUG : file2.txt.juwopuf3.partial: renamed to: file2.txt 2024/05/06 06:08:03 INFO : file2.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:03 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:03 DEBUG : file1.txt.fibowak7.partial: renamed to: file1.txt 2024/05/06 06:08:03 INFO : file1.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file11.txt.rucomib8.partial: renamed to: file11.txt 2024/05/06 06:08:03 INFO : file11.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:03 DEBUG : file5L.txt.famuxek6.partial: renamed to: file5L.txt 2024/05/06 06:08:03 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:03 DEBUG : file5R.txt.mubabub7.partial: renamed to: file5R.txt 2024/05/06 06:08:03 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:03 DEBUG : file6.txt.tenonuf2.partial: renamed to: file6.txt 2024/05/06 06:08:03 INFO : file6.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:03 DEBUG : file7.txt.dadebos0.partial: renamed to: file7.txt 2024/05/06 06:08:03 INFO : file7.txt: Copied (new) 2024/05/06 06:08:03 ERROR : : error listing: directory not found 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2] 2024/05/06 06:08:03 ERROR : : error listing: directory not found 2024/05/06 06:08:03 checking initFs Local file system at /tmp/060802gi/initdir/test_changes-tuxiyes8 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/changes/path1: Waiting for checks to finish 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/changes/path1: Waiting for transfers to finish 2024/05/06 06:08:03 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.txt.zijiwin5.partial: renamed to: file1.txt 2024/05/06 06:08:03 INFO : file1.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:03 DEBUG : file2.txt.nejacoq3.partial: renamed to: file2.txt 2024/05/06 06:08:03 INFO : file2.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file3.txt.zopecev9.partial: renamed to: file3.txt 2024/05/06 06:08:03 INFO : file3.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : RCLONE_TEST.qoyapur6.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:03 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:03 DEBUG : file5.txt.zinurih7.partial: renamed to: file5.txt 2024/05/06 06:08:03 INFO : file5.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file4.txt.wikajij3.partial: renamed to: file4.txt 2024/05/06 06:08:03 INFO : file4.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file8.txt.jesejir7.partial: renamed to: file8.txt 2024/05/06 06:08:03 INFO : file8.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file6.txt.suqaceq7.partial: renamed to: file6.txt 2024/05/06 06:08:03 INFO : file6.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file7.txt.matiwik8.partial: renamed to: file7.txt 2024/05/06 06:08:03 INFO : file7.txt: Copied (new) 2024/05/06 06:08:03 checking Path1 Local file system at /tmp/060802gi/changes/path1 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2] 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/RCLONE_TEST] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file3.txt] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file1.txt] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file2.txt] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: Waiting for checks to finish 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: Waiting for transfers to finish 2024/05/06 06:08:03 INFO : file3.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file4.txt] 2024/05/06 06:08:03 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file5.txt] 2024/05/06 06:08:03 INFO : file1.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file6.txt] 2024/05/06 06:08:03 INFO : file2.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file7.txt] 2024/05/06 06:08:03 INFO : file4.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file8.txt] 2024/05/06 06:08:03 INFO : file5.txt: Copied (new) 2024/05/06 06:08:03 INFO : file6.txt: Copied (new) 2024/05/06 06:08:03 INFO : file7.txt: Copied (new) 2024/05/06 06:08:03 INFO : file8.txt: Copied (new) 2024/05/06 06:08:03 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2] 2024/05/06 06:08:03 (01) : test changes 2024/05/06 06:08:03 (02) : test initial bisync 2024/05/06 06:08:03 (03) : bisync resync 2024/05/06 06:08:03 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:03 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:03 INFO : Synching Path1 "/tmp/060802gi/changes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/" 2024/05/06 06:08:03 INFO : Copying Path2 files to Path1 2024/05/06 06:08:03 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:03 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:03 INFO : Resync updating listings 2024/05/06 06:08:03 INFO : Validating listings for Path1 "/tmp/060802gi/changes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/" 2024/05/06 06:08:03 INFO : Bisync successful 2024/05/06 06:08:03 (04) : test make modifications on both paths 2024/05/06 06:08:03 (05) : test new on path2 - file10 2024/05/06 06:08:03 (06) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_changes-zoteluj8/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/ 2024/05/06 06:08:03 INFO : file10.txt: Copied (new) 2024/05/06 06:08:03 (07) : test newer on path2 - file1 2024/05/06 06:08:03 (08) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_changes-zoteluj8/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/ 2024/05/06 06:08:03 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:03 (09) : test new on path1 - file11 2024/05/06 06:08:03 (10) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_changes-zoteluj8/file11.txt /tmp/060802gi/changes/path1/ 2024/05/06 06:08:03 INFO : file11.txt: Copied (new) 2024/05/06 06:08:03 (11) : test newer on path1 - file2 2024/05/06 06:08:03 (12) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_changes-zoteluj8/file2.txt /tmp/060802gi/changes/path1/ 2024/05/06 06:08:03 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:03 (13) : test deleted on path2 - file3 2024/05/06 06:08:03 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file3.txt 2024/05/06 06:08:03 INFO : file3.txt: Deleted 2024/05/06 06:08:03 (15) : test deleted on path1 - file4 2024/05/06 06:08:03 (16) : delete-file /tmp/060802gi/changes/path1/file4.txt 2024/05/06 06:08:03 INFO : file4.txt: Deleted 2024/05/06 06:08:03 (17) : test deleted on both paths - file8 2024/05/06 06:08:03 (18) : delete-file /tmp/060802gi/changes/path1/file8.txt 2024/05/06 06:08:03 INFO : file8.txt: Deleted 2024/05/06 06:08:03 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file8.txt 2024/05/06 06:08:03 INFO : file8.txt: Deleted 2024/05/06 06:08:03 (20) : test changed on both paths - file5 (file5R, file5L) 2024/05/06 06:08:03 (21) : touch-glob 2001-01-02 /tmp/060802gi/datadir/test_changes-zoteluj8/ file5R.txt 2024/05/06 06:08:03 (22) : copy-as /tmp/060802gi/datadir/test_changes-zoteluj8/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/ file5.txt 2024/05/06 06:08:03 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:03 (23) : touch-glob 2001-03-04 /tmp/060802gi/datadir/test_changes-zoteluj8/ file5L.txt 2024/05/06 06:08:03 (24) : copy-as /tmp/060802gi/datadir/test_changes-zoteluj8/file5L.txt /tmp/060802gi/changes/path1/ file5.txt 2024/05/06 06:08:03 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:03 (25) : test newer on path2 and deleted on path1 - file6 2024/05/06 06:08:03 (26) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_changes-zoteluj8/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/ 2024/05/06 06:08:03 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:08:03 (27) : delete-file /tmp/060802gi/changes/path1/file6.txt 2024/05/06 06:08:03 INFO : file6.txt: Deleted 2024/05/06 06:08:03 (28) : test newer on path1 and deleted on path2 - file7 2024/05/06 06:08:03 (29) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_changes-zoteluj8/file7.txt /tmp/060802gi/changes/path1/ 2024/05/06 06:08:03 INFO : file7.txt: Copied (replaced existing) 2024/05/06 06:08:03 (30) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file7.txt 2024/05/06 06:08:03 INFO : file7.txt: Deleted 2024/05/06 06:08:03 (31) : test bisync run 2024/05/06 06:08:03 (32) : bisync 2024/05/06 06:08:03 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:03 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:03 INFO : Synching Path1 "/tmp/060802gi/changes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/" 2024/05/06 06:08:03 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:03 INFO : Path1 checking for diffs 2024/05/06 06:08:03 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:03 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:08:03 INFO : - Path1 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:08:03 INFO : - Path1 File was deleted - file6.txt 2024/05/06 06:08:03 INFO : - Path1 File changed: size (larger), time (newer) - file7.txt 2024/05/06 06:08:03 INFO : - Path1 File was deleted - file8.txt 2024/05/06 06:08:03 INFO : - Path1 File is new - file11.txt 2024/05/06 06:08:03 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:08:03 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:08:03 INFO : Path2 checking for diffs 2024/05/06 06:08:03 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:03 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:08:03 INFO : - Path2 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:08:03 INFO : - Path2 File changed: size (larger), time (newer) - file6.txt 2024/05/06 06:08:03 INFO : - Path2 File was deleted - file7.txt 2024/05/06 06:08:03 INFO : - Path2 File was deleted - file8.txt 2024/05/06 06:08:03 INFO : - Path2 File is new - file10.txt 2024/05/06 06:08:03 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:08:03 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:08:03 INFO : Applying changes 2024/05/06 06:08:03 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:03 INFO : Checking potential conflicts... 2024/05/06 06:08:03 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: 1 differences found 2024/05/06 06:08:03 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2: 1 errors while checking 2024/05/06 06:08:03 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:03 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file11.txt 2024/05/06 06:08:03 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file2.txt 2024/05/06 06:08:03 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file4.txt 2024/05/06 06:08:03 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:08:03 NOTICE: - Path1 Renaming Path1 copy - /tmp/060802gi/changes/path1/file5.txt.conflict1 2024/05/06 06:08:03 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/05/06 06:08:03 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file5.txt.conflict1 2024/05/06 06:08:03 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file5.txt.conflict2 2024/05/06 06:08:03 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/05/06 06:08:03 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/changes/path1/file5.txt.conflict2 2024/05/06 06:08:03 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/changes/path1/file6.txt 2024/05/06 06:08:03 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/file7.txt 2024/05/06 06:08:03 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/changes/path1/file1.txt 2024/05/06 06:08:03 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/changes/path1/file10.txt 2024/05/06 06:08:03 INFO : - Path1 Queue delete - /tmp/060802gi/changes/path1/file3.txt 2024/05/06 06:08:03 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:03 INFO : file10.txt: Copied (new) 2024/05/06 06:08:03 INFO : file6.txt: Copied (new) 2024/05/06 06:08:03 INFO : file5.txt.conflict2: Copied (new) 2024/05/06 06:08:03 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:03 INFO : file3.txt: Deleted 2024/05/06 06:08:03 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:03 INFO : file11.txt: Copied (new) 2024/05/06 06:08:03 INFO : file5.txt.conflict1: Copied (new) 2024/05/06 06:08:03 INFO : file7.txt: Copied (new) 2024/05/06 06:08:03 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:03 INFO : file4.txt: Deleted 2024/05/06 06:08:03 INFO : Updating listings 2024/05/06 06:08:03 INFO : Validating listings for Path1 "/tmp/060802gi/changes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/changes/path2/" 2024/05/06 06:08:03 INFO : Bisync successful bisync_test.go:555: TEST changes PASSED === RUN TestBisyncLocalRemote/check_access 2024/05/06 06:08:03 DEBUG : Creating backend with remote "/tmp/060802gi/check_access/path1" 2024/05/06 06:08:03 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:03 DEBUG : path2: Making directory 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:03 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2" 2024/05/06 06:08:03 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:03 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:03 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:03 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:03 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:03 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:03 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2" 2024/05/06 06:08:03 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_check_access-tinucaf7" 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:03 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:03 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:03 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file3.txt.vilakat2.partial: renamed to: file3.txt 2024/05/06 06:08:03 INFO : file3.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file4.txt.puficuk4.partial: renamed to: file4.txt 2024/05/06 06:08:03 INFO : file4.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/initdir/test_check_access-tinucaf7: Waiting for checks to finish 2024/05/06 06:08:03 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file2.txt.guxubew3.partial: renamed to: file2.txt 2024/05/06 06:08:03 INFO : file2.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:03 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:03 DEBUG : RCLONE_TEST.xiniran5.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:03 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:03 DEBUG : subdir/RCLONE_TEST.zuzuxeb2.partial: renamed to: subdir/RCLONE_TEST 2024/05/06 06:08:03 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/initdir/test_check_access-tinucaf7: Waiting for transfers to finish 2024/05/06 06:08:03 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : subdir/file20.txt.widedew9.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:03 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.txt.tonaqoy6.partial: renamed to: file1.txt 2024/05/06 06:08:03 INFO : file1.txt: Copied (new) 2024/05/06 06:08:03 INFO : subdir: Updated directory metadata 2024/05/06 06:08:03 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_check_access-gizequz5" 2024/05/06 06:08:03 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/datadir/test_check_access-gizequz5: Waiting for checks to finish 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/datadir/test_check_access-gizequz5: Waiting for transfers to finish 2024/05/06 06:08:03 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:08:03 DEBUG : hold.txt.xevebak7.partial: renamed to: hold.txt 2024/05/06 06:08:03 INFO : hold.txt: Copied (new) 2024/05/06 06:08:03 ERROR : : error listing: directory not found 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2] 2024/05/06 06:08:03 ERROR : : error listing: directory not found 2024/05/06 06:08:03 checking initFs Local file system at /tmp/060802gi/initdir/test_check_access-tinucaf7 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:03 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:03 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:03 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/check_access/path1: Waiting for checks to finish 2024/05/06 06:08:03 DEBUG : Local file system at /tmp/060802gi/check_access/path1: Waiting for transfers to finish 2024/05/06 06:08:03 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file3.txt.tanofip9.partial: renamed to: file3.txt 2024/05/06 06:08:03 INFO : file3.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file1.txt.tirodaj1.partial: renamed to: file1.txt 2024/05/06 06:08:03 INFO : file1.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file2.txt.yusegic3.partial: renamed to: file2.txt 2024/05/06 06:08:03 INFO : file2.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:03 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : RCLONE_TEST.qugojet0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:03 DEBUG : subdir/file20.txt.bociket0.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:03 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:03 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:03 DEBUG : file4.txt.sujexix2.partial: renamed to: file4.txt 2024/05/06 06:08:03 INFO : file4.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:03 DEBUG : subdir/RCLONE_TEST.kezuxeq2.partial: renamed to: subdir/RCLONE_TEST 2024/05/06 06:08:03 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:03 INFO : subdir: Updated directory metadata 2024/05/06 06:08:03 checking Path1 Local file system at /tmp/060802gi/check_access/path1 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2] 2024/05/06 06:08:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : subdir: Making directory 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/subdir] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/RCLONE_TEST] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/file1.txt] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/file3.txt] 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/file2.txt] 2024/05/06 06:08:03 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: Waiting for checks to finish 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: Waiting for transfers to finish 2024/05/06 06:08:03 INFO : file1.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/file4.txt] 2024/05/06 06:08:03 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/subdir/RCLONE_TEST] 2024/05/06 06:08:03 INFO : file3.txt: Copied (new) 2024/05/06 06:08:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/subdir/file20.txt] 2024/05/06 06:08:04 INFO : file2.txt: Copied (new) 2024/05/06 06:08:04 INFO : file4.txt: Copied (new) 2024/05/06 06:08:04 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:04 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2] 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/subdir] 2024/05/06 06:08:04 (01) : test check-access 2024/05/06 06:08:04 (02) : test initial bisync 2024/05/06 06:08:04 (03) : bisync resync 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Copying Path2 files to Path1 2024/05/06 06:08:04 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:04 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:04 INFO : Resync updating listings 2024/05/06 06:08:04 INFO : Validating listings for Path1 "/tmp/060802gi/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Bisync successful 2024/05/06 06:08:04 (04) : test 1. see that check-access passes with the initial setup 2024/05/06 06:08:04 (05) : bisync check-access 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:04 INFO : Path1 checking for diffs 2024/05/06 06:08:04 INFO : Path2 checking for diffs 2024/05/06 06:08:04 INFO : Checking access health 2024/05/06 06:08:04 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:04 INFO : No changes found 2024/05/06 06:08:04 INFO : Updating listings 2024/05/06 06:08:04 INFO : Validating listings for Path1 "/tmp/060802gi/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Bisync successful 2024/05/06 06:08:04 (06) : test 2. delete the path2 subdir RCLONE_TEST and run sync. should fail critical. 2024/05/06 06:08:04 (07) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/subdir/RCLONE_TEST 2024/05/06 06:08:04 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:04 (08) : bisync check-access 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:04 INFO : Path1 checking for diffs 2024/05/06 06:08:04 INFO : Path2 checking for diffs 2024/05/06 06:08:04 INFO : - Path2 File was deleted - subdir/RCLONE_TEST 2024/05/06 06:08:04 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:04 INFO : Checking access health 2024/05/06 06:08:04 ERROR : Access test failed: Path1 count 2, Path2 count 1 - RCLONE_TEST 2024/05/06 06:08:04 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/RCLONE_TEST 2024/05/06 06:08:04 ERROR : Bisync critical error: check file check failed 2024/05/06 06:08:04 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:04 Bisync error: bisync aborted 2024/05/06 06:08:04 (09) : copy-listings path2-missing 2024/05/06 06:08:04 (10) : test 3. put the path2 subdir RCLONE_TEST back, resync. 2024/05/06 06:08:04 (11) : copy-file /tmp/060802gi/check_access/path1/subdir/RCLONE_TEST TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/ 2024/05/06 06:08:04 (12) : bisync resync 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Copying Path2 files to Path1 2024/05/06 06:08:04 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:04 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:04 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 INFO : Resync updating listings 2024/05/06 06:08:04 INFO : Validating listings for Path1 "/tmp/060802gi/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Bisync successful 2024/05/06 06:08:04 (13) : test 4. run sync with check-access. should pass. 2024/05/06 06:08:04 (14) : bisync check-access 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:04 INFO : Path1 checking for diffs 2024/05/06 06:08:04 INFO : Path2 checking for diffs 2024/05/06 06:08:04 INFO : Checking access health 2024/05/06 06:08:04 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:04 INFO : No changes found 2024/05/06 06:08:04 INFO : Updating listings 2024/05/06 06:08:04 INFO : Validating listings for Path1 "/tmp/060802gi/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Bisync successful 2024/05/06 06:08:04 (15) : test 5. delete path1 top level RCLONE_TEST, run sync. should fail critical. 2024/05/06 06:08:04 (16) : delete-file /tmp/060802gi/check_access/path1/RCLONE_TEST 2024/05/06 06:08:04 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:04 (17) : bisync check-access 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:04 INFO : Path1 checking for diffs 2024/05/06 06:08:04 INFO : - Path1 File was deleted - RCLONE_TEST 2024/05/06 06:08:04 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:04 INFO : Path2 checking for diffs 2024/05/06 06:08:04 INFO : Checking access health 2024/05/06 06:08:04 ERROR : Access test failed: Path1 count 1, Path2 count 2 - RCLONE_TEST 2024/05/06 06:08:04 ERROR : -  Access test failed: Path2 file not found in Path1 - RCLONE_TEST 2024/05/06 06:08:04 ERROR : Bisync critical error: check file check failed 2024/05/06 06:08:04 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:04 Bisync error: bisync aborted 2024/05/06 06:08:04 (18) : copy-listings path1-missing 2024/05/06 06:08:04 (19) : test 6. run again. should fail critical due to missing listings. 2024/05/06 06:08:04 (20) : bisync check-access 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/060802gi/workdir/tmp_060802gi_check_access_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_check_access_path2.path1.lst Path2: /tmp/060802gi/workdir/tmp_060802gi_check_access_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_check_access_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/060802gi/workdir" 2024/05/06 06:08:04 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:04 Bisync error: bisync aborted 2024/05/06 06:08:04 (21) : move-listings missing-listings 2024/05/06 06:08:04 (22) : test 7. run resync, which will copy the path2 top level back to path1. 2024/05/06 06:08:04 (23) : bisync resync 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Copying Path2 files to Path1 2024/05/06 06:08:04 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:04 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:04 INFO : Resync updating listings 2024/05/06 06:08:04 INFO : Validating listings for Path1 "/tmp/060802gi/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Bisync successful 2024/05/06 06:08:04 (24) : test 8. run sync with --check-access. should pass. 2024/05/06 06:08:04 (25) : bisync check-access 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:04 INFO : Path1 checking for diffs 2024/05/06 06:08:04 INFO : Path2 checking for diffs 2024/05/06 06:08:04 INFO : Checking access health 2024/05/06 06:08:04 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:04 INFO : No changes found 2024/05/06 06:08:04 INFO : Updating listings 2024/05/06 06:08:04 INFO : Validating listings for Path1 "/tmp/060802gi/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access/path2/" 2024/05/06 06:08:04 INFO : Bisync successful bisync_test.go:555: TEST check_access PASSED === RUN TestBisyncLocalRemote/check_access_filters 2024/05/06 06:08:04 DEBUG : Creating backend with remote "/tmp/060802gi/check_access_filters/path1" 2024/05/06 06:08:04 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:04 DEBUG : path2: Making directory 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:04 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2" 2024/05/06 06:08:04 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:04 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:04 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2" 2024/05/06 06:08:04 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_check_access_filters-murugel4" 2024/05/06 06:08:04 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:04 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:04 DEBUG : subdir-not: Making directory with metadata 2024/05/06 06:08:04 INFO : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not 2024/05/06 06:08:04 DEBUG : subdirX: Making directory with metadata 2024/05/06 06:08:04 INFO : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdirX", newDst=subdirX 2024/05/06 06:08:04 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1: Making directory with metadata 2024/05/06 06:08:04 INFO : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/subdirA: Making directory with metadata 2024/05/06 06:08:04 DEBUG : file1.txt.zuvahut9.partial: renamed to: file1.txt 2024/05/06 06:08:04 INFO : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA 2024/05/06 06:08:04 DEBUG : subdir/subdirB: Making directory with metadata 2024/05/06 06:08:04 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 INFO : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB 2024/05/06 06:08:04 DEBUG : file3.txt.fatawax8.partial: renamed to: file3.txt 2024/05/06 06:08:04 INFO : file3.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 INFO : file1.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : file2.txt.dixomuj0.partial: renamed to: file2.txt 2024/05/06 06:08:04 INFO : file2.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : RCLONE_TEST.qesocuy4.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:04 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : file4.txt.turuhiq1.partial: renamed to: file4.txt 2024/05/06 06:08:04 INFO : file4.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2: Making directory with metadata 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2 2024/05/06 06:08:04 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdirX/file20.txt.ciserif6.partial: renamed to: subdirX/file20.txt 2024/05/06 06:08:04 INFO : subdirX/file20.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/RCLONE_TEST.zukokam4.partial: renamed to: subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:08:04 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/file30.txt.bilevup8.partial: renamed to: subdirX/subdirX1/file30.txt 2024/05/06 06:08:04 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdirX/RCLONE_TEST.gopojal0.partial: renamed to: subdirX/RCLONE_TEST 2024/05/06 06:08:04 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir/file20.txt.fuzoquz1.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:04 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir/subdirB/file30.txt.zosubor8.partial: renamed to: subdir/subdirB/file30.txt 2024/05/06 06:08:04 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir/RCLONE_TEST.tujemov5.partial: renamed to: subdir/RCLONE_TEST 2024/05/06 06:08:04 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir-not/file20.txt.bupedut2.partial: renamed to: subdir-not/file20.txt 2024/05/06 06:08:04 INFO : subdir-not/file20.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : Local file system at /tmp/060802gi/initdir/test_check_access_filters-murugel4: Waiting for checks to finish 2024/05/06 06:08:04 DEBUG : Local file system at /tmp/060802gi/initdir/test_check_access_filters-murugel4: Waiting for transfers to finish 2024/05/06 06:08:04 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdir/subdirB/RCLONE_TEST.dahilej3.partial: renamed to: subdir/subdirB/RCLONE_TEST 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/file30.txt.divuyoj2.partial: renamed to: subdir-not/subdir-not2/file30.txt 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.fomedod4.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdir-not/RCLONE_TEST.vugafak0.partial: renamed to: subdir-not/RCLONE_TEST 2024/05/06 06:08:04 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir/subdirA/RCLONE_TEST.bozozaj5.partial: renamed to: subdir/subdirA/RCLONE_TEST 2024/05/06 06:08:04 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/subdirA/file30.txt.dekomab4.partial: renamed to: subdir/subdirA/file30.txt 2024/05/06 06:08:04 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2: Updated directory metadata 2024/05/06 06:08:04 INFO : subdir/subdirA: Updated directory metadata 2024/05/06 06:08:04 INFO : subdirX/subdirX1: Updated directory metadata 2024/05/06 06:08:04 INFO : subdir/subdirB: Updated directory metadata 2024/05/06 06:08:04 INFO : subdir-not: Updated directory metadata 2024/05/06 06:08:04 INFO : subdirX: Updated directory metadata 2024/05/06 06:08:04 INFO : subdir: Updated directory metadata 2024/05/06 06:08:04 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_check_access_filters-pogozur4" 2024/05/06 06:08:04 DEBUG : exclude-other-filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : include-other-filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : Local file system at /tmp/060802gi/datadir/test_check_access_filters-pogozur4: Waiting for checks to finish 2024/05/06 06:08:04 DEBUG : Local file system at /tmp/060802gi/datadir/test_check_access_filters-pogozur4: Waiting for transfers to finish 2024/05/06 06:08:04 DEBUG : exclude-other-filtersfile.txt: md5 = 5fcc6205d7df1c2e9ed3a15a1356b345 OK 2024/05/06 06:08:04 DEBUG : exclude-other-filtersfile.txt.kaqilir7.partial: renamed to: exclude-other-filtersfile.txt 2024/05/06 06:08:04 INFO : exclude-other-filtersfile.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : include-other-filtersfile.txt: md5 = 2ec13b2813141ed088e5978ef5a47b0e OK 2024/05/06 06:08:04 DEBUG : include-other-filtersfile.txt.giboxey9.partial: renamed to: include-other-filtersfile.txt 2024/05/06 06:08:04 INFO : include-other-filtersfile.txt: Copied (new) 2024/05/06 06:08:04 ERROR : : error listing: directory not found 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2] 2024/05/06 06:08:04 ERROR : : error listing: directory not found 2024/05/06 06:08:04 checking initFs Local file system at /tmp/060802gi/initdir/test_check_access_filters-murugel4 2024/05/06 06:08:04 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:04 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:04 DEBUG : subdir-not: Making directory with metadata 2024/05/06 06:08:04 INFO : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not 2024/05/06 06:08:04 DEBUG : subdirX: Making directory with metadata 2024/05/06 06:08:04 INFO : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdirX", newDst=subdirX 2024/05/06 06:08:04 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1: Making directory with metadata 2024/05/06 06:08:04 DEBUG : file1.txt.bonidav9.partial: renamed to: file1.txt 2024/05/06 06:08:04 INFO : file1.txt: Copied (new) 2024/05/06 06:08:04 INFO : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file3.txt.piqasuy6.partial: renamed to: file3.txt 2024/05/06 06:08:04 INFO : file3.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/subdirA: Making directory with metadata 2024/05/06 06:08:04 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 INFO : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA 2024/05/06 06:08:04 DEBUG : subdir/subdirB: Making directory with metadata 2024/05/06 06:08:04 DEBUG : file4.txt.badecex9.partial: renamed to: file4.txt 2024/05/06 06:08:04 INFO : file4.txt: Copied (new) 2024/05/06 06:08:04 INFO : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB 2024/05/06 06:08:04 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2: Making directory with metadata 2024/05/06 06:08:04 DEBUG : subdirX/RCLONE_TEST.lamewaq9.partial: renamed to: subdirX/RCLONE_TEST 2024/05/06 06:08:04 DEBUG : file2.txt.caxuced8.partial: renamed to: file2.txt 2024/05/06 06:08:04 INFO : file2.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : RCLONE_TEST.kuviril9.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:04 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : subdirX/file20.txt.comogeq7.partial: renamed to: subdirX/file20.txt 2024/05/06 06:08:04 INFO : subdirX/file20.txt: Copied (new) 2024/05/06 06:08:04 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:04 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/file30.txt.yiyirid7.partial: renamed to: subdirX/subdirX1/file30.txt 2024/05/06 06:08:04 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : Local file system at /tmp/060802gi/check_access_filters/path1: Waiting for checks to finish 2024/05/06 06:08:04 DEBUG : Local file system at /tmp/060802gi/check_access_filters/path1: Waiting for transfers to finish 2024/05/06 06:08:04 DEBUG : subdir/file20.txt.xixeyoh1.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:04 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdir/RCLONE_TEST.juwunoj8.partial: renamed to: subdir/RCLONE_TEST 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/RCLONE_TEST.tominiq2.partial: renamed to: subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:08:04 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir/subdirA/file30.txt.futeliz4.partial: renamed to: subdir/subdirA/file30.txt 2024/05/06 06:08:04 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/subdirB/file30.txt.kupoxux0.partial: renamed to: subdir/subdirB/file30.txt 2024/05/06 06:08:04 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/subdirB/RCLONE_TEST.faseqih9.partial: renamed to: subdir/subdirB/RCLONE_TEST 2024/05/06 06:08:04 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdir-not/RCLONE_TEST.yoroqos9.partial: renamed to: subdir-not/RCLONE_TEST 2024/05/06 06:08:04 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/file30.txt.welemar2.partial: renamed to: subdir-not/subdir-not2/file30.txt 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir/subdirA/RCLONE_TEST.sebiwin0.partial: renamed to: subdir/subdirA/RCLONE_TEST 2024/05/06 06:08:04 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:04 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:04 DEBUG : subdir-not/file20.txt.geropal2.partial: renamed to: subdir-not/file20.txt 2024/05/06 06:08:04 INFO : subdir-not/file20.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.nirapev4.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2: Updated directory metadata 2024/05/06 06:08:04 INFO : subdirX/subdirX1: Updated directory metadata 2024/05/06 06:08:04 INFO : subdir/subdirA: Updated directory metadata 2024/05/06 06:08:04 INFO : subdir/subdirB: Updated directory metadata 2024/05/06 06:08:04 INFO : subdirX: Updated directory metadata 2024/05/06 06:08:04 INFO : subdir: Updated directory metadata 2024/05/06 06:08:04 INFO : subdir-not: Updated directory metadata 2024/05/06 06:08:04 checking Path1 Local file system at /tmp/060802gi/check_access_filters/path1 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2] 2024/05/06 06:08:04 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir: Making directory 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir] 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/file2.txt] 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/RCLONE_TEST] 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/file3.txt] 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/file1.txt] 2024/05/06 06:08:04 DEBUG : subdir-not: Making directory 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir-not] 2024/05/06 06:08:04 DEBUG : subdirX: Making directory 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdirX] 2024/05/06 06:08:04 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/subdirA: Making directory 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir/subdirA] 2024/05/06 06:08:04 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2: Making directory 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir-not/subdir-not2] 2024/05/06 06:08:04 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1: Making directory 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdirX/subdirX1] 2024/05/06 06:08:04 DEBUG : subdir/subdirB: Making directory 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir/subdirB] 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: Waiting for checks to finish 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: Waiting for transfers to finish 2024/05/06 06:08:04 INFO : file2.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/file4.txt] 2024/05/06 06:08:04 INFO : file3.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir/RCLONE_TEST] 2024/05/06 06:08:04 INFO : file1.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir/file20.txt] 2024/05/06 06:08:04 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir-not/RCLONE_TEST] 2024/05/06 06:08:04 INFO : file4.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir-not/file20.txt] 2024/05/06 06:08:04 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdirX/RCLONE_TEST] 2024/05/06 06:08:04 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdirX/file20.txt] 2024/05/06 06:08:04 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST] 2024/05/06 06:08:04 INFO : subdir-not/file20.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir-not/subdir-not2/file30.txt] 2024/05/06 06:08:04 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdirX/subdirX1/RCLONE_TEST] 2024/05/06 06:08:04 INFO : subdirX/file20.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdirX/subdirX1/file30.txt] 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir/subdirA/RCLONE_TEST] 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir/subdirA/file30.txt] 2024/05/06 06:08:04 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir/subdirB/RCLONE_TEST] 2024/05/06 06:08:04 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir/subdirB/file30.txt] 2024/05/06 06:08:04 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/05/06 06:08:04 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/05/06 06:08:04 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2] 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdirX] 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir] 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir-not] 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdirX/subdirX1] 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir/subdirB] 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir/subdirA] 2024/05/06 06:08:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir-not/subdir-not2] 2024/05/06 06:08:04 (01) : test check-access-filters 2024/05/06 06:08:04 (02) : test EXCLUDE - OTHER TESTS 2024/05/06 06:08:04 (03) : copy-file /tmp/060802gi/datadir/test_check_access_filters-pogozur4/exclude-other-filtersfile.txt /tmp/060802gi/workdir/ 2024/05/06 06:08:04 INFO : exclude-other-filtersfile.txt: Copied (new) 2024/05/06 06:08:04 (04) : test resync to get the filters file md5 built. 2024/05/06 06:08:04 (05) : bisync resync filters-file=/tmp/060802gi/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:04 INFO : Using filters file /tmp/060802gi/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:04 INFO : Storing filters file hash to /tmp/060802gi/workdir/exclude-other-filtersfile.txt.md5 2024/05/06 06:08:04 INFO : Copying Path2 files to Path1 2024/05/06 06:08:04 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:04 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:04 INFO : Resync updating listings 2024/05/06 06:08:04 INFO : Validating listings for Path1 "/tmp/060802gi/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:04 INFO : Bisync successful 2024/05/06 06:08:04 (06) : test EXCLUDE - test filters for check access 2024/05/06 06:08:04 (07) : bisync check-access filters-file=/tmp/060802gi/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:04 INFO : Using filters file /tmp/060802gi/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:04 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:04 INFO : Path1 checking for diffs 2024/05/06 06:08:04 INFO : Path2 checking for diffs 2024/05/06 06:08:04 INFO : Checking access health 2024/05/06 06:08:04 INFO : Found 3 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:04 INFO : No changes found 2024/05/06 06:08:04 INFO : Updating listings 2024/05/06 06:08:04 INFO : Validating listings for Path1 "/tmp/060802gi/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:04 INFO : Bisync successful 2024/05/06 06:08:04 (08) : copy-listings exclude-initial 2024/05/06 06:08:04 (09) : test EXCLUDE - delete RCLONE_TEST files in excluded directories 2024/05/06 06:08:04 (10) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir/subdirA/RCLONE_TEST 2024/05/06 06:08:04 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:04 (11) : delete-file /tmp/060802gi/check_access_filters/path1/subdir-not/RCLONE_TEST 2024/05/06 06:08:04 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:04 (12) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST 2024/05/06 06:08:04 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:04 (13) : delete-file /tmp/060802gi/check_access_filters/path1/subdirX/RCLONE_TEST 2024/05/06 06:08:04 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:04 (14) : test EXCLUDE - test should PASS 2024/05/06 06:08:04 (15) : bisync check-access filters-file=/tmp/060802gi/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:04 INFO : Using filters file /tmp/060802gi/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:04 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:04 INFO : Path1 checking for diffs 2024/05/06 06:08:04 INFO : Path2 checking for diffs 2024/05/06 06:08:04 INFO : Checking access health 2024/05/06 06:08:04 INFO : Found 3 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:04 INFO : No changes found 2024/05/06 06:08:04 INFO : Updating listings 2024/05/06 06:08:04 INFO : Validating listings for Path1 "/tmp/060802gi/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:04 INFO : Bisync successful 2024/05/06 06:08:04 (16) : copy-listings exclude-pass-run 2024/05/06 06:08:04 (17) : test EXCLUDE - delete RCLONE_TEST files in included directories 2024/05/06 06:08:04 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/RCLONE_TEST 2024/05/06 06:08:04 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:04 (19) : delete-file /tmp/060802gi/check_access_filters/path1/subdir/RCLONE_TEST 2024/05/06 06:08:04 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:04 (20) : test EXCLUDE - test should ABORT 2024/05/06 06:08:04 (21) : bisync check-access filters-file=/tmp/060802gi/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:04 INFO : Synching Path1 "/tmp/060802gi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:04 INFO : Using filters file /tmp/060802gi/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:04 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:04 INFO : Path1 checking for diffs 2024/05/06 06:08:04 INFO : - Path1 File was deleted - subdir/RCLONE_TEST 2024/05/06 06:08:04 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:04 INFO : Path2 checking for diffs 2024/05/06 06:08:04 INFO : - Path2 File was deleted - RCLONE_TEST 2024/05/06 06:08:04 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:04 INFO : Checking access health 2024/05/06 06:08:04 ERROR : -  Access test failed: Path1 file not found in Path2 - RCLONE_TEST 2024/05/06 06:08:04 ERROR : -  Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST 2024/05/06 06:08:04 ERROR : Bisync critical error: check file check failed 2024/05/06 06:08:04 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:04 Bisync error: bisync aborted 2024/05/06 06:08:04 (22) : move-listings exclude-error-run 2024/05/06 06:08:04 (23) : test INCLUDE - OTHER TESTS 2024/05/06 06:08:04 (24) : test reset to the initial state 2024/05/06 06:08:04 (25) : copy-dir /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/initial /tmp/060802gi/check_access_filters/path1/ 2024/05/06 06:08:04 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:08:04 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/05/06 06:08:04 INFO : subdirX: Updated directory metadata 2024/05/06 06:08:04 INFO : subdir-not: Updated directory metadata 2024/05/06 06:08:04 INFO : subdir: Updated directory metadata 2024/05/06 06:08:04 (26) : sync-dir /tmp/060802gi/check_access_filters/path1/ TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/ 2024/05/06 06:08:04 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/05/06 06:08:05 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:05 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/05/06 06:08:05 (27) : copy-file /tmp/060802gi/datadir/test_check_access_filters-pogozur4/include-other-filtersfile.txt /tmp/060802gi/workdir/ 2024/05/06 06:08:05 INFO : include-other-filtersfile.txt: Copied (new) 2024/05/06 06:08:05 (28) : bisync resync filters-file=/tmp/060802gi/workdir/include-other-filtersfile.txt 2024/05/06 06:08:05 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:05 INFO : Using filters file /tmp/060802gi/workdir/include-other-filtersfile.txt 2024/05/06 06:08:05 INFO : Storing filters file hash to /tmp/060802gi/workdir/include-other-filtersfile.txt.md5 2024/05/06 06:08:05 INFO : Copying Path2 files to Path1 2024/05/06 06:08:05 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:05 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:05 INFO : Resync updating listings 2024/05/06 06:08:05 INFO : Validating listings for Path1 "/tmp/060802gi/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:05 INFO : Bisync successful 2024/05/06 06:08:05 (29) : test INCLUDE - test include/exclude filters for check access 2024/05/06 06:08:05 (30) : bisync check-access filters-file=/tmp/060802gi/workdir/include-other-filtersfile.txt 2024/05/06 06:08:05 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:05 INFO : Using filters file /tmp/060802gi/workdir/include-other-filtersfile.txt 2024/05/06 06:08:05 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:05 INFO : Path1 checking for diffs 2024/05/06 06:08:05 INFO : Path2 checking for diffs 2024/05/06 06:08:05 INFO : Checking access health 2024/05/06 06:08:05 INFO : Found 5 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:05 INFO : No changes found 2024/05/06 06:08:05 INFO : Updating listings 2024/05/06 06:08:05 INFO : Validating listings for Path1 "/tmp/060802gi/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:05 INFO : Bisync successful 2024/05/06 06:08:05 (31) : copy-listings include-initial 2024/05/06 06:08:05 (32) : test INCLUDE - delete RCLONE_TEST files in excluded directories 2024/05/06 06:08:05 (33) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir/subdirA/RCLONE_TEST 2024/05/06 06:08:05 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:05 (34) : delete-file /tmp/060802gi/check_access_filters/path1/subdir-not/RCLONE_TEST 2024/05/06 06:08:05 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:05 (35) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST 2024/05/06 06:08:05 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:05 (36) : test INCLUDE - test should PASS 2024/05/06 06:08:05 (37) : bisync check-access filters-file=/tmp/060802gi/workdir/include-other-filtersfile.txt 2024/05/06 06:08:05 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:05 INFO : Using filters file /tmp/060802gi/workdir/include-other-filtersfile.txt 2024/05/06 06:08:05 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:05 INFO : Path1 checking for diffs 2024/05/06 06:08:05 INFO : Path2 checking for diffs 2024/05/06 06:08:05 INFO : Checking access health 2024/05/06 06:08:05 INFO : Found 5 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:05 INFO : No changes found 2024/05/06 06:08:05 INFO : Updating listings 2024/05/06 06:08:05 INFO : Validating listings for Path1 "/tmp/060802gi/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:05 INFO : Bisync successful 2024/05/06 06:08:05 (38) : copy-listings include-pass-run 2024/05/06 06:08:05 (39) : test INCLUDE - delete RCLONE_TEST files in included directories 2024/05/06 06:08:05 (40) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/RCLONE_TEST 2024/05/06 06:08:05 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:05 (41) : delete-file /tmp/060802gi/check_access_filters/path1/subdir/RCLONE_TEST 2024/05/06 06:08:05 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:05 (42) : delete-file /tmp/060802gi/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:08:05 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:05 (43) : test INCLUDE - test should ABORT 2024/05/06 06:08:05 (44) : bisync check-access filters-file=/tmp/060802gi/workdir/include-other-filtersfile.txt 2024/05/06 06:08:05 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir-not: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdirX: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdirX/subdirX1: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir/subdirA: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir/subdirB: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : subdir-not/subdir-not2: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_access_filters/path2/" 2024/05/06 06:08:05 INFO : Using filters file /tmp/060802gi/workdir/include-other-filtersfile.txt 2024/05/06 06:08:05 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:05 INFO : Path1 checking for diffs 2024/05/06 06:08:05 INFO : - Path1 File was deleted - subdir/RCLONE_TEST 2024/05/06 06:08:05 INFO : - Path1 File was deleted - subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:08:05 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2024/05/06 06:08:05 INFO : Path2 checking for diffs 2024/05/06 06:08:05 INFO : - Path2 File was deleted - RCLONE_TEST 2024/05/06 06:08:05 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:05 INFO : Checking access health 2024/05/06 06:08:05 ERROR : Access test failed: Path1 count 3, Path2 count 4 - RCLONE_TEST 2024/05/06 06:08:05 ERROR : -  Access test failed: Path1 file not found in Path2 - RCLONE_TEST 2024/05/06 06:08:05 ERROR : -  Access test failed: Path2 file not found in Path1 - subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:08:05 ERROR : -  Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST 2024/05/06 06:08:05 ERROR : Bisync critical error: check file check failed 2024/05/06 06:08:05 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:05 Bisync error: bisync aborted 2024/05/06 06:08:05 (45) : move-listings include-error-run bisync_test.go:555: TEST check_access_filters PASSED === RUN TestBisyncLocalRemote/check_filename 2024/05/06 06:08:05 DEBUG : Creating backend with remote "/tmp/060802gi/check_filename/path1" 2024/05/06 06:08:05 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:05 DEBUG : path2: Making directory 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:05 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2" 2024/05/06 06:08:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:05 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2" 2024/05/06 06:08:05 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_check_filename-cobahon3" 2024/05/06 06:08:05 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:05 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:05 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:05 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file1.txt.nabeqip1.partial: renamed to: file1.txt 2024/05/06 06:08:05 INFO : file1.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : Local file system at /tmp/060802gi/initdir/test_check_filename-cobahon3: Waiting for checks to finish 2024/05/06 06:08:05 DEBUG : Local file system at /tmp/060802gi/initdir/test_check_filename-cobahon3: Waiting for transfers to finish 2024/05/06 06:08:05 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file2.txt.recajot1.partial: renamed to: file2.txt 2024/05/06 06:08:05 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 INFO : file2.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file3.txt.tiwanuc9.partial: renamed to: file3.txt 2024/05/06 06:08:05 DEBUG : file4.txt.lotaqif6.partial: renamed to: file4.txt 2024/05/06 06:08:05 INFO : file3.txt: Copied (new) 2024/05/06 06:08:05 INFO : file4.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:05 DEBUG : .chk_file.bitaxux6.partial: renamed to: .chk_file 2024/05/06 06:08:05 INFO : .chk_file: Copied (new) 2024/05/06 06:08:05 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : subdir/file20.txt.qigoseq7.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:05 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:05 DEBUG : subdir/.chk_file.qiluyuf4.partial: renamed to: subdir/.chk_file 2024/05/06 06:08:05 INFO : subdir/.chk_file: Copied (new) 2024/05/06 06:08:05 INFO : subdir: Updated directory metadata 2024/05/06 06:08:05 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_check_filename-geteyub8" 2024/05/06 06:08:05 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : Local file system at /tmp/060802gi/datadir/test_check_filename-geteyub8: Waiting for checks to finish 2024/05/06 06:08:05 DEBUG : Local file system at /tmp/060802gi/datadir/test_check_filename-geteyub8: Waiting for transfers to finish 2024/05/06 06:08:05 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:08:05 DEBUG : hold.txt.xewiyem4.partial: renamed to: hold.txt 2024/05/06 06:08:05 INFO : hold.txt: Copied (new) 2024/05/06 06:08:05 ERROR : : error listing: directory not found 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2] 2024/05/06 06:08:05 ERROR : : error listing: directory not found 2024/05/06 06:08:05 checking initFs Local file system at /tmp/060802gi/initdir/test_check_filename-cobahon3 2024/05/06 06:08:05 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:05 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:05 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:05 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : Local file system at /tmp/060802gi/check_filename/path1: Waiting for checks to finish 2024/05/06 06:08:05 DEBUG : Local file system at /tmp/060802gi/check_filename/path1: Waiting for transfers to finish 2024/05/06 06:08:05 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file1.txt.decizil0.partial: renamed to: file1.txt 2024/05/06 06:08:05 INFO : file1.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file2.txt.nitafaz2.partial: renamed to: file2.txt 2024/05/06 06:08:05 INFO : file2.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:05 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : .chk_file.nihokek0.partial: renamed to: .chk_file 2024/05/06 06:08:05 INFO : .chk_file: Copied (new) 2024/05/06 06:08:05 DEBUG : file3.txt.qayosif8.partial: renamed to: file3.txt 2024/05/06 06:08:05 INFO : file3.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file4.txt.sosetam1.partial: renamed to: file4.txt 2024/05/06 06:08:05 INFO : file4.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:05 DEBUG : subdir/.chk_file.giqosox9.partial: renamed to: subdir/.chk_file 2024/05/06 06:08:05 INFO : subdir/.chk_file: Copied (new) 2024/05/06 06:08:05 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : subdir/file20.txt.voricep7.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:05 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:05 INFO : subdir: Updated directory metadata 2024/05/06 06:08:05 checking Path1 Local file system at /tmp/060802gi/check_filename/path1 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2] 2024/05/06 06:08:05 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : subdir: Making directory 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/subdir] 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/.chk_file] 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/file2.txt] 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/file1.txt] 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/file3.txt] 2024/05/06 06:08:05 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: Waiting for checks to finish 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: Waiting for transfers to finish 2024/05/06 06:08:05 INFO : file2.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/file4.txt] 2024/05/06 06:08:05 INFO : .chk_file: Copied (new) 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/subdir/.chk_file] 2024/05/06 06:08:05 INFO : file1.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/subdir/file20.txt] 2024/05/06 06:08:05 INFO : file3.txt: Copied (new) 2024/05/06 06:08:05 INFO : file4.txt: Copied (new) 2024/05/06 06:08:05 INFO : subdir/.chk_file: Copied (new) 2024/05/06 06:08:05 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:05 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2] 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/subdir] 2024/05/06 06:08:05 (01) : test check-filename 2024/05/06 06:08:05 (02) : test initial bisync 2024/05/06 06:08:05 (03) : bisync resync 2024/05/06 06:08:05 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/" 2024/05/06 06:08:05 INFO : Copying Path2 files to Path1 2024/05/06 06:08:05 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:05 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:05 INFO : Resync updating listings 2024/05/06 06:08:05 INFO : Validating listings for Path1 "/tmp/060802gi/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/" 2024/05/06 06:08:05 INFO : Bisync successful 2024/05/06 06:08:05 (04) : test 1. see that check-access passes with the initial setup 2024/05/06 06:08:05 (05) : bisync check-access check-filename=.chk_file 2024/05/06 06:08:05 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/" 2024/05/06 06:08:05 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:05 INFO : Path1 checking for diffs 2024/05/06 06:08:05 INFO : Path2 checking for diffs 2024/05/06 06:08:05 INFO : Checking access health 2024/05/06 06:08:05 INFO : Found 2 matching ".chk_file" files on both paths 2024/05/06 06:08:05 INFO : No changes found 2024/05/06 06:08:05 INFO : Updating listings 2024/05/06 06:08:05 INFO : Validating listings for Path1 "/tmp/060802gi/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/" 2024/05/06 06:08:05 INFO : Bisync successful 2024/05/06 06:08:05 (06) : copy-listings initial-pass 2024/05/06 06:08:05 (07) : test 2. delete the remote subdir .chk_file, run sync. should fail critical. 2024/05/06 06:08:05 (08) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/subdir/.chk_file 2024/05/06 06:08:05 INFO : .chk_file: Deleted 2024/05/06 06:08:05 (09) : bisync check-access check-filename=.chk_file 2024/05/06 06:08:05 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/" 2024/05/06 06:08:05 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:05 INFO : Path1 checking for diffs 2024/05/06 06:08:05 INFO : Path2 checking for diffs 2024/05/06 06:08:05 INFO : - Path2 File was deleted - subdir/.chk_file 2024/05/06 06:08:05 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:05 INFO : Checking access health 2024/05/06 06:08:05 ERROR : Access test failed: Path1 count 2, Path2 count 1 - .chk_file 2024/05/06 06:08:05 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/.chk_file 2024/05/06 06:08:05 ERROR : Bisync critical error: check file check failed 2024/05/06 06:08:05 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:05 Bisync error: bisync aborted 2024/05/06 06:08:05 (10) : move-listings path2-missing 2024/05/06 06:08:05 (11) : test 3. put the remote subdir .chk_file back, run resync. 2024/05/06 06:08:05 (12) : copy-file /tmp/060802gi/check_filename/path1/subdir/.chk_file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/subdir/ 2024/05/06 06:08:05 INFO : .chk_file: Copied (new) 2024/05/06 06:08:05 (13) : bisync check-access resync check-filename=.chk_file 2024/05/06 06:08:05 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/" 2024/05/06 06:08:05 INFO : Copying Path2 files to Path1 2024/05/06 06:08:05 INFO : Checking access health 2024/05/06 06:08:05 INFO : Found 2 matching ".chk_file" files on both paths 2024/05/06 06:08:05 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:05 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:05 INFO : Resync updating listings 2024/05/06 06:08:05 INFO : Validating listings for Path1 "/tmp/060802gi/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/" 2024/05/06 06:08:05 INFO : Bisync successful 2024/05/06 06:08:05 (14) : test 4. run sync with check-access. should pass. 2024/05/06 06:08:05 (15) : bisync check-access check-filename=.chk_file 2024/05/06 06:08:05 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/" 2024/05/06 06:08:05 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:05 INFO : Path1 checking for diffs 2024/05/06 06:08:05 INFO : Path2 checking for diffs 2024/05/06 06:08:05 INFO : Checking access health 2024/05/06 06:08:05 INFO : Found 2 matching ".chk_file" files on both paths 2024/05/06 06:08:05 INFO : No changes found 2024/05/06 06:08:05 INFO : Updating listings 2024/05/06 06:08:05 INFO : Validating listings for Path1 "/tmp/060802gi/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_filename/path2/" 2024/05/06 06:08:05 INFO : Bisync successful bisync_test.go:555: TEST check_filename PASSED === RUN TestBisyncLocalRemote/check_sync 2024/05/06 06:08:05 DEBUG : Creating backend with remote "/tmp/060802gi/check_sync/path1" 2024/05/06 06:08:05 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:05 DEBUG : path2: Making directory 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:05 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2" 2024/05/06 06:08:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:05 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2" 2024/05/06 06:08:05 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_check_sync-siladog7" 2024/05/06 06:08:05 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : Local file system at /tmp/060802gi/initdir/test_check_sync-siladog7: Waiting for checks to finish 2024/05/06 06:08:05 DEBUG : Local file system at /tmp/060802gi/initdir/test_check_sync-siladog7: Waiting for transfers to finish 2024/05/06 06:08:05 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file1.txt.wajazug1.partial: renamed to: file1.txt 2024/05/06 06:08:05 INFO : file1.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file2.txt.tikulut9.partial: renamed to: file2.txt 2024/05/06 06:08:05 INFO : file2.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file3.txt.womomol3.partial: renamed to: file3.txt 2024/05/06 06:08:05 INFO : file3.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:05 DEBUG : RCLONE_TEST.cunocaz3.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:05 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:05 DEBUG : file6.txt.wohojov5.partial: renamed to: file6.txt 2024/05/06 06:08:05 INFO : file6.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file7.txt.dusudoh8.partial: renamed to: file7.txt 2024/05/06 06:08:05 INFO : file7.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file8.txt.cacixub4.partial: renamed to: file8.txt 2024/05/06 06:08:05 INFO : file8.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file5.txt.nadofol4.partial: renamed to: file5.txt 2024/05/06 06:08:05 INFO : file5.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file4.txt.mikunel2.partial: renamed to: file4.txt 2024/05/06 06:08:05 INFO : file4.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_check_sync-xetiruv6" 2024/05/06 06:08:05 DEBUG : _testdir_path1.._testdir_path2.path1.lst: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : _testdir_path1.._testdir_path2.path2.lst: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : Local file system at /tmp/060802gi/datadir/test_check_sync-xetiruv6: Waiting for checks to finish 2024/05/06 06:08:05 DEBUG : Local file system at /tmp/060802gi/datadir/test_check_sync-xetiruv6: Waiting for transfers to finish 2024/05/06 06:08:05 DEBUG : _testdir_path1.._testdir_path2.path2.lst: md5 = d6ce44a26af9c2110b1750fe88dc4b69 OK 2024/05/06 06:08:05 DEBUG : _testdir_path1.._testdir_path2.path1.lst: md5 = fdb18e0dff6961813e12c57227d2e854 OK 2024/05/06 06:08:05 DEBUG : _testdir_path1.._testdir_path2.path2.lst.netabek6.partial: renamed to: _testdir_path1.._testdir_path2.path2.lst 2024/05/06 06:08:05 INFO : _testdir_path1.._testdir_path2.path2.lst: Copied (new) 2024/05/06 06:08:05 DEBUG : _testdir_path1.._testdir_path2.path1.lst.xuguwik3.partial: renamed to: _testdir_path1.._testdir_path2.path1.lst 2024/05/06 06:08:05 INFO : _testdir_path1.._testdir_path2.path1.lst: Copied (new) 2024/05/06 06:08:05 ERROR : : error listing: directory not found 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2] 2024/05/06 06:08:05 ERROR : : error listing: directory not found 2024/05/06 06:08:05 checking initFs Local file system at /tmp/060802gi/initdir/test_check_sync-siladog7 2024/05/06 06:08:05 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : Local file system at /tmp/060802gi/check_sync/path1: Waiting for checks to finish 2024/05/06 06:08:05 DEBUG : Local file system at /tmp/060802gi/check_sync/path1: Waiting for transfers to finish 2024/05/06 06:08:05 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file1.txt.doganey4.partial: renamed to: file1.txt 2024/05/06 06:08:05 INFO : file1.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:05 DEBUG : file3.txt.wutulex0.partial: renamed to: file3.txt 2024/05/06 06:08:05 INFO : file3.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : RCLONE_TEST.guhumom8.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:05 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:05 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file4.txt.desicuf5.partial: renamed to: file4.txt 2024/05/06 06:08:05 INFO : file4.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file5.txt.werufes3.partial: renamed to: file5.txt 2024/05/06 06:08:05 INFO : file5.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file2.txt.renixeg3.partial: renamed to: file2.txt 2024/05/06 06:08:05 INFO : file2.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file7.txt.yihibuc2.partial: renamed to: file7.txt 2024/05/06 06:08:05 INFO : file7.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file6.txt.caduvas5.partial: renamed to: file6.txt 2024/05/06 06:08:05 INFO : file6.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:05 DEBUG : file8.txt.nirekoq4.partial: renamed to: file8.txt 2024/05/06 06:08:05 INFO : file8.txt: Copied (new) 2024/05/06 06:08:05 checking Path1 Local file system at /tmp/060802gi/check_sync/path1 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2] 2024/05/06 06:08:05 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/RCLONE_TEST] 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/file1.txt] 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/file2.txt] 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/file3.txt] 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: Waiting for checks to finish 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: Waiting for transfers to finish 2024/05/06 06:08:05 INFO : file1.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/file4.txt] 2024/05/06 06:08:05 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/file5.txt] 2024/05/06 06:08:05 INFO : file2.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/file6.txt] 2024/05/06 06:08:05 INFO : file3.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/file7.txt] 2024/05/06 06:08:05 INFO : file4.txt: Copied (new) 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/file8.txt] 2024/05/06 06:08:05 INFO : file5.txt: Copied (new) 2024/05/06 06:08:05 INFO : file6.txt: Copied (new) 2024/05/06 06:08:05 INFO : file7.txt: Copied (new) 2024/05/06 06:08:05 INFO : file8.txt: Copied (new) 2024/05/06 06:08:05 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2 2024/05/06 06:08:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2] 2024/05/06 06:08:05 (01) : test check-sync 2024/05/06 06:08:05 (02) : test initial bisync 2024/05/06 06:08:05 (03) : bisync resync 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/" 2024/05/06 06:08:05 INFO : Copying Path2 files to Path1 2024/05/06 06:08:05 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:05 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:05 INFO : Resync updating listings 2024/05/06 06:08:05 INFO : Validating listings for Path1 "/tmp/060802gi/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/" 2024/05/06 06:08:05 INFO : Bisync successful 2024/05/06 06:08:05 (04) : test 1. run check-sync-only on a clean sync 2024/05/06 06:08:05 (05) : bisync check-sync-only 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Validating listings for Path1 "/tmp/060802gi/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/" 2024/05/06 06:08:05 INFO : Bisync successful 2024/05/06 06:08:05 (06) : test 2. inject modified listings into the workdir 2024/05/06 06:08:05 (07) : copy-as /tmp/060802gi/datadir/test_check_sync-xetiruv6/_testdir_path1.._testdir_path2.path1.lst /tmp/060802gi/workdir/ tmp_060802gi_check_sync_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_check_sync_path2.path1.lst 2024/05/06 06:08:05 INFO : _testdir_path1.._testdir_path2.path1.lst: Copied (replaced existing) to: tmp_060802gi_check_sync_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_check_sync_path2.path1.lst 2024/05/06 06:08:05 (08) : copy-as /tmp/060802gi/datadir/test_check_sync-xetiruv6/_testdir_path1.._testdir_path2.path2.lst /tmp/060802gi/workdir/ tmp_060802gi_check_sync_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_check_sync_path2.path2.lst 2024/05/06 06:08:05 INFO : _testdir_path1.._testdir_path2.path2.lst: Copied (replaced existing) to: tmp_060802gi_check_sync_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_check_sync_path2.path2.lst 2024/05/06 06:08:05 (09) : test 3. run check-sync-only on modified listings 2024/05/06 06:08:05 (10) : bisync check-sync-only 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Validating listings for Path1 "/tmp/060802gi/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/" 2024/05/06 06:08:05 ERROR : -  Path1 file not found in Path2 - file2.txt 2024/05/06 06:08:05 ERROR : -  Path2 file not found in Path1 - file1.txt 2024/05/06 06:08:05 ERROR : Bisync critical error: path1 and path2 are out of sync, run --resync to recover 2024/05/06 06:08:05 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:05 Bisync error: bisync aborted 2024/05/06 06:08:05 (11) : copy-listings check-sync-only 2024/05/06 06:08:05 (12) : test 4. run normal sync to check that it aborts 2024/05/06 06:08:05 (13) : bisync 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/" 2024/05/06 06:08:05 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/060802gi/workdir/tmp_060802gi_check_sync_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_check_sync_path2.path1.lst Path2: /tmp/060802gi/workdir/tmp_060802gi_check_sync_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_check_sync_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/060802gi/workdir" 2024/05/06 06:08:05 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:05 Bisync error: bisync aborted 2024/05/06 06:08:05 (14) : test 5. prune failure listings after critical abort 2024/05/06 06:08:05 (15) : delete-glob /tmp/060802gi/workdir/ *.lst 2024/05/06 06:08:05 (16) : delete-glob /tmp/060802gi/workdir/ *.lst-err 2024/05/06 06:08:05 INFO : tmp_060802gi_check_sync_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_check_sync_path2.path1.lst-err: Deleted 2024/05/06 06:08:05 INFO : tmp_060802gi_check_sync_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_check_sync_path2.path2.lst-err: Deleted 2024/05/06 06:08:05 (17) : delete-glob /tmp/060802gi/workdir/ *.lst-new 2024/05/06 06:08:05 INFO : tmp_060802gi_check_sync_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_check_sync_path2.path1.lst-new: Deleted 2024/05/06 06:08:05 INFO : tmp_060802gi_check_sync_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_check_sync_path2.path2.lst-new: Deleted 2024/05/06 06:08:05 (18) : test 6. run resync 2024/05/06 06:08:05 (19) : bisync resync 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/" 2024/05/06 06:08:05 INFO : Copying Path2 files to Path1 2024/05/06 06:08:05 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:05 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:05 INFO : Resync updating listings 2024/05/06 06:08:05 INFO : Validating listings for Path1 "/tmp/060802gi/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/" 2024/05/06 06:08:05 INFO : Bisync successful 2024/05/06 06:08:05 (20) : test 7. run normal sync with check-sync enabled (default) 2024/05/06 06:08:05 (21) : bisync 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/" 2024/05/06 06:08:05 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:05 INFO : Path1 checking for diffs 2024/05/06 06:08:05 INFO : Path2 checking for diffs 2024/05/06 06:08:05 INFO : No changes found 2024/05/06 06:08:05 INFO : Updating listings 2024/05/06 06:08:05 INFO : Validating listings for Path1 "/tmp/060802gi/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/" 2024/05/06 06:08:05 INFO : Bisync successful 2024/05/06 06:08:05 (22) : test 8. run normal sync with no-check-sync 2024/05/06 06:08:05 (23) : bisync no-check-sync 2024/05/06 06:08:05 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:05 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:05 INFO : Synching Path1 "/tmp/060802gi/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/check_sync/path2/" 2024/05/06 06:08:05 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:05 INFO : Path1 checking for diffs 2024/05/06 06:08:05 INFO : Path2 checking for diffs 2024/05/06 06:08:05 INFO : No changes found 2024/05/06 06:08:05 INFO : Updating listings 2024/05/06 06:08:05 INFO : Bisync successful bisync_test.go:555: TEST check_sync PASSED === RUN TestBisyncLocalRemote/compare_all 2024/05/06 06:08:06 DEBUG : Creating backend with remote "/tmp/060802gi/compare_all/path1" 2024/05/06 06:08:06 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:06 DEBUG : path2: Making directory 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:06 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2" 2024/05/06 06:08:06 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:06 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:06 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:06 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:06 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:06 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:06 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2" 2024/05/06 06:08:06 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_compare_all-pahoguc6" 2024/05/06 06:08:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file2.txt.tinoqix0.partial: renamed to: file2.txt 2024/05/06 06:08:06 INFO : file2.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file1.txt.dijozor7.partial: renamed to: file1.txt 2024/05/06 06:08:06 INFO : file1.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file3.txt.gunubaf5.partial: renamed to: file3.txt 2024/05/06 06:08:06 INFO : file3.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : Local file system at /tmp/060802gi/initdir/test_compare_all-pahoguc6: Waiting for checks to finish 2024/05/06 06:08:06 DEBUG : Local file system at /tmp/060802gi/initdir/test_compare_all-pahoguc6: Waiting for transfers to finish 2024/05/06 06:08:06 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file4.txt.piqumep2.partial: renamed to: file4.txt 2024/05/06 06:08:06 INFO : file4.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:06 DEBUG : RCLONE_TEST.gutuvug9.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:06 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:06 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file7.txt.retawap0.partial: renamed to: file7.txt 2024/05/06 06:08:06 INFO : file7.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file6.txt.yawetir6.partial: renamed to: file6.txt 2024/05/06 06:08:06 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 INFO : file6.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file5.txt.kenabob5.partial: renamed to: file5.txt 2024/05/06 06:08:06 INFO : file5.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file8.txt.nosacef7.partial: renamed to: file8.txt 2024/05/06 06:08:06 INFO : file8.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_compare_all-xeyozet9" 2024/05/06 06:08:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:06 DEBUG : file10.txt.yuxazeh0.partial: renamed to: file10.txt 2024/05/06 06:08:06 INFO : file10.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:06 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:06 DEBUG : file11.txt.zimudub1.partial: renamed to: file11.txt 2024/05/06 06:08:06 INFO : file11.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file1.txt.rizotuf1.partial: renamed to: file1.txt 2024/05/06 06:08:06 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:06 INFO : file1.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file5L.txt.nowegoc2.partial: renamed to: file5L.txt 2024/05/06 06:08:06 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:06 DEBUG : file2.txt.kelosol5.partial: renamed to: file2.txt 2024/05/06 06:08:06 INFO : file2.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:06 DEBUG : file6.txt.pukusan4.partial: renamed to: file6.txt 2024/05/06 06:08:06 INFO : file6.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : Local file system at /tmp/060802gi/datadir/test_compare_all-xeyozet9: Waiting for checks to finish 2024/05/06 06:08:06 DEBUG : Local file system at /tmp/060802gi/datadir/test_compare_all-xeyozet9: Waiting for transfers to finish 2024/05/06 06:08:06 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:06 DEBUG : file5R.txt.gabejor7.partial: renamed to: file5R.txt 2024/05/06 06:08:06 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:06 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file7.txt.qetofam1.partial: renamed to: file7.txt 2024/05/06 06:08:06 INFO : file7.txt: Copied (new) 2024/05/06 06:08:06 ERROR : : error listing: directory not found 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2] 2024/05/06 06:08:06 ERROR : : error listing: directory not found 2024/05/06 06:08:06 checking initFs Local file system at /tmp/060802gi/initdir/test_compare_all-pahoguc6 2024/05/06 06:08:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : Local file system at /tmp/060802gi/compare_all/path1: Waiting for checks to finish 2024/05/06 06:08:06 DEBUG : Local file system at /tmp/060802gi/compare_all/path1: Waiting for transfers to finish 2024/05/06 06:08:06 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:06 DEBUG : file1.txt.filonen4.partial: renamed to: file1.txt 2024/05/06 06:08:06 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 INFO : file1.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : RCLONE_TEST.mudihij9.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:06 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:06 DEBUG : file2.txt.qoxuzuk8.partial: renamed to: file2.txt 2024/05/06 06:08:06 INFO : file2.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file5.txt.dasakoh4.partial: renamed to: file5.txt 2024/05/06 06:08:06 INFO : file5.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file4.txt.xawifiw0.partial: renamed to: file4.txt 2024/05/06 06:08:06 INFO : file4.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file3.txt.disexix3.partial: renamed to: file3.txt 2024/05/06 06:08:06 DEBUG : file6.txt.ponohuc6.partial: renamed to: file6.txt 2024/05/06 06:08:06 INFO : file3.txt: Copied (new) 2024/05/06 06:08:06 INFO : file6.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file7.txt.tehadol3.partial: renamed to: file7.txt 2024/05/06 06:08:06 INFO : file7.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file8.txt.sukitib1.partial: renamed to: file8.txt 2024/05/06 06:08:06 INFO : file8.txt: Copied (new) 2024/05/06 06:08:06 checking Path1 Local file system at /tmp/060802gi/compare_all/path1 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2] 2024/05/06 06:08:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/RCLONE_TEST] 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file3.txt] 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file1.txt] 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file2.txt] 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: Waiting for checks to finish 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: Waiting for transfers to finish 2024/05/06 06:08:06 INFO : file1.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file4.txt] 2024/05/06 06:08:06 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file5.txt] 2024/05/06 06:08:06 INFO : file2.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file6.txt] 2024/05/06 06:08:06 INFO : file3.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file7.txt] 2024/05/06 06:08:06 INFO : file4.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file8.txt] 2024/05/06 06:08:06 INFO : file5.txt: Copied (new) 2024/05/06 06:08:06 INFO : file6.txt: Copied (new) 2024/05/06 06:08:06 INFO : file7.txt: Copied (new) 2024/05/06 06:08:06 INFO : file8.txt: Copied (new) 2024/05/06 06:08:06 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2] 2024/05/06 06:08:06 (01) : test changes compare-all 2024/05/06 06:08:06 (02) : test initial bisync 2024/05/06 06:08:06 (03) : bisync resync compare-all 2024/05/06 06:08:06 NOTICE: Local file system at /tmp/060802gi/compare_all/path1: will use md5 for same-side diffs on Path1 only 2024/05/06 06:08:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:08:06 INFO : Synching Path1 "/tmp/060802gi/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/" 2024/05/06 06:08:06 INFO : Copying Path2 files to Path1 2024/05/06 06:08:06 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:06 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:06 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:06 INFO : Resync updating listings 2024/05/06 06:08:06 INFO : Validating listings for Path1 "/tmp/060802gi/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/" 2024/05/06 06:08:06 INFO : Bisync successful 2024/05/06 06:08:06 (04) : test make modifications on both paths 2024/05/06 06:08:06 (05) : test new on path2 - file10 2024/05/06 06:08:06 (06) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_compare_all-xeyozet9/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/ 2024/05/06 06:08:06 INFO : file10.txt: Copied (new) 2024/05/06 06:08:06 (07) : test newer on path2 - file1 2024/05/06 06:08:06 (08) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_compare_all-xeyozet9/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/ 2024/05/06 06:08:06 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:06 (09) : test new on path1 - file11 2024/05/06 06:08:06 (10) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_compare_all-xeyozet9/file11.txt /tmp/060802gi/compare_all/path1/ 2024/05/06 06:08:06 INFO : file11.txt: Copied (new) 2024/05/06 06:08:06 (11) : test newer on path1 - file2 2024/05/06 06:08:06 (12) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_compare_all-xeyozet9/file2.txt /tmp/060802gi/compare_all/path1/ 2024/05/06 06:08:06 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:06 (13) : test deleted on path2 - file3 2024/05/06 06:08:06 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file3.txt 2024/05/06 06:08:06 INFO : file3.txt: Deleted 2024/05/06 06:08:06 (15) : test deleted on path1 - file4 2024/05/06 06:08:06 (16) : delete-file /tmp/060802gi/compare_all/path1/file4.txt 2024/05/06 06:08:06 INFO : file4.txt: Deleted 2024/05/06 06:08:06 (17) : test deleted on both paths - file8 2024/05/06 06:08:06 (18) : delete-file /tmp/060802gi/compare_all/path1/file8.txt 2024/05/06 06:08:06 INFO : file8.txt: Deleted 2024/05/06 06:08:06 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file8.txt 2024/05/06 06:08:06 INFO : file8.txt: Deleted 2024/05/06 06:08:06 (20) : test changed on both paths - file5 (file5R, file5L) 2024/05/06 06:08:06 (21) : touch-glob 2001-01-02 /tmp/060802gi/datadir/test_compare_all-xeyozet9/ file5R.txt 2024/05/06 06:08:06 (22) : copy-as /tmp/060802gi/datadir/test_compare_all-xeyozet9/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/ file5.txt 2024/05/06 06:08:06 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:06 (23) : touch-glob 2001-03-04 /tmp/060802gi/datadir/test_compare_all-xeyozet9/ file5L.txt 2024/05/06 06:08:06 (24) : copy-as /tmp/060802gi/datadir/test_compare_all-xeyozet9/file5L.txt /tmp/060802gi/compare_all/path1/ file5.txt 2024/05/06 06:08:06 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:06 (25) : test newer on path2 and deleted on path1 - file6 2024/05/06 06:08:06 (26) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_compare_all-xeyozet9/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/ 2024/05/06 06:08:06 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:08:06 (27) : delete-file /tmp/060802gi/compare_all/path1/file6.txt 2024/05/06 06:08:06 INFO : file6.txt: Deleted 2024/05/06 06:08:06 (28) : test newer on path1 and deleted on path2 - file7 2024/05/06 06:08:06 (29) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_compare_all-xeyozet9/file7.txt /tmp/060802gi/compare_all/path1/ 2024/05/06 06:08:06 INFO : file7.txt: Copied (replaced existing) 2024/05/06 06:08:06 (30) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file7.txt 2024/05/06 06:08:06 INFO : file7.txt: Deleted 2024/05/06 06:08:06 (31) : test bisync run 2024/05/06 06:08:06 (32) : bisync compare-all 2024/05/06 06:08:06 NOTICE: Local file system at /tmp/060802gi/compare_all/path1: will use md5 for same-side diffs on Path1 only 2024/05/06 06:08:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:08:06 INFO : Synching Path1 "/tmp/060802gi/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/" 2024/05/06 06:08:06 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:06 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:06 INFO : Path1 checking for diffs 2024/05/06 06:08:06 INFO : - Path1 File changed: size (larger), time (newer), hash - file2.txt 2024/05/06 06:08:06 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:08:06 INFO : - Path1 File changed: size (larger), time (newer), hash - file5.txt 2024/05/06 06:08:06 INFO : - Path1 File was deleted - file6.txt 2024/05/06 06:08:06 INFO : - Path1 File changed: size (larger), time (newer), hash - file7.txt 2024/05/06 06:08:06 INFO : - Path1 File was deleted - file8.txt 2024/05/06 06:08:06 INFO : - Path1 File is new - file11.txt 2024/05/06 06:08:06 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:08:06 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2024/05/06 06:08:06 INFO : Path2 checking for diffs 2024/05/06 06:08:06 INFO : - Path2 File changed: size (larger), time (newer), hash - file1.txt 2024/05/06 06:08:06 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:08:06 INFO : - Path2 File changed: size (larger), time (newer), hash - file5.txt 2024/05/06 06:08:06 INFO : - Path2 File changed: size (larger), time (newer), hash - file6.txt 2024/05/06 06:08:06 INFO : - Path2 File was deleted - file7.txt 2024/05/06 06:08:06 INFO : - Path2 File was deleted - file8.txt 2024/05/06 06:08:06 INFO : - Path2 File is new - file10.txt 2024/05/06 06:08:06 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:08:06 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2024/05/06 06:08:06 INFO : Applying changes 2024/05/06 06:08:06 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file11.txt 2024/05/06 06:08:06 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file2.txt 2024/05/06 06:08:06 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file4.txt 2024/05/06 06:08:06 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:08:06 NOTICE: - Path1 Renaming Path1 copy - /tmp/060802gi/compare_all/path1/file5.txt.conflict1 2024/05/06 06:08:06 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/05/06 06:08:06 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file5.txt.conflict1 2024/05/06 06:08:06 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file5.txt.conflict2 2024/05/06 06:08:06 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/05/06 06:08:06 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/compare_all/path1/file5.txt.conflict2 2024/05/06 06:08:06 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/compare_all/path1/file6.txt 2024/05/06 06:08:06 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/file7.txt 2024/05/06 06:08:06 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/compare_all/path1/file1.txt 2024/05/06 06:08:06 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/compare_all/path1/file10.txt 2024/05/06 06:08:06 INFO : - Path1 Queue delete - /tmp/060802gi/compare_all/path1/file3.txt 2024/05/06 06:08:06 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:06 INFO : file10.txt: Copied (new) 2024/05/06 06:08:06 INFO : file5.txt.conflict2: Copied (new) 2024/05/06 06:08:06 INFO : file6.txt: Copied (new) 2024/05/06 06:08:06 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:06 INFO : file3.txt: Deleted 2024/05/06 06:08:06 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:06 INFO : file11.txt: Copied (new) 2024/05/06 06:08:06 INFO : file7.txt: Copied (new) 2024/05/06 06:08:06 INFO : file5.txt.conflict1: Copied (new) 2024/05/06 06:08:06 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:06 INFO : file4.txt: Deleted 2024/05/06 06:08:06 INFO : Updating listings 2024/05/06 06:08:06 INFO : Validating listings for Path1 "/tmp/060802gi/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/compare_all/path2/" 2024/05/06 06:08:06 INFO : Bisync successful bisync_test.go:555: TEST compare_all PASSED === RUN TestBisyncLocalRemote/createemptysrcdirs 2024/05/06 06:08:06 DEBUG : Creating backend with remote "/tmp/060802gi/createemptysrcdirs/path1" 2024/05/06 06:08:06 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:06 DEBUG : path2: Making directory 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:06 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2" 2024/05/06 06:08:06 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:06 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:06 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:06 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:06 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:06 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:06 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2" 2024/05/06 06:08:06 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_createemptysrcdirs-biwelok8" 2024/05/06 06:08:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : Local file system at /tmp/060802gi/initdir/test_createemptysrcdirs-biwelok8: Waiting for checks to finish 2024/05/06 06:08:06 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file1.copy1.txt.lusinam9.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:06 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file1.copy2.txt.fecopij1.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:06 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : Local file system at /tmp/060802gi/initdir/test_createemptysrcdirs-biwelok8: Waiting for transfers to finish 2024/05/06 06:08:06 DEBUG : file1.copy4.txt.jefocay1.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:06 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:06 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : RCLONE_TEST.pafisos0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:06 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:06 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file1.copy3.txt.vuzesux1.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:06 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file1.copy5.txt.gofiguf5.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:06 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file1.txt.gujuced1.partial: renamed to: file1.txt 2024/05/06 06:08:06 INFO : file1.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1" 2024/05/06 06:08:06 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : Local file system at /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1: Waiting for checks to finish 2024/05/06 06:08:06 DEBUG : Local file system at /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1: Waiting for transfers to finish 2024/05/06 06:08:06 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : placeholder.txt.hineniz8.partial: renamed to: placeholder.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) 2024/05/06 06:08:06 ERROR : : error listing: directory not found 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2] 2024/05/06 06:08:06 ERROR : : error listing: directory not found 2024/05/06 06:08:06 checking initFs Local file system at /tmp/060802gi/initdir/test_createemptysrcdirs-biwelok8 2024/05/06 06:08:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : Local file system at /tmp/060802gi/createemptysrcdirs/path1: Waiting for checks to finish 2024/05/06 06:08:06 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : Local file system at /tmp/060802gi/createemptysrcdirs/path1: Waiting for transfers to finish 2024/05/06 06:08:06 DEBUG : file1.copy1.txt.hihaxiv4.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:06 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file1.copy3.txt.xapotap8.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:06 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file1.copy2.txt.xaropuj7.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:06 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:06 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file1.copy5.txt.malolep6.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:06 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:06 DEBUG : file1.copy4.txt.jegakiv0.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:06 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : file1.txt.goxiruy3.partial: renamed to: file1.txt 2024/05/06 06:08:06 INFO : file1.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:06 DEBUG : RCLONE_TEST.nasuhox9.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:06 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:06 checking Path1 Local file system at /tmp/060802gi/createemptysrcdirs/path1 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2] 2024/05/06 06:08:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/RCLONE_TEST] 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/file1.copy1.txt] 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2: Waiting for checks to finish 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/file1.copy3.txt] 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2: Waiting for transfers to finish 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/file1.copy2.txt] 2024/05/06 06:08:06 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/file1.copy4.txt] 2024/05/06 06:08:06 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/file1.copy5.txt] 2024/05/06 06:08:06 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/file1.txt] 2024/05/06 06:08:06 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:06 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:06 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:06 INFO : file1.txt: Copied (new) 2024/05/06 06:08:06 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2 2024/05/06 06:08:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2] 2024/05/06 06:08:06 (01) : test createemptysrcdirs 2024/05/06 06:08:06 (02) : test initial bisync 2024/05/06 06:08:06 (03) : touch-glob 2001-01-02 /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/ placeholder.txt 2024/05/06 06:08:06 (04) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Updated modification time in destination 2024/05/06 06:08:06 (05) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy1.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Updated modification time in destination 2024/05/06 06:08:06 (06) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy2.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Updated modification time in destination 2024/05/06 06:08:06 (07) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy3.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Updated modification time in destination 2024/05/06 06:08:06 (08) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy4.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Updated modification time in destination 2024/05/06 06:08:06 (09) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy5.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Updated modification time in destination 2024/05/06 06:08:06 (10) : bisync resync 2024/05/06 06:08:06 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:06 INFO : Synching Path1 "/tmp/060802gi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Copying Path2 files to Path1 2024/05/06 06:08:06 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:06 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:06 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:06 INFO : file1.copy1.txt: Copied (replaced existing) 2024/05/06 06:08:06 INFO : file1.copy3.txt: Copied (replaced existing) 2024/05/06 06:08:06 INFO : file1.copy2.txt: Copied (replaced existing) 2024/05/06 06:08:06 INFO : file1.copy5.txt: Copied (replaced existing) 2024/05/06 06:08:06 INFO : file1.copy4.txt: Copied (replaced existing) 2024/05/06 06:08:06 INFO : Resync updating listings 2024/05/06 06:08:06 INFO : Validating listings for Path1 "/tmp/060802gi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Bisync successful 2024/05/06 06:08:06 (11) : test 1. Create an empty dir on Path1 by creating subdir/placeholder.txt and then deleting the placeholder 2024/05/06 06:08:06 (12) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ subdir/placeholder.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: subdir/placeholder.txt 2024/05/06 06:08:06 (13) : touch-glob 2001-01-02 /tmp/060802gi/createemptysrcdirs/path1/ subdir 2024/05/06 06:08:06 (14) : delete-file /tmp/060802gi/createemptysrcdirs/path1/subdir/placeholder.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Deleted 2024/05/06 06:08:06 (15) : test 2. Run bisync without --create-empty-src-dirs 2024/05/06 06:08:06 (16) : bisync 2024/05/06 06:08:06 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:06 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:06 INFO : Synching Path1 "/tmp/060802gi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:06 INFO : Path1 checking for diffs 2024/05/06 06:08:06 INFO : Path2 checking for diffs 2024/05/06 06:08:06 INFO : No changes found 2024/05/06 06:08:06 INFO : Updating listings 2024/05/06 06:08:06 INFO : Validating listings for Path1 "/tmp/060802gi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Bisync successful 2024/05/06 06:08:06 (17) : test 3. Confirm the subdir exists only on Path1 and not Path2 2024/05/06 06:08:06 (18) : list-dirs /tmp/060802gi/createemptysrcdirs/path1/ 2024/05/06 06:08:06 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:06 (19) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/ 2024/05/06 06:08:06 (20) : test 4.Run bisync WITH --create-empty-src-dirs 2024/05/06 06:08:06 (21) : bisync create-empty-src-dirs 2024/05/06 06:08:06 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:06 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:06 INFO : Synching Path1 "/tmp/060802gi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:06 INFO : Path1 checking for diffs 2024/05/06 06:08:06 INFO : - Path1 File is new - subdir 2024/05/06 06:08:06 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:06 INFO : Path2 checking for diffs 2024/05/06 06:08:06 INFO : Applying changes 2024/05/06 06:08:06 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/subdir 2024/05/06 06:08:06 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:06 INFO : Updating listings 2024/05/06 06:08:06 INFO : Validating listings for Path1 "/tmp/060802gi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Bisync successful 2024/05/06 06:08:06 (22) : test 5. Confirm the subdir exists on both paths 2024/05/06 06:08:06 (23) : list-dirs /tmp/060802gi/createemptysrcdirs/path1/ 2024/05/06 06:08:06 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:06 (24) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/ 2024/05/06 06:08:06 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:06 (25) : test 6. Delete the empty dir on Path1 using purge-children (and also add files so the path isn't empty) 2024/05/06 06:08:06 (26) : purge-children /tmp/060802gi/createemptysrcdirs/path1/ 2024/05/06 06:08:06 INFO : subdir: Removing directory 2024/05/06 06:08:06 (27) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: file1.txt 2024/05/06 06:08:06 (28) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy1.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2024/05/06 06:08:06 (29) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy2.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2024/05/06 06:08:06 (30) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy3.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2024/05/06 06:08:06 (31) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy4.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2024/05/06 06:08:06 (32) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy5.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2024/05/06 06:08:06 (33) : test 7. Run bisync without --create-empty-src-dirs 2024/05/06 06:08:06 (34) : bisync 2024/05/06 06:08:06 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:06 INFO : Synching Path1 "/tmp/060802gi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:06 INFO : Path1 checking for diffs 2024/05/06 06:08:06 INFO : - Path1 File was deleted - RCLONE_TEST 2024/05/06 06:08:06 INFO : - Path1 File was deleted - subdir 2024/05/06 06:08:06 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2024/05/06 06:08:06 INFO : Path2 checking for diffs 2024/05/06 06:08:06 INFO : - Path2 File was deleted - subdir 2024/05/06 06:08:06 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:06 INFO : Applying changes 2024/05/06 06:08:06 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/RCLONE_TEST 2024/05/06 06:08:06 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:06 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:06 INFO : Updating listings 2024/05/06 06:08:06 INFO : Validating listings for Path1 "/tmp/060802gi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Bisync successful 2024/05/06 06:08:06 (35) : test 8. Confirm the subdir exists only on Path2 and not Path1 2024/05/06 06:08:06 (36) : list-dirs /tmp/060802gi/createemptysrcdirs/path1/ 2024/05/06 06:08:06 (37) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/ 2024/05/06 06:08:06 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:06 (38) : test 9. Reset, do the delete again, and run bisync WITH --create-empty-src-dirs 2024/05/06 06:08:06 (39) : bisync resync create-empty-src-dirs 2024/05/06 06:08:06 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:06 INFO : Synching Path1 "/tmp/060802gi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Copying Path2 files to Path1 2024/05/06 06:08:06 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:06 INFO : subdir: Made directory with metadata (mtime=2024-05-06T06:08:06.882Z) 2024/05/06 06:08:06 INFO : subdir: Updated directory metadata 2024/05/06 06:08:06 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:06 INFO : Resync updating listings 2024/05/06 06:08:06 INFO : Validating listings for Path1 "/tmp/060802gi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Bisync successful 2024/05/06 06:08:06 (40) : list-dirs /tmp/060802gi/createemptysrcdirs/path1/ 2024/05/06 06:08:06 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:06 (41) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/ 2024/05/06 06:08:06 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:06 (42) : purge-children /tmp/060802gi/createemptysrcdirs/path1/ 2024/05/06 06:08:06 INFO : subdir: Removing directory 2024/05/06 06:08:06 (43) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: file1.txt 2024/05/06 06:08:06 (44) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy1.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2024/05/06 06:08:06 (45) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy2.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2024/05/06 06:08:06 (46) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy3.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2024/05/06 06:08:06 (47) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy4.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2024/05/06 06:08:06 (48) : copy-as /tmp/060802gi/datadir/test_createemptysrcdirs-fipogih1/placeholder.txt /tmp/060802gi/createemptysrcdirs/path1/ file1.copy5.txt 2024/05/06 06:08:06 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2024/05/06 06:08:06 (49) : list-dirs /tmp/060802gi/createemptysrcdirs/path1/ 2024/05/06 06:08:06 (50) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/ 2024/05/06 06:08:06 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:06 (51) : bisync create-empty-src-dirs 2024/05/06 06:08:06 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:06 INFO : Synching Path1 "/tmp/060802gi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:06 INFO : Path1 checking for diffs 2024/05/06 06:08:06 INFO : - Path1 File was deleted - subdir 2024/05/06 06:08:06 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:06 INFO : Path2 checking for diffs 2024/05/06 06:08:06 INFO : Applying changes 2024/05/06 06:08:06 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/subdir 2024/05/06 06:08:06 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:06 INFO : subdir: Removing directory 2024/05/06 06:08:06 INFO : Updating listings 2024/05/06 06:08:06 INFO : Validating listings for Path1 "/tmp/060802gi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Bisync successful 2024/05/06 06:08:06 (52) : test 10. Confirm the subdir has been removed on both paths 2024/05/06 06:08:06 (53) : list-dirs /tmp/060802gi/createemptysrcdirs/path1/ 2024/05/06 06:08:06 (54) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/ 2024/05/06 06:08:06 (55) : test 11. bisync again (because if we leave subdir in listings, test will fail due to mismatched modtime) 2024/05/06 06:08:06 (56) : bisync create-empty-src-dirs 2024/05/06 06:08:06 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:06 INFO : Synching Path1 "/tmp/060802gi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:06 INFO : Path1 checking for diffs 2024/05/06 06:08:06 INFO : Path2 checking for diffs 2024/05/06 06:08:06 INFO : No changes found 2024/05/06 06:08:06 INFO : Updating listings 2024/05/06 06:08:06 INFO : Validating listings for Path1 "/tmp/060802gi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/createemptysrcdirs/path2/" 2024/05/06 06:08:06 INFO : Bisync successful bisync_test.go:555: TEST createemptysrcdirs PASSED === RUN TestBisyncLocalRemote/dry_run 2024/05/06 06:08:07 DEBUG : Creating backend with remote "/tmp/060802gi/dry_run/path1" 2024/05/06 06:08:07 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:07 DEBUG : path2: Making directory 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:07 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2" 2024/05/06 06:08:07 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:07 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:07 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2" 2024/05/06 06:08:07 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_dry_run-kaxofuq9" 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:07 DEBUG : RCLONE_TEST.dorihid3.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:07 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/initdir/test_dry_run-kaxofuq9: Waiting for checks to finish 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/initdir/test_dry_run-kaxofuq9: Waiting for transfers to finish 2024/05/06 06:08:07 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file2.txt.vulosoh7.partial: renamed to: file2.txt 2024/05/06 06:08:07 INFO : file2.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file1.txt.fivigod7.partial: renamed to: file1.txt 2024/05/06 06:08:07 INFO : file1.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file4.txt.luleqip1.partial: renamed to: file4.txt 2024/05/06 06:08:07 INFO : file4.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file3.txt.fopuhas3.partial: renamed to: file3.txt 2024/05/06 06:08:07 INFO : file3.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file6.txt.miqeyow6.partial: renamed to: file6.txt 2024/05/06 06:08:07 INFO : file6.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file5.txt.lasizar0.partial: renamed to: file5.txt 2024/05/06 06:08:07 INFO : file5.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file7.txt.bexodis2.partial: renamed to: file7.txt 2024/05/06 06:08:07 INFO : file7.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_dry_run-xigavik6" 2024/05/06 06:08:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/datadir/test_dry_run-xigavik6: Waiting for checks to finish 2024/05/06 06:08:07 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:07 DEBUG : file1.txt.dorivot0.partial: renamed to: file1.txt 2024/05/06 06:08:07 INFO : file1.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:07 DEBUG : file10.txt.ludawon2.partial: renamed to: file10.txt 2024/05/06 06:08:07 INFO : file10.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/datadir/test_dry_run-xigavik6: Waiting for transfers to finish 2024/05/06 06:08:07 DEBUG : file11.txt.ruvoxap6.partial: renamed to: file11.txt 2024/05/06 06:08:07 INFO : file11.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:07 DEBUG : file5L.txt.bezohas3.partial: renamed to: file5L.txt 2024/05/06 06:08:07 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:07 DEBUG : file2.txt.rikequy5.partial: renamed to: file2.txt 2024/05/06 06:08:07 INFO : file2.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:07 DEBUG : file5R.txt.yesugox9.partial: renamed to: file5R.txt 2024/05/06 06:08:07 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:07 DEBUG : file6.txt.xibosuk8.partial: renamed to: file6.txt 2024/05/06 06:08:07 INFO : file6.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:07 DEBUG : file7.txt.bitotel7.partial: renamed to: file7.txt 2024/05/06 06:08:07 INFO : file7.txt: Copied (new) 2024/05/06 06:08:07 ERROR : : error listing: directory not found 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2] 2024/05/06 06:08:07 ERROR : : error listing: directory not found 2024/05/06 06:08:07 checking initFs Local file system at /tmp/060802gi/initdir/test_dry_run-kaxofuq9 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/dry_run/path1: Waiting for checks to finish 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/dry_run/path1: Waiting for transfers to finish 2024/05/06 06:08:07 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file2.txt.mitatij3.partial: renamed to: file2.txt 2024/05/06 06:08:07 INFO : file2.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:07 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file1.txt.gunaciv9.partial: renamed to: file1.txt 2024/05/06 06:08:07 INFO : file1.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : RCLONE_TEST.piqeciy7.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:07 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:07 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file3.txt.giwihok6.partial: renamed to: file3.txt 2024/05/06 06:08:07 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 INFO : file3.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file4.txt.quxumab0.partial: renamed to: file4.txt 2024/05/06 06:08:07 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 INFO : file4.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file5.txt.penuxem0.partial: renamed to: file5.txt 2024/05/06 06:08:07 INFO : file5.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file6.txt.xuxaqeb2.partial: renamed to: file6.txt 2024/05/06 06:08:07 INFO : file6.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file7.txt.lumubid6.partial: renamed to: file7.txt 2024/05/06 06:08:07 INFO : file7.txt: Copied (new) 2024/05/06 06:08:07 checking Path1 Local file system at /tmp/060802gi/dry_run/path1 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2] 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/RCLONE_TEST] 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file3.txt] 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file2.txt] 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: Waiting for checks to finish 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file1.txt] 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: Waiting for transfers to finish 2024/05/06 06:08:07 INFO : file3.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file4.txt] 2024/05/06 06:08:07 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file5.txt] 2024/05/06 06:08:07 INFO : file2.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file6.txt] 2024/05/06 06:08:07 INFO : file1.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file7.txt] 2024/05/06 06:08:07 INFO : file4.txt: Copied (new) 2024/05/06 06:08:07 INFO : file5.txt: Copied (new) 2024/05/06 06:08:07 INFO : file6.txt: Copied (new) 2024/05/06 06:08:07 INFO : file7.txt: Copied (new) 2024/05/06 06:08:07 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2] 2024/05/06 06:08:07 (01) : test dry-run 2024/05/06 06:08:07 (02) : test initial bisync 2024/05/06 06:08:07 (03) : bisync resync 2024/05/06 06:08:07 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:07 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:07 INFO : Synching Path1 "/tmp/060802gi/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/" 2024/05/06 06:08:07 INFO : Copying Path2 files to Path1 2024/05/06 06:08:07 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:07 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:07 INFO : Resync updating listings 2024/05/06 06:08:07 INFO : Validating listings for Path1 "/tmp/060802gi/dry_run/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/" 2024/05/06 06:08:07 INFO : Bisync successful 2024/05/06 06:08:07 (04) : test new on path2 - file10 2024/05/06 06:08:07 (05) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_dry_run-xigavik6/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/ 2024/05/06 06:08:07 INFO : file10.txt: Copied (new) 2024/05/06 06:08:07 (06) : test newer on path2 - file1 2024/05/06 06:08:07 (07) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_dry_run-xigavik6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/ 2024/05/06 06:08:07 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:07 (08) : test new on path1 - file11 2024/05/06 06:08:07 (09) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_dry_run-xigavik6/file11.txt /tmp/060802gi/dry_run/path1/ 2024/05/06 06:08:07 INFO : file11.txt: Copied (new) 2024/05/06 06:08:07 (10) : test newer on path1 - file2 2024/05/06 06:08:07 (11) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_dry_run-xigavik6/file2.txt /tmp/060802gi/dry_run/path1/ 2024/05/06 06:08:07 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:07 (12) : test deleted on path2 - file3 2024/05/06 06:08:07 (13) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file3.txt 2024/05/06 06:08:07 INFO : file3.txt: Deleted 2024/05/06 06:08:07 (14) : test deleted on path1 - file4 2024/05/06 06:08:07 (15) : delete-file /tmp/060802gi/dry_run/path1/file4.txt 2024/05/06 06:08:07 INFO : file4.txt: Deleted 2024/05/06 06:08:07 (16) : test changed on path2 and on path1 - file5 (file5R, file5L) 2024/05/06 06:08:07 (17) : touch-glob 2001-01-02 /tmp/060802gi/datadir/test_dry_run-xigavik6/ file5R.txt 2024/05/06 06:08:07 (18) : copy-as /tmp/060802gi/datadir/test_dry_run-xigavik6/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/ file5.txt 2024/05/06 06:08:07 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:07 (19) : touch-glob 2001-03-04 /tmp/060802gi/datadir/test_dry_run-xigavik6/ file5L.txt 2024/05/06 06:08:07 (20) : copy-as /tmp/060802gi/datadir/test_dry_run-xigavik6/file5L.txt /tmp/060802gi/dry_run/path1/ file5.txt 2024/05/06 06:08:07 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:07 (21) : test newer on path2 and deleted on path1 - file6 2024/05/06 06:08:07 (22) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_dry_run-xigavik6/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/ 2024/05/06 06:08:07 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:08:07 (23) : delete-file /tmp/060802gi/dry_run/path1/file6.txt 2024/05/06 06:08:07 INFO : file6.txt: Deleted 2024/05/06 06:08:07 (24) : test newer on path1 and deleted on path2 - file7 2024/05/06 06:08:07 (25) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_dry_run-xigavik6/file7.txt /tmp/060802gi/dry_run/path1/ 2024/05/06 06:08:07 INFO : file7.txt: Copied (replaced existing) 2024/05/06 06:08:07 (26) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file7.txt 2024/05/06 06:08:07 INFO : file7.txt: Deleted 2024/05/06 06:08:07 (27) : test sync with dry-run and resync 2024/05/06 06:08:07 (28) : bisync dry-run resync 2024/05/06 06:08:07 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:07 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:07 INFO : Synching Path1 "/tmp/060802gi/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/" 2024/05/06 06:08:07 INFO : Copying Path2 files to Path1 2024/05/06 06:08:07 NOTICE: - Path2 Resync is copying files to - Path1 2024/05/06 06:08:07 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:07 NOTICE: file4.txt: Skipped copy as --dry-run is set (size 0) 2024/05/06 06:08:07 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:07 NOTICE: - Path1 Resync is copying files to - Path2 2024/05/06 06:08:07 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:07 NOTICE: file3.txt: Skipped copy as --dry-run is set (size 0) 2024/05/06 06:08:07 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:07 NOTICE: file5.txt: Skipped copy as --dry-run is set (size 39) 2024/05/06 06:08:07 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13) 2024/05/06 06:08:07 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 0) 2024/05/06 06:08:07 INFO : Resync updating listings 2024/05/06 06:08:07 INFO : Bisync successful 2024/05/06 06:08:07 (29) : copy-listings dryrun-resync 2024/05/06 06:08:07 (30) : test sync with dry-run 2024/05/06 06:08:07 (31) : bisync dry-run 2024/05/06 06:08:07 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:07 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:07 INFO : Synching Path1 "/tmp/060802gi/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/" 2024/05/06 06:08:07 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:07 INFO : Path1 checking for diffs 2024/05/06 06:08:07 NOTICE: - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:07 NOTICE: - Path1 File was deleted - file4.txt 2024/05/06 06:08:07 NOTICE: - Path1 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:08:07 NOTICE: - Path1 File was deleted - file6.txt 2024/05/06 06:08:07 NOTICE: - Path1 File changed: size (larger), time (newer) - file7.txt 2024/05/06 06:08:07 NOTICE: - Path1 File is new - file11.txt 2024/05/06 06:08:07 INFO : Path1: 6 changes:  1 new,  3 modified,  2 deleted 2024/05/06 06:08:07 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:08:07 INFO : Path2 checking for diffs 2024/05/06 06:08:07 NOTICE: - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:07 NOTICE: - Path2 File was deleted - file3.txt 2024/05/06 06:08:07 NOTICE: - Path2 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:08:07 NOTICE: - Path2 File changed: size (larger), time (newer) - file6.txt 2024/05/06 06:08:07 NOTICE: - Path2 File was deleted - file7.txt 2024/05/06 06:08:07 NOTICE: - Path2 File is new - file10.txt 2024/05/06 06:08:07 INFO : Path2: 6 changes:  1 new,  3 modified,  2 deleted 2024/05/06 06:08:07 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:08:07 INFO : Applying changes 2024/05/06 06:08:07 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:07 INFO : Checking potential conflicts... 2024/05/06 06:08:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: 1 differences found 2024/05/06 06:08:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: 1 errors while checking 2024/05/06 06:08:07 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:07 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file11.txt 2024/05/06 06:08:07 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file2.txt 2024/05/06 06:08:07 NOTICE: - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file4.txt 2024/05/06 06:08:07 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:08:07 NOTICE: file5.txt: Skipped rename as --dry-run is set 2024/05/06 06:08:07 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file5.txt.conflict1 2024/05/06 06:08:07 NOTICE: file5.txt: Skipped rename as --dry-run is set 2024/05/06 06:08:07 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/dry_run/path1/file5.txt.conflict2 2024/05/06 06:08:07 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/dry_run/path1/file6.txt 2024/05/06 06:08:07 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file7.txt 2024/05/06 06:08:07 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/dry_run/path1/file1.txt 2024/05/06 06:08:07 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/dry_run/path1/file10.txt 2024/05/06 06:08:07 NOTICE: - Path1 Queue delete - /tmp/060802gi/dry_run/path1/file3.txt 2024/05/06 06:08:07 NOTICE: - Path2 Do queued copies to - Path1 2024/05/06 06:08:07 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:07 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:07 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:07 NOTICE: file3.txt: Skipped delete as --dry-run is set (size 0) 2024/05/06 06:08:07 NOTICE: - Path1 Do queued copies to - Path2 2024/05/06 06:08:07 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:07 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:07 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13) 2024/05/06 06:08:07 NOTICE: file4.txt: Skipped delete as --dry-run is set (size 0) 2024/05/06 06:08:07 INFO : Updating listings 2024/05/06 06:08:07 INFO : Bisync successful 2024/05/06 06:08:07 (32) : copy-listings dryrun 2024/05/06 06:08:07 (33) : test sync without dry-run 2024/05/06 06:08:07 (34) : bisync 2024/05/06 06:08:07 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:07 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:07 INFO : Synching Path1 "/tmp/060802gi/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/" 2024/05/06 06:08:07 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:07 INFO : Path1 checking for diffs 2024/05/06 06:08:07 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:07 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:08:07 INFO : - Path1 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:08:07 INFO : - Path1 File was deleted - file6.txt 2024/05/06 06:08:07 INFO : - Path1 File changed: size (larger), time (newer) - file7.txt 2024/05/06 06:08:07 INFO : - Path1 File is new - file11.txt 2024/05/06 06:08:07 INFO : Path1: 6 changes:  1 new,  3 modified,  2 deleted 2024/05/06 06:08:07 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:08:07 INFO : Path2 checking for diffs 2024/05/06 06:08:07 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:07 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:08:07 INFO : - Path2 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:08:07 INFO : - Path2 File changed: size (larger), time (newer) - file6.txt 2024/05/06 06:08:07 INFO : - Path2 File was deleted - file7.txt 2024/05/06 06:08:07 INFO : - Path2 File is new - file10.txt 2024/05/06 06:08:07 INFO : Path2: 6 changes:  1 new,  3 modified,  2 deleted 2024/05/06 06:08:07 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:08:07 INFO : Applying changes 2024/05/06 06:08:07 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:07 INFO : Checking potential conflicts... 2024/05/06 06:08:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: 1 differences found 2024/05/06 06:08:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2: 1 errors while checking 2024/05/06 06:08:07 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:07 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file11.txt 2024/05/06 06:08:07 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file2.txt 2024/05/06 06:08:07 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file4.txt 2024/05/06 06:08:07 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:08:07 NOTICE: - Path1 Renaming Path1 copy - /tmp/060802gi/dry_run/path1/file5.txt.conflict1 2024/05/06 06:08:07 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/05/06 06:08:07 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file5.txt.conflict1 2024/05/06 06:08:07 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file5.txt.conflict2 2024/05/06 06:08:07 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/05/06 06:08:07 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/dry_run/path1/file5.txt.conflict2 2024/05/06 06:08:07 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/dry_run/path1/file6.txt 2024/05/06 06:08:07 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/file7.txt 2024/05/06 06:08:07 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/dry_run/path1/file1.txt 2024/05/06 06:08:07 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/dry_run/path1/file10.txt 2024/05/06 06:08:07 INFO : - Path1 Queue delete - /tmp/060802gi/dry_run/path1/file3.txt 2024/05/06 06:08:07 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:07 INFO : file10.txt: Copied (new) 2024/05/06 06:08:07 INFO : file5.txt.conflict2: Copied (new) 2024/05/06 06:08:07 INFO : file6.txt: Copied (new) 2024/05/06 06:08:07 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:07 INFO : file3.txt: Deleted 2024/05/06 06:08:07 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:07 INFO : file11.txt: Copied (new) 2024/05/06 06:08:07 INFO : file5.txt.conflict1: Copied (new) 2024/05/06 06:08:07 INFO : file7.txt: Copied (new) 2024/05/06 06:08:07 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:07 INFO : file4.txt: Deleted 2024/05/06 06:08:07 INFO : Updating listings 2024/05/06 06:08:07 INFO : Validating listings for Path1 "/tmp/060802gi/dry_run/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/dry_run/path2/" 2024/05/06 06:08:07 INFO : Bisync successful bisync_test.go:555: TEST dry_run PASSED === RUN TestBisyncLocalRemote/equal 2024/05/06 06:08:07 DEBUG : Creating backend with remote "/tmp/060802gi/equal/path1" 2024/05/06 06:08:07 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:07 DEBUG : path2: Making directory 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:07 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2" 2024/05/06 06:08:07 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:07 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:07 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2" 2024/05/06 06:08:07 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_equal-dusojun5" 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/initdir/test_equal-dusojun5: Waiting for checks to finish 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/initdir/test_equal-dusojun5: Waiting for transfers to finish 2024/05/06 06:08:07 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file1.txt.xerohak3.partial: renamed to: file1.txt 2024/05/06 06:08:07 INFO : file1.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file2.txt.fufojej5.partial: renamed to: file2.txt 2024/05/06 06:08:07 INFO : file2.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:07 DEBUG : RCLONE_TEST.nojociv9.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:07 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:07 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_equal-muruyiq9" 2024/05/06 06:08:07 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/datadir/test_equal-muruyiq9: Waiting for checks to finish 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/datadir/test_equal-muruyiq9: Waiting for transfers to finish 2024/05/06 06:08:07 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/05/06 06:08:07 DEBUG : file1L.txt.rubogan4.partial: renamed to: file1L.txt 2024/05/06 06:08:07 INFO : file1L.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/05/06 06:08:07 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK 2024/05/06 06:08:07 DEBUG : file2.txt.loqiyem4.partial: renamed to: file2.txt 2024/05/06 06:08:07 INFO : file2.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file1R.txt.kavowiq2.partial: renamed to: file1R.txt 2024/05/06 06:08:07 INFO : file1R.txt: Copied (new) 2024/05/06 06:08:07 ERROR : : error listing: directory not found 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2] 2024/05/06 06:08:07 ERROR : : error listing: directory not found 2024/05/06 06:08:07 checking initFs Local file system at /tmp/060802gi/initdir/test_equal-dusojun5 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/equal/path1: Waiting for checks to finish 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/equal/path1: Waiting for transfers to finish 2024/05/06 06:08:07 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file1.txt.qutipaj0.partial: renamed to: file1.txt 2024/05/06 06:08:07 INFO : file1.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file2.txt.tuvovel1.partial: renamed to: file2.txt 2024/05/06 06:08:07 INFO : file2.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:07 DEBUG : RCLONE_TEST.curamud3.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:07 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:07 checking Path1 Local file system at /tmp/060802gi/equal/path1 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2] 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2: Waiting for checks to finish 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2/RCLONE_TEST] 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2/file2.txt] 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2: Waiting for transfers to finish 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2/file1.txt] 2024/05/06 06:08:07 INFO : file2.txt: Copied (new) 2024/05/06 06:08:07 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:07 INFO : file1.txt: Copied (new) 2024/05/06 06:08:07 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2] 2024/05/06 06:08:07 (01) : test equal 2024/05/06 06:08:07 (02) : test initial bisync 2024/05/06 06:08:07 (03) : bisync resync 2024/05/06 06:08:07 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:07 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:07 INFO : Synching Path1 "/tmp/060802gi/equal/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2/" 2024/05/06 06:08:07 INFO : Copying Path2 files to Path1 2024/05/06 06:08:07 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:07 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:07 INFO : Resync updating listings 2024/05/06 06:08:07 INFO : Validating listings for Path1 "/tmp/060802gi/equal/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2/" 2024/05/06 06:08:07 INFO : Bisync successful 2024/05/06 06:08:07 (04) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:07 (05) : touch-glob 2001-01-02 /tmp/060802gi/datadir/test_equal-muruyiq9/ file1R.txt 2024/05/06 06:08:07 (06) : copy-as /tmp/060802gi/datadir/test_equal-muruyiq9/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2/ file1.txt 2024/05/06 06:08:07 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:07 (07) : touch-glob 2001-03-04 /tmp/060802gi/datadir/test_equal-muruyiq9/ file1L.txt 2024/05/06 06:08:07 (08) : copy-as /tmp/060802gi/datadir/test_equal-muruyiq9/file1L.txt /tmp/060802gi/equal/path1/ file1.txt 2024/05/06 06:08:07 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:07 (09) : test changed on both paths and identical - file2 2024/05/06 06:08:07 (10) : touch-glob 2001-01-02 /tmp/060802gi/datadir/test_equal-muruyiq9/ file2.txt 2024/05/06 06:08:07 (11) : copy-as /tmp/060802gi/datadir/test_equal-muruyiq9/file2.txt /tmp/060802gi/equal/path1/ file2.txt 2024/05/06 06:08:07 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:07 (12) : copy-as /tmp/060802gi/datadir/test_equal-muruyiq9/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2/ file2.txt 2024/05/06 06:08:07 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:07 (13) : test bisync run 2024/05/06 06:08:07 (14) : bisync 2024/05/06 06:08:07 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:07 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:07 INFO : Synching Path1 "/tmp/060802gi/equal/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2/" 2024/05/06 06:08:07 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:07 INFO : Path1 checking for diffs 2024/05/06 06:08:07 INFO : - Path1 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:07 INFO : - Path1 [35mFile changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:07 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:08:07 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/05/06 06:08:07 INFO : Path2 checking for diffs 2024/05/06 06:08:07 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:07 INFO : - Path2 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:07 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:08:07 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/05/06 06:08:07 INFO : Applying changes 2024/05/06 06:08:07 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:07 INFO : Checking potential conflicts... 2024/05/06 06:08:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2: 1 differences found 2024/05/06 06:08:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2: 1 errors while checking 2024/05/06 06:08:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2: 1 matching files 2024/05/06 06:08:07 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:07 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:07 NOTICE: - Path1 Renaming Path1 copy - /tmp/060802gi/equal/path1/file1.txt.conflict1 2024/05/06 06:08:07 INFO : file1.txt: Moved (server-side) to: file1.txt.conflict1 2024/05/06 06:08:07 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2/file1.txt.conflict1 2024/05/06 06:08:07 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2/file1.txt.conflict2 2024/05/06 06:08:07 INFO : file1.txt: Moved (server-side) to: file1.txt.conflict2 2024/05/06 06:08:07 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/equal/path1/file1.txt.conflict2 2024/05/06 06:08:07 NOTICE: - WARNING New or changed in both paths - file2.txt 2024/05/06 06:08:07 INFO : Files are equal! Skipping: file2.txt 2024/05/06 06:08:07 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:07 INFO : file1.txt.conflict2: Copied (new) 2024/05/06 06:08:07 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:07 INFO : file1.txt.conflict1: Copied (new) 2024/05/06 06:08:07 INFO : Updating listings 2024/05/06 06:08:07 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:07 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:07 INFO : Validating listings for Path1 "/tmp/060802gi/equal/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/equal/path2/" 2024/05/06 06:08:07 INFO : Bisync successful bisync_test.go:555: TEST equal PASSED === RUN TestBisyncLocalRemote/ext_paths 2024/05/06 06:08:07 DEBUG : Creating backend with remote "/tmp/060802gi/ext_paths/path1" 2024/05/06 06:08:07 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:07 DEBUG : path2: Making directory 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:07 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2" 2024/05/06 06:08:07 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:07 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:07 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2" 2024/05/06 06:08:07 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_ext_paths-johuroc0" 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ: Making directory with metadata 2024/05/06 06:08:07 INFO : 測試РуÑÑкий ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z) 2024/05/06 06:08:07 DEBUG : Added delayed dir = "測試РуÑÑкий ěáñ", newDst=測試РуÑÑкий ěáñ 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/initdir/test_ext_paths-johuroc0: Waiting for checks to finish 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/initdir/test_ext_paths-johuroc0: Waiting for transfers to finish 2024/05/06 06:08:07 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file_enconde_mañana_funcionará.txt.joruhax9.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/05/06 06:08:07 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file1.txt.fuxevur7.partial: renamed to: file1.txt 2024/05/06 06:08:07 INFO : file1.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : РуÑÑкий.txt.yipesan7.partial: renamed to: РуÑÑкий.txt 2024/05/06 06:08:07 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : 測試_check file.kihilil0.partial: renamed to: 測試_check file 2024/05/06 06:08:07 INFO : 測試_check file: Copied (new) 2024/05/06 06:08:07 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:07 DEBUG : filename_contains_Ä›_.txt.vahevap9.partial: renamed to: filename_contains_Ä›_.txt 2024/05/06 06:08:07 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt.huhidew4.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt 2024/05/06 06:08:07 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:07 DEBUG : filename_contains_ࢺ_.txt.dadadoq7.partial: renamed to: filename_contains_ࢺ_.txt 2024/05/06 06:08:07 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt.jucoyuf6.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt 2024/05/06 06:08:07 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/測試_check file.lixotes2.partial: renamed to: 測試РуÑÑкий ěáñ/測試_check file 2024/05/06 06:08:07 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:07 DEBUG : RCLONE_TEST.cidaxag2.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:07 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:07 INFO : 測試РуÑÑкий ěáñ: Updated directory metadata 2024/05/06 06:08:07 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_ext_paths-bufucep7" 2024/05/06 06:08:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/datadir/test_ext_paths-bufucep7: Waiting for checks to finish 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/datadir/test_ext_paths-bufucep7: Waiting for transfers to finish 2024/05/06 06:08:07 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:07 DEBUG : file1.txt.qapowel4.partial: renamed to: file1.txt 2024/05/06 06:08:07 INFO : file1.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/05/06 06:08:07 DEBUG : 測試_filtersfile.txt.pumogut0.partial: renamed to: 測試_filtersfile.txt 2024/05/06 06:08:07 INFO : 測試_filtersfile.txt: Copied (new) 2024/05/06 06:08:07 ERROR : : error listing: directory not found 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2] 2024/05/06 06:08:07 ERROR : : error listing: directory not found 2024/05/06 06:08:07 checking initFs Local file system at /tmp/060802gi/initdir/test_ext_paths-johuroc0 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ: Making directory with metadata 2024/05/06 06:08:07 INFO : 測試РуÑÑкий ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z) 2024/05/06 06:08:07 DEBUG : Added delayed dir = "測試РуÑÑкий ěáñ", newDst=測試РуÑÑкий ěáñ 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : file1.txt.hulixuv7.partial: renamed to: file1.txt 2024/05/06 06:08:07 INFO : file1.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:07 DEBUG : file_enconde_mañana_funcionará.txt.mimexeq0.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/05/06 06:08:07 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : RCLONE_TEST.surudif0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:07 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:07 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:07 DEBUG : filename_contains_Ä›_.txt.nicofeq3.partial: renamed to: filename_contains_Ä›_.txt 2024/05/06 06:08:07 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/ext_paths/path1: Waiting for checks to finish 2024/05/06 06:08:07 DEBUG : Local file system at /tmp/060802gi/ext_paths/path1: Waiting for transfers to finish 2024/05/06 06:08:07 DEBUG : 測試_check file.vilojof3.partial: renamed to: 測試_check file 2024/05/06 06:08:07 INFO : 測試_check file: Copied (new) 2024/05/06 06:08:07 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:07 DEBUG : filename_contains_ࢺ_.txt.tuvigah2.partial: renamed to: filename_contains_ࢺ_.txt 2024/05/06 06:08:07 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:07 DEBUG : РуÑÑкий.txt.pulopul7.partial: renamed to: РуÑÑкий.txt 2024/05/06 06:08:07 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt.qelavin8.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt 2024/05/06 06:08:07 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt.zehovij1.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt 2024/05/06 06:08:07 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/測試_check file.qaxizoc9.partial: renamed to: 測試РуÑÑкий ěáñ/測試_check file 2024/05/06 06:08:07 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/05/06 06:08:07 INFO : 測試РуÑÑкий ěáñ: Updated directory metadata 2024/05/06 06:08:07 checking Path1 Local file system at /tmp/060802gi/ext_paths/path1 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2] 2024/05/06 06:08:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ: Making directory 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ] 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/RCLONE_TEST] 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/file1.txt] 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/filename_contains_Ä›_.txt] 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/file_enconde_mañana_funcionará.txt] 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: Waiting for checks to finish 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: Waiting for transfers to finish 2024/05/06 06:08:07 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/filename_contains_ࢺ_.txt] 2024/05/06 06:08:07 INFO : file1.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/РуÑÑкий.txt] 2024/05/06 06:08:07 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試_check file] 2024/05/06 06:08:07 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt] 2024/05/06 06:08:07 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt] 2024/05/06 06:08:07 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ/測試_check file] 2024/05/06 06:08:07 INFO : 測試_check file: Copied (new) 2024/05/06 06:08:07 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:07 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:08 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/05/06 06:08:08 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2] 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ] 2024/05/06 06:08:08 (01) : test extended-char-paths 2024/05/06 06:08:08 (02) : fix-names /tmp/060802gi/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/ 2024/05/06 06:08:08 ERROR : Local file system at /tmp/060802gi/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-xekoses5: Server side directory move failed: rename /tmp/060802gi/ext_paths/path1/測試РуÑÑкий eÌŒaÌñ /tmp/060802gi/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-xekoses5: no such file or directory 2024/05/06 06:08:08 INFO : Local file system at /tmp/060802gi/ext_paths/path1/測試РуÑÑкий ěáñ: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2024/05/06 06:08:08 ERROR : Local file system at /tmp/060802gi/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-xekoses5: error reading source root directory: directory not found 2024/05/06 06:08:08 (03) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/ 2024/05/06 06:08:08 ERROR : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-vabuzem5: Server side directory move failed: rename /rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий eÌŒaÌñ: file does not exist 2024/05/06 06:08:08 INFO : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ/: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2024/05/06 06:08:08 ERROR : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-vabuzem5: error reading source root directory: directory not found 2024/05/06 06:08:08 (04) : fix-names /tmp/060802gi/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:08:08 (05) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:08:08 (06) : fix-names /tmp/060802gi/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/filename_contains_Ä›_.txt 2024/05/06 06:08:08 (07) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/filename_contains_Ä›_.txt 2024/05/06 06:08:08 (08) : fix-names /tmp/060802gi/ext_paths/path1/測試_check{spc}file 2024/05/06 06:08:08 (09) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試_check{spc}file 2024/05/06 06:08:08 (10) : fix-names /tmp/060802gi/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:08:08 (11) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:08:08 (12) : test resync subdirs with extended chars 2024/05/06 06:08:08 (13) : bisync subdir=測試РуÑÑкий{spc}{spc}ěáñ resync 2024/05/06 06:08:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:08 INFO : Synching Path1 "/tmp/060802gi/ext_paths/path1/測試РуÑÑкий ěáñ/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/05/06 06:08:08 INFO : Copying Path2 files to Path1 2024/05/06 06:08:08 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:08 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:08 INFO : Resync updating listings 2024/05/06 06:08:08 INFO : Validating listings for Path1 "/tmp/060802gi/ext_paths/path1/測試РуÑÑкий ěáñ/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/05/06 06:08:08 INFO : Bisync successful 2024/05/06 06:08:08 (14) : copy-listings resync 2024/05/06 06:08:08 (15) : test place new files with extended chars on each side 2024/05/06 06:08:08 (16) : touch-glob 2001-01-02 /tmp/060802gi/datadir/test_ext_paths-bufucep7/ file1.txt 2024/05/06 06:08:08 (17) : copy-as /tmp/060802gi/datadir/test_ext_paths-bufucep7/file1.txt /tmp/060802gi/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ 測試_file1p1 2024/05/06 06:08:08 INFO : file1.txt: Copied (new) to: 測試_file1p1 2024/05/06 06:08:08 (18) : copy-as /tmp/060802gi/datadir/test_ext_paths-bufucep7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ 測試_file1p2 2024/05/06 06:08:08 INFO : file1.txt: Copied (new) to: 測試_file1p2 2024/05/06 06:08:08 (19) : test normal sync of subdirs with extended chars 2024/05/06 06:08:08 (20) : bisync subdir=測試РуÑÑкий{spc}{spc}ěáñ 2024/05/06 06:08:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:08 INFO : Synching Path1 "/tmp/060802gi/ext_paths/path1/測試РуÑÑкий ěáñ/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/05/06 06:08:08 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:08 INFO : Path1 checking for diffs 2024/05/06 06:08:08 INFO : - Path1 File is new - 測試_file1p1 2024/05/06 06:08:08 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:08 INFO : Path2 checking for diffs 2024/05/06 06:08:08 INFO : - Path2 File is new - 測試_file1p2 2024/05/06 06:08:08 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:08 INFO : Applying changes 2024/05/06 06:08:08 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ/測試_file1p1 2024/05/06 06:08:08 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/ext_paths/path1/測試РуÑÑкий ěáñ/測試_file1p2 2024/05/06 06:08:08 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:08 INFO : 測試_file1p2: Copied (new) 2024/05/06 06:08:08 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:08 INFO : 測試_file1p1: Copied (new) 2024/05/06 06:08:08 INFO : Updating listings 2024/05/06 06:08:08 INFO : Validating listings for Path1 "/tmp/060802gi/ext_paths/path1/測試РуÑÑкий ěáñ/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/05/06 06:08:08 INFO : Bisync successful 2024/05/06 06:08:08 (21) : move-listings normal-sync 2024/05/06 06:08:08 (22) : test check-filename with extended chars. check should fail. 2024/05/06 06:08:08 (23) : bisync resync 2024/05/06 06:08:08 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/05/06 06:08:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:08 INFO : Synching Path1 "/tmp/060802gi/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/" 2024/05/06 06:08:08 INFO : Copying Path2 files to Path1 2024/05/06 06:08:08 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:08 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:08 INFO : Resync updating listings 2024/05/06 06:08:08 INFO : Validating listings for Path1 "/tmp/060802gi/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/" 2024/05/06 06:08:08 INFO : Bisync successful 2024/05/06 06:08:08 (24) : delete-file /tmp/060802gi/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:08:08 INFO : 測試_check file: Deleted 2024/05/06 06:08:08 (25) : bisync check-access check-filename=測試_check{spc}file 2024/05/06 06:08:08 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/05/06 06:08:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:08 INFO : Synching Path1 "/tmp/060802gi/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/" 2024/05/06 06:08:08 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:08 INFO : Path1 checking for diffs 2024/05/06 06:08:08 INFO : - Path1 File was deleted - 測試РуÑÑкий ěáñ/測試_check file 2024/05/06 06:08:08 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:08 INFO : Path2 checking for diffs 2024/05/06 06:08:08 INFO : Checking access health 2024/05/06 06:08:08 ERROR : Access test failed: Path1 count 1, Path2 count 2 - 測試_check file 2024/05/06 06:08:08 ERROR : -  Access test failed: Path2 file not found in Path1 - 測試РуÑÑкий ěáñ/測試_check file 2024/05/06 06:08:08 ERROR : Bisync critical error: check file check failed 2024/05/06 06:08:08 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:08 Bisync error: bisync aborted 2024/05/06 06:08:08 (26) : copy-listings check-access-fail 2024/05/06 06:08:08 (27) : test check-filename with extended chars. check should pass. 2024/05/06 06:08:08 (28) : bisync resync 2024/05/06 06:08:08 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/05/06 06:08:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:08 INFO : Synching Path1 "/tmp/060802gi/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/" 2024/05/06 06:08:08 INFO : Copying Path2 files to Path1 2024/05/06 06:08:08 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:08 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/05/06 06:08:08 INFO : 測試РуÑÑкий ěáñ: Updated directory metadata 2024/05/06 06:08:08 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:08 INFO : Resync updating listings 2024/05/06 06:08:08 INFO : Validating listings for Path1 "/tmp/060802gi/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/" 2024/05/06 06:08:08 INFO : Bisync successful 2024/05/06 06:08:08 (29) : bisync check-access check-filename=測試_check{spc}file 2024/05/06 06:08:08 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/05/06 06:08:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:08 INFO : Synching Path1 "/tmp/060802gi/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/" 2024/05/06 06:08:08 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:08 INFO : Path1 checking for diffs 2024/05/06 06:08:08 INFO : Path2 checking for diffs 2024/05/06 06:08:08 INFO : Checking access health 2024/05/06 06:08:08 INFO : Found 2 matching "測試_check file" files on both paths 2024/05/06 06:08:08 INFO : No changes found 2024/05/06 06:08:08 INFO : Updating listings 2024/05/06 06:08:08 INFO : Validating listings for Path1 "/tmp/060802gi/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/" 2024/05/06 06:08:08 INFO : Bisync successful 2024/05/06 06:08:08 (30) : move-listings check-access-pass 2024/05/06 06:08:08 (31) : test filters-file path with extended chars - masks /fileZ.txt 2024/05/06 06:08:08 (32) : copy-file /tmp/060802gi/datadir/test_ext_paths-bufucep7/測試_filtersfile.txt /tmp/060802gi/workdir/ 2024/05/06 06:08:08 INFO : 測試_filtersfile.txt: Copied (new) 2024/05/06 06:08:08 (33) : bisync filters-file=/tmp/060802gi/workdir/測試_filtersfile.txt resync 2024/05/06 06:08:08 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/05/06 06:08:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:08 INFO : Synching Path1 "/tmp/060802gi/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/" 2024/05/06 06:08:08 INFO : Using filters file /tmp/060802gi/workdir/測試_filtersfile.txt 2024/05/06 06:08:08 INFO : Storing filters file hash to /tmp/060802gi/workdir/測試_filtersfile.txt.md5 2024/05/06 06:08:08 INFO : Copying Path2 files to Path1 2024/05/06 06:08:08 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:08 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:08 INFO : Resync updating listings 2024/05/06 06:08:08 INFO : Validating listings for Path1 "/tmp/060802gi/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/" 2024/05/06 06:08:08 INFO : Bisync successful 2024/05/06 06:08:08 (34) : copy-as /tmp/060802gi/datadir/test_ext_paths-bufucep7/file1.txt /tmp/060802gi/ext_paths/path1/ fileZ.txt 2024/05/06 06:08:08 INFO : file1.txt: Copied (new) to: fileZ.txt 2024/05/06 06:08:08 (35) : bisync filters-file=/tmp/060802gi/workdir/測試_filtersfile.txt 2024/05/06 06:08:08 INFO : 測試РуÑÑкий ěáñ: Set directory modification time (using SetModTime) 2024/05/06 06:08:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:08 INFO : Synching Path1 "/tmp/060802gi/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/" 2024/05/06 06:08:08 INFO : Using filters file /tmp/060802gi/workdir/測試_filtersfile.txt 2024/05/06 06:08:08 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:08 INFO : Path1 checking for diffs 2024/05/06 06:08:08 INFO : Path2 checking for diffs 2024/05/06 06:08:08 INFO : No changes found 2024/05/06 06:08:08 INFO : Updating listings 2024/05/06 06:08:08 INFO : Validating listings for Path1 "/tmp/060802gi/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ext_paths/path2/" 2024/05/06 06:08:08 INFO : Bisync successful bisync_test.go:555: TEST ext_paths PASSED === RUN TestBisyncLocalRemote/extended_filenames 2024/05/06 06:08:08 DEBUG : Creating backend with remote "/tmp/060802gi/extended_filenames/path1" 2024/05/06 06:08:08 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:08 DEBUG : path2: Making directory 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:08 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2" 2024/05/06 06:08:08 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:08 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:08 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:08 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:08 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:08 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:08 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2" 2024/05/06 06:08:08 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_extended_filenames-yepixex1" 2024/05/06 06:08:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_: Making directory with metadata 2024/05/06 06:08:08 INFO : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:08 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_ 2024/05/06 06:08:08 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file1 - Copy (2).txt.doroyak8.partial: renamed to: file1 - Copy (2).txt 2024/05/06 06:08:08 INFO : file1 - Copy (2).txt: Copied (new) 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : Local file system at /tmp/060802gi/initdir/test_extended_filenames-yepixex1: Waiting for checks to finish 2024/05/06 06:08:08 DEBUG : Local file system at /tmp/060802gi/initdir/test_extended_filenames-yepixex1: Waiting for transfers to finish 2024/05/06 06:08:08 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:08 DEBUG : RCLONE_TEST.qolojif0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:08 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:08 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file1 - Copy.txt.jahagit6.partial: renamed to: file1 - Copy.txt 2024/05/06 06:08:08 INFO : file1 - Copy.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file_enconde_mañana_funcionará.txt.getamug3.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/05/06 06:08:08 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file1.txt.livogoj5.partial: renamed to: file1.txt 2024/05/06 06:08:08 INFO : file1.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : РуÑÑкий.txt.zixeqip4.partial: renamed to: РуÑÑкий.txt 2024/05/06 06:08:08 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:08 DEBUG : filename_contains_Ä›_.txt.kumobog3.partial: renamed to: filename_contains_Ä›_.txt 2024/05/06 06:08:08 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:08 DEBUG : filename_contains_ࢺ_.txt.howacup7.partial: renamed to: filename_contains_ࢺ_.txt 2024/05/06 06:08:08 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.jizubiy7.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt 2024/05/06 06:08:08 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt.jopediz5.partial: renamed to: subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:08:08 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:08 INFO : subdir_with_ࢺ_: Updated directory metadata 2024/05/06 06:08:08 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_extended_filenames-makupap2" 2024/05/06 06:08:08 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : Local file system at /tmp/060802gi/datadir/test_extended_filenames-makupap2: Waiting for checks to finish 2024/05/06 06:08:08 DEBUG : Local file system at /tmp/060802gi/datadir/test_extended_filenames-makupap2: Waiting for transfers to finish 2024/05/06 06:08:08 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:08 DEBUG : file1.txt.fogexow1.partial: renamed to: file1.txt 2024/05/06 06:08:08 INFO : file1.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file2.txt: md5 = 40b811fb5009223b6da573f169619d8e OK 2024/05/06 06:08:08 DEBUG : file2.txt.lugexus9.partial: renamed to: file2.txt 2024/05/06 06:08:08 INFO : file2.txt: Copied (new) 2024/05/06 06:08:08 ERROR : : error listing: directory not found 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2] 2024/05/06 06:08:08 ERROR : : error listing: directory not found 2024/05/06 06:08:08 checking initFs Local file system at /tmp/060802gi/initdir/test_extended_filenames-yepixex1 2024/05/06 06:08:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_: Making directory with metadata 2024/05/06 06:08:08 INFO : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:08 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_ 2024/05/06 06:08:08 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file1 - Copy.txt.ropexin8.partial: renamed to: file1 - Copy.txt 2024/05/06 06:08:08 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 INFO : file1 - Copy.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file1.txt.gutuvat6.partial: renamed to: file1.txt 2024/05/06 06:08:08 INFO : file1.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:08 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file_enconde_mañana_funcionará.txt.sibuduw9.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/05/06 06:08:08 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : RCLONE_TEST.jofanej8.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:08 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file1 - Copy (2).txt.baqejil6.partial: renamed to: file1 - Copy (2).txt 2024/05/06 06:08:08 INFO : file1 - Copy (2).txt: Copied (new) 2024/05/06 06:08:08 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : РуÑÑкий.txt.jepicev7.partial: renamed to: РуÑÑкий.txt 2024/05/06 06:08:08 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : Local file system at /tmp/060802gi/extended_filenames/path1: Waiting for checks to finish 2024/05/06 06:08:08 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:08 DEBUG : Local file system at /tmp/060802gi/extended_filenames/path1: Waiting for transfers to finish 2024/05/06 06:08:08 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:08 DEBUG : filename_contains_ࢺ_.txt.nakeyef8.partial: renamed to: filename_contains_ࢺ_.txt 2024/05/06 06:08:08 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : filename_contains_Ä›_.txt.qidabug8.partial: renamed to: filename_contains_Ä›_.txt 2024/05/06 06:08:08 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt.locufip3.partial: renamed to: subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:08:08 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.heraviz9.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt 2024/05/06 06:08:08 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:08 INFO : subdir_with_ࢺ_: Updated directory metadata 2024/05/06 06:08:08 checking Path1 Local file system at /tmp/060802gi/extended_filenames/path1 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2] 2024/05/06 06:08:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_: Making directory 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/subdir_with_ࢺ_] 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/RCLONE_TEST] 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/file1 - Copy.txt] 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/file1 - Copy (2).txt] 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/file1.txt] 2024/05/06 06:08:08 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: Waiting for checks to finish 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: Waiting for transfers to finish 2024/05/06 06:08:08 INFO : file1 - Copy.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/file_enconde_mañana_funcionará.txt] 2024/05/06 06:08:08 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/filename_contains_Ä›_.txt] 2024/05/06 06:08:08 INFO : file1 - Copy (2).txt: Copied (new) 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/filename_contains_ࢺ_.txt] 2024/05/06 06:08:08 INFO : file1.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/РуÑÑкий.txt] 2024/05/06 06:08:08 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_Ä›_.txt] 2024/05/06 06:08:08 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ࢺ_.txt] 2024/05/06 06:08:08 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:08 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:08 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:08 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:08 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2] 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/subdir_with_ࢺ_] 2024/05/06 06:08:08 (01) : test extended-filenames 2024/05/06 06:08:08 (02) : fix-names /tmp/060802gi/extended_filenames/path1/subdir_with_ࢺ_/ 2024/05/06 06:08:08 (03) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/subdir_with_ࢺ_/ 2024/05/06 06:08:08 (04) : fix-names /tmp/060802gi/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:08:08 (05) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:08:08 (06) : fix-names /tmp/060802gi/extended_filenames/path1/РуÑÑкий.txt 2024/05/06 06:08:08 (07) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/РуÑÑкий.txt 2024/05/06 06:08:08 (08) : fix-names /tmp/060802gi/extended_filenames/path1/file_enconde_mañana_funcionará.txt 2024/05/06 06:08:08 (09) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2/file_enconde_mañana_funcionará.txt 2024/05/06 06:08:08 (10) : test initial bisync 2024/05/06 06:08:08 (11) : bisync resync 2024/05/06 06:08:08 NOTICE: Local file system at /tmp/060802gi/extended_filenames/path1: Replacing invalid UTF-8 characters in "eÌŒ\x81\xfe aÌñhࢺ_測試РуÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬eÌö" 2024/05/06 06:08:08 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:08:08 NOTICE: Local file system at /tmp/060802gi/extended_filenames/path1: Replacing invalid UTF-8 characters in "Ä›\x81\xfe áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö" 2024/05/06 06:08:08 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/05/06 06:08:08 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:08:08 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) bisync_test.go:1014: Fs is incapable of running test as the paths produce different results, skipping: extended_filenames (path1: file1 - Copy (2).txtfile1 - Copy (2).txt (BOTH) path2: РуÑÑкий.txtÄ›þ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶ (РуÑÑкий.txtÄ›þ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶)) (fs1: Local file system at /tmp/060802gi/extended_filenames/path1 fs2: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/extended_filenames/path2) @@ -1 +1 @@ -file1 - Copy (2).txtfile1 - Copy (2).txt+РуÑÑкий.txtÄ›þ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶ === RUN TestBisyncLocalRemote/filters 2024/05/06 06:08:08 DEBUG : Creating backend with remote "/tmp/060802gi/filters/path1" 2024/05/06 06:08:08 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:08 DEBUG : path2: Making directory 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:08 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2" 2024/05/06 06:08:08 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:08 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:08 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:08 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:08 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:08 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:08 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2" 2024/05/06 06:08:08 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_filters-joduvuc5" 2024/05/06 06:08:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:08 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:08 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:08 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : Local file system at /tmp/060802gi/initdir/test_filters-joduvuc5: Waiting for checks to finish 2024/05/06 06:08:08 DEBUG : file1.txt.qehovey7.partial: renamed to: file1.txt 2024/05/06 06:08:08 INFO : file1.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : Local file system at /tmp/060802gi/initdir/test_filters-joduvuc5: Waiting for transfers to finish 2024/05/06 06:08:08 DEBUG : file2.txt.cisoluc1.partial: renamed to: file2.txt 2024/05/06 06:08:08 INFO : file2.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file4.txt.yedosib0.partial: renamed to: file4.txt 2024/05/06 06:08:08 INFO : file4.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file5.txt.hidedev9.partial: renamed to: file5.txt 2024/05/06 06:08:08 INFO : file5.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:08 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file6.txt.vopisap3.partial: renamed to: file6.txt 2024/05/06 06:08:08 INFO : file6.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : RCLONE_TEST.majujew2.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:08 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:08 DEBUG : file3.txt.yexariy1.partial: renamed to: file3.txt 2024/05/06 06:08:08 INFO : file3.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : subdir/file20.txt.xesubot5.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:08 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file7.txt.xituhej7.partial: renamed to: file7.txt 2024/05/06 06:08:08 INFO : file7.txt: Copied (new) 2024/05/06 06:08:08 INFO : subdir: Updated directory metadata 2024/05/06 06:08:08 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_filters-fikutib0" 2024/05/06 06:08:08 DEBUG : fileZ.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : filtersfile.flt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : Local file system at /tmp/060802gi/datadir/test_filters-fikutib0: Waiting for checks to finish 2024/05/06 06:08:08 DEBUG : Local file system at /tmp/060802gi/datadir/test_filters-fikutib0: Waiting for transfers to finish 2024/05/06 06:08:08 DEBUG : fileZ.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:08 DEBUG : fileZ.txt.riniyaw5.partial: renamed to: fileZ.txt 2024/05/06 06:08:08 INFO : fileZ.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : filtersfile.flt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/05/06 06:08:08 DEBUG : filtersfile.flt.veyujoq4.partial: renamed to: filtersfile.flt 2024/05/06 06:08:08 INFO : filtersfile.flt: Copied (new) 2024/05/06 06:08:08 ERROR : : error listing: directory not found 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2] 2024/05/06 06:08:08 ERROR : : error listing: directory not found 2024/05/06 06:08:08 checking initFs Local file system at /tmp/060802gi/initdir/test_filters-joduvuc5 2024/05/06 06:08:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:08 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:08 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:08 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : Local file system at /tmp/060802gi/filters/path1: Waiting for checks to finish 2024/05/06 06:08:08 DEBUG : Local file system at /tmp/060802gi/filters/path1: Waiting for transfers to finish 2024/05/06 06:08:08 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file2.txt.bukobeh3.partial: renamed to: file2.txt 2024/05/06 06:08:08 INFO : file2.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file3.txt.gakahok1.partial: renamed to: file3.txt 2024/05/06 06:08:08 INFO : file3.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file4.txt.hiqoged9.partial: renamed to: file4.txt 2024/05/06 06:08:08 INFO : file4.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:08 DEBUG : file1.txt.jamikil2.partial: renamed to: file1.txt 2024/05/06 06:08:08 INFO : file1.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file5.txt.jufexok5.partial: renamed to: file5.txt 2024/05/06 06:08:08 DEBUG : RCLONE_TEST.tuboxuc5.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:08 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:08 INFO : file5.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file6.txt.veqapiq0.partial: renamed to: file6.txt 2024/05/06 06:08:08 INFO : file6.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : subdir/file20.txt.hoxijej5.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:08 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:08 DEBUG : file7.txt.rirewuk8.partial: renamed to: file7.txt 2024/05/06 06:08:08 INFO : file7.txt: Copied (new) 2024/05/06 06:08:08 INFO : subdir: Updated directory metadata 2024/05/06 06:08:08 checking Path1 Local file system at /tmp/060802gi/filters/path1 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2] 2024/05/06 06:08:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : subdir: Making directory 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/subdir] 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/file1.txt] 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/RCLONE_TEST] 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/file2.txt] 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/file3.txt] 2024/05/06 06:08:08 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: Waiting for checks to finish 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: Waiting for transfers to finish 2024/05/06 06:08:08 INFO : file1.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/file4.txt] 2024/05/06 06:08:08 INFO : file2.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/file5.txt] 2024/05/06 06:08:08 INFO : file3.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/file6.txt] 2024/05/06 06:08:08 INFO : file4.txt: Copied (new) 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/file7.txt] 2024/05/06 06:08:08 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/subdir/file20.txt] 2024/05/06 06:08:08 INFO : file5.txt: Copied (new) 2024/05/06 06:08:08 INFO : file6.txt: Copied (new) 2024/05/06 06:08:08 INFO : file7.txt: Copied (new) 2024/05/06 06:08:08 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:08 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2] 2024/05/06 06:08:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/subdir] 2024/05/06 06:08:08 (01) : test filters 2024/05/06 06:08:08 (02) : copy-file /tmp/060802gi/datadir/test_filters-fikutib0/filtersfile.flt /tmp/060802gi/workdir/ 2024/05/06 06:08:08 INFO : filtersfile.flt: Copied (new) 2024/05/06 06:08:08 (03) : test resync to force building of the filters md5 hash 2024/05/06 06:08:08 (04) : bisync filters-file=/tmp/060802gi/workdir/filtersfile.flt resync 2024/05/06 06:08:08 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:08 INFO : Synching Path1 "/tmp/060802gi/filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/" 2024/05/06 06:08:08 INFO : Using filters file /tmp/060802gi/workdir/filtersfile.flt 2024/05/06 06:08:08 INFO : Storing filters file hash to /tmp/060802gi/workdir/filtersfile.flt.md5 2024/05/06 06:08:08 INFO : Copying Path2 files to Path1 2024/05/06 06:08:08 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:08 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:08 INFO : Resync updating listings 2024/05/06 06:08:08 INFO : Validating listings for Path1 "/tmp/060802gi/filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/" 2024/05/06 06:08:08 INFO : Bisync successful 2024/05/06 06:08:08 (05) : copy-listings resync 2024/05/06 06:08:08 (06) : test place new files on the remote 2024/05/06 06:08:08 (07) : touch-glob 2001-01-02 /tmp/060802gi/datadir/test_filters-fikutib0/ fileZ.txt 2024/05/06 06:08:08 (08) : copy-as /tmp/060802gi/datadir/test_filters-fikutib0/fileZ.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/ fileZ.txt 2024/05/06 06:08:08 INFO : fileZ.txt: Copied (new) 2024/05/06 06:08:08 (09) : copy-as /tmp/060802gi/datadir/test_filters-fikutib0/fileZ.txt /tmp/060802gi/filters/path1/subdir fileZ.txt 2024/05/06 06:08:08 INFO : fileZ.txt: Copied (new) 2024/05/06 06:08:08 (10) : test bisync with filters-file. path2-side fileZ.txt will be filtered. 2024/05/06 06:08:08 (11) : bisync filters-file=/tmp/060802gi/workdir/filtersfile.flt 2024/05/06 06:08:08 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:08 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:08 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:08 INFO : Synching Path1 "/tmp/060802gi/filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/" 2024/05/06 06:08:08 INFO : Using filters file /tmp/060802gi/workdir/filtersfile.flt 2024/05/06 06:08:08 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:08 INFO : Path1 checking for diffs 2024/05/06 06:08:08 INFO : - Path1 File is new - subdir/fileZ.txt 2024/05/06 06:08:08 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:08 INFO : Path2 checking for diffs 2024/05/06 06:08:08 INFO : Applying changes 2024/05/06 06:08:08 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/subdir/fileZ.txt 2024/05/06 06:08:08 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:09 INFO : subdir/fileZ.txt: Copied (new) 2024/05/06 06:08:09 INFO : Updating listings 2024/05/06 06:08:09 INFO : Validating listings for Path1 "/tmp/060802gi/filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filters/path2/" 2024/05/06 06:08:09 INFO : Bisync successful bisync_test.go:555: TEST filters PASSED === RUN TestBisyncLocalRemote/filtersfile_checks 2024/05/06 06:08:09 DEBUG : Creating backend with remote "/tmp/060802gi/filtersfile_checks/path1" 2024/05/06 06:08:09 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:09 DEBUG : path2: Making directory 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:09 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2" 2024/05/06 06:08:09 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:09 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:09 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2" 2024/05/06 06:08:09 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_filtersfile_checks-lahites5" 2024/05/06 06:08:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:09 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:09 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:09 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : subdir/file20.txt.poxipez5.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:09 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/initdir/test_filtersfile_checks-lahites5: Waiting for checks to finish 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/initdir/test_filtersfile_checks-lahites5: Waiting for transfers to finish 2024/05/06 06:08:09 DEBUG : file1.txt.faquyup0.partial: renamed to: file1.txt 2024/05/06 06:08:09 INFO : file1.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file2.txt.gagehot2.partial: renamed to: file2.txt 2024/05/06 06:08:09 INFO : file2.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:09 DEBUG : RCLONE_TEST.zizekad7.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:09 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:09 INFO : subdir: Updated directory metadata 2024/05/06 06:08:09 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_filtersfile_checks-fayovom1" 2024/05/06 06:08:09 DEBUG : filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : filtersfile2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/datadir/test_filtersfile_checks-fayovom1: Waiting for checks to finish 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/datadir/test_filtersfile_checks-fayovom1: Waiting for transfers to finish 2024/05/06 06:08:09 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:08:09 DEBUG : hold.txt.totibiw8.partial: renamed to: hold.txt 2024/05/06 06:08:09 INFO : hold.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : filtersfile.txt: md5 = cbf4389cb34d9e160689d1578eb5707f OK 2024/05/06 06:08:09 DEBUG : filtersfile2.txt: md5 = 95acc1e3b5beda465d9b2cb32808588c OK 2024/05/06 06:08:09 DEBUG : filtersfile.txt.qidofip8.partial: renamed to: filtersfile.txt 2024/05/06 06:08:09 INFO : filtersfile.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : filtersfile2.txt.haxinuv8.partial: renamed to: filtersfile2.txt 2024/05/06 06:08:09 INFO : filtersfile2.txt: Copied (new) 2024/05/06 06:08:09 ERROR : : error listing: directory not found 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2] 2024/05/06 06:08:09 ERROR : : error listing: directory not found 2024/05/06 06:08:09 checking initFs Local file system at /tmp/060802gi/initdir/test_filtersfile_checks-lahites5 2024/05/06 06:08:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:09 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:09 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:09 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file1.txt.vewugiw4.partial: renamed to: file1.txt 2024/05/06 06:08:09 INFO : file1.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/filtersfile_checks/path1: Waiting for checks to finish 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/filtersfile_checks/path1: Waiting for transfers to finish 2024/05/06 06:08:09 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file2.txt.sukocej5.partial: renamed to: file2.txt 2024/05/06 06:08:09 INFO : file2.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : subdir/file20.txt.vigakeh8.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:09 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:09 DEBUG : RCLONE_TEST.secabav0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:09 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:09 INFO : subdir: Updated directory metadata 2024/05/06 06:08:09 checking Path1 Local file system at /tmp/060802gi/filtersfile_checks/path1 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2] 2024/05/06 06:08:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : subdir: Making directory 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/subdir] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/RCLONE_TEST] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/file1.txt] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/file2.txt] 2024/05/06 06:08:09 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/subdir/file20.txt] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2: Waiting for checks to finish 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2: Waiting for transfers to finish 2024/05/06 06:08:09 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:09 INFO : file1.txt: Copied (new) 2024/05/06 06:08:09 INFO : file2.txt: Copied (new) 2024/05/06 06:08:09 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:09 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/subdir] 2024/05/06 06:08:09 (01) : test filtersfile-checks 2024/05/06 06:08:09 (02) : test initial bisync 2024/05/06 06:08:09 (03) : bisync resync 2024/05/06 06:08:09 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/" 2024/05/06 06:08:09 INFO : Copying Path2 files to Path1 2024/05/06 06:08:09 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:09 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:09 INFO : Resync updating listings 2024/05/06 06:08:09 INFO : Validating listings for Path1 "/tmp/060802gi/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/" 2024/05/06 06:08:09 INFO : Bisync successful 2024/05/06 06:08:09 (04) : test 1. inject filters file in workdir. 2024/05/06 06:08:09 (05) : copy-file /tmp/060802gi/datadir/test_filtersfile_checks-fayovom1/filtersfile.txt /tmp/060802gi/workdir/ 2024/05/06 06:08:09 INFO : filtersfile.txt: Copied (new) 2024/05/06 06:08:09 (06) : test 2. run with filters-file but without md5. should abort. 2024/05/06 06:08:09 (07) : bisync filters-file=/tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/" 2024/05/06 06:08:09 INFO : Using filters file /tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 ERROR : Bisync critical error: filters file md5 hash not found (must run --resync): /tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:09 Bisync error: bisync aborted 2024/05/06 06:08:09 (08) : test 3. run without filters-file. should be blocked due to prior abort. 2024/05/06 06:08:09 (09) : bisync 2024/05/06 06:08:09 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/" 2024/05/06 06:08:09 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/060802gi/workdir/tmp_060802gi_filtersfile_checks_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_filtersfile_checks_path2.path1.lst Path2: /tmp/060802gi/workdir/tmp_060802gi_filtersfile_checks_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_filtersfile_checks_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/060802gi/workdir" 2024/05/06 06:08:09 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:09 Bisync error: bisync aborted 2024/05/06 06:08:09 (10) : test 4. run with filters-file and resync. 2024/05/06 06:08:09 (11) : bisync filters-file=/tmp/060802gi/workdir/filtersfile.txt resync 2024/05/06 06:08:09 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/" 2024/05/06 06:08:09 INFO : Using filters file /tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 INFO : Storing filters file hash to /tmp/060802gi/workdir/filtersfile.txt.md5 2024/05/06 06:08:09 INFO : Copying Path2 files to Path1 2024/05/06 06:08:09 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:09 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:09 INFO : Resync updating listings 2024/05/06 06:08:09 INFO : Validating listings for Path1 "/tmp/060802gi/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/" 2024/05/06 06:08:09 INFO : Bisync successful 2024/05/06 06:08:09 (12) : test 5. run with filters-file alone. should run. 2024/05/06 06:08:09 (13) : bisync filters-file=/tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/" 2024/05/06 06:08:09 INFO : Using filters file /tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:09 INFO : Path1 checking for diffs 2024/05/06 06:08:09 INFO : Path2 checking for diffs 2024/05/06 06:08:09 INFO : No changes found 2024/05/06 06:08:09 INFO : Updating listings 2024/05/06 06:08:09 INFO : Validating listings for Path1 "/tmp/060802gi/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/" 2024/05/06 06:08:09 INFO : Bisync successful 2024/05/06 06:08:09 (14) : test 6. push changed filters-file to workdir. 2024/05/06 06:08:09 (15) : copy-as /tmp/060802gi/datadir/test_filtersfile_checks-fayovom1/filtersfile2.txt /tmp/060802gi/workdir/ filtersfile.txt 2024/05/06 06:08:09 INFO : filtersfile2.txt: Copied (replaced existing) to: filtersfile.txt 2024/05/06 06:08:09 (16) : test 7. run with filters-file alone. should abort. 2024/05/06 06:08:09 (17) : bisync filters-file=/tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/" 2024/05/06 06:08:09 INFO : Using filters file /tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:09 Bisync error: bisync aborted 2024/05/06 06:08:09 (18) : test 8. run with filters-file and resync and dry-run. should do the dry-run but still cause next non-resync run to abort. 2024/05/06 06:08:09 (19) : bisync filters-file=/tmp/060802gi/workdir/filtersfile.txt resync dry-run 2024/05/06 06:08:09 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/" 2024/05/06 06:08:09 INFO : Using filters file /tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 INFO : Skipped storing filters file hash to /tmp/060802gi/workdir/filtersfile.txt.md5 as --dry-run is set 2024/05/06 06:08:09 INFO : Copying Path2 files to Path1 2024/05/06 06:08:09 NOTICE: - Path2 Resync is copying files to - Path1 2024/05/06 06:08:09 NOTICE: - Path1 Resync is copying files to - Path2 2024/05/06 06:08:09 INFO : Resync updating listings 2024/05/06 06:08:09 INFO : Bisync successful 2024/05/06 06:08:09 (20) : test 9. run with filters-file alone. should abort. 2024/05/06 06:08:09 (21) : bisync filters-file=/tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/filtersfile_checks/path2/" 2024/05/06 06:08:09 INFO : Using filters file /tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/060802gi/workdir/filtersfile.txt 2024/05/06 06:08:09 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:09 Bisync error: bisync aborted bisync_test.go:555: TEST filtersfile_checks PASSED === RUN TestBisyncLocalRemote/ignorelistingchecksum 2024/05/06 06:08:09 DEBUG : Creating backend with remote "/tmp/060802gi/ignorelistingchecksum/path1" 2024/05/06 06:08:09 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:09 DEBUG : path2: Making directory 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:09 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2" 2024/05/06 06:08:09 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:09 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:09 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2" 2024/05/06 06:08:09 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_ignorelistingchecksum-vociraw9" 2024/05/06 06:08:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:09 INFO : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/05/06 06:08:09 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:09 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file1.copy2.txt.nilahob1.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:09 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file1.copy1.txt.kuzefum4.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:09 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/initdir/test_ignorelistingchecksum-vociraw9: Waiting for checks to finish 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/initdir/test_ignorelistingchecksum-vociraw9: Waiting for transfers to finish 2024/05/06 06:08:09 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:09 DEBUG : file1.copy4.txt.qijumog9.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:09 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : RCLONE_TEST.piridod2.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:09 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:09 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file1.copy3.txt.moxupey6.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:09 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file1.copy5.txt.dijigoh1.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:09 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file1.txt.lenovip5.partial: renamed to: file1.txt 2024/05/06 06:08:09 INFO : file1.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : subdir/file20.txt.begetec1.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:09 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:09 INFO : subdir: Updated directory metadata 2024/05/06 06:08:09 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_ignorelistingchecksum-zomasih4" 2024/05/06 06:08:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/datadir/test_ignorelistingchecksum-zomasih4: Waiting for checks to finish 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/datadir/test_ignorelistingchecksum-zomasih4: Waiting for transfers to finish 2024/05/06 06:08:09 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:09 DEBUG : file1.txt.wetewic5.partial: renamed to: file1.txt 2024/05/06 06:08:09 INFO : file1.txt: Copied (new) 2024/05/06 06:08:09 ERROR : : error listing: directory not found 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2] 2024/05/06 06:08:09 ERROR : : error listing: directory not found 2024/05/06 06:08:09 checking initFs Local file system at /tmp/060802gi/initdir/test_ignorelistingchecksum-vociraw9 2024/05/06 06:08:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:09 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 INFO : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/05/06 06:08:09 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:09 DEBUG : file1.copy1.txt.nutojeb0.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:09 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/ignorelistingchecksum/path1: Waiting for checks to finish 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/ignorelistingchecksum/path1: Waiting for transfers to finish 2024/05/06 06:08:09 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file1.copy2.txt.xukocox6.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:09 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file1.copy3.txt.sipevet0.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:09 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:09 DEBUG : file1.copy4.txt.midosug1.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:09 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : RCLONE_TEST.lehakaf1.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:09 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:09 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file1.txt.hofocut9.partial: renamed to: file1.txt 2024/05/06 06:08:09 INFO : file1.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file1.copy5.txt.lovowuj3.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:09 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : subdir/file20.txt.zovicas8.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:09 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:09 INFO : subdir: Updated directory metadata 2024/05/06 06:08:09 checking Path1 Local file system at /tmp/060802gi/ignorelistingchecksum/path1 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2] 2024/05/06 06:08:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : subdir: Making directory 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/subdir] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/RCLONE_TEST] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/file1.copy1.txt] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/file1.copy2.txt] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/file1.copy3.txt] 2024/05/06 06:08:09 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: Waiting for checks to finish 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: Waiting for transfers to finish 2024/05/06 06:08:09 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/file1.copy4.txt] 2024/05/06 06:08:09 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/file1.copy5.txt] 2024/05/06 06:08:09 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/file1.txt] 2024/05/06 06:08:09 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/subdir/file20.txt] 2024/05/06 06:08:09 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:09 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:09 INFO : file1.txt: Copied (new) 2024/05/06 06:08:09 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:09 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/subdir] 2024/05/06 06:08:09 (01) : test basic 2024/05/06 06:08:09 (02) : test initial bisync 2024/05/06 06:08:09 (03) : bisync resync 2024/05/06 06:08:09 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/" 2024/05/06 06:08:09 INFO : Copying Path2 files to Path1 2024/05/06 06:08:09 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:09 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:09 INFO : Resync updating listings 2024/05/06 06:08:09 INFO : Validating listings for Path1 "/tmp/060802gi/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/" 2024/05/06 06:08:09 INFO : Bisync successful 2024/05/06 06:08:09 (04) : bisync resync ignore-listing-checksum 2024/05/06 06:08:09 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/" 2024/05/06 06:08:09 INFO : Copying Path2 files to Path1 2024/05/06 06:08:09 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:09 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:09 INFO : Resync updating listings 2024/05/06 06:08:09 INFO : Validating listings for Path1 "/tmp/060802gi/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/" 2024/05/06 06:08:09 INFO : Bisync successful 2024/05/06 06:08:09 (05) : test place newer files on both paths 2024/05/06 06:08:09 (06) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_ignorelistingchecksum-zomasih4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/ 2024/05/06 06:08:09 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:09 (07) : copy-as /tmp/060802gi/datadir/test_ignorelistingchecksum-zomasih4/file1.txt /tmp/060802gi/ignorelistingchecksum/path1/subdir file20.txt 2024/05/06 06:08:09 INFO : file1.txt: Copied (replaced existing) to: file20.txt 2024/05/06 06:08:09 (08) : test bisync run 2024/05/06 06:08:09 (09) : bisync ignore-listing-checksum 2024/05/06 06:08:09 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/" 2024/05/06 06:08:09 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:09 INFO : Path1 checking for diffs 2024/05/06 06:08:09 INFO : - Path1 File changed: size (larger), time (newer) - subdir/file20.txt 2024/05/06 06:08:09 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:09 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:09 INFO : Path2 checking for diffs 2024/05/06 06:08:09 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:09 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:09 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:09 INFO : Applying changes 2024/05/06 06:08:09 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/subdir/file20.txt 2024/05/06 06:08:09 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/ignorelistingchecksum/path1/file1.txt 2024/05/06 06:08:09 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:09 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:09 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:09 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:09 INFO : Updating listings 2024/05/06 06:08:09 INFO : Validating listings for Path1 "/tmp/060802gi/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/ignorelistingchecksum/path2/" 2024/05/06 06:08:09 INFO : Bisync successful bisync_test.go:555: TEST ignorelistingchecksum PASSED === RUN TestBisyncLocalRemote/max_delete_path1 2024/05/06 06:08:09 DEBUG : Creating backend with remote "/tmp/060802gi/max_delete_path1/path1" 2024/05/06 06:08:09 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:09 DEBUG : path2: Making directory 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:09 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2" 2024/05/06 06:08:09 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:09 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:09 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2" 2024/05/06 06:08:09 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_max_delete_path1-mevunur5" 2024/05/06 06:08:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/initdir/test_max_delete_path1-mevunur5: Waiting for checks to finish 2024/05/06 06:08:09 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file2.txt.pefazeh0.partial: renamed to: file2.txt 2024/05/06 06:08:09 INFO : file2.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/initdir/test_max_delete_path1-mevunur5: Waiting for transfers to finish 2024/05/06 06:08:09 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file3.txt.duvunin1.partial: renamed to: file3.txt 2024/05/06 06:08:09 INFO : file3.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file5.txt.xulagox8.partial: renamed to: file5.txt 2024/05/06 06:08:09 INFO : file5.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file4.txt.gesawus6.partial: renamed to: file4.txt 2024/05/06 06:08:09 INFO : file4.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file7.txt.wogutit0.partial: renamed to: file7.txt 2024/05/06 06:08:09 INFO : file7.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file8.txt.pazeriv8.partial: renamed to: file8.txt 2024/05/06 06:08:09 INFO : file8.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file6.txt.rikosem5.partial: renamed to: file6.txt 2024/05/06 06:08:09 INFO : file6.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file1.txt.hezociy3.partial: renamed to: file1.txt 2024/05/06 06:08:09 INFO : file1.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:09 DEBUG : file9.txt.yecudev7.partial: renamed to: file9.txt 2024/05/06 06:08:09 INFO : file9.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_max_delete_path1-lenaruc8" 2024/05/06 06:08:09 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/datadir/test_max_delete_path1-lenaruc8: Waiting for checks to finish 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/datadir/test_max_delete_path1-lenaruc8: Waiting for transfers to finish 2024/05/06 06:08:09 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:08:09 DEBUG : hold.txt.sarucoz6.partial: renamed to: hold.txt 2024/05/06 06:08:09 INFO : hold.txt: Copied (new) 2024/05/06 06:08:09 ERROR : : error listing: directory not found 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2] 2024/05/06 06:08:09 ERROR : : error listing: directory not found 2024/05/06 06:08:09 checking initFs Local file system at /tmp/060802gi/initdir/test_max_delete_path1-mevunur5 2024/05/06 06:08:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file3.txt.layayas9.partial: renamed to: file3.txt 2024/05/06 06:08:09 INFO : file3.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file4.txt.rahamam1.partial: renamed to: file4.txt 2024/05/06 06:08:09 INFO : file4.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file1.txt.xocewep9.partial: renamed to: file1.txt 2024/05/06 06:08:09 INFO : file1.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/max_delete_path1/path1: Waiting for checks to finish 2024/05/06 06:08:09 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file6.txt.haxagoz6.partial: renamed to: file6.txt 2024/05/06 06:08:09 INFO : file6.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : Local file system at /tmp/060802gi/max_delete_path1/path1: Waiting for transfers to finish 2024/05/06 06:08:09 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file2.txt.zehivut0.partial: renamed to: file2.txt 2024/05/06 06:08:09 INFO : file2.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file5.txt.benafat0.partial: renamed to: file5.txt 2024/05/06 06:08:09 INFO : file5.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:09 DEBUG : file7.txt.qufawas7.partial: renamed to: file7.txt 2024/05/06 06:08:09 INFO : file7.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file8.txt.cetopin4.partial: renamed to: file8.txt 2024/05/06 06:08:09 INFO : file8.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:09 DEBUG : file9.txt.gofoyuz2.partial: renamed to: file9.txt 2024/05/06 06:08:09 INFO : file9.txt: Copied (new) 2024/05/06 06:08:09 checking Path1 Local file system at /tmp/060802gi/max_delete_path1/path1 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2] 2024/05/06 06:08:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file1.txt] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file2.txt] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file3.txt] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: Waiting for checks to finish 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file4.txt] 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: Waiting for transfers to finish 2024/05/06 06:08:09 INFO : file1.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file5.txt] 2024/05/06 06:08:09 INFO : file2.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file6.txt] 2024/05/06 06:08:09 INFO : file3.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file7.txt] 2024/05/06 06:08:09 INFO : file4.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file8.txt] 2024/05/06 06:08:09 INFO : file5.txt: Copied (new) 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file9.txt] 2024/05/06 06:08:09 INFO : file6.txt: Copied (new) 2024/05/06 06:08:09 INFO : file7.txt: Copied (new) 2024/05/06 06:08:09 INFO : file8.txt: Copied (new) 2024/05/06 06:08:09 INFO : file9.txt: Copied (new) 2024/05/06 06:08:09 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2 2024/05/06 06:08:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2] 2024/05/06 06:08:09 (01) : test max-delete-path1 2024/05/06 06:08:09 (02) : test initial bisync 2024/05/06 06:08:09 (03) : bisync resync 2024/05/06 06:08:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/" 2024/05/06 06:08:09 INFO : Copying Path2 files to Path1 2024/05/06 06:08:09 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:09 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:09 INFO : Resync updating listings 2024/05/06 06:08:09 INFO : Validating listings for Path1 "/tmp/060802gi/max_delete_path1/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/" 2024/05/06 06:08:09 INFO : Bisync successful 2024/05/06 06:08:09 (04) : test delete >50% of local files 2024/05/06 06:08:09 (05) : delete-file /tmp/060802gi/max_delete_path1/path1/file1.txt 2024/05/06 06:08:09 INFO : file1.txt: Deleted 2024/05/06 06:08:09 (06) : delete-file /tmp/060802gi/max_delete_path1/path1/file2.txt 2024/05/06 06:08:09 INFO : file2.txt: Deleted 2024/05/06 06:08:09 (07) : delete-file /tmp/060802gi/max_delete_path1/path1/file3.txt 2024/05/06 06:08:09 INFO : file3.txt: Deleted 2024/05/06 06:08:09 (08) : delete-file /tmp/060802gi/max_delete_path1/path1/file4.txt 2024/05/06 06:08:09 INFO : file4.txt: Deleted 2024/05/06 06:08:09 (09) : delete-file /tmp/060802gi/max_delete_path1/path1/file5.txt 2024/05/06 06:08:09 INFO : file5.txt: Deleted 2024/05/06 06:08:09 (10) : test sync should fail due to too many local deletes 2024/05/06 06:08:09 (11) : bisync 2024/05/06 06:08:09 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:09 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:09 INFO : Synching Path1 "/tmp/060802gi/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/" 2024/05/06 06:08:09 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:09 INFO : Path1 checking for diffs 2024/05/06 06:08:09 INFO : - Path1 File was deleted - file1.txt 2024/05/06 06:08:09 INFO : - Path1 File was deleted - file2.txt 2024/05/06 06:08:09 INFO : - Path1 File was deleted - file3.txt 2024/05/06 06:08:09 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:08:09 INFO : - Path1 File was deleted - file5.txt 2024/05/06 06:08:09 INFO : Path1: 5 changes:  0 new,  0 modified,  5 deleted 2024/05/06 06:08:09 INFO : Path2 checking for diffs 2024/05/06 06:08:09 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path1 "/tmp/060802gi/max_delete_path1/path1/". Run with --force if desired. 2024/05/06 06:08:09 NOTICE: Bisync aborted. Please try again. 2024/05/06 06:08:09 Bisync error: too many deletes 2024/05/06 06:08:09 (12) : copy-listings initial-fail 2024/05/06 06:08:09 (13) : test change max-delete limit to 60%. sync should run. 2024/05/06 06:08:09 (14) : bisync max-delete=60 2024/05/06 06:08:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:10 INFO : Synching Path1 "/tmp/060802gi/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/" 2024/05/06 06:08:10 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:10 INFO : Path1 checking for diffs 2024/05/06 06:08:10 INFO : - Path1 File was deleted - file1.txt 2024/05/06 06:08:10 INFO : - Path1 File was deleted - file2.txt 2024/05/06 06:08:10 INFO : - Path1 File was deleted - file3.txt 2024/05/06 06:08:10 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:08:10 INFO : - Path1 File was deleted - file5.txt 2024/05/06 06:08:10 INFO : Path1: 5 changes:  0 new,  0 modified,  5 deleted 2024/05/06 06:08:10 INFO : Path2 checking for diffs 2024/05/06 06:08:10 INFO : Applying changes 2024/05/06 06:08:10 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file1.txt 2024/05/06 06:08:10 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file2.txt 2024/05/06 06:08:10 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file3.txt 2024/05/06 06:08:10 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file4.txt 2024/05/06 06:08:10 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/file5.txt 2024/05/06 06:08:10 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:10 INFO : file1.txt: Deleted 2024/05/06 06:08:10 INFO : file2.txt: Deleted 2024/05/06 06:08:10 INFO : file3.txt: Deleted 2024/05/06 06:08:10 INFO : file4.txt: Deleted 2024/05/06 06:08:10 INFO : file5.txt: Deleted 2024/05/06 06:08:10 INFO : Updating listings 2024/05/06 06:08:10 INFO : Validating listings for Path1 "/tmp/060802gi/max_delete_path1/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path1/path2/" 2024/05/06 06:08:10 INFO : Bisync successful bisync_test.go:555: TEST max_delete_path1 PASSED === RUN TestBisyncLocalRemote/max_delete_path2_force 2024/05/06 06:08:10 DEBUG : Creating backend with remote "/tmp/060802gi/max_delete_path2_force/path1" 2024/05/06 06:08:10 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:10 DEBUG : path2: Making directory 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:10 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2" 2024/05/06 06:08:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:10 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2" 2024/05/06 06:08:10 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_max_delete_path2_force-homoqum4" 2024/05/06 06:08:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/initdir/test_max_delete_path2_force-homoqum4: Waiting for checks to finish 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/initdir/test_max_delete_path2_force-homoqum4: Waiting for transfers to finish 2024/05/06 06:08:10 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file1.txt.xobidiw0.partial: renamed to: file1.txt 2024/05/06 06:08:10 INFO : file1.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file2.txt.yofunuj9.partial: renamed to: file2.txt 2024/05/06 06:08:10 INFO : file2.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file3.txt.ruhunib3.partial: renamed to: file3.txt 2024/05/06 06:08:10 INFO : file3.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file5.txt.mihaqeg3.partial: renamed to: file5.txt 2024/05/06 06:08:10 INFO : file5.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file6.txt.serusif6.partial: renamed to: file6.txt 2024/05/06 06:08:10 INFO : file6.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file7.txt.laxupin5.partial: renamed to: file7.txt 2024/05/06 06:08:10 INFO : file7.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file4.txt.kamomig8.partial: renamed to: file4.txt 2024/05/06 06:08:10 INFO : file4.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file8.txt.kenunog2.partial: renamed to: file8.txt 2024/05/06 06:08:10 INFO : file8.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:10 DEBUG : file9.txt.poxubal7.partial: renamed to: file9.txt 2024/05/06 06:08:10 INFO : file9.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_max_delete_path2_force-decocol7" 2024/05/06 06:08:10 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/datadir/test_max_delete_path2_force-decocol7: Waiting for checks to finish 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/datadir/test_max_delete_path2_force-decocol7: Waiting for transfers to finish 2024/05/06 06:08:10 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:08:10 DEBUG : hold.txt.ponefap1.partial: renamed to: hold.txt 2024/05/06 06:08:10 INFO : hold.txt: Copied (new) 2024/05/06 06:08:10 ERROR : : error listing: directory not found 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2] 2024/05/06 06:08:10 ERROR : : error listing: directory not found 2024/05/06 06:08:10 checking initFs Local file system at /tmp/060802gi/initdir/test_max_delete_path2_force-homoqum4 2024/05/06 06:08:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file1.txt.kerepes9.partial: renamed to: file1.txt 2024/05/06 06:08:10 INFO : file1.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file2.txt.tuzapeb6.partial: renamed to: file2.txt 2024/05/06 06:08:10 INFO : file2.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/max_delete_path2_force/path1: Waiting for checks to finish 2024/05/06 06:08:10 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file5.txt.hejodut8.partial: renamed to: file5.txt 2024/05/06 06:08:10 INFO : file5.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file4.txt.muboxap9.partial: renamed to: file4.txt 2024/05/06 06:08:10 INFO : file4.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file7.txt.sowepow8.partial: renamed to: file7.txt 2024/05/06 06:08:10 INFO : file7.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file8.txt.purizuw4.partial: renamed to: file8.txt 2024/05/06 06:08:10 INFO : file8.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/max_delete_path2_force/path1: Waiting for transfers to finish 2024/05/06 06:08:10 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file3.txt.qorugud6.partial: renamed to: file3.txt 2024/05/06 06:08:10 INFO : file3.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file6.txt.zalumib3.partial: renamed to: file6.txt 2024/05/06 06:08:10 INFO : file6.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:10 DEBUG : file9.txt.xowamod1.partial: renamed to: file9.txt 2024/05/06 06:08:10 INFO : file9.txt: Copied (new) 2024/05/06 06:08:10 checking Path1 Local file system at /tmp/060802gi/max_delete_path2_force/path1 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2] 2024/05/06 06:08:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file1.txt] 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file2.txt] 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file3.txt] 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file4.txt] 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: Waiting for checks to finish 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: Waiting for transfers to finish 2024/05/06 06:08:10 INFO : file1.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file5.txt] 2024/05/06 06:08:10 INFO : file2.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file6.txt] 2024/05/06 06:08:10 INFO : file3.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file7.txt] 2024/05/06 06:08:10 INFO : file4.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file8.txt] 2024/05/06 06:08:10 INFO : file5.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file9.txt] 2024/05/06 06:08:10 INFO : file6.txt: Copied (new) 2024/05/06 06:08:10 INFO : file7.txt: Copied (new) 2024/05/06 06:08:10 INFO : file8.txt: Copied (new) 2024/05/06 06:08:10 INFO : file9.txt: Copied (new) 2024/05/06 06:08:10 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2] 2024/05/06 06:08:10 (01) : test max-delete-path2-force 2024/05/06 06:08:10 (02) : test initial bisync 2024/05/06 06:08:10 (03) : bisync resync 2024/05/06 06:08:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:10 INFO : Synching Path1 "/tmp/060802gi/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/" 2024/05/06 06:08:10 INFO : Copying Path2 files to Path1 2024/05/06 06:08:10 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:10 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:10 INFO : Resync updating listings 2024/05/06 06:08:10 INFO : Validating listings for Path1 "/tmp/060802gi/max_delete_path2_force/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/" 2024/05/06 06:08:10 INFO : Bisync successful 2024/05/06 06:08:10 (04) : test delete >50% of remote files 2024/05/06 06:08:10 (05) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file1.txt 2024/05/06 06:08:10 INFO : file1.txt: Deleted 2024/05/06 06:08:10 (06) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file2.txt 2024/05/06 06:08:10 INFO : file2.txt: Deleted 2024/05/06 06:08:10 (07) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file3.txt 2024/05/06 06:08:10 INFO : file3.txt: Deleted 2024/05/06 06:08:10 (08) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file4.txt 2024/05/06 06:08:10 INFO : file4.txt: Deleted 2024/05/06 06:08:10 (09) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/file5.txt 2024/05/06 06:08:10 INFO : file5.txt: Deleted 2024/05/06 06:08:10 (10) : test sync should fail due to too many path2 deletes 2024/05/06 06:08:10 (11) : bisync 2024/05/06 06:08:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:10 INFO : Synching Path1 "/tmp/060802gi/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/" 2024/05/06 06:08:10 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:10 INFO : Path1 checking for diffs 2024/05/06 06:08:10 INFO : Path2 checking for diffs 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file1.txt 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file2.txt 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file4.txt 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file5.txt 2024/05/06 06:08:10 INFO : Path2: 5 changes:  0 new,  0 modified,  5 deleted 2024/05/06 06:08:10 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/". Run with --force if desired. 2024/05/06 06:08:10 NOTICE: Bisync aborted. Please try again. 2024/05/06 06:08:10 Bisync error: too many deletes 2024/05/06 06:08:10 (12) : copy-listings initial-fail 2024/05/06 06:08:10 (13) : test apply force option. sync should run. 2024/05/06 06:08:10 (14) : bisync force 2024/05/06 06:08:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:10 INFO : Synching Path1 "/tmp/060802gi/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/" 2024/05/06 06:08:10 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:10 INFO : Path1 checking for diffs 2024/05/06 06:08:10 INFO : Path2 checking for diffs 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file1.txt 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file2.txt 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file4.txt 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file5.txt 2024/05/06 06:08:10 INFO : Path2: 5 changes:  0 new,  0 modified,  5 deleted 2024/05/06 06:08:10 INFO : Applying changes 2024/05/06 06:08:10 INFO : - Path1 Queue delete - /tmp/060802gi/max_delete_path2_force/path1/file1.txt 2024/05/06 06:08:10 INFO : - Path1 Queue delete - /tmp/060802gi/max_delete_path2_force/path1/file2.txt 2024/05/06 06:08:10 INFO : - Path1 Queue delete - /tmp/060802gi/max_delete_path2_force/path1/file3.txt 2024/05/06 06:08:10 INFO : - Path1 Queue delete - /tmp/060802gi/max_delete_path2_force/path1/file4.txt 2024/05/06 06:08:10 INFO : - Path1 Queue delete - /tmp/060802gi/max_delete_path2_force/path1/file5.txt 2024/05/06 06:08:10 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:10 INFO : file1.txt: Deleted 2024/05/06 06:08:10 INFO : file4.txt: Deleted 2024/05/06 06:08:10 INFO : file3.txt: Deleted 2024/05/06 06:08:10 INFO : file2.txt: Deleted 2024/05/06 06:08:10 INFO : file5.txt: Deleted 2024/05/06 06:08:10 INFO : Updating listings 2024/05/06 06:08:10 INFO : Validating listings for Path1 "/tmp/060802gi/max_delete_path2_force/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/max_delete_path2_force/path2/" 2024/05/06 06:08:10 INFO : Bisync successful bisync_test.go:555: TEST max_delete_path2_force PASSED === RUN TestBisyncLocalRemote/nomodtime 2024/05/06 06:08:10 DEBUG : Creating backend with remote "/tmp/060802gi/nomodtime/path1" 2024/05/06 06:08:10 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:10 DEBUG : path2: Making directory 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:10 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2" 2024/05/06 06:08:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:10 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2" 2024/05/06 06:08:10 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_nomodtime-qileveb2" 2024/05/06 06:08:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/initdir/test_nomodtime-qileveb2: Waiting for checks to finish 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/initdir/test_nomodtime-qileveb2: Waiting for transfers to finish 2024/05/06 06:08:10 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:10 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : RCLONE_TEST.kefiqur5.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:10 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:10 DEBUG : file3.txt.lujahet4.partial: renamed to: file3.txt 2024/05/06 06:08:10 INFO : file3.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file1.txt.levozop9.partial: renamed to: file1.txt 2024/05/06 06:08:10 INFO : file1.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file4.txt.cuzehaw9.partial: renamed to: file4.txt 2024/05/06 06:08:10 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 INFO : file4.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file5.txt.gupumuy2.partial: renamed to: file5.txt 2024/05/06 06:08:10 INFO : file5.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file7.txt.rahuhor7.partial: renamed to: file7.txt 2024/05/06 06:08:10 INFO : file7.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file6.txt.niqicoc6.partial: renamed to: file6.txt 2024/05/06 06:08:10 INFO : file6.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file2.txt.wicedoy6.partial: renamed to: file2.txt 2024/05/06 06:08:10 INFO : file2.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file8.txt.biboquv2.partial: renamed to: file8.txt 2024/05/06 06:08:10 INFO : file8.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_nomodtime-vukuwum0" 2024/05/06 06:08:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/datadir/test_nomodtime-vukuwum0: Waiting for checks to finish 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/datadir/test_nomodtime-vukuwum0: Waiting for transfers to finish 2024/05/06 06:08:10 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:10 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:10 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:10 DEBUG : file10.txt.zezevoh3.partial: renamed to: file10.txt 2024/05/06 06:08:10 INFO : file10.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file11.txt.jojukic4.partial: renamed to: file11.txt 2024/05/06 06:08:10 INFO : file11.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file1.txt.xutidef8.partial: renamed to: file1.txt 2024/05/06 06:08:10 INFO : file1.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:10 DEBUG : file2.txt.kecakid8.partial: renamed to: file2.txt 2024/05/06 06:08:10 INFO : file2.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:10 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:10 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:10 DEBUG : file5R.txt.facezek3.partial: renamed to: file5R.txt 2024/05/06 06:08:10 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file6.txt.fupigif6.partial: renamed to: file6.txt 2024/05/06 06:08:10 INFO : file6.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file5L.txt.sigenas1.partial: renamed to: file5L.txt 2024/05/06 06:08:10 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:10 DEBUG : file7.txt.sozimes3.partial: renamed to: file7.txt 2024/05/06 06:08:10 INFO : file7.txt: Copied (new) 2024/05/06 06:08:10 ERROR : : error listing: directory not found 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2] 2024/05/06 06:08:10 ERROR : : error listing: directory not found 2024/05/06 06:08:10 checking initFs Local file system at /tmp/060802gi/initdir/test_nomodtime-qileveb2 2024/05/06 06:08:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file1.txt.vikudar6.partial: renamed to: file1.txt 2024/05/06 06:08:10 INFO : file1.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file2.txt.yigujeq0.partial: renamed to: file2.txt 2024/05/06 06:08:10 INFO : file2.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/nomodtime/path1: Waiting for checks to finish 2024/05/06 06:08:10 DEBUG : file3.txt.hodegus4.partial: renamed to: file3.txt 2024/05/06 06:08:10 INFO : file3.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/nomodtime/path1: Waiting for transfers to finish 2024/05/06 06:08:10 DEBUG : file5.txt.legumew3.partial: renamed to: file5.txt 2024/05/06 06:08:10 DEBUG : RCLONE_TEST.verunin6.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:10 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:10 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file6.txt.ruquwob8.partial: renamed to: file6.txt 2024/05/06 06:08:10 INFO : file6.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file4.txt.pemiyes0.partial: renamed to: file4.txt 2024/05/06 06:08:10 INFO : file4.txt: Copied (new) 2024/05/06 06:08:10 INFO : file5.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file8.txt.mupezes6.partial: renamed to: file8.txt 2024/05/06 06:08:10 INFO : file8.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file7.txt.gopakoc2.partial: renamed to: file7.txt 2024/05/06 06:08:10 INFO : file7.txt: Copied (new) 2024/05/06 06:08:10 checking Path1 Local file system at /tmp/060802gi/nomodtime/path1 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2] 2024/05/06 06:08:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file1.txt] 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/RCLONE_TEST] 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file3.txt] 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: Waiting for checks to finish 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: Waiting for transfers to finish 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file2.txt] 2024/05/06 06:08:10 INFO : file3.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file4.txt] 2024/05/06 06:08:10 INFO : file1.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file5.txt] 2024/05/06 06:08:10 INFO : file2.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file6.txt] 2024/05/06 06:08:10 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file7.txt] 2024/05/06 06:08:10 INFO : file4.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file8.txt] 2024/05/06 06:08:10 INFO : file5.txt: Copied (new) 2024/05/06 06:08:10 INFO : file6.txt: Copied (new) 2024/05/06 06:08:10 INFO : file7.txt: Copied (new) 2024/05/06 06:08:10 INFO : file8.txt: Copied (new) 2024/05/06 06:08:10 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2] 2024/05/06 06:08:10 (01) : test changes 2024/05/06 06:08:10 (02) : test initial bisync 2024/05/06 06:08:10 (03) : bisync resync nomodtime 2024/05/06 06:08:10 NOTICE: Local file system at /tmp/060802gi/nomodtime/path1: will use md5 for same-side diffs on Path1 only 2024/05/06 06:08:10 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:08:10 INFO : Synching Path1 "/tmp/060802gi/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/" 2024/05/06 06:08:10 INFO : Copying Path2 files to Path1 2024/05/06 06:08:10 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:10 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:10 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:10 INFO : Resync updating listings 2024/05/06 06:08:10 INFO : Validating listings for Path1 "/tmp/060802gi/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/" 2024/05/06 06:08:10 INFO : Bisync successful 2024/05/06 06:08:10 (04) : test make modifications on both paths 2024/05/06 06:08:10 (05) : test new on path2 - file10 2024/05/06 06:08:10 (06) : copy-file /tmp/060802gi/datadir/test_nomodtime-vukuwum0/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/ 2024/05/06 06:08:10 INFO : file10.txt: Copied (new) 2024/05/06 06:08:10 (07) : test changed on path2 - file1 2024/05/06 06:08:10 (08) : copy-file /tmp/060802gi/datadir/test_nomodtime-vukuwum0/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/ 2024/05/06 06:08:10 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:10 (09) : test new on path1 - file11 2024/05/06 06:08:10 (10) : copy-file /tmp/060802gi/datadir/test_nomodtime-vukuwum0/file11.txt /tmp/060802gi/nomodtime/path1/ 2024/05/06 06:08:10 INFO : file11.txt: Copied (new) 2024/05/06 06:08:10 (11) : test changed on path1 - file2 2024/05/06 06:08:10 (12) : copy-file /tmp/060802gi/datadir/test_nomodtime-vukuwum0/file2.txt /tmp/060802gi/nomodtime/path1/ 2024/05/06 06:08:10 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:10 (13) : test deleted on path2 - file3 2024/05/06 06:08:10 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file3.txt 2024/05/06 06:08:10 INFO : file3.txt: Deleted 2024/05/06 06:08:10 (15) : test deleted on path1 - file4 2024/05/06 06:08:10 (16) : delete-file /tmp/060802gi/nomodtime/path1/file4.txt 2024/05/06 06:08:10 INFO : file4.txt: Deleted 2024/05/06 06:08:10 (17) : test deleted on both paths - file8 2024/05/06 06:08:10 (18) : delete-file /tmp/060802gi/nomodtime/path1/file8.txt 2024/05/06 06:08:10 INFO : file8.txt: Deleted 2024/05/06 06:08:10 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file8.txt 2024/05/06 06:08:10 INFO : file8.txt: Deleted 2024/05/06 06:08:10 (20) : test changed on both paths - file5 (file5R, file5L) 2024/05/06 06:08:10 (21) : copy-as /tmp/060802gi/datadir/test_nomodtime-vukuwum0/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/ file5.txt 2024/05/06 06:08:10 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:10 (22) : copy-as /tmp/060802gi/datadir/test_nomodtime-vukuwum0/file5L.txt /tmp/060802gi/nomodtime/path1/ file5.txt 2024/05/06 06:08:10 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:10 (23) : test changed on path2 and deleted on path1 - file6 2024/05/06 06:08:10 (24) : copy-file /tmp/060802gi/datadir/test_nomodtime-vukuwum0/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/ 2024/05/06 06:08:10 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:08:10 (25) : delete-file /tmp/060802gi/nomodtime/path1/file6.txt 2024/05/06 06:08:10 INFO : file6.txt: Deleted 2024/05/06 06:08:10 (26) : test changed on path1 and deleted on path2 - file7 2024/05/06 06:08:10 (27) : copy-file /tmp/060802gi/datadir/test_nomodtime-vukuwum0/file7.txt /tmp/060802gi/nomodtime/path1/ 2024/05/06 06:08:10 INFO : file7.txt: Copied (replaced existing) 2024/05/06 06:08:10 (28) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file7.txt 2024/05/06 06:08:10 INFO : file7.txt: Deleted 2024/05/06 06:08:10 (29) : test bisync run 2024/05/06 06:08:10 (30) : bisync nomodtime 2024/05/06 06:08:10 NOTICE: Local file system at /tmp/060802gi/nomodtime/path1: will use md5 for same-side diffs on Path1 only 2024/05/06 06:08:10 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:08:10 INFO : Synching Path1 "/tmp/060802gi/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/" 2024/05/06 06:08:10 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:10 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:10 INFO : Path1 checking for diffs 2024/05/06 06:08:10 INFO : - Path1 File changed: size (larger), hash - file2.txt 2024/05/06 06:08:10 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:08:10 INFO : - Path1 File changed: size (larger), hash - file5.txt 2024/05/06 06:08:10 INFO : - Path1 File was deleted - file6.txt 2024/05/06 06:08:10 INFO : - Path1 File changed: size (larger), hash - file7.txt 2024/05/06 06:08:10 INFO : - Path1 File was deleted - file8.txt 2024/05/06 06:08:10 INFO : - Path1 File is new - file11.txt 2024/05/06 06:08:10 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:08:10 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2024/05/06 06:08:10 INFO : Path2 checking for diffs 2024/05/06 06:08:10 INFO : - Path2 File changed: size (larger), hash - file1.txt 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:08:10 INFO : - Path2 File changed: size (larger), hash - file5.txt 2024/05/06 06:08:10 INFO : - Path2 File changed: size (larger), hash - file6.txt 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file7.txt 2024/05/06 06:08:10 INFO : - Path2 File was deleted - file8.txt 2024/05/06 06:08:10 INFO : - Path2 File is new - file10.txt 2024/05/06 06:08:10 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:08:10 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2024/05/06 06:08:10 INFO : Applying changes 2024/05/06 06:08:10 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file11.txt 2024/05/06 06:08:10 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file2.txt 2024/05/06 06:08:10 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file4.txt 2024/05/06 06:08:10 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:08:10 NOTICE: - Path1 Renaming Path1 copy - /tmp/060802gi/nomodtime/path1/file5.txt.conflict1 2024/05/06 06:08:10 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/05/06 06:08:10 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file5.txt.conflict1 2024/05/06 06:08:10 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file5.txt.conflict2 2024/05/06 06:08:10 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/05/06 06:08:10 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/nomodtime/path1/file5.txt.conflict2 2024/05/06 06:08:10 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/nomodtime/path1/file6.txt 2024/05/06 06:08:10 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/file7.txt 2024/05/06 06:08:10 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/nomodtime/path1/file1.txt 2024/05/06 06:08:10 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/nomodtime/path1/file10.txt 2024/05/06 06:08:10 INFO : - Path1 Queue delete - /tmp/060802gi/nomodtime/path1/file3.txt 2024/05/06 06:08:10 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:10 INFO : file10.txt: Copied (new) 2024/05/06 06:08:10 INFO : file5.txt.conflict2: Copied (new) 2024/05/06 06:08:10 INFO : file6.txt: Copied (new) 2024/05/06 06:08:10 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:10 INFO : file3.txt: Deleted 2024/05/06 06:08:10 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:10 INFO : file11.txt: Copied (new) 2024/05/06 06:08:10 INFO : file7.txt: Copied (new) 2024/05/06 06:08:10 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:10 INFO : file5.txt.conflict1: Copied (new) 2024/05/06 06:08:10 INFO : file4.txt: Deleted 2024/05/06 06:08:10 INFO : Updating listings 2024/05/06 06:08:10 INFO : Validating listings for Path1 "/tmp/060802gi/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/nomodtime/path2/" 2024/05/06 06:08:10 INFO : Bisync successful bisync_test.go:555: TEST nomodtime PASSED === RUN TestBisyncLocalRemote/normalization 2024/05/06 06:08:10 DEBUG : Creating backend with remote "/tmp/060802gi/normalization/path1" 2024/05/06 06:08:10 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:10 DEBUG : path2: Making directory 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:10 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2" 2024/05/06 06:08:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:10 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2" 2024/05/06 06:08:10 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_normalization-hebohuy2" 2024/05/06 06:08:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory with metadata 2024/05/06 06:08:10 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/05/06 06:08:10 DEBUG : Added delayed dir = "測試_РуÑÑкий_ _ _Ä›_áñ", newDst=測試_РуÑÑкий_ _ _Ä›_áñ 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/initdir/test_normalization-hebohuy2: Waiting for checks to finish 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/initdir/test_normalization-hebohuy2: Waiting for transfers to finish 2024/05/06 06:08:10 DEBUG : RCLONE_TEST.rutidat5.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:10 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:10 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file1.txt.kujasej9.partial: renamed to: file1.txt 2024/05/06 06:08:10 INFO : file1.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt.zametot4.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt 2024/05/06 06:08:10 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file.dunaxin6.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file 2024/05/06 06:08:10 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt.bolirev5.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt 2024/05/06 06:08:10 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:10 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Updated directory metadata 2024/05/06 06:08:10 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_normalization-qetiduz1" 2024/05/06 06:08:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/datadir/test_normalization-qetiduz1: Waiting for checks to finish 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/datadir/test_normalization-qetiduz1: Waiting for transfers to finish 2024/05/06 06:08:10 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:10 DEBUG : file1.txt.quwubon9.partial: renamed to: file1.txt 2024/05/06 06:08:10 INFO : file1.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/05/06 06:08:10 DEBUG : 測試_filtersfile.txt.xuhituk0.partial: renamed to: 測試_filtersfile.txt 2024/05/06 06:08:10 INFO : 測試_filtersfile.txt: Copied (new) 2024/05/06 06:08:10 ERROR : : error listing: directory not found 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2] 2024/05/06 06:08:10 ERROR : : error listing: directory not found 2024/05/06 06:08:10 checking initFs Local file system at /tmp/060802gi/initdir/test_normalization-hebohuy2 2024/05/06 06:08:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory with metadata 2024/05/06 06:08:10 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/05/06 06:08:10 DEBUG : Added delayed dir = "測試_РуÑÑкий_ _ _Ä›_áñ", newDst=測試_РуÑÑкий_ _ _Ä›_áñ 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/normalization/path1: Waiting for checks to finish 2024/05/06 06:08:10 DEBUG : Local file system at /tmp/060802gi/normalization/path1: Waiting for transfers to finish 2024/05/06 06:08:10 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : file1.txt.bidisos1.partial: renamed to: file1.txt 2024/05/06 06:08:10 INFO : file1.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file.mifaqad9.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file 2024/05/06 06:08:10 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/05/06 06:08:10 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:10 DEBUG : RCLONE_TEST.sutuhoj8.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:10 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt.huqoyuh6.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt 2024/05/06 06:08:10 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt.marogug3.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt 2024/05/06 06:08:10 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:10 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Updated directory metadata 2024/05/06 06:08:10 checking Path1 Local file system at /tmp/060802gi/normalization/path1 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2] 2024/05/06 06:08:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2/RCLONE_TEST] 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2/file1.txt] 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt] 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt] 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2: Waiting for checks to finish 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2: Waiting for transfers to finish 2024/05/06 06:08:10 INFO : file1.txt: Copied (new) 2024/05/06 06:08:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file] 2024/05/06 06:08:10 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:10 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:10 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:11 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/05/06 06:08:11 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2] 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/05/06 06:08:11 (01) : test normalization 2024/05/06 06:08:11 (02) : touch-copy 2001-01-02 /tmp/060802gi/datadir/test_normalization-qetiduz1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2/ 2024/05/06 06:08:11 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:11 (03) : test initial bisync 2024/05/06 06:08:11 (04) : bisync resync 2024/05/06 06:08:11 NOTICE: Local file system at /tmp/060802gi/normalization/path1: Replacing invalid UTF-8 characters in "eÌŒ\x81\xfe aÌñhࢺ_測試РуÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬eÌö" 2024/05/06 06:08:11 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:08:11 NOTICE: Local file system at /tmp/060802gi/normalization/path1: Replacing invalid UTF-8 characters in "Ä›\x81\xfe áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö" 2024/05/06 06:08:11 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/05/06 06:08:11 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:08:11 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) bisync_test.go:1014: Fs is incapable of running test as the paths produce different results, skipping: normalization (path1: 測試_РуÑÑкий_ _ _Ä›_áñ測試_РуÑÑкий_ _ _Ä›_áñ (NFC) path2: 測試_РуÑÑкий_ _ _Ä›_áñěþ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶ (測試_РуÑÑкий_ _ _Ä›_áñěþ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶)) (fs1: Local file system at /tmp/060802gi/normalization/path1 fs2: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/normalization/path2) @@ -1 +1 @@ -測試_РуÑÑкий_ _ _Ä›_áñ測試_РуÑÑкий_ _ _Ä›_áñ+測試_РуÑÑкий_ _ _Ä›_áñěþ áñhࢺ_測試РуÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶ === RUN TestBisyncLocalRemote/rclone_args 2024/05/06 06:08:11 DEBUG : Creating backend with remote "/tmp/060802gi/rclone_args/path1" 2024/05/06 06:08:11 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:11 DEBUG : path2: Making directory 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:11 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2" 2024/05/06 06:08:11 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:11 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:11 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2" 2024/05/06 06:08:11 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_rclone_args-bifapij2" 2024/05/06 06:08:11 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:11 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:11 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:11 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:11 DEBUG : Local file system at /tmp/060802gi/initdir/test_rclone_args-bifapij2: Waiting for checks to finish 2024/05/06 06:08:11 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2024/05/06 06:08:11 DEBUG : file2.txt.xekohen6.partial: renamed to: file2.txt 2024/05/06 06:08:11 INFO : file2.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : Local file system at /tmp/060802gi/initdir/test_rclone_args-bifapij2: Waiting for transfers to finish 2024/05/06 06:08:11 DEBUG : file1.txt.pemuqus2.partial: renamed to: file1.txt 2024/05/06 06:08:11 INFO : file1.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:11 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:11 DEBUG : subdir/file20.txt.meberaw4.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:11 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:11 DEBUG : RCLONE_TEST.divokum2.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:11 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:11 DEBUG : subdir/file21.txt.yohedat7.partial: renamed to: subdir/file21.txt 2024/05/06 06:08:11 INFO : subdir/file21.txt: Copied (new) 2024/05/06 06:08:11 INFO : subdir: Updated directory metadata 2024/05/06 06:08:11 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_rclone_args-sifaseg7" 2024/05/06 06:08:11 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file21.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : Local file system at /tmp/060802gi/datadir/test_rclone_args-sifaseg7: Waiting for checks to finish 2024/05/06 06:08:11 DEBUG : Local file system at /tmp/060802gi/datadir/test_rclone_args-sifaseg7: Waiting for transfers to finish 2024/05/06 06:08:11 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:11 DEBUG : file20.txt.hegasic4.partial: renamed to: file20.txt 2024/05/06 06:08:11 INFO : file20.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:11 DEBUG : file21.txt.ribibux9.partial: renamed to: file21.txt 2024/05/06 06:08:11 INFO : file21.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:11 DEBUG : file2.txt.mazuhof3.partial: renamed to: file2.txt 2024/05/06 06:08:11 INFO : file2.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:11 DEBUG : file1.txt.wagitak8.partial: renamed to: file1.txt 2024/05/06 06:08:11 INFO : file1.txt: Copied (new) 2024/05/06 06:08:11 ERROR : : error listing: directory not found 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2] 2024/05/06 06:08:11 ERROR : : error listing: directory not found 2024/05/06 06:08:11 checking initFs Local file system at /tmp/060802gi/initdir/test_rclone_args-bifapij2 2024/05/06 06:08:11 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:11 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:11 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:11 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : Local file system at /tmp/060802gi/rclone_args/path1: Waiting for checks to finish 2024/05/06 06:08:11 DEBUG : Local file system at /tmp/060802gi/rclone_args/path1: Waiting for transfers to finish 2024/05/06 06:08:11 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:11 DEBUG : RCLONE_TEST.lefanog3.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:11 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:11 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:11 DEBUG : subdir/file21.txt.tidehed7.partial: renamed to: subdir/file21.txt 2024/05/06 06:08:11 INFO : subdir/file21.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:11 DEBUG : file2.txt.nogucix4.partial: renamed to: file2.txt 2024/05/06 06:08:11 INFO : file2.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2024/05/06 06:08:11 DEBUG : file1.txt.kubijif5.partial: renamed to: file1.txt 2024/05/06 06:08:11 INFO : file1.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:11 DEBUG : subdir/file20.txt.regemal2.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:11 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:11 INFO : subdir: Updated directory metadata 2024/05/06 06:08:11 checking Path1 Local file system at /tmp/060802gi/rclone_args/path1 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2] 2024/05/06 06:08:11 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : subdir: Making directory 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/subdir] 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/RCLONE_TEST] 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/file1.txt] 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/file2.txt] 2024/05/06 06:08:11 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/subdir/file20.txt] 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2: Waiting for checks to finish 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2: Waiting for transfers to finish 2024/05/06 06:08:11 INFO : file2.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/subdir/file21.txt] 2024/05/06 06:08:11 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:11 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:11 INFO : file1.txt: Copied (new) 2024/05/06 06:08:11 INFO : subdir/file21.txt: Copied (new) 2024/05/06 06:08:11 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2] 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/subdir] 2024/05/06 06:08:11 (01) : test rclone-args 2024/05/06 06:08:11 (02) : touch-glob 2001-01-02 /tmp/060802gi/datadir/test_rclone_args-sifaseg7/ * 2024/05/06 06:08:11 (03) : test initial bisync 2024/05/06 06:08:11 (04) : bisync resync checksum 2024/05/06 06:08:11 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:11 NOTICE: Local file system at /tmp/060802gi/rclone_args/path1: will use md5 for same-side diffs on Path1 only 2024/05/06 06:08:11 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:08:11 INFO : Synching Path1 "/tmp/060802gi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Copying Path2 files to Path1 2024/05/06 06:08:11 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:11 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:11 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:11 INFO : Resync updating listings 2024/05/06 06:08:11 INFO : Validating listings for Path1 "/tmp/060802gi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Bisync successful 2024/05/06 06:08:11 (05) : test place newer files on both paths 2024/05/06 06:08:11 (06) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file1.txt /tmp/060802gi/rclone_args/path1/ 2024/05/06 06:08:11 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:11 (07) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/ 2024/05/06 06:08:11 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:11 (08) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file20.txt /tmp/060802gi/rclone_args/path1/subdir 2024/05/06 06:08:11 INFO : file20.txt: Updated modification time in destination 2024/05/06 06:08:11 (09) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/subdir 2024/05/06 06:08:11 INFO : file21.txt: Copied (replaced existing) 2024/05/06 06:08:11 (10) : touch-glob 2001-01-02 /tmp/060802gi/rclone_args/path1/ file1.txt 2024/05/06 06:08:11 (11) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/ file2.txt 2024/05/06 06:08:11 (12) : touch-glob 2001-01-02 /tmp/060802gi/rclone_args/path1/subdir/ file20.txt 2024/05/06 06:08:11 (13) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/subdir/ file21.txt 2024/05/06 06:08:11 (14) : test run bisync with custom options 2024/05/06 06:08:11 (15) : bisync checksum 2024/05/06 06:08:11 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:11 NOTICE: Local file system at /tmp/060802gi/rclone_args/path1: will use md5 for same-side diffs on Path1 only 2024/05/06 06:08:11 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:08:11 INFO : Synching Path1 "/tmp/060802gi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:11 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:11 INFO : Path1 checking for diffs 2024/05/06 06:08:11 INFO : - Path1 File changed: hash - file1.txt 2024/05/06 06:08:11 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:11 INFO : (Modified:  1 hash differs) 2024/05/06 06:08:11 INFO : Path2 checking for diffs 2024/05/06 06:08:11 INFO : - Path2 File changed: size (larger), hash - file2.txt 2024/05/06 06:08:11 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:11 INFO : (Modified:  1 larger,  0 smaller,  1 hash differs) 2024/05/06 06:08:11 INFO : Applying changes 2024/05/06 06:08:11 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/file1.txt 2024/05/06 06:08:11 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/rclone_args/path1/file2.txt 2024/05/06 06:08:11 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:11 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:11 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : Updating listings 2024/05/06 06:08:11 INFO : Validating listings for Path1 "/tmp/060802gi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Bisync successful 2024/05/06 06:08:11 (16) : touch-glob 2007-07-23 /tmp/060802gi/datadir/test_rclone_args-sifaseg7/ * 2024/05/06 06:08:11 (17) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file1.txt /tmp/060802gi/rclone_args/path1/ 2024/05/06 06:08:11 INFO : file1.txt: Updated modification time in destination 2024/05/06 06:08:11 (18) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/ 2024/05/06 06:08:11 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:11 (19) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file20.txt /tmp/060802gi/rclone_args/path1/subdir 2024/05/06 06:08:11 INFO : file20.txt: Updated modification time in destination 2024/05/06 06:08:11 (20) : copy-as /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/ file1.txt 2024/05/06 06:08:11 INFO : file21.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:11 (21) : touch-glob 2007-07-23 /tmp/060802gi/rclone_args/path1/ file1.txt 2024/05/06 06:08:11 (22) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/ file2.txt 2024/05/06 06:08:11 (23) : touch-glob 2007-07-23 /tmp/060802gi/rclone_args/path1/subdir/ file20.txt 2024/05/06 06:08:11 (24) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/subdir/ file21.txt 2024/05/06 06:08:11 (25) : bisync size-only 2024/05/06 06:08:11 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:11 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:11 INFO : Synching Path1 "/tmp/060802gi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:11 INFO : Path1 checking for diffs 2024/05/06 06:08:11 INFO : Path2 checking for diffs 2024/05/06 06:08:11 INFO : - Path2 File changed: size (smaller) - file1.txt 2024/05/06 06:08:11 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:11 INFO : (Modified:  0 larger,  1 smaller) 2024/05/06 06:08:11 INFO : Applying changes 2024/05/06 06:08:11 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/rclone_args/path1/file1.txt 2024/05/06 06:08:11 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:11 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : Updating listings 2024/05/06 06:08:11 INFO : Validating listings for Path1 "/tmp/060802gi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Bisync successful 2024/05/06 06:08:11 (26) : bisync resync 2024/05/06 06:08:11 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:11 INFO : Synching Path1 "/tmp/060802gi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Copying Path2 files to Path1 2024/05/06 06:08:11 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:11 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:11 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : subdir/file21.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : Resync updating listings 2024/05/06 06:08:11 INFO : Validating listings for Path1 "/tmp/060802gi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Bisync successful 2024/05/06 06:08:11 (27) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file1.txt /tmp/060802gi/rclone_args/path1/ 2024/05/06 06:08:11 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:11 (28) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/ 2024/05/06 06:08:11 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:11 (29) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file20.txt /tmp/060802gi/rclone_args/path1/subdir 2024/05/06 06:08:11 (30) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/subdir 2024/05/06 06:08:11 INFO : file21.txt: Copied (replaced existing) 2024/05/06 06:08:11 (31) : touch-glob 2007-07-23 /tmp/060802gi/rclone_args/path1/ file1.txt 2024/05/06 06:08:11 (32) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/ file2.txt 2024/05/06 06:08:11 (33) : touch-glob 2007-07-23 /tmp/060802gi/rclone_args/path1/subdir/ file20.txt 2024/05/06 06:08:11 (34) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/subdir/ file21.txt 2024/05/06 06:08:11 (35) : bisync ignore-size 2024/05/06 06:08:11 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": false, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:11 INFO : Synching Path1 "/tmp/060802gi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:11 INFO : Path1 checking for diffs 2024/05/06 06:08:11 INFO : Path2 checking for diffs 2024/05/06 06:08:11 INFO : - Path2 File changed: time (newer) - file2.txt 2024/05/06 06:08:11 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2024/05/06 06:08:11 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:08:11 INFO : (Modified:  2 newer,  0 older) 2024/05/06 06:08:11 INFO : Applying changes 2024/05/06 06:08:11 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/rclone_args/path1/file2.txt 2024/05/06 06:08:11 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/rclone_args/path1/subdir/file21.txt 2024/05/06 06:08:11 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:11 INFO : subdir/file21.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:11 INFO : Updating listings 2024/05/06 06:08:11 INFO : Validating listings for Path1 "/tmp/060802gi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Bisync successful 2024/05/06 06:08:11 (36) : bisync resync compare-all 2024/05/06 06:08:11 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:11 NOTICE: Local file system at /tmp/060802gi/rclone_args/path1: will use md5 for same-side diffs on Path1 only 2024/05/06 06:08:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:08:11 INFO : Synching Path1 "/tmp/060802gi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Copying Path2 files to Path1 2024/05/06 06:08:11 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:11 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:11 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:11 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : Resync updating listings 2024/05/06 06:08:11 INFO : Validating listings for Path1 "/tmp/060802gi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Bisync successful 2024/05/06 06:08:11 (37) : copy-as /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/ file2.txt 2024/05/06 06:08:11 INFO : file21.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:11 (38) : touch-glob 2023-08-26 /tmp/060802gi/datadir/test_rclone_args-sifaseg7/ * 2024/05/06 06:08:11 (39) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file1.txt /tmp/060802gi/rclone_args/path1/ 2024/05/06 06:08:11 INFO : file1.txt: Updated modification time in destination 2024/05/06 06:08:11 (40) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file20.txt /tmp/060802gi/rclone_args/path1/subdir 2024/05/06 06:08:11 INFO : file20.txt: Updated modification time in destination 2024/05/06 06:08:11 (41) : copy-file /tmp/060802gi/datadir/test_rclone_args-sifaseg7/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/subdir 2024/05/06 06:08:11 INFO : file21.txt: Copied (replaced existing) 2024/05/06 06:08:11 (42) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/ file2.txt 2024/05/06 06:08:11 (43) : touch-glob 2023-08-26 /tmp/060802gi/rclone_args/path1/ file1.txt 2024/05/06 06:08:11 (44) : touch-glob 2023-08-26 /tmp/060802gi/rclone_args/path1/subdir/ file20.txt 2024/05/06 06:08:11 (45) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/subdir/ file21.txt 2024/05/06 06:08:11 (46) : bisync compare-all 2024/05/06 06:08:11 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:11 NOTICE: Local file system at /tmp/060802gi/rclone_args/path1: will use md5 for same-side diffs on Path1 only 2024/05/06 06:08:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 1, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": true } 2024/05/06 06:08:11 INFO : Synching Path1 "/tmp/060802gi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:11 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:11 INFO : Path1 checking for diffs 2024/05/06 06:08:11 INFO : - Path1 File changed: time (newer) - file1.txt 2024/05/06 06:08:11 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2024/05/06 06:08:11 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:08:11 INFO : (Modified:  2 newer,  0 older) 2024/05/06 06:08:11 INFO : Path2 checking for diffs 2024/05/06 06:08:11 INFO : - Path2 File changed: size (smaller), hash - file2.txt 2024/05/06 06:08:11 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2024/05/06 06:08:11 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:08:11 INFO : (Modified:  1 newer,  0 older,  0 larger,  1 smaller,  1 hash differs) 2024/05/06 06:08:11 INFO : Applying changes 2024/05/06 06:08:11 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/file1.txt 2024/05/06 06:08:11 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/subdir/file20.txt 2024/05/06 06:08:11 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/rclone_args/path1/file2.txt 2024/05/06 06:08:11 INFO : - Path2 Queue copy to Path1 - /tmp/060802gi/rclone_args/path1/subdir/file21.txt 2024/05/06 06:08:11 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:11 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : subdir/file21.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:11 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:11 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:11 INFO : Updating listings 2024/05/06 06:08:11 INFO : Validating listings for Path1 "/tmp/060802gi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rclone_args/path2/" 2024/05/06 06:08:11 INFO : Bisync successful bisync_test.go:555: TEST rclone_args PASSED === RUN TestBisyncLocalRemote/resolve 2024/05/06 06:08:11 DEBUG : Creating backend with remote "/tmp/060802gi/resolve/path1" 2024/05/06 06:08:11 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:11 DEBUG : path2: Making directory 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:11 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2" 2024/05/06 06:08:11 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:11 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:11 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2" 2024/05/06 06:08:11 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_resolve-gexevam1" 2024/05/06 06:08:11 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : Local file system at /tmp/060802gi/initdir/test_resolve-gexevam1: Waiting for checks to finish 2024/05/06 06:08:11 DEBUG : Local file system at /tmp/060802gi/initdir/test_resolve-gexevam1: Waiting for transfers to finish 2024/05/06 06:08:11 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:11 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:11 DEBUG : file1.txt.gehexev9.partial: renamed to: file1.txt 2024/05/06 06:08:11 INFO : file1.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : file2.txt.yemuvir3.partial: renamed to: file2.txt 2024/05/06 06:08:11 INFO : file2.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:11 DEBUG : RCLONE_TEST.laxadir5.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:11 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:11 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_resolve-lipivec1" 2024/05/06 06:08:11 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : Local file system at /tmp/060802gi/datadir/test_resolve-lipivec1: Waiting for checks to finish 2024/05/06 06:08:11 DEBUG : Local file system at /tmp/060802gi/datadir/test_resolve-lipivec1: Waiting for transfers to finish 2024/05/06 06:08:11 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK 2024/05/06 06:08:11 DEBUG : file1R.txt.lofeqac5.partial: renamed to: file1R.txt 2024/05/06 06:08:11 INFO : file1R.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/05/06 06:08:11 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/05/06 06:08:11 DEBUG : file2.txt.mufecuz9.partial: renamed to: file2.txt 2024/05/06 06:08:11 INFO : file2.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : file1L.txt.nojakoz3.partial: renamed to: file1L.txt 2024/05/06 06:08:11 INFO : file1L.txt: Copied (new) 2024/05/06 06:08:11 ERROR : : error listing: directory not found 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2] 2024/05/06 06:08:11 ERROR : : error listing: directory not found 2024/05/06 06:08:11 checking initFs Local file system at /tmp/060802gi/initdir/test_resolve-gexevam1 2024/05/06 06:08:11 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : Local file system at /tmp/060802gi/resolve/path1: Waiting for checks to finish 2024/05/06 06:08:11 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:11 DEBUG : Local file system at /tmp/060802gi/resolve/path1: Waiting for transfers to finish 2024/05/06 06:08:11 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:11 DEBUG : file1.txt.ceruqej9.partial: renamed to: file1.txt 2024/05/06 06:08:11 INFO : file1.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : file2.txt.dedulek3.partial: renamed to: file2.txt 2024/05/06 06:08:11 INFO : file2.txt: Copied (new) 2024/05/06 06:08:11 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:11 DEBUG : RCLONE_TEST.xiyetum9.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:11 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:11 checking Path1 Local file system at /tmp/060802gi/resolve/path1 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2] 2024/05/06 06:08:11 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/RCLONE_TEST] 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/file1.txt] 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: Waiting for checks to finish 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/file2.txt] 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: Waiting for transfers to finish 2024/05/06 06:08:11 INFO : file1.txt: Copied (new) 2024/05/06 06:08:11 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:11 INFO : file2.txt: Copied (new) 2024/05/06 06:08:11 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2 2024/05/06 06:08:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2] 2024/05/06 06:08:11 (01) : test resolve 2024/05/06 06:08:11 (02) : test initial bisync 2024/05/06 06:08:11 (03) : bisync resync 2024/05/06 06:08:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:11 INFO : Synching Path1 "/tmp/060802gi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:11 INFO : Copying Path2 files to Path1 2024/05/06 06:08:11 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:11 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:11 INFO : Resync updating listings 2024/05/06 06:08:11 INFO : Validating listings for Path1 "/tmp/060802gi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:11 INFO : Bisync successful 2024/05/06 06:08:11 (04) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:11 (05) : touch-glob 2001-01-02 /tmp/060802gi/datadir/test_resolve-lipivec1/ file1R.txt 2024/05/06 06:08:11 (06) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/ file1.txt 2024/05/06 06:08:11 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:11 (07) : touch-glob 2001-03-04 /tmp/060802gi/datadir/test_resolve-lipivec1/ file1L.txt 2024/05/06 06:08:11 (08) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1L.txt /tmp/060802gi/resolve/path1/ file1.txt 2024/05/06 06:08:11 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:11 (09) : test bisync run with --conflict-resolve=newer --conflict-loser=delete --conflict-suffix=potato 2024/05/06 06:08:11 (10) : bisync conflict-resolve=newer conflict-loser=delete conflict-suffix=potato 2024/05/06 06:08:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:11 INFO : Synching Path1 "/tmp/060802gi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:11 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:11 INFO : Path1 checking for diffs 2024/05/06 06:08:11 INFO : - Path1 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:11 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:11 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:11 INFO : Path2 checking for diffs 2024/05/06 06:08:11 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:11 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:11 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:11 INFO : Applying changes 2024/05/06 06:08:11 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:11 INFO : Checking potential conflicts... 2024/05/06 06:08:11 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: 1 differences found 2024/05/06 06:08:11 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: 1 errors while checking 2024/05/06 06:08:11 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:11 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:11 INFO : file1.txt: Path1 is newer. Path1: 2001-03-04 00:00:00 +0000 UTC, Path2: 2001-01-02 00:00:00 +0000 UTC, Difference: 1464h0m0s 2024/05/06 06:08:11 INFO : file1.txt: The winner is: Path1 2024/05/06 06:08:11 NOTICE: - Path2 Deleting Path2 copy - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/file1.txt 2024/05/06 06:08:11 INFO : file1.txt: Deleted 2024/05/06 06:08:11 INFO : - Path1 Queue copy to Path2 - file1.txt 2024/05/06 06:08:11 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:11 INFO : file1.txt: Copied (new) 2024/05/06 06:08:11 INFO : Updating listings 2024/05/06 06:08:11 INFO : Validating listings for Path1 "/tmp/060802gi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:11 INFO : Bisync successful 2024/05/06 06:08:11 (11) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:11 (12) : touch-glob 2001-07-23 /tmp/060802gi/datadir/test_resolve-lipivec1/ file1R.txt 2024/05/06 06:08:11 (13) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/ file1.txt 2024/05/06 06:08:11 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:11 (14) : touch-glob 2001-08-26 /tmp/060802gi/datadir/test_resolve-lipivec1/ file1L.txt 2024/05/06 06:08:11 (15) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1L.txt /tmp/060802gi/resolve/path1/ file1.txt 2024/05/06 06:08:11 INFO : file1L.txt: Updated modification time in destination 2024/05/06 06:08:11 (16) : test bisync run with --conflict-resolve=path2 --conflict-loser=num --conflict-suffix=dinosaur 2024/05/06 06:08:11 (17) : bisync conflict-resolve=path2 conflict-loser=num conflict-suffix=dinosaur 2024/05/06 06:08:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:11 INFO : Synching Path1 "/tmp/060802gi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:11 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:11 INFO : Path1 checking for diffs 2024/05/06 06:08:11 INFO : - Path1 File changed: time (newer) - file1.txt 2024/05/06 06:08:11 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:11 INFO : (Modified:  1 newer,  0 older) 2024/05/06 06:08:11 INFO : Path2 checking for diffs 2024/05/06 06:08:11 INFO : - Path2 File changed: time (newer) - file1.txt 2024/05/06 06:08:11 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:11 INFO : (Modified:  1 newer,  0 older) 2024/05/06 06:08:11 INFO : Applying changes 2024/05/06 06:08:11 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:11 INFO : Checking potential conflicts... 2024/05/06 06:08:11 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: 1 differences found 2024/05/06 06:08:11 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: 1 errors while checking 2024/05/06 06:08:11 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:11 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:11 INFO : file1.txt: The winner is: Path2 2024/05/06 06:08:11 NOTICE: - Path1 Renaming Path1 copy - /tmp/060802gi/resolve/path1/file1.txt.dinosaur1 2024/05/06 06:08:11 INFO : file1.txt: Moved (server-side) to: file1.txt.dinosaur1 2024/05/06 06:08:11 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/file1.txt.dinosaur1 2024/05/06 06:08:11 NOTICE: - Path2 Not renaming Path2 copy, as it was determined the winner - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/file1.txt 2024/05/06 06:08:11 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/resolve/path1/file1.txt 2024/05/06 06:08:11 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:11 INFO : file1.txt: Copied (new) 2024/05/06 06:08:11 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:11 INFO : file1.txt.dinosaur1: Copied (new) 2024/05/06 06:08:11 INFO : Updating listings 2024/05/06 06:08:11 INFO : Validating listings for Path1 "/tmp/060802gi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:11 INFO : Bisync successful 2024/05/06 06:08:11 (18) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:11 (19) : touch-glob 2002-07-23 /tmp/060802gi/datadir/test_resolve-lipivec1/ file1R.txt 2024/05/06 06:08:11 (20) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/ file1.txt 2024/05/06 06:08:11 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:11 (21) : touch-glob 2002-08-26 /tmp/060802gi/datadir/test_resolve-lipivec1/ file1L.txt 2024/05/06 06:08:11 (22) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1L.txt /tmp/060802gi/resolve/path1/ file1.txt 2024/05/06 06:08:11 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:11 (23) : test bisync run with --conflict-resolve=larger --conflict-loser=num --conflict-suffix=apple 2024/05/06 06:08:11 (24) : bisync conflict-resolve=larger conflict-loser=num conflict-suffix=apple 2024/05/06 06:08:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:11 INFO : Synching Path1 "/tmp/060802gi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:11 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:11 INFO : Path1 checking for diffs 2024/05/06 06:08:11 INFO : - Path1 File is new - file1.txt 2024/05/06 06:08:11 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:11 INFO : Path2 checking for diffs 2024/05/06 06:08:11 INFO : - Path2 File is new - file1.txt 2024/05/06 06:08:11 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:11 INFO : Applying changes 2024/05/06 06:08:11 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:11 INFO : Checking potential conflicts... 2024/05/06 06:08:11 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: 1 differences found 2024/05/06 06:08:11 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: 1 errors while checking 2024/05/06 06:08:11 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:11 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:11 INFO : file1.txt: Winner cannot be determined as sizes are equal. Path1: 33, Path2: 33, Difference: 0 2024/05/06 06:08:11 INFO : file1.txt: A winner could not be determined. 2024/05/06 06:08:11 NOTICE: - Path1 Renaming Path1 copy - /tmp/060802gi/resolve/path1/file1.txt.apple1 2024/05/06 06:08:11 INFO : file1.txt: Moved (server-side) to: file1.txt.apple1 2024/05/06 06:08:11 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/file1.txt.apple1 2024/05/06 06:08:11 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/file1.txt.apple2 2024/05/06 06:08:11 INFO : file1.txt: Moved (server-side) to: file1.txt.apple2 2024/05/06 06:08:11 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/resolve/path1/file1.txt.apple2 2024/05/06 06:08:11 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:11 INFO : file1.txt.apple2: Copied (new) 2024/05/06 06:08:11 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:11 INFO : file1.txt.apple1: Copied (new) 2024/05/06 06:08:11 INFO : Updating listings 2024/05/06 06:08:11 INFO : Validating listings for Path1 "/tmp/060802gi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:11 INFO : Bisync successful 2024/05/06 06:08:11 (25) : test different suffixes 2024/05/06 06:08:11 (26) : touch-glob 2003-07-23 /tmp/060802gi/datadir/test_resolve-lipivec1/ file1R.txt 2024/05/06 06:08:11 (27) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/ file1.txt 2024/05/06 06:08:11 INFO : file1R.txt: Copied (new) to: file1.txt 2024/05/06 06:08:11 (28) : touch-glob 2003-07-23 /tmp/060802gi/datadir/test_resolve-lipivec1/ file1L.txt 2024/05/06 06:08:11 (29) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1L.txt /tmp/060802gi/resolve/path1/ file1.txt 2024/05/06 06:08:11 INFO : file1L.txt: Copied (new) to: file1.txt 2024/05/06 06:08:11 (30) : test bisync run with --conflict-resolve=older --conflict-loser=num --conflict-suffix=cloud,local 2024/05/06 06:08:11 (31) : bisync conflict-resolve=older conflict-loser=num conflict-suffix=cloud,local 2024/05/06 06:08:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:11 INFO : Synching Path1 "/tmp/060802gi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:11 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:11 INFO : Path1 checking for diffs 2024/05/06 06:08:11 INFO : - Path1 File is new - file1.txt 2024/05/06 06:08:11 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:11 INFO : Path2 checking for diffs 2024/05/06 06:08:11 INFO : - Path2 File is new - file1.txt 2024/05/06 06:08:11 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:11 INFO : Applying changes 2024/05/06 06:08:11 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:11 INFO : Checking potential conflicts... 2024/05/06 06:08:11 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: 1 differences found 2024/05/06 06:08:11 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: 1 errors while checking 2024/05/06 06:08:11 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:11 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:11 INFO : file1.txt: Winner cannot be determined as times are equal. Path1: 2003-07-23 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 0s 2024/05/06 06:08:11 INFO : file1.txt: A winner could not be determined. 2024/05/06 06:08:11 NOTICE: - Path1 Renaming Path1 copy - /tmp/060802gi/resolve/path1/file1.txt.cloud1 2024/05/06 06:08:11 INFO : file1.txt: Moved (server-side) to: file1.txt.cloud1 2024/05/06 06:08:11 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/file1.txt.cloud1 2024/05/06 06:08:11 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/file1.txt.local1 2024/05/06 06:08:11 INFO : file1.txt: Moved (server-side) to: file1.txt.local1 2024/05/06 06:08:11 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/resolve/path1/file1.txt.local1 2024/05/06 06:08:11 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:11 INFO : file1.txt.local1: Copied (new) 2024/05/06 06:08:11 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:11 INFO : file1.txt.cloud1: Copied (new) 2024/05/06 06:08:11 INFO : Updating listings 2024/05/06 06:08:11 INFO : Validating listings for Path1 "/tmp/060802gi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:11 INFO : Bisync successful 2024/05/06 06:08:11 (32) : test legacy 2024/05/06 06:08:11 (33) : touch-glob 2004-07-23 /tmp/060802gi/datadir/test_resolve-lipivec1/ file1R.txt 2024/05/06 06:08:11 (34) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/ file1.txt 2024/05/06 06:08:12 INFO : file1R.txt: Copied (new) to: file1.txt 2024/05/06 06:08:12 (35) : touch-glob 2004-07-23 /tmp/060802gi/datadir/test_resolve-lipivec1/ file1L.txt 2024/05/06 06:08:12 (36) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1L.txt /tmp/060802gi/resolve/path1/ file1.txt 2024/05/06 06:08:12 INFO : file1L.txt: Copied (new) to: file1.txt 2024/05/06 06:08:12 (37) : test bisync run with --conflict-resolve=none --conflict-loser=pathname --conflict-suffix=.path 2024/05/06 06:08:12 (38) : bisync conflict-resolve=none conflict-loser=pathname conflict-suffix=.path 2024/05/06 06:08:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:12 INFO : Synching Path1 "/tmp/060802gi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:12 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:12 INFO : Path1 checking for diffs 2024/05/06 06:08:12 INFO : - Path1 File is new - file1.txt 2024/05/06 06:08:12 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:12 INFO : Path2 checking for diffs 2024/05/06 06:08:12 INFO : - Path2 File is new - file1.txt 2024/05/06 06:08:12 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:12 INFO : Applying changes 2024/05/06 06:08:12 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:12 INFO : Checking potential conflicts... 2024/05/06 06:08:12 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: 1 differences found 2024/05/06 06:08:12 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: 1 errors while checking 2024/05/06 06:08:12 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:12 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:12 NOTICE: - Path1 Renaming Path1 copy - /tmp/060802gi/resolve/path1/file1.txt..path1 2024/05/06 06:08:12 INFO : file1.txt: Moved (server-side) to: file1.txt..path1 2024/05/06 06:08:12 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/file1.txt..path1 2024/05/06 06:08:12 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/file1.txt..path2 2024/05/06 06:08:12 INFO : file1.txt: Moved (server-side) to: file1.txt..path2 2024/05/06 06:08:12 NOTICE: - Path2 Queue copy to Path1 - /tmp/060802gi/resolve/path1/file1.txt..path2 2024/05/06 06:08:12 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:12 INFO : file1.txt..path2: Copied (new) 2024/05/06 06:08:12 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:12 INFO : file1.txt..path1: Copied (new) 2024/05/06 06:08:12 INFO : Updating listings 2024/05/06 06:08:12 INFO : Validating listings for Path1 "/tmp/060802gi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:12 INFO : Bisync successful 2024/05/06 06:08:12 (39) : test deletes on both sides with default suffix 2024/05/06 06:08:12 (40) : touch-glob 2005-01-02 /tmp/060802gi/datadir/test_resolve-lipivec1/ file1R.txt 2024/05/06 06:08:12 (41) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/ file1.txt 2024/05/06 06:08:12 INFO : file1R.txt: Copied (new) to: file1.txt 2024/05/06 06:08:12 (42) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1R.txt /tmp/060802gi/resolve/path1/ file2.txt 2024/05/06 06:08:12 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:12 (43) : touch-glob 2006-03-04 /tmp/060802gi/datadir/test_resolve-lipivec1/ file1L.txt 2024/05/06 06:08:12 (44) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1L.txt /tmp/060802gi/resolve/path1/ file1.txt 2024/05/06 06:08:12 INFO : file1L.txt: Copied (new) to: file1.txt 2024/05/06 06:08:12 (45) : copy-as /tmp/060802gi/datadir/test_resolve-lipivec1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/ file2.txt 2024/05/06 06:08:12 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:12 (46) : test bisync run with --conflict-resolve=newer --conflict-loser=delete 2024/05/06 06:08:12 (47) : bisync conflict-resolve=newer conflict-loser=delete 2024/05/06 06:08:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:12 INFO : Synching Path1 "/tmp/060802gi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:12 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:12 INFO : Path1 checking for diffs 2024/05/06 06:08:12 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:12 INFO : - Path1 File is new - file1.txt 2024/05/06 06:08:12 INFO : Path1: 2 changes:  1 new,  1 modified,  0 deleted 2024/05/06 06:08:12 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:12 INFO : Path2 checking for diffs 2024/05/06 06:08:12 INFO : - Path2 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:12 INFO : - Path2 File is new - file1.txt 2024/05/06 06:08:12 INFO : Path2: 2 changes:  1 new,  1 modified,  0 deleted 2024/05/06 06:08:12 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:12 INFO : Applying changes 2024/05/06 06:08:12 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:12 INFO : Checking potential conflicts... 2024/05/06 06:08:12 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: 2 differences found 2024/05/06 06:08:12 NOTICE: hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2: 2 errors while checking 2024/05/06 06:08:12 INFO : Finished checking the potential conflicts. 2 differences found 2024/05/06 06:08:12 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:12 INFO : file1.txt: Path1 is newer. Path1: 2006-03-04 00:00:00 +0000 UTC, Path2: 2005-01-02 00:00:00 +0000 UTC, Difference: 10224h0m0s 2024/05/06 06:08:12 INFO : file1.txt: The winner is: Path1 2024/05/06 06:08:12 NOTICE: - Path2 Deleting Path2 copy - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/file1.txt 2024/05/06 06:08:12 INFO : file1.txt: Deleted 2024/05/06 06:08:12 INFO : - Path1 Queue copy to Path2 - file1.txt 2024/05/06 06:08:12 NOTICE: - WARNING New or changed in both paths - file2.txt 2024/05/06 06:08:12 INFO : file2.txt: Path2 is newer. Path1: 2005-01-02 00:00:00 +0000 UTC, Path2: 2006-03-04 00:00:00 +0000 UTC, Difference: 10224h0m0s 2024/05/06 06:08:12 INFO : file2.txt: The winner is: Path2 2024/05/06 06:08:12 NOTICE: - Path1 Deleting Path1 copy - /tmp/060802gi/resolve/path1/file2.txt 2024/05/06 06:08:12 INFO : file2.txt: Deleted 2024/05/06 06:08:12 INFO : - Path2 Queue copy to Path1 - file2.txt 2024/05/06 06:08:12 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:12 INFO : file2.txt: Copied (new) 2024/05/06 06:08:12 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:12 INFO : file1.txt: Copied (new) 2024/05/06 06:08:12 INFO : Updating listings 2024/05/06 06:08:12 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:12 INFO : Validating listings for Path1 "/tmp/060802gi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resolve/path2/" 2024/05/06 06:08:12 INFO : Bisync successful bisync_test.go:555: TEST resolve PASSED === RUN TestBisyncLocalRemote/resync 2024/05/06 06:08:12 DEBUG : Creating backend with remote "/tmp/060802gi/resync/path1" 2024/05/06 06:08:12 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:12 DEBUG : path2: Making directory 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:12 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2" 2024/05/06 06:08:12 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:12 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:12 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2" 2024/05/06 06:08:12 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_resync-butipun6" 2024/05/06 06:08:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file3.txt.dovifof0.partial: renamed to: file3.txt 2024/05/06 06:08:12 INFO : file3.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : file1.txt.qejonam8.partial: renamed to: file1.txt 2024/05/06 06:08:12 INFO : file1.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file4.txt.viduvif6.partial: renamed to: file4.txt 2024/05/06 06:08:12 INFO : file4.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : Local file system at /tmp/060802gi/initdir/test_resync-butipun6: Waiting for checks to finish 2024/05/06 06:08:12 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file6.txt.bupevac2.partial: renamed to: file6.txt 2024/05/06 06:08:12 INFO : file6.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : Local file system at /tmp/060802gi/initdir/test_resync-butipun6: Waiting for transfers to finish 2024/05/06 06:08:12 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file7.txt.tuziyec5.partial: renamed to: file7.txt 2024/05/06 06:08:12 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 INFO : file7.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:12 DEBUG : file5.txt.dacenim2.partial: renamed to: file5.txt 2024/05/06 06:08:12 INFO : file5.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : file2.txt.dibilef8.partial: renamed to: file2.txt 2024/05/06 06:08:12 INFO : file2.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : RCLONE_TEST.lonitog7.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:12 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:12 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_resync-xepirek9" 2024/05/06 06:08:12 DEBUG : fileA.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : fileB.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : Local file system at /tmp/060802gi/datadir/test_resync-xepirek9: Waiting for checks to finish 2024/05/06 06:08:12 DEBUG : Local file system at /tmp/060802gi/datadir/test_resync-xepirek9: Waiting for transfers to finish 2024/05/06 06:08:12 DEBUG : fileB.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:12 DEBUG : fileB.txt.xolidug3.partial: renamed to: fileB.txt 2024/05/06 06:08:12 INFO : fileB.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : fileA.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:12 DEBUG : fileA.txt.yiwatop3.partial: renamed to: fileA.txt 2024/05/06 06:08:12 INFO : fileA.txt: Copied (new) 2024/05/06 06:08:12 ERROR : : error listing: directory not found 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2] 2024/05/06 06:08:12 ERROR : : error listing: directory not found 2024/05/06 06:08:12 checking initFs Local file system at /tmp/060802gi/initdir/test_resync-butipun6 2024/05/06 06:08:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : Local file system at /tmp/060802gi/resync/path1: Waiting for checks to finish 2024/05/06 06:08:12 DEBUG : Local file system at /tmp/060802gi/resync/path1: Waiting for transfers to finish 2024/05/06 06:08:12 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file1.txt.fewavub5.partial: renamed to: file1.txt 2024/05/06 06:08:12 INFO : file1.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : file3.txt.puziyow3.partial: renamed to: file3.txt 2024/05/06 06:08:12 INFO : file3.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file4.txt.gapehol7.partial: renamed to: file4.txt 2024/05/06 06:08:12 INFO : file4.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file2.txt.zavekos1.partial: renamed to: file2.txt 2024/05/06 06:08:12 INFO : file2.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file5.txt.qaqulil9.partial: renamed to: file5.txt 2024/05/06 06:08:12 INFO : file5.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : file6.txt.busekav1.partial: renamed to: file6.txt 2024/05/06 06:08:12 INFO : file6.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:12 DEBUG : RCLONE_TEST.kukuden4.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:12 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:12 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file7.txt.nigevim2.partial: renamed to: file7.txt 2024/05/06 06:08:12 INFO : file7.txt: Copied (new) 2024/05/06 06:08:12 checking Path1 Local file system at /tmp/060802gi/resync/path1 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2] 2024/05/06 06:08:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/RCLONE_TEST] 2024/05/06 06:08:12 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: Waiting for checks to finish 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: Waiting for transfers to finish 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/file1.txt] 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/file3.txt] 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/file2.txt] 2024/05/06 06:08:12 INFO : file1.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/file4.txt] 2024/05/06 06:08:12 INFO : file3.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/file5.txt] 2024/05/06 06:08:12 INFO : file2.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/file6.txt] 2024/05/06 06:08:12 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/file7.txt] 2024/05/06 06:08:12 INFO : file4.txt: Copied (new) 2024/05/06 06:08:12 INFO : file5.txt: Copied (new) 2024/05/06 06:08:12 INFO : file6.txt: Copied (new) 2024/05/06 06:08:12 INFO : file7.txt: Copied (new) 2024/05/06 06:08:12 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2] 2024/05/06 06:08:12 (01) : test resync 2024/05/06 06:08:12 (02) : test 1. resync with empty path1, resulting in copying all content from path2. 2024/05/06 06:08:12 (03) : purge-children /tmp/060802gi/resync/path1/ 2024/05/06 06:08:12 (04) : bisync resync 2024/05/06 06:08:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:12 INFO : Synching Path1 "/tmp/060802gi/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/" 2024/05/06 06:08:12 INFO : Copying Path2 files to Path1 2024/05/06 06:08:12 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:12 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:12 INFO : file1.txt: Copied (new) 2024/05/06 06:08:12 INFO : file3.txt: Copied (new) 2024/05/06 06:08:12 INFO : file2.txt: Copied (new) 2024/05/06 06:08:12 INFO : file4.txt: Copied (new) 2024/05/06 06:08:12 INFO : file5.txt: Copied (new) 2024/05/06 06:08:12 INFO : file6.txt: Copied (new) 2024/05/06 06:08:12 INFO : file7.txt: Copied (new) 2024/05/06 06:08:12 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:12 INFO : Resync updating listings 2024/05/06 06:08:12 INFO : Validating listings for Path1 "/tmp/060802gi/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/" 2024/05/06 06:08:12 INFO : Bisync successful 2024/05/06 06:08:12 (05) : move-listings empty-path1 2024/05/06 06:08:12 (06) : test 2. resync with empty path2, resulting in synching all content to path2. 2024/05/06 06:08:12 (07) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/ 2024/05/06 06:08:12 (08) : bisync resync 2024/05/06 06:08:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:12 INFO : Synching Path1 "/tmp/060802gi/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/" 2024/05/06 06:08:12 INFO : Copying Path2 files to Path1 2024/05/06 06:08:12 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:12 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:12 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:12 INFO : file3.txt: Copied (new) 2024/05/06 06:08:12 INFO : file1.txt: Copied (new) 2024/05/06 06:08:12 INFO : file2.txt: Copied (new) 2024/05/06 06:08:12 INFO : file4.txt: Copied (new) 2024/05/06 06:08:12 INFO : file5.txt: Copied (new) 2024/05/06 06:08:12 INFO : file6.txt: Copied (new) 2024/05/06 06:08:12 INFO : file7.txt: Copied (new) 2024/05/06 06:08:12 INFO : Resync updating listings 2024/05/06 06:08:12 INFO : Validating listings for Path1 "/tmp/060802gi/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/" 2024/05/06 06:08:12 INFO : Bisync successful 2024/05/06 06:08:12 (09) : move-listings empty-path2 2024/05/06 06:08:12 (10) : test 3. exercise all of the various file difference scenarios during a resync. 2024/05/06 06:08:12 (11) : touch-glob 2002-02-02 /tmp/060802gi/datadir/test_resync-xepirek9/ fileA.txt 2024/05/06 06:08:12 (12) : touch-glob 1999-09-09 /tmp/060802gi/datadir/test_resync-xepirek9/ fileB.txt 2024/05/06 06:08:12 (13) : test = file - path1 - path2 - expected action - who wins 2024/05/06 06:08:12 (14) : test - file1.txt - exists - missing - sync path1 > path2 - path1 2024/05/06 06:08:12 (15) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/file1.txt 2024/05/06 06:08:12 INFO : file1.txt: Deleted 2024/05/06 06:08:12 (16) : test - file2.txt - missing - exists - copy path2 > path1 - path2 2024/05/06 06:08:12 (17) : delete-file /tmp/060802gi/resync/path1/file2.txt 2024/05/06 06:08:12 INFO : file2.txt: Deleted 2024/05/06 06:08:12 (18) : test - file3.txt - exists - newer date - sync path1 > path2 - path1 2024/05/06 06:08:12 (19) : copy-as /tmp/060802gi/datadir/test_resync-xepirek9/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/ file3.txt 2024/05/06 06:08:12 INFO : fileA.txt: Copied (replaced existing) to: file3.txt 2024/05/06 06:08:12 (20) : test - file4.txt - missing - newer date - copy path2 > path1 - path2 2024/05/06 06:08:12 (21) : delete-file /tmp/060802gi/resync/path1/file4.txt 2024/05/06 06:08:12 INFO : file4.txt: Deleted 2024/05/06 06:08:12 (22) : copy-as /tmp/060802gi/datadir/test_resync-xepirek9/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/ file4.txt 2024/05/06 06:08:12 INFO : fileA.txt: Copied (replaced existing) to: file4.txt 2024/05/06 06:08:12 (23) : test - file5.txt - exists - older date - sync path1 > path2 - path1 2024/05/06 06:08:12 (24) : copy-as /tmp/060802gi/datadir/test_resync-xepirek9/fileB.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/ file5.txt 2024/05/06 06:08:12 INFO : fileB.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:12 (25) : test - file6.txt - older date - newer date - sync path1 > path2 - path1 2024/05/06 06:08:12 (26) : copy-as /tmp/060802gi/datadir/test_resync-xepirek9/fileB.txt /tmp/060802gi/resync/path1/ file6.txt 2024/05/06 06:08:12 INFO : fileB.txt: Copied (replaced existing) to: file6.txt 2024/05/06 06:08:12 (27) : copy-as /tmp/060802gi/datadir/test_resync-xepirek9/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/ file6.txt 2024/05/06 06:08:12 INFO : fileA.txt: Copied (replaced existing) to: file6.txt 2024/05/06 06:08:12 (28) : test - file7.txt - exists - exists (same) - none - same 2024/05/06 06:08:12 (29) : test run bisync with resync 2024/05/06 06:08:12 (30) : bisync resync 2024/05/06 06:08:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:12 INFO : Synching Path1 "/tmp/060802gi/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/" 2024/05/06 06:08:12 INFO : Copying Path2 files to Path1 2024/05/06 06:08:12 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:12 INFO : file2.txt: Copied (new) 2024/05/06 06:08:12 INFO : file4.txt: Copied (new) 2024/05/06 06:08:12 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:12 INFO : file1.txt: Copied (new) 2024/05/06 06:08:12 INFO : file3.txt: Copied (replaced existing) 2024/05/06 06:08:12 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:08:12 INFO : file5.txt: Copied (replaced existing) 2024/05/06 06:08:12 INFO : Resync updating listings 2024/05/06 06:08:12 INFO : Validating listings for Path1 "/tmp/060802gi/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/" 2024/05/06 06:08:12 INFO : Bisync successful 2024/05/06 06:08:12 (31) : copy-listings mixed-diffs 2024/05/06 06:08:12 (32) : test run normal bisync 2024/05/06 06:08:12 (33) : bisync 2024/05/06 06:08:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:12 INFO : Synching Path1 "/tmp/060802gi/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/" 2024/05/06 06:08:12 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:12 INFO : Path1 checking for diffs 2024/05/06 06:08:12 INFO : Path2 checking for diffs 2024/05/06 06:08:12 INFO : No changes found 2024/05/06 06:08:12 INFO : Updating listings 2024/05/06 06:08:12 INFO : Validating listings for Path1 "/tmp/060802gi/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/" 2024/05/06 06:08:12 INFO : Bisync successful 2024/05/06 06:08:12 (34) : test 4. confirm critical error on normal sync of empty path. 2024/05/06 06:08:12 (35) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/ 2024/05/06 06:08:12 (36) : bisync 2024/05/06 06:08:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:12 INFO : Synching Path1 "/tmp/060802gi/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync/path2/" 2024/05/06 06:08:12 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:12 INFO : Path1 checking for diffs 2024/05/06 06:08:12 INFO : Path2 checking for diffs 2024/05/06 06:08:12 ERROR : Empty current Path2 listing. Cannot sync to an empty directory: /tmp/060802gi/workdir/tmp_060802gi_resync_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_resync_path2.path2.lst-new 2024/05/06 06:08:12 ERROR : Bisync critical error: empty current Path2 listing: /tmp/060802gi/workdir/tmp_060802gi_resync_path1..TestHdfs_rclone-test-yagozel7lusazib1yuramux7_060802gi_resync_path2.path2.lst-new 2024/05/06 06:08:12 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:12 Bisync error: bisync aborted bisync_test.go:555: TEST resync PASSED === RUN TestBisyncLocalRemote/resync_modes 2024/05/06 06:08:12 DEBUG : Creating backend with remote "/tmp/060802gi/resync_modes/path1" 2024/05/06 06:08:12 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:12 DEBUG : path2: Making directory 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:12 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2" 2024/05/06 06:08:12 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:12 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:12 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2" 2024/05/06 06:08:12 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_resync_modes-sejobag4" 2024/05/06 06:08:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:12 DEBUG : RCLONE_TEST.cojohay3.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:12 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:12 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : Local file system at /tmp/060802gi/initdir/test_resync_modes-sejobag4: Waiting for checks to finish 2024/05/06 06:08:12 DEBUG : file1.txt.texeweg6.partial: renamed to: file1.txt 2024/05/06 06:08:12 INFO : file1.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : Local file system at /tmp/060802gi/initdir/test_resync_modes-sejobag4: Waiting for transfers to finish 2024/05/06 06:08:12 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file2.txt.purajod6.partial: renamed to: file2.txt 2024/05/06 06:08:12 INFO : file2.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_resync_modes-bekudak8" 2024/05/06 06:08:12 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : Local file system at /tmp/060802gi/datadir/test_resync_modes-bekudak8: Waiting for checks to finish 2024/05/06 06:08:12 DEBUG : Local file system at /tmp/060802gi/datadir/test_resync_modes-bekudak8: Waiting for transfers to finish 2024/05/06 06:08:12 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/05/06 06:08:12 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/05/06 06:08:12 DEBUG : file1L.txt.sufevap1.partial: renamed to: file1L.txt 2024/05/06 06:08:12 INFO : file1L.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : file2.txt.qapeduy7.partial: renamed to: file2.txt 2024/05/06 06:08:12 INFO : file2.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : file1R.txt: md5 = 705bb3c0ef02925739e834ca98c099c3 OK 2024/05/06 06:08:12 DEBUG : file1R.txt.fusepaq7.partial: renamed to: file1R.txt 2024/05/06 06:08:12 INFO : file1R.txt: Copied (new) 2024/05/06 06:08:12 ERROR : : error listing: directory not found 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2] 2024/05/06 06:08:12 ERROR : : error listing: directory not found 2024/05/06 06:08:12 checking initFs Local file system at /tmp/060802gi/initdir/test_resync_modes-sejobag4 2024/05/06 06:08:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : Local file system at /tmp/060802gi/resync_modes/path1: Waiting for checks to finish 2024/05/06 06:08:12 DEBUG : Local file system at /tmp/060802gi/resync_modes/path1: Waiting for transfers to finish 2024/05/06 06:08:12 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:12 DEBUG : RCLONE_TEST.qikujul9.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:12 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:12 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file1.txt.jepotez8.partial: renamed to: file1.txt 2024/05/06 06:08:12 INFO : file1.txt: Copied (new) 2024/05/06 06:08:12 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:12 DEBUG : file2.txt.dokutol0.partial: renamed to: file2.txt 2024/05/06 06:08:12 INFO : file2.txt: Copied (new) 2024/05/06 06:08:12 checking Path1 Local file system at /tmp/060802gi/resync_modes/path1 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2] 2024/05/06 06:08:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2: Waiting for checks to finish 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2: Waiting for transfers to finish 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/file1.txt] 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/RCLONE_TEST] 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/file2.txt] 2024/05/06 06:08:12 INFO : file1.txt: Copied (new) 2024/05/06 06:08:12 INFO : file2.txt: Copied (new) 2024/05/06 06:08:12 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:12 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2 2024/05/06 06:08:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2] 2024/05/06 06:08:12 (01) : test resync-mode 2024/05/06 06:08:12 (02) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:12 (03) : touch-glob 2001-01-02 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1R.txt 2024/05/06 06:08:12 (04) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/ file1.txt 2024/05/06 06:08:12 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:12 (05) : touch-glob 2001-03-04 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1L.txt 2024/05/06 06:08:12 (06) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1L.txt /tmp/060802gi/resync_modes/path1/ file1.txt 2024/05/06 06:08:12 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:12 (07) : test bisync run with --resync-mode=newer 2024/05/06 06:08:12 (08) : bisync resync resync-mode=newer 2024/05/06 06:08:12 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:12 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:12 INFO : Synching Path1 "/tmp/060802gi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:12 INFO : Copying Path2 files to Path1 2024/05/06 06:08:12 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:12 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:12 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:12 INFO : Resync updating listings 2024/05/06 06:08:12 INFO : Validating listings for Path1 "/tmp/060802gi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:12 INFO : Bisync successful 2024/05/06 06:08:12 (09) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:12 (10) : touch-glob 2001-07-23 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1R.txt 2024/05/06 06:08:12 (11) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/ file1.txt 2024/05/06 06:08:13 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:13 (12) : touch-glob 2001-08-26 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1L.txt 2024/05/06 06:08:13 (13) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1L.txt /tmp/060802gi/resync_modes/path1/ file1.txt 2024/05/06 06:08:13 INFO : file1L.txt: Updated modification time in destination 2024/05/06 06:08:13 (14) : test bisync run with --resync-mode=path2 2024/05/06 06:08:13 (15) : bisync resync resync-mode=path2 2024/05/06 06:08:13 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:13 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:13 INFO : Synching Path1 "/tmp/060802gi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:13 INFO : Copying Path2 files to Path1 2024/05/06 06:08:13 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:13 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:13 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:13 INFO : Resync updating listings 2024/05/06 06:08:13 INFO : Validating listings for Path1 "/tmp/060802gi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:13 INFO : Bisync successful 2024/05/06 06:08:13 (16) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:13 (17) : touch-glob 2002-07-23 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1R.txt 2024/05/06 06:08:13 (18) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/ file1.txt 2024/05/06 06:08:13 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:13 (19) : touch-glob 2002-08-26 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1L.txt 2024/05/06 06:08:13 (20) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1L.txt /tmp/060802gi/resync_modes/path1/ file1.txt 2024/05/06 06:08:13 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:13 (21) : test bisync run with --resync-mode=larger 2024/05/06 06:08:13 (22) : bisync resync resync-mode=larger 2024/05/06 06:08:13 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:13 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:13 INFO : Synching Path1 "/tmp/060802gi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:13 INFO : Copying Path2 files to Path1 2024/05/06 06:08:13 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:13 INFO : file1.txt: Path2 is larger. Path1: 33, Path2: 42, Difference: 9 2024/05/06 06:08:13 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:13 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:13 INFO : Resync updating listings 2024/05/06 06:08:13 INFO : Validating listings for Path1 "/tmp/060802gi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:13 INFO : Bisync successful 2024/05/06 06:08:13 (23) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:13 (24) : touch-glob 2003-07-23 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1R.txt 2024/05/06 06:08:13 (25) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/ file1.txt 2024/05/06 06:08:13 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:13 (26) : touch-glob 2003-09-04 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1L.txt 2024/05/06 06:08:13 (27) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1L.txt /tmp/060802gi/resync_modes/path1/ file1.txt 2024/05/06 06:08:13 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:13 (28) : test bisync run with --resync-mode=older 2024/05/06 06:08:13 (29) : bisync resync resync-mode=older 2024/05/06 06:08:13 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:13 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:13 INFO : Synching Path1 "/tmp/060802gi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:13 INFO : Copying Path2 files to Path1 2024/05/06 06:08:13 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:13 INFO : file1.txt: Path2 is older. Path1: 2003-09-04 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 1032h0m0s 2024/05/06 06:08:13 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:13 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:13 INFO : Resync updating listings 2024/05/06 06:08:13 INFO : Validating listings for Path1 "/tmp/060802gi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:13 INFO : Bisync successful 2024/05/06 06:08:13 (30) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:13 (31) : touch-glob 2004-07-23 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1R.txt 2024/05/06 06:08:13 (32) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/ file1.txt 2024/05/06 06:08:13 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:13 (33) : touch-glob 2004-07-23 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1L.txt 2024/05/06 06:08:13 (34) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1L.txt /tmp/060802gi/resync_modes/path1/ file1.txt 2024/05/06 06:08:13 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:13 (35) : test bisync run with --resync-mode=smaller 2024/05/06 06:08:13 (36) : bisync resync resync-mode=smaller 2024/05/06 06:08:13 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:13 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:13 INFO : Synching Path1 "/tmp/060802gi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:13 INFO : Copying Path2 files to Path1 2024/05/06 06:08:13 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:13 INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9 2024/05/06 06:08:13 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:13 INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9 2024/05/06 06:08:13 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:13 INFO : Resync updating listings 2024/05/06 06:08:13 INFO : Validating listings for Path1 "/tmp/060802gi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:13 INFO : Bisync successful 2024/05/06 06:08:13 (37) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:13 (38) : touch-glob 2005-01-02 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1R.txt 2024/05/06 06:08:13 (39) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/ file1.txt 2024/05/06 06:08:13 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:13 (40) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1R.txt /tmp/060802gi/resync_modes/path1/ file2.txt 2024/05/06 06:08:13 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:13 (41) : touch-glob 2006-03-04 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1L.txt 2024/05/06 06:08:13 (42) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1L.txt /tmp/060802gi/resync_modes/path1/ file1.txt 2024/05/06 06:08:13 INFO : file1L.txt: Updated modification time in destination 2024/05/06 06:08:13 (43) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/ file2.txt 2024/05/06 06:08:13 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:13 (44) : test bisync run with --resync-mode=path1 2024/05/06 06:08:13 (45) : bisync resync resync-mode=path1 2024/05/06 06:08:13 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:13 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:13 INFO : Synching Path1 "/tmp/060802gi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:13 INFO : Copying Path2 files to Path1 2024/05/06 06:08:13 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:13 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:13 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:13 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:13 INFO : Resync updating listings 2024/05/06 06:08:13 INFO : Validating listings for Path1 "/tmp/060802gi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:13 INFO : Bisync successful 2024/05/06 06:08:13 (46) : test no winner 2024/05/06 06:08:13 (47) : touch-glob 2022-02-22 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1R.txt 2024/05/06 06:08:13 (48) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/ file1.txt 2024/05/06 06:08:13 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:13 (49) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1R.txt /tmp/060802gi/resync_modes/path1/ file2.txt 2024/05/06 06:08:13 INFO : file1R.txt: Updated modification time in destination 2024/05/06 06:08:13 (50) : touch-glob 2022-02-22 /tmp/060802gi/datadir/test_resync_modes-bekudak8/ file1L.txt 2024/05/06 06:08:13 (51) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1L.txt /tmp/060802gi/resync_modes/path1/ file1.txt 2024/05/06 06:08:13 INFO : file1L.txt: Updated modification time in destination 2024/05/06 06:08:13 (52) : copy-as /tmp/060802gi/datadir/test_resync_modes-bekudak8/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/ file2.txt 2024/05/06 06:08:13 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:13 (53) : test bisync run with --resync-mode=newer 2024/05/06 06:08:13 (54) : bisync resync resync-mode=newer 2024/05/06 06:08:13 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:13 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:13 INFO : Synching Path1 "/tmp/060802gi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:13 INFO : Copying Path2 files to Path1 2024/05/06 06:08:13 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:13 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:13 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:13 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:13 INFO : Resync updating listings 2024/05/06 06:08:13 INFO : Validating listings for Path1 "/tmp/060802gi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/resync_modes/path2/" 2024/05/06 06:08:13 INFO : Bisync successful bisync_test.go:555: TEST resync_modes PASSED === RUN TestBisyncLocalRemote/rmdirs 2024/05/06 06:08:13 DEBUG : Creating backend with remote "/tmp/060802gi/rmdirs/path1" 2024/05/06 06:08:13 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:13 DEBUG : path2: Making directory 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:13 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2" 2024/05/06 06:08:13 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:13 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:13 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2" 2024/05/06 06:08:13 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_rmdirs-cufahuz8" 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:13 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:13 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:13 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060802gi/initdir/test_rmdirs-cufahuz8: Waiting for checks to finish 2024/05/06 06:08:13 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.copy1.txt.sanazom9.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:13 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.copy4.txt.ciliroq5.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:13 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060802gi/initdir/test_rmdirs-cufahuz8: Waiting for transfers to finish 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:13 DEBUG : RCLONE_TEST.nahixut1.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:13 DEBUG : file1.copy2.txt.redeqoy9.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:13 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:13 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.copy5.txt.debudur2.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:13 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : subdir/file20.txt.ranapeq8.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:13 DEBUG : file1.copy3.txt.kiqoduy3.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:13 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:13 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.txt.vajuvik1.partial: renamed to: file1.txt 2024/05/06 06:08:13 INFO : file1.txt: Copied (new) 2024/05/06 06:08:13 INFO : subdir: Updated directory metadata 2024/05/06 06:08:13 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_rmdirs-honohey0" 2024/05/06 06:08:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060802gi/datadir/test_rmdirs-honohey0: Waiting for checks to finish 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060802gi/datadir/test_rmdirs-honohey0: Waiting for transfers to finish 2024/05/06 06:08:13 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:13 DEBUG : file1.txt.tigumad0.partial: renamed to: file1.txt 2024/05/06 06:08:13 INFO : file1.txt: Copied (new) 2024/05/06 06:08:13 ERROR : : error listing: directory not found 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2] 2024/05/06 06:08:13 ERROR : : error listing: directory not found 2024/05/06 06:08:13 checking initFs Local file system at /tmp/060802gi/initdir/test_rmdirs-cufahuz8 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:13 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.copy2.txt.nevusuq4.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:13 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.copy3.txt.temewoh6.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:13 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:13 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:13 DEBUG : file1.copy4.txt.piyiqol4.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:13 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.copy1.txt.kehifix1.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:13 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060802gi/rmdirs/path1: Waiting for checks to finish 2024/05/06 06:08:13 DEBUG : file1.copy5.txt.jibofej5.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060802gi/rmdirs/path1: Waiting for transfers to finish 2024/05/06 06:08:13 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:13 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : subdir/file20.txt.hucoyac6.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:13 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : RCLONE_TEST.muxeqey7.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:13 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.txt.nikuloh9.partial: renamed to: file1.txt 2024/05/06 06:08:13 INFO : file1.txt: Copied (new) 2024/05/06 06:08:13 INFO : subdir: Updated directory metadata 2024/05/06 06:08:13 checking Path1 Local file system at /tmp/060802gi/rmdirs/path1 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2] 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : subdir: Making directory 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/subdir] 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/RCLONE_TEST] 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/file1.copy2.txt] 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/file1.copy1.txt] 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/file1.copy3.txt] 2024/05/06 06:08:13 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: Waiting for checks to finish 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: Waiting for transfers to finish 2024/05/06 06:08:13 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/file1.copy4.txt] 2024/05/06 06:08:13 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/file1.copy5.txt] 2024/05/06 06:08:13 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/file1.txt] 2024/05/06 06:08:13 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/subdir/file20.txt] 2024/05/06 06:08:13 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:13 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:13 INFO : file1.txt: Copied (new) 2024/05/06 06:08:13 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:13 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2] 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/subdir] 2024/05/06 06:08:13 (01) : test rmdirs 2024/05/06 06:08:13 (02) : test initial bisync 2024/05/06 06:08:13 (03) : bisync resync 2024/05/06 06:08:13 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:13 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:13 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:13 INFO : Synching Path1 "/tmp/060802gi/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/" 2024/05/06 06:08:13 INFO : Copying Path2 files to Path1 2024/05/06 06:08:13 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:13 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:13 INFO : Resync updating listings 2024/05/06 06:08:13 INFO : Validating listings for Path1 "/tmp/060802gi/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/" 2024/05/06 06:08:13 INFO : Bisync successful 2024/05/06 06:08:13 (04) : test 1. delete path1 subdir file 2024/05/06 06:08:13 (05) : delete-file /tmp/060802gi/rmdirs/path1/subdir/file20.txt 2024/05/06 06:08:13 INFO : file20.txt: Deleted 2024/05/06 06:08:13 (06) : test 2. run bisync without remove-empty-dirs 2024/05/06 06:08:13 (07) : bisync 2024/05/06 06:08:13 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:13 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:13 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:13 INFO : Synching Path1 "/tmp/060802gi/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/" 2024/05/06 06:08:13 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:13 INFO : Path1 checking for diffs 2024/05/06 06:08:13 INFO : - Path1 File was deleted - subdir/file20.txt 2024/05/06 06:08:13 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:13 INFO : Path2 checking for diffs 2024/05/06 06:08:13 INFO : Applying changes 2024/05/06 06:08:13 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/subdir/file20.txt 2024/05/06 06:08:13 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:13 INFO : subdir/file20.txt: Deleted 2024/05/06 06:08:13 INFO : Updating listings 2024/05/06 06:08:13 INFO : Validating listings for Path1 "/tmp/060802gi/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/" 2024/05/06 06:08:13 INFO : Bisync successful 2024/05/06 06:08:13 (08) : test 3. confirm the subdir still exists on both paths 2024/05/06 06:08:13 (09) : list-dirs /tmp/060802gi/rmdirs/path1/ 2024/05/06 06:08:13 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:13 (10) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/ 2024/05/06 06:08:13 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:13 (11) : test 4. run bisync with remove-empty-dirs 2024/05/06 06:08:13 (12) : bisync remove-empty-dirs 2024/05/06 06:08:13 INFO : subdir: Set directory modification time (using SetModTime) 2024/05/06 06:08:13 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:13 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": true, "DownloadHash": false } 2024/05/06 06:08:13 INFO : Synching Path1 "/tmp/060802gi/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/" 2024/05/06 06:08:13 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:13 INFO : Path1 checking for diffs 2024/05/06 06:08:13 INFO : Path2 checking for diffs 2024/05/06 06:08:13 INFO : No changes found 2024/05/06 06:08:13 INFO : Updating listings 2024/05/06 06:08:13 INFO : Validating listings for Path1 "/tmp/060802gi/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/" 2024/05/06 06:08:13 INFO : Removing empty directories 2024/05/06 06:08:13 INFO : subdir: Removing directory 2024/05/06 06:08:13 INFO : subdir: Removing directory 2024/05/06 06:08:13 INFO : Bisync successful 2024/05/06 06:08:13 (13) : test 5. confirm the subdir has been removed on both paths 2024/05/06 06:08:13 (14) : list-dirs /tmp/060802gi/rmdirs/path1/ 2024/05/06 06:08:13 (15) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-yagozel7lusazib1yuramux7/060802gi/rmdirs/path2/ bisync_test.go:555: TEST rmdirs PASSED === RUN TestBisyncLocalRemote/volatile 2024/05/06 06:08:13 DEBUG : Creating backend with remote "/tmp/060802gi/volatile/path1" 2024/05/06 06:08:13 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi" for canonical name "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi" 2024/05/06 06:08:13 DEBUG : path2: Making directory 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi: mkdir [/rclone-test-yagozel7lusazib1yuramux7/060802gi/path2] 2024/05/06 06:08:13 DEBUG : Creating backend with remote "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2" 2024/05/06 06:08:13 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:13 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:13 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2" 2024/05/06 06:08:13 DEBUG : Creating backend with remote "/tmp/060802gi/initdir/test_volatile-luguged3" 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.txt.fatukep8.partial: renamed to: file1.txt 2024/05/06 06:08:13 INFO : file1.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060802gi/initdir/test_volatile-luguged3: Waiting for checks to finish 2024/05/06 06:08:13 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060802gi/initdir/test_volatile-luguged3: Waiting for transfers to finish 2024/05/06 06:08:13 DEBUG : file2.txt.reviyay1.partial: renamed to: file2.txt 2024/05/06 06:08:13 INFO : file2.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file4.txt.haduvum1.partial: renamed to: file4.txt 2024/05/06 06:08:13 INFO : file4.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:13 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file6.txt.pimeyal1.partial: renamed to: file6.txt 2024/05/06 06:08:13 INFO : file6.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : RCLONE_TEST.jomeyib9.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:13 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:13 DEBUG : file5.txt.qijuvaj4.partial: renamed to: file5.txt 2024/05/06 06:08:13 INFO : file5.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file3.txt.yuberos0.partial: renamed to: file3.txt 2024/05/06 06:08:13 INFO : file3.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file7.txt.dezehuf9.partial: renamed to: file7.txt 2024/05/06 06:08:13 INFO : file7.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file8.txt.nuxuzum4.partial: renamed to: file8.txt 2024/05/06 06:08:13 INFO : file8.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : Creating backend with remote "/tmp/060802gi/datadir/test_volatile-yugeyes5" 2024/05/06 06:08:13 DEBUG : dummy.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060802gi/datadir/test_volatile-yugeyes5: Waiting for checks to finish 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060802gi/datadir/test_volatile-yugeyes5: Waiting for transfers to finish 2024/05/06 06:08:13 DEBUG : dummy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : dummy.txt.mohirid1.partial: renamed to: dummy.txt 2024/05/06 06:08:13 INFO : dummy.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:13 DEBUG : file1.txt.teminaz1.partial: renamed to: file1.txt 2024/05/06 06:08:13 INFO : file1.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:13 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:13 DEBUG : file11.txt.qayiyeg4.partial: renamed to: file11.txt 2024/05/06 06:08:13 INFO : file11.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file2.txt.deqeyod2.partial: renamed to: file2.txt 2024/05/06 06:08:13 INFO : file2.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:13 DEBUG : file10.txt.qosecik7.partial: renamed to: file10.txt 2024/05/06 06:08:13 INFO : file10.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:13 DEBUG : file5L.txt.fuliqed1.partial: renamed to: file5L.txt 2024/05/06 06:08:13 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:13 DEBUG : file5R.txt.quhaxag5.partial: renamed to: file5R.txt 2024/05/06 06:08:13 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:13 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file6.txt.hapanar1.partial: renamed to: file6.txt 2024/05/06 06:08:13 INFO : file6.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:13 DEBUG : file7.txt.hasujef0.partial: renamed to: file7.txt 2024/05/06 06:08:13 INFO : file7.txt: Copied (new) 2024/05/06 06:08:13 ERROR : : error listing: directory not found 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2] 2024/05/06 06:08:13 ERROR : : error listing: directory not found 2024/05/06 06:08:13 checking initFs Local file system at /tmp/060802gi/initdir/test_volatile-luguged3 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060802gi/volatile/path1: Waiting for checks to finish 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060802gi/volatile/path1: Waiting for transfers to finish 2024/05/06 06:08:13 DEBUG : file1.txt.vuyuqus4.partial: renamed to: file1.txt 2024/05/06 06:08:13 INFO : file1.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file2.txt.lutukil5.partial: renamed to: file2.txt 2024/05/06 06:08:13 INFO : file2.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file3.txt.wegujen8.partial: renamed to: file3.txt 2024/05/06 06:08:13 INFO : file3.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file5.txt.zarotad3.partial: renamed to: file5.txt 2024/05/06 06:08:13 INFO : file5.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file4.txt.ditipic3.partial: renamed to: file4.txt 2024/05/06 06:08:13 INFO : file4.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file6.txt.yolocip2.partial: renamed to: file6.txt 2024/05/06 06:08:13 INFO : file6.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file7.txt.gakurog1.partial: renamed to: file7.txt 2024/05/06 06:08:13 INFO : file7.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file8.txt.vefupow8.partial: renamed to: file8.txt 2024/05/06 06:08:13 INFO : file8.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:13 DEBUG : RCLONE_TEST.vegokoh8.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:13 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:13 checking Path1 Local file system at /tmp/060802gi/volatile/path1 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2] 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2/RCLONE_TEST] 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2/file1.txt] 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: Waiting for checks to finish 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: Waiting for transfers to finish 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2/file3.txt] 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2/file2.txt] 2024/05/06 06:08:13 INFO : file1.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2/file4.txt] 2024/05/06 06:08:13 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2/file5.txt] 2024/05/06 06:08:13 INFO : file3.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2/file6.txt] 2024/05/06 06:08:13 INFO : file2.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2/file7.txt] 2024/05/06 06:08:13 INFO : file4.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: update [/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2/file8.txt] 2024/05/06 06:08:13 INFO : file5.txt: Copied (new) 2024/05/06 06:08:13 INFO : file6.txt: Copied (new) 2024/05/06 06:08:13 INFO : file7.txt: Copied (new) 2024/05/06 06:08:13 INFO : file8.txt: Copied (new) 2024/05/06 06:08:13 checking path2 hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2: list [/rclone-test-yagozel7lusazib1yuramux7/060802gi/volatile/path2] 2024/05/06 06:08:13 (01) : test volatile 2024/05/06 06:08:13 (02) : test initial bisync 2024/05/06 06:08:13 (03) : bisync resync bisync_test.go:923: skipping 'volatile' test on non-local as it requires uploading 100 files 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7: Purge remote 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-yagozel7lusazib1yuramux7: purge [/rclone-test-yagozel7lusazib1yuramux7] --- PASS: TestBisyncLocalRemote (11.52s) --- PASS: TestBisyncLocalRemote/all_changed (0.61s) --- SKIP: TestBisyncLocalRemote/backupdir (0.19s) --- PASS: TestBisyncLocalRemote/basic (0.30s) --- PASS: TestBisyncLocalRemote/changes (0.44s) --- PASS: TestBisyncLocalRemote/check_access (0.44s) --- PASS: TestBisyncLocalRemote/check_access_filters (0.92s) --- PASS: TestBisyncLocalRemote/check_filename (0.32s) --- PASS: TestBisyncLocalRemote/check_sync (0.45s) --- PASS: TestBisyncLocalRemote/compare_all (0.50s) --- PASS: TestBisyncLocalRemote/createemptysrcdirs (0.48s) --- PASS: TestBisyncLocalRemote/dry_run (0.54s) --- PASS: TestBisyncLocalRemote/equal (0.21s) --- PASS: TestBisyncLocalRemote/ext_paths (0.60s) --- SKIP: TestBisyncLocalRemote/extended_filenames (0.36s) --- PASS: TestBisyncLocalRemote/filters (0.32s) --- PASS: TestBisyncLocalRemote/filtersfile_checks (0.34s) --- PASS: TestBisyncLocalRemote/ignorelistingchecksum (0.34s) --- PASS: TestBisyncLocalRemote/max_delete_path1 (0.33s) --- PASS: TestBisyncLocalRemote/max_delete_path2_force (0.34s) --- PASS: TestBisyncLocalRemote/nomodtime (0.48s) --- SKIP: TestBisyncLocalRemote/normalization (0.24s) --- PASS: TestBisyncLocalRemote/rclone_args (0.57s) --- PASS: TestBisyncLocalRemote/resolve (0.50s) --- PASS: TestBisyncLocalRemote/resync (0.64s) --- PASS: TestBisyncLocalRemote/resync_modes (0.55s) --- PASS: TestBisyncLocalRemote/rmdirs (0.29s) --- SKIP: TestBisyncLocalRemote/volatile (0.19s) === RUN TestBisyncRemoteRemote 2024/05/06 06:08:13 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5" 2024/05/06 06:08:13 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:13 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:13 remote: TestHdfs:rclone-test-gisiqir9sihivew7fomireq5 === RUN TestBisyncRemoteRemote/all_changed 2024/05/06 06:08:13 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:13 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/05/06 06:08:13 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:13 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:13 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:13 DEBUG : path1: Making directory 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:13 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1" 2024/05/06 06:08:13 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:13 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:13 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1" 2024/05/06 06:08:13 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:13 DEBUG : path2: Making directory 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:13 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2" 2024/05/06 06:08:13 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:13 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:13 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:13 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:13 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2" 2024/05/06 06:08:13 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_all_changed-jijinej6" 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:13 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:13 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:13 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.copy1.txt.paducux9.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:13 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.copy2.txt.qocenik0.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:13 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060813ko/initdir/test_all_changed-jijinej6: Waiting for checks to finish 2024/05/06 06:08:13 DEBUG : Local file system at /tmp/060813ko/initdir/test_all_changed-jijinej6: Waiting for transfers to finish 2024/05/06 06:08:13 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.copy5.txt.qesadoz9.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:13 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.copy4.txt.fozujax1.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:13 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:13 DEBUG : RCLONE_TEST.bonovow4.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:13 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : file1.copy3.txt.zuxebun4.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:13 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : file1.txt.vuwoyog6.partial: renamed to: file1.txt 2024/05/06 06:08:13 INFO : file1.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:13 DEBUG : subdir/file20.txt.mawizel5.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:13 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:13 INFO : subdir: Updated directory metadata 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1] 2024/05/06 06:08:13 ERROR : : error listing: directory not found 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2] 2024/05/06 06:08:13 ERROR : : error listing: directory not found 2024/05/06 06:08:13 checking initFs Local file system at /tmp/060813ko/initdir/test_all_changed-jijinej6 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1] 2024/05/06 06:08:13 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : subdir: Making directory 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/subdir] 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/file1.copy2.txt] 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/RCLONE_TEST] 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/file1.copy3.txt] 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/file1.copy1.txt] 2024/05/06 06:08:13 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: Waiting for checks to finish 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: Waiting for transfers to finish 2024/05/06 06:08:13 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/file1.copy4.txt] 2024/05/06 06:08:13 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/file1.copy5.txt] 2024/05/06 06:08:13 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/file1.txt] 2024/05/06 06:08:13 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/subdir/file20.txt] 2024/05/06 06:08:13 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:14 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:14 INFO : file1.txt: Copied (new) 2024/05/06 06:08:14 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:14 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/subdir] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2] 2024/05/06 06:08:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : subdir: Making directory 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/subdir] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/RCLONE_TEST] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy3.txt] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy2.txt] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy1.txt] 2024/05/06 06:08:14 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: Waiting for checks to finish 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: Waiting for transfers to finish 2024/05/06 06:08:14 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy4.txt] 2024/05/06 06:08:14 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy5.txt] 2024/05/06 06:08:14 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.txt] 2024/05/06 06:08:14 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/subdir/file20.txt] 2024/05/06 06:08:14 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:14 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:14 INFO : file1.txt: Copied (new) 2024/05/06 06:08:14 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:14 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/subdir] 2024/05/06 06:08:14 (01) : test all-changed 2024/05/06 06:08:14 (02) : test initial bisync 2024/05/06 06:08:14 (03) : bisync resync 2024/05/06 06:08:14 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:14 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:14 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/" 2024/05/06 06:08:14 INFO : Copying Path2 files to Path1 2024/05/06 06:08:14 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:14 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:14 INFO : Resync updating listings 2024/05/06 06:08:14 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/" 2024/05/06 06:08:14 INFO : Bisync successful 2024/05/06 06:08:14 (04) : test change timestamp on all files except RCLONE_TEST 2024/05/06 06:08:14 (05) : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/ file* 2024/05/06 06:08:14 (06) : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/subdir file* 2024/05/06 06:08:14 (07) : test sync should pass 2024/05/06 06:08:14 (08) : bisync 2024/05/06 06:08:14 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:14 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:14 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/" 2024/05/06 06:08:14 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:14 INFO : Path1 checking for diffs 2024/05/06 06:08:14 INFO : - Path1 File changed: time (newer) - file1.copy1.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (newer) - file1.copy2.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (newer) - file1.copy3.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (newer) - file1.copy4.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (newer) - file1.copy5.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (newer) - file1.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2024/05/06 06:08:14 INFO : Path1: 7 changes:  0 new,  7 modified,  0 deleted 2024/05/06 06:08:14 INFO : (Modified:  7 newer,  0 older) 2024/05/06 06:08:14 INFO : Path2 checking for diffs 2024/05/06 06:08:14 INFO : Applying changes 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy1.txt 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy2.txt 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy3.txt 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy4.txt 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy5.txt 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.txt 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/subdir/file20.txt 2024/05/06 06:08:14 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:14 INFO : file1.copy2.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : file1.copy3.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : file1.copy5.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : file1.copy4.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : file1.copy1.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : Updating listings 2024/05/06 06:08:14 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/" 2024/05/06 06:08:14 INFO : Bisync successful 2024/05/06 06:08:14 (09) : test change timestamp on all files including RCLONE_TEST 2024/05/06 06:08:14 (10) : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/ * 2024/05/06 06:08:14 (11) : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/subdir * 2024/05/06 06:08:14 (12) : test sync should fail 2024/05/06 06:08:14 (13) : bisync 2024/05/06 06:08:14 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:14 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:14 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/" 2024/05/06 06:08:14 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:14 INFO : Path1 checking for diffs 2024/05/06 06:08:14 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - file1.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2024/05/06 06:08:14 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2024/05/06 06:08:14 INFO : (Modified:  1 newer,  7 older) 2024/05/06 06:08:14 INFO : Path2 checking for diffs 2024/05/06 06:08:14 ERROR : Safety abort: all files were changed on Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/". Run with --force if desired. 2024/05/06 06:08:14 NOTICE: Bisync aborted. Please try again. 2024/05/06 06:08:14 Bisync error: all files were changed 2024/05/06 06:08:14 (14) : test sync with force should pass 2024/05/06 06:08:14 (15) : bisync force 2024/05/06 06:08:14 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:14 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:14 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/" 2024/05/06 06:08:14 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:14 INFO : Path1 checking for diffs 2024/05/06 06:08:14 INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - file1.copy1.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - file1.copy2.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - file1.copy3.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - file1.copy4.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - file1.copy5.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - file1.txt 2024/05/06 06:08:14 INFO : - Path1 File changed: time (older) - subdir/file20.txt 2024/05/06 06:08:14 INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2024/05/06 06:08:14 INFO : (Modified:  1 newer,  7 older) 2024/05/06 06:08:14 INFO : Path2 checking for diffs 2024/05/06 06:08:14 INFO : Applying changes 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/RCLONE_TEST 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy1.txt 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy2.txt 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy3.txt 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy4.txt 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.copy5.txt 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/file1.txt 2024/05/06 06:08:14 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/subdir/file20.txt 2024/05/06 06:08:14 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:14 INFO : file1.copy1.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : file1.copy2.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : file1.copy3.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : file1.copy4.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : file1.copy5.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : RCLONE_TEST: Copied (replaced existing) 2024/05/06 06:08:14 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:14 INFO : Updating listings 2024/05/06 06:08:14 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/all_changed/path2/" 2024/05/06 06:08:14 INFO : Bisync successful bisync_test.go:555: TEST all_changed PASSED === RUN TestBisyncRemoteRemote/backupdir 2024/05/06 06:08:14 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:14 DEBUG : path1: Making directory 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:14 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1" 2024/05/06 06:08:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:14 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1" 2024/05/06 06:08:14 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:14 DEBUG : path2: Making directory 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:14 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2" 2024/05/06 06:08:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:14 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2" 2024/05/06 06:08:14 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_backupdir-puqajib9" 2024/05/06 06:08:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:14 DEBUG : file1.txt.perudud3.partial: renamed to: file1.txt 2024/05/06 06:08:14 INFO : file1.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : Local file system at /tmp/060813ko/initdir/test_backupdir-puqajib9: Waiting for checks to finish 2024/05/06 06:08:14 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:14 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:14 DEBUG : file2.txt.neyirin8.partial: renamed to: file2.txt 2024/05/06 06:08:14 INFO : file2.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:14 DEBUG : file4.txt.xuteqac5.partial: renamed to: file4.txt 2024/05/06 06:08:14 INFO : file4.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : RCLONE_TEST.nazexit8.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:14 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:14 DEBUG : Local file system at /tmp/060813ko/initdir/test_backupdir-puqajib9: Waiting for transfers to finish 2024/05/06 06:08:14 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:14 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:14 DEBUG : file3.txt.povaxec6.partial: renamed to: file3.txt 2024/05/06 06:08:14 INFO : file3.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : file5.txt.yofemih9.partial: renamed to: file5.txt 2024/05/06 06:08:14 INFO : file5.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:14 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:14 DEBUG : file6.txt.laxafet3.partial: renamed to: file6.txt 2024/05/06 06:08:14 INFO : file6.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : file7.txt.nudikep3.partial: renamed to: file7.txt 2024/05/06 06:08:14 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:14 INFO : file7.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : file8.txt.rebejun7.partial: renamed to: file8.txt 2024/05/06 06:08:14 INFO : file8.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_backupdir-mevanup6" 2024/05/06 06:08:14 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:14 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:14 DEBUG : file1.txt.nobirez8.partial: renamed to: file1.txt 2024/05/06 06:08:14 INFO : file1.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : Local file system at /tmp/060813ko/datadir/test_backupdir-mevanup6: Waiting for checks to finish 2024/05/06 06:08:14 DEBUG : Local file system at /tmp/060813ko/datadir/test_backupdir-mevanup6: Waiting for transfers to finish 2024/05/06 06:08:14 DEBUG : file10.txt.niqusat1.partial: renamed to: file10.txt 2024/05/06 06:08:14 INFO : file10.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:14 DEBUG : file2.txt.kaxazed5.partial: renamed to: file2.txt 2024/05/06 06:08:14 INFO : file2.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:14 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:14 DEBUG : file11.txt.qirepem0.partial: renamed to: file11.txt 2024/05/06 06:08:14 INFO : file11.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : file5R.txt.budicib2.partial: renamed to: file5R.txt 2024/05/06 06:08:14 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:14 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:14 DEBUG : file5L.txt.koyefop1.partial: renamed to: file5L.txt 2024/05/06 06:08:14 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : file6.txt.nelufuh2.partial: renamed to: file6.txt 2024/05/06 06:08:14 INFO : file6.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:14 DEBUG : file7.txt.tawigif8.partial: renamed to: file7.txt 2024/05/06 06:08:14 INFO : file7.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1] 2024/05/06 06:08:14 ERROR : : error listing: directory not found 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2] 2024/05/06 06:08:14 ERROR : : error listing: directory not found 2024/05/06 06:08:14 checking initFs Local file system at /tmp/060813ko/initdir/test_backupdir-puqajib9 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1] 2024/05/06 06:08:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1/RCLONE_TEST] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: Waiting for checks to finish 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1/file1.txt] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: Waiting for transfers to finish 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1/file2.txt] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1/file3.txt] 2024/05/06 06:08:14 INFO : file1.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1/file4.txt] 2024/05/06 06:08:14 INFO : file2.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1/file5.txt] 2024/05/06 06:08:14 INFO : file3.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1/file6.txt] 2024/05/06 06:08:14 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1/file7.txt] 2024/05/06 06:08:14 INFO : file4.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1/file8.txt] 2024/05/06 06:08:14 INFO : file5.txt: Copied (new) 2024/05/06 06:08:14 INFO : file6.txt: Copied (new) 2024/05/06 06:08:14 INFO : file7.txt: Copied (new) 2024/05/06 06:08:14 INFO : file8.txt: Copied (new) 2024/05/06 06:08:14 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path1] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2] 2024/05/06 06:08:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2/file1.txt] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2/file2.txt] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2/file3.txt] 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: Waiting for checks to finish 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: Waiting for transfers to finish 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2/RCLONE_TEST] 2024/05/06 06:08:14 INFO : file1.txt: Copied (new) 2024/05/06 06:08:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2/file4.txt] 2024/05/06 06:08:15 INFO : file2.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2/file5.txt] 2024/05/06 06:08:15 INFO : file3.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2/file6.txt] 2024/05/06 06:08:15 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2/file7.txt] 2024/05/06 06:08:15 INFO : file4.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2/file8.txt] 2024/05/06 06:08:15 INFO : file5.txt: Copied (new) 2024/05/06 06:08:15 INFO : file6.txt: Copied (new) 2024/05/06 06:08:15 INFO : file7.txt: Copied (new) 2024/05/06 06:08:15 INFO : file8.txt: Copied (new) 2024/05/06 06:08:15 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/backupdir/path2] 2024/05/06 06:08:15 (01) : test backupdir 2024/05/06 06:08:15 (02) : test initial bisync 2024/05/06 06:08:15 (03) : bisync resync backupdir1=/tmp/060813ko/workdir/backupdirs/backupdir1 backupdir2=/tmp/060813ko/workdir/backupdirs/backupdir2 bisync_test.go:920: backupdir test currently only works on local (it uses the workdir) === RUN TestBisyncRemoteRemote/basic 2024/05/06 06:08:15 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:15 DEBUG : path1: Making directory 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:15 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1" 2024/05/06 06:08:15 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:15 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:15 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1" 2024/05/06 06:08:15 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:15 DEBUG : path2: Making directory 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:15 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2" 2024/05/06 06:08:15 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:15 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:15 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2" 2024/05/06 06:08:15 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_basic-rotivih6" 2024/05/06 06:08:15 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:15 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:15 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:15 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file1.copy1.txt.momaxof1.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:15 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file1.copy2.txt.vugecif5.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:15 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : Local file system at /tmp/060813ko/initdir/test_basic-rotivih6: Waiting for checks to finish 2024/05/06 06:08:15 DEBUG : Local file system at /tmp/060813ko/initdir/test_basic-rotivih6: Waiting for transfers to finish 2024/05/06 06:08:15 DEBUG : file1.copy3.txt.sipasak7.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:15 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file1.copy4.txt.hidequm6.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:15 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file1.txt.yehapuv5.partial: renamed to: file1.txt 2024/05/06 06:08:15 INFO : file1.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:15 DEBUG : RCLONE_TEST.facevib8.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:15 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:15 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : subdir/file20.txt.zemutax7.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:15 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file1.copy5.txt.jadofim7.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:15 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:15 INFO : subdir: Updated directory metadata 2024/05/06 06:08:15 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_basic-dagiyed6" 2024/05/06 06:08:15 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : Local file system at /tmp/060813ko/datadir/test_basic-dagiyed6: Waiting for checks to finish 2024/05/06 06:08:15 DEBUG : Local file system at /tmp/060813ko/datadir/test_basic-dagiyed6: Waiting for transfers to finish 2024/05/06 06:08:15 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:15 DEBUG : file1.txt.xiyafoy2.partial: renamed to: file1.txt 2024/05/06 06:08:15 INFO : file1.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1] 2024/05/06 06:08:15 ERROR : : error listing: directory not found 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2] 2024/05/06 06:08:15 ERROR : : error listing: directory not found 2024/05/06 06:08:15 checking initFs Local file system at /tmp/060813ko/initdir/test_basic-rotivih6 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1] 2024/05/06 06:08:15 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : subdir: Making directory 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/subdir] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/RCLONE_TEST] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/file1.copy1.txt] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/file1.copy2.txt] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/file1.copy3.txt] 2024/05/06 06:08:15 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: Waiting for checks to finish 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: Waiting for transfers to finish 2024/05/06 06:08:15 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/file1.copy4.txt] 2024/05/06 06:08:15 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/file1.copy5.txt] 2024/05/06 06:08:15 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/file1.txt] 2024/05/06 06:08:15 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/RCLONE_TEST: replication in progress) 2024/05/06 06:08:15 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/05/06 06:08:15 DEBUG : pacer: Reducing sleep to 30ms 2024/05/06 06:08:15 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/subdir/file20.txt] 2024/05/06 06:08:15 DEBUG : pacer: Reducing sleep to 22.5ms 2024/05/06 06:08:15 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : pacer: Reducing sleep to 20ms 2024/05/06 06:08:15 INFO : file1.txt: Copied (new) 2024/05/06 06:08:15 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:15 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:15 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/subdir] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2] 2024/05/06 06:08:15 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : subdir: Making directory 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/subdir] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/RCLONE_TEST] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/file1.copy1.txt] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/file1.copy2.txt] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/file1.copy3.txt] 2024/05/06 06:08:15 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: Waiting for checks to finish 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: Waiting for transfers to finish 2024/05/06 06:08:15 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/file1.copy4.txt] 2024/05/06 06:08:15 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/file1.copy5.txt] 2024/05/06 06:08:15 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/file1.txt] 2024/05/06 06:08:15 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/subdir/file20.txt] 2024/05/06 06:08:15 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:15 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:15 INFO : file1.txt: Copied (new) 2024/05/06 06:08:15 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:15 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/subdir] 2024/05/06 06:08:15 (01) : test basic 2024/05/06 06:08:15 (02) : test initial bisync 2024/05/06 06:08:15 (03) : bisync resync 2024/05/06 06:08:15 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:15 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:15 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/" 2024/05/06 06:08:15 INFO : Copying Path2 files to Path1 2024/05/06 06:08:15 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:15 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:15 INFO : Resync updating listings 2024/05/06 06:08:15 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/" 2024/05/06 06:08:15 INFO : Bisync successful 2024/05/06 06:08:15 (04) : test place newer files on both paths 2024/05/06 06:08:15 (05) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_basic-dagiyed6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/ 2024/05/06 06:08:15 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:15 (06) : copy-as /tmp/060813ko/datadir/test_basic-dagiyed6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/subdir file20.txt 2024/05/06 06:08:15 INFO : file1.txt: Copied (replaced existing) to: file20.txt 2024/05/06 06:08:15 (07) : test bisync run 2024/05/06 06:08:15 (08) : bisync 2024/05/06 06:08:15 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:15 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:15 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/" 2024/05/06 06:08:15 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:15 INFO : Path1 checking for diffs 2024/05/06 06:08:15 INFO : - Path1 File changed: size (larger), time (newer) - subdir/file20.txt 2024/05/06 06:08:15 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:15 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:15 INFO : Path2 checking for diffs 2024/05/06 06:08:15 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:15 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:15 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:15 INFO : Applying changes 2024/05/06 06:08:15 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/subdir/file20.txt 2024/05/06 06:08:15 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/file1.txt 2024/05/06 06:08:15 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:15 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:15 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:15 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:15 INFO : Updating listings 2024/05/06 06:08:15 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/basic/path2/" 2024/05/06 06:08:15 INFO : Bisync successful bisync_test.go:555: TEST basic PASSED === RUN TestBisyncRemoteRemote/changes 2024/05/06 06:08:15 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:15 DEBUG : path1: Making directory 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:15 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1" 2024/05/06 06:08:15 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:15 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:15 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1" 2024/05/06 06:08:15 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:15 DEBUG : path2: Making directory 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:15 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2" 2024/05/06 06:08:15 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:15 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:15 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2" 2024/05/06 06:08:15 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_changes-kasipom1" 2024/05/06 06:08:15 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file1.txt.tovazon5.partial: renamed to: file1.txt 2024/05/06 06:08:15 INFO : file1.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : Local file system at /tmp/060813ko/initdir/test_changes-kasipom1: Waiting for checks to finish 2024/05/06 06:08:15 DEBUG : Local file system at /tmp/060813ko/initdir/test_changes-kasipom1: Waiting for transfers to finish 2024/05/06 06:08:15 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file3.txt.lukuyuy1.partial: renamed to: file3.txt 2024/05/06 06:08:15 INFO : file3.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file2.txt.tucacak2.partial: renamed to: file2.txt 2024/05/06 06:08:15 INFO : file2.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:15 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file4.txt.fibesen5.partial: renamed to: file4.txt 2024/05/06 06:08:15 INFO : file4.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : RCLONE_TEST.jenocak7.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:15 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:15 DEBUG : file5.txt.sisihuf3.partial: renamed to: file5.txt 2024/05/06 06:08:15 INFO : file5.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file6.txt.gutijig6.partial: renamed to: file6.txt 2024/05/06 06:08:15 INFO : file6.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:15 DEBUG : file7.txt.habakem6.partial: renamed to: file7.txt 2024/05/06 06:08:15 DEBUG : file8.txt.bamonut4.partial: renamed to: file8.txt 2024/05/06 06:08:15 INFO : file7.txt: Copied (new) 2024/05/06 06:08:15 INFO : file8.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_changes-qeqejos7" 2024/05/06 06:08:15 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:15 DEBUG : file1.txt.qosihuk8.partial: renamed to: file1.txt 2024/05/06 06:08:15 INFO : file1.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:15 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:15 DEBUG : file10.txt.ritehak6.partial: renamed to: file10.txt 2024/05/06 06:08:15 INFO : file10.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : Local file system at /tmp/060813ko/datadir/test_changes-qeqejos7: Waiting for checks to finish 2024/05/06 06:08:15 DEBUG : file2.txt.yejiheb2.partial: renamed to: file2.txt 2024/05/06 06:08:15 INFO : file2.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : Local file system at /tmp/060813ko/datadir/test_changes-qeqejos7: Waiting for transfers to finish 2024/05/06 06:08:15 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:15 DEBUG : file11.txt.vixaboh4.partial: renamed to: file11.txt 2024/05/06 06:08:15 INFO : file11.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:15 DEBUG : file5L.txt.zecusux4.partial: renamed to: file5L.txt 2024/05/06 06:08:15 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:15 DEBUG : file5R.txt.vudigaw3.partial: renamed to: file5R.txt 2024/05/06 06:08:15 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:15 DEBUG : file6.txt.ponomig0.partial: renamed to: file6.txt 2024/05/06 06:08:15 INFO : file6.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:15 DEBUG : file7.txt.lizuhug3.partial: renamed to: file7.txt 2024/05/06 06:08:15 INFO : file7.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1] 2024/05/06 06:08:15 ERROR : : error listing: directory not found 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2] 2024/05/06 06:08:15 ERROR : : error listing: directory not found 2024/05/06 06:08:15 checking initFs Local file system at /tmp/060813ko/initdir/test_changes-kasipom1 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1] 2024/05/06 06:08:15 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file1.txt] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file2.txt] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/RCLONE_TEST] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file3.txt] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: Waiting for checks to finish 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: Waiting for transfers to finish 2024/05/06 06:08:15 INFO : file1.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file4.txt] 2024/05/06 06:08:15 INFO : file2.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file5.txt] 2024/05/06 06:08:15 INFO : file3.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file6.txt] 2024/05/06 06:08:15 INFO : file4.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file7.txt] 2024/05/06 06:08:15 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file8.txt] 2024/05/06 06:08:15 INFO : file5.txt: Copied (new) 2024/05/06 06:08:15 INFO : file6.txt: Copied (new) 2024/05/06 06:08:15 INFO : file7.txt: Copied (new) 2024/05/06 06:08:15 INFO : file8.txt: Copied (new) 2024/05/06 06:08:15 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2] 2024/05/06 06:08:15 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file3.txt] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file1.txt] 2024/05/06 06:08:15 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file2.txt] 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: Waiting for checks to finish 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: Waiting for transfers to finish 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/RCLONE_TEST] 2024/05/06 06:08:15 INFO : file3.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file4.txt] 2024/05/06 06:08:15 INFO : file1.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file5.txt] 2024/05/06 06:08:15 INFO : file2.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file6.txt] 2024/05/06 06:08:15 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file7.txt] 2024/05/06 06:08:15 INFO : file4.txt: Copied (new) 2024/05/06 06:08:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file8.txt] 2024/05/06 06:08:15 INFO : file5.txt: Copied (new) 2024/05/06 06:08:15 INFO : file6.txt: Copied (new) 2024/05/06 06:08:16 INFO : file7.txt: Copied (new) 2024/05/06 06:08:16 INFO : file8.txt: Copied (new) 2024/05/06 06:08:16 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2] 2024/05/06 06:08:16 (01) : test changes 2024/05/06 06:08:16 (02) : test initial bisync 2024/05/06 06:08:16 (03) : bisync resync 2024/05/06 06:08:16 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:16 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:16 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/" 2024/05/06 06:08:16 INFO : Copying Path2 files to Path1 2024/05/06 06:08:16 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:16 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:16 INFO : Resync updating listings 2024/05/06 06:08:16 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/" 2024/05/06 06:08:16 INFO : Bisync successful 2024/05/06 06:08:16 (04) : test make modifications on both paths 2024/05/06 06:08:16 (05) : test new on path2 - file10 2024/05/06 06:08:16 (06) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_changes-qeqejos7/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/ 2024/05/06 06:08:16 INFO : file10.txt: Copied (new) 2024/05/06 06:08:16 (07) : test newer on path2 - file1 2024/05/06 06:08:16 (08) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_changes-qeqejos7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/ 2024/05/06 06:08:16 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:16 (09) : test new on path1 - file11 2024/05/06 06:08:16 (10) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_changes-qeqejos7/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/ 2024/05/06 06:08:16 INFO : file11.txt: Copied (new) 2024/05/06 06:08:16 (11) : test newer on path1 - file2 2024/05/06 06:08:16 (12) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_changes-qeqejos7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/ 2024/05/06 06:08:16 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:16 (13) : test deleted on path2 - file3 2024/05/06 06:08:16 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file3.txt 2024/05/06 06:08:16 INFO : file3.txt: Deleted 2024/05/06 06:08:16 (15) : test deleted on path1 - file4 2024/05/06 06:08:16 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file4.txt 2024/05/06 06:08:16 INFO : file4.txt: Deleted 2024/05/06 06:08:16 (17) : test deleted on both paths - file8 2024/05/06 06:08:16 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file8.txt 2024/05/06 06:08:16 INFO : file8.txt: Deleted 2024/05/06 06:08:16 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file8.txt 2024/05/06 06:08:16 INFO : file8.txt: Deleted 2024/05/06 06:08:16 (20) : test changed on both paths - file5 (file5R, file5L) 2024/05/06 06:08:16 (21) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_changes-qeqejos7/ file5R.txt 2024/05/06 06:08:16 (22) : copy-as /tmp/060813ko/datadir/test_changes-qeqejos7/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/ file5.txt 2024/05/06 06:08:16 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:16 (23) : touch-glob 2001-03-04 /tmp/060813ko/datadir/test_changes-qeqejos7/ file5L.txt 2024/05/06 06:08:16 (24) : copy-as /tmp/060813ko/datadir/test_changes-qeqejos7/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/ file5.txt 2024/05/06 06:08:16 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:16 (25) : test newer on path2 and deleted on path1 - file6 2024/05/06 06:08:16 (26) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_changes-qeqejos7/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/ 2024/05/06 06:08:16 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:08:16 (27) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file6.txt 2024/05/06 06:08:16 INFO : file6.txt: Deleted 2024/05/06 06:08:16 (28) : test newer on path1 and deleted on path2 - file7 2024/05/06 06:08:16 (29) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_changes-qeqejos7/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/ 2024/05/06 06:08:16 INFO : file7.txt: Copied (replaced existing) 2024/05/06 06:08:16 (30) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file7.txt 2024/05/06 06:08:16 INFO : file7.txt: Deleted 2024/05/06 06:08:16 (31) : test bisync run 2024/05/06 06:08:16 (32) : bisync 2024/05/06 06:08:16 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:16 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:16 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/" 2024/05/06 06:08:16 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:16 INFO : Path1 checking for diffs 2024/05/06 06:08:16 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:16 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:08:16 INFO : - Path1 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:08:16 INFO : - Path1 File was deleted - file6.txt 2024/05/06 06:08:16 INFO : - Path1 File changed: size (larger), time (newer) - file7.txt 2024/05/06 06:08:16 INFO : - Path1 File was deleted - file8.txt 2024/05/06 06:08:16 INFO : - Path1 File is new - file11.txt 2024/05/06 06:08:16 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:08:16 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:08:16 INFO : Path2 checking for diffs 2024/05/06 06:08:16 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:16 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:08:16 INFO : - Path2 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:08:16 INFO : - Path2 File changed: size (larger), time (newer) - file6.txt 2024/05/06 06:08:16 INFO : - Path2 File was deleted - file7.txt 2024/05/06 06:08:16 INFO : - Path2 File was deleted - file8.txt 2024/05/06 06:08:16 INFO : - Path2 File is new - file10.txt 2024/05/06 06:08:16 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:08:16 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:08:16 INFO : Applying changes 2024/05/06 06:08:16 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:16 INFO : Checking potential conflicts... 2024/05/06 06:08:16 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: 1 differences found 2024/05/06 06:08:16 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2: 1 errors while checking 2024/05/06 06:08:16 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:16 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file11.txt 2024/05/06 06:08:16 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file2.txt 2024/05/06 06:08:16 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file4.txt 2024/05/06 06:08:16 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:08:16 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file5.txt.conflict1 2024/05/06 06:08:16 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/05/06 06:08:16 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file5.txt.conflict1 2024/05/06 06:08:16 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file5.txt.conflict2 2024/05/06 06:08:16 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/05/06 06:08:16 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file5.txt.conflict2 2024/05/06 06:08:16 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file6.txt 2024/05/06 06:08:16 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/file7.txt 2024/05/06 06:08:16 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file1.txt 2024/05/06 06:08:16 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file10.txt 2024/05/06 06:08:16 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/file3.txt 2024/05/06 06:08:16 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:16 INFO : file10.txt: Copied (new) 2024/05/06 06:08:16 INFO : file5.txt.conflict2: Copied (new) 2024/05/06 06:08:16 INFO : file6.txt: Copied (new) 2024/05/06 06:08:16 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:16 INFO : file3.txt: Deleted 2024/05/06 06:08:16 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:16 INFO : file7.txt: Copied (new) 2024/05/06 06:08:16 INFO : file5.txt.conflict1: Copied (new) 2024/05/06 06:08:16 INFO : file11.txt: Copied (new) 2024/05/06 06:08:16 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:16 INFO : file4.txt: Deleted 2024/05/06 06:08:16 INFO : Updating listings 2024/05/06 06:08:16 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/changes/path2/" 2024/05/06 06:08:16 INFO : Bisync successful bisync_test.go:555: TEST changes PASSED === RUN TestBisyncRemoteRemote/check_access 2024/05/06 06:08:16 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:16 DEBUG : path1: Making directory 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:16 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1" 2024/05/06 06:08:16 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:16 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:16 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:16 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:16 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:16 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:16 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1" 2024/05/06 06:08:16 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:16 DEBUG : path2: Making directory 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:16 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2" 2024/05/06 06:08:16 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:16 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:16 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:16 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:16 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:16 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:16 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2" 2024/05/06 06:08:16 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_check_access-xuxikag9" 2024/05/06 06:08:16 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:16 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:16 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:16 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:16 DEBUG : RCLONE_TEST.zedudef3.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:16 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:16 DEBUG : Local file system at /tmp/060813ko/initdir/test_check_access-xuxikag9: Waiting for checks to finish 2024/05/06 06:08:16 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:16 DEBUG : Local file system at /tmp/060813ko/initdir/test_check_access-xuxikag9: Waiting for transfers to finish 2024/05/06 06:08:16 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:16 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:16 DEBUG : file2.txt.foxusom7.partial: renamed to: file2.txt 2024/05/06 06:08:16 INFO : file2.txt: Copied (new) 2024/05/06 06:08:16 DEBUG : file1.txt.daxaqeg8.partial: renamed to: file1.txt 2024/05/06 06:08:16 INFO : file1.txt: Copied (new) 2024/05/06 06:08:16 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:16 DEBUG : file4.txt.wetozik3.partial: renamed to: file4.txt 2024/05/06 06:08:16 INFO : file4.txt: Copied (new) 2024/05/06 06:08:16 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:16 DEBUG : subdir/file20.txt.dibopam8.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:16 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:16 DEBUG : file3.txt.yuyejup9.partial: renamed to: file3.txt 2024/05/06 06:08:16 INFO : file3.txt: Copied (new) 2024/05/06 06:08:16 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:16 DEBUG : subdir/RCLONE_TEST.jupuret5.partial: renamed to: subdir/RCLONE_TEST 2024/05/06 06:08:16 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:16 INFO : subdir: Updated directory metadata 2024/05/06 06:08:16 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_check_access-gucozop7" 2024/05/06 06:08:16 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : Local file system at /tmp/060813ko/datadir/test_check_access-gucozop7: Waiting for checks to finish 2024/05/06 06:08:16 DEBUG : Local file system at /tmp/060813ko/datadir/test_check_access-gucozop7: Waiting for transfers to finish 2024/05/06 06:08:16 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:08:16 DEBUG : hold.txt.panitav0.partial: renamed to: hold.txt 2024/05/06 06:08:16 INFO : hold.txt: Copied (new) 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1] 2024/05/06 06:08:16 ERROR : : error listing: directory not found 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2] 2024/05/06 06:08:16 ERROR : : error listing: directory not found 2024/05/06 06:08:16 checking initFs Local file system at /tmp/060813ko/initdir/test_check_access-xuxikag9 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1] 2024/05/06 06:08:16 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : subdir: Making directory 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/subdir] 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/RCLONE_TEST] 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/file1.txt] 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/file2.txt] 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/file3.txt] 2024/05/06 06:08:16 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: Waiting for checks to finish 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: Waiting for transfers to finish 2024/05/06 06:08:16 INFO : file1.txt: Copied (new) 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/file4.txt] 2024/05/06 06:08:16 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/subdir/RCLONE_TEST] 2024/05/06 06:08:16 INFO : file2.txt: Copied (new) 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/subdir/file20.txt] 2024/05/06 06:08:16 INFO : file3.txt: Copied (new) 2024/05/06 06:08:16 INFO : file4.txt: Copied (new) 2024/05/06 06:08:16 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:16 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:16 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1] 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/subdir] 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2] 2024/05/06 06:08:16 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : subdir: Making directory 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/subdir] 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/file1.txt] 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/RCLONE_TEST] 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/file2.txt] 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/file3.txt] 2024/05/06 06:08:16 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: Waiting for checks to finish 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: Waiting for transfers to finish 2024/05/06 06:08:16 INFO : file1.txt: Copied (new) 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/file4.txt] 2024/05/06 06:08:16 INFO : file2.txt: Copied (new) 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/subdir/RCLONE_TEST] 2024/05/06 06:08:16 INFO : file3.txt: Copied (new) 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/subdir/file20.txt] 2024/05/06 06:08:16 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:16 INFO : file4.txt: Copied (new) 2024/05/06 06:08:16 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:16 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:16 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2] 2024/05/06 06:08:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/subdir] 2024/05/06 06:08:16 (01) : test check-access 2024/05/06 06:08:16 (02) : test initial bisync 2024/05/06 06:08:16 (03) : bisync resync 2024/05/06 06:08:16 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:16 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:16 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:16 INFO : Copying Path2 files to Path1 2024/05/06 06:08:16 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:16 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:16 INFO : Resync updating listings 2024/05/06 06:08:16 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:16 INFO : Bisync successful 2024/05/06 06:08:16 (04) : test 1. see that check-access passes with the initial setup 2024/05/06 06:08:16 (05) : bisync check-access 2024/05/06 06:08:16 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:16 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:16 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:16 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:16 INFO : Path1 checking for diffs 2024/05/06 06:08:16 INFO : Path2 checking for diffs 2024/05/06 06:08:16 INFO : Checking access health 2024/05/06 06:08:16 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:16 INFO : No changes found 2024/05/06 06:08:16 INFO : Updating listings 2024/05/06 06:08:16 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:16 INFO : Bisync successful 2024/05/06 06:08:16 (06) : test 2. delete the path2 subdir RCLONE_TEST and run sync. should fail critical. 2024/05/06 06:08:16 (07) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/subdir/RCLONE_TEST 2024/05/06 06:08:16 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:16 (08) : bisync check-access 2024/05/06 06:08:16 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:16 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:16 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:16 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:16 INFO : Path1 checking for diffs 2024/05/06 06:08:16 INFO : Path2 checking for diffs 2024/05/06 06:08:16 INFO : - Path2 File was deleted - subdir/RCLONE_TEST 2024/05/06 06:08:16 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:16 INFO : Checking access health 2024/05/06 06:08:16 ERROR : Access test failed: Path1 count 2, Path2 count 1 - RCLONE_TEST 2024/05/06 06:08:16 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/RCLONE_TEST 2024/05/06 06:08:16 ERROR : Bisync critical error: check file check failed 2024/05/06 06:08:16 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:16 Bisync error: bisync aborted 2024/05/06 06:08:16 (09) : copy-listings path2-missing 2024/05/06 06:08:16 (10) : test 3. put the path2 subdir RCLONE_TEST back, resync. 2024/05/06 06:08:16 (11) : copy-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/subdir/RCLONE_TEST TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/ 2024/05/06 06:08:16 (12) : bisync resync 2024/05/06 06:08:16 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:16 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:16 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:16 INFO : Copying Path2 files to Path1 2024/05/06 06:08:16 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:16 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:16 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:16 INFO : Resync updating listings 2024/05/06 06:08:16 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:16 INFO : Bisync successful 2024/05/06 06:08:16 (13) : test 4. run sync with check-access. should pass. 2024/05/06 06:08:16 (14) : bisync check-access 2024/05/06 06:08:17 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:17 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:17 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:17 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:17 INFO : Path1 checking for diffs 2024/05/06 06:08:17 INFO : Path2 checking for diffs 2024/05/06 06:08:17 INFO : Checking access health 2024/05/06 06:08:17 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:17 INFO : No changes found 2024/05/06 06:08:17 INFO : Updating listings 2024/05/06 06:08:17 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:17 INFO : Bisync successful 2024/05/06 06:08:17 (15) : test 5. delete path1 top level RCLONE_TEST, run sync. should fail critical. 2024/05/06 06:08:17 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/RCLONE_TEST 2024/05/06 06:08:17 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:17 (17) : bisync check-access 2024/05/06 06:08:17 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:17 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:17 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:17 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:17 INFO : Path1 checking for diffs 2024/05/06 06:08:17 INFO : - Path1 File was deleted - RCLONE_TEST 2024/05/06 06:08:17 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:17 INFO : Path2 checking for diffs 2024/05/06 06:08:17 INFO : Checking access health 2024/05/06 06:08:17 ERROR : Access test failed: Path1 count 1, Path2 count 2 - RCLONE_TEST 2024/05/06 06:08:17 ERROR : -  Access test failed: Path2 file not found in Path1 - RCLONE_TEST 2024/05/06 06:08:17 ERROR : Bisync critical error: check file check failed 2024/05/06 06:08:17 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:17 Bisync error: bisync aborted 2024/05/06 06:08:17 (18) : copy-listings path1-missing 2024/05/06 06:08:17 (19) : test 6. run again. should fail critical due to missing listings. 2024/05/06 06:08:17 (20) : bisync check-access 2024/05/06 06:08:17 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:17 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:17 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:17 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/060813ko/workdir/TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_access_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_access_path2.path1.lst Path2: /tmp/060813ko/workdir/TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_access_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_access_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/060813ko/workdir" 2024/05/06 06:08:17 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:17 Bisync error: bisync aborted 2024/05/06 06:08:17 (21) : move-listings missing-listings 2024/05/06 06:08:17 (22) : test 7. run resync, which will copy the path2 top level back to path1. 2024/05/06 06:08:17 (23) : bisync resync 2024/05/06 06:08:17 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:17 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:17 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:17 INFO : Copying Path2 files to Path1 2024/05/06 06:08:17 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:17 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:17 INFO : Resync updating listings 2024/05/06 06:08:17 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:17 INFO : Bisync successful 2024/05/06 06:08:17 (24) : test 8. run sync with --check-access. should pass. 2024/05/06 06:08:17 (25) : bisync check-access 2024/05/06 06:08:17 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:17 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:17 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:17 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:17 INFO : Path1 checking for diffs 2024/05/06 06:08:17 INFO : Path2 checking for diffs 2024/05/06 06:08:17 INFO : Checking access health 2024/05/06 06:08:17 INFO : Found 2 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:17 INFO : No changes found 2024/05/06 06:08:17 INFO : Updating listings 2024/05/06 06:08:17 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access/path2/" 2024/05/06 06:08:17 INFO : Bisync successful bisync_test.go:555: TEST check_access PASSED === RUN TestBisyncRemoteRemote/check_access_filters 2024/05/06 06:08:17 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:17 DEBUG : path1: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:17 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1" 2024/05/06 06:08:17 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:17 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:17 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:17 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:17 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:17 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:17 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1" 2024/05/06 06:08:17 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:17 DEBUG : path2: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:17 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2" 2024/05/06 06:08:17 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:17 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:17 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:17 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:17 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:17 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:17 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2" 2024/05/06 06:08:17 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_check_access_filters-pediyer1" 2024/05/06 06:08:17 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:17 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:17 DEBUG : file1.txt.xizocax4.partial: renamed to: file1.txt 2024/05/06 06:08:17 INFO : file1.txt: Copied (new) 2024/05/06 06:08:17 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:17 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:17 DEBUG : subdir-not: Making directory with metadata 2024/05/06 06:08:17 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:17 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:17 DEBUG : file2.txt.haposuv6.partial: renamed to: file2.txt 2024/05/06 06:08:17 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:17 INFO : file2.txt: Copied (new) 2024/05/06 06:08:17 INFO : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:17 DEBUG : file3.txt.gasavut9.partial: renamed to: file3.txt 2024/05/06 06:08:17 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not 2024/05/06 06:08:17 INFO : file3.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : subdirX: Making directory with metadata 2024/05/06 06:08:17 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:17 DEBUG : file4.txt.kocikox7.partial: renamed to: file4.txt 2024/05/06 06:08:17 DEBUG : RCLONE_TEST.dahaxeq5.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:17 INFO : file4.txt: Copied (new) 2024/05/06 06:08:17 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 INFO : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:17 DEBUG : Added delayed dir = "subdirX", newDst=subdirX 2024/05/06 06:08:17 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirA: Making directory with metadata 2024/05/06 06:08:17 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1: Making directory with metadata 2024/05/06 06:08:17 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2: Making directory with metadata 2024/05/06 06:08:17 INFO : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:17 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1 2024/05/06 06:08:17 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:17 INFO : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:17 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2 2024/05/06 06:08:17 DEBUG : subdir/file20.txt.wumalim3.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:17 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:17 DEBUG : subdir/RCLONE_TEST.hurekut6.partial: renamed to: subdir/RCLONE_TEST 2024/05/06 06:08:17 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 INFO : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:17 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA 2024/05/06 06:08:17 DEBUG : subdir/subdirB: Making directory with metadata 2024/05/06 06:08:17 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:17 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:17 DEBUG : subdir-not/file20.txt.famesud1.partial: renamed to: subdir-not/file20.txt 2024/05/06 06:08:17 INFO : subdir-not/file20.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : subdirX/RCLONE_TEST.yajotic7.partial: renamed to: subdirX/RCLONE_TEST 2024/05/06 06:08:17 INFO : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:17 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:17 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2/file30.txt.repawis8.partial: renamed to: subdir-not/subdir-not2/file30.txt 2024/05/06 06:08:17 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:17 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir-not/RCLONE_TEST.bayalop7.partial: renamed to: subdir-not/RCLONE_TEST 2024/05/06 06:08:17 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:17 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : subdirX/file20.txt.hemajuy0.partial: renamed to: subdirX/file20.txt 2024/05/06 06:08:17 INFO : subdirX/file20.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1/file30.txt.qecenez5.partial: renamed to: subdirX/subdirX1/file30.txt 2024/05/06 06:08:17 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : Local file system at /tmp/060813ko/initdir/test_check_access_filters-pediyer1: Waiting for checks to finish 2024/05/06 06:08:17 DEBUG : Local file system at /tmp/060813ko/initdir/test_check_access_filters-pediyer1: Waiting for transfers to finish 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1/RCLONE_TEST.sigitok7.partial: renamed to: subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:08:17 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:17 DEBUG : subdir/subdirB/file30.txt.kuxoged9.partial: renamed to: subdir/subdirB/file30.txt 2024/05/06 06:08:17 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.qipuhur8.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST 2024/05/06 06:08:17 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:17 DEBUG : subdir/subdirA/file30.txt.janaxoy0.partial: renamed to: subdir/subdirA/file30.txt 2024/05/06 06:08:17 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:17 DEBUG : subdir/subdirB/RCLONE_TEST.binulof4.partial: renamed to: subdir/subdirB/RCLONE_TEST 2024/05/06 06:08:17 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:17 DEBUG : subdir/subdirA/RCLONE_TEST.zadogew2.partial: renamed to: subdir/subdirA/RCLONE_TEST 2024/05/06 06:08:17 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 INFO : subdir/subdirB: Updated directory metadata 2024/05/06 06:08:17 INFO : subdirX/subdirX1: Updated directory metadata 2024/05/06 06:08:17 INFO : subdir/subdirA: Updated directory metadata 2024/05/06 06:08:17 INFO : subdir-not/subdir-not2: Updated directory metadata 2024/05/06 06:08:17 INFO : subdirX: Updated directory metadata 2024/05/06 06:08:17 INFO : subdir-not: Updated directory metadata 2024/05/06 06:08:17 INFO : subdir: Updated directory metadata 2024/05/06 06:08:17 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_check_access_filters-nuleder3" 2024/05/06 06:08:17 DEBUG : exclude-other-filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : include-other-filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : Local file system at /tmp/060813ko/datadir/test_check_access_filters-nuleder3: Waiting for checks to finish 2024/05/06 06:08:17 DEBUG : Local file system at /tmp/060813ko/datadir/test_check_access_filters-nuleder3: Waiting for transfers to finish 2024/05/06 06:08:17 DEBUG : include-other-filtersfile.txt: md5 = 2ec13b2813141ed088e5978ef5a47b0e OK 2024/05/06 06:08:17 DEBUG : include-other-filtersfile.txt.tegeriy9.partial: renamed to: include-other-filtersfile.txt 2024/05/06 06:08:17 INFO : include-other-filtersfile.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : exclude-other-filtersfile.txt: md5 = 5fcc6205d7df1c2e9ed3a15a1356b345 OK 2024/05/06 06:08:17 DEBUG : exclude-other-filtersfile.txt.kawetug5.partial: renamed to: exclude-other-filtersfile.txt 2024/05/06 06:08:17 INFO : exclude-other-filtersfile.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1] 2024/05/06 06:08:17 ERROR : : error listing: directory not found 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2] 2024/05/06 06:08:17 ERROR : : error listing: directory not found 2024/05/06 06:08:17 checking initFs Local file system at /tmp/060813ko/initdir/test_check_access_filters-pediyer1 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1] 2024/05/06 06:08:17 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/file1.txt] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/file2.txt] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/RCLONE_TEST] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/file3.txt] 2024/05/06 06:08:17 DEBUG : subdir-not: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir-not] 2024/05/06 06:08:17 DEBUG : subdirX: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdirX] 2024/05/06 06:08:17 INFO : file3.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/file4.txt] 2024/05/06 06:08:17 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirA: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir/subdirA] 2024/05/06 06:08:17 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir-not/subdir-not2] 2024/05/06 06:08:17 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdirX/subdirX1] 2024/05/06 06:08:17 DEBUG : subdir/subdirB: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir/subdirB] 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: Waiting for checks to finish 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: Waiting for transfers to finish 2024/05/06 06:08:17 INFO : file2.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir/RCLONE_TEST] 2024/05/06 06:08:17 INFO : file1.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir/file20.txt] 2024/05/06 06:08:17 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir-not/RCLONE_TEST] 2024/05/06 06:08:17 INFO : file4.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir-not/file20.txt] 2024/05/06 06:08:17 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdirX/RCLONE_TEST] 2024/05/06 06:08:17 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdirX/file20.txt] 2024/05/06 06:08:17 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir-not/subdir-not2/RCLONE_TEST] 2024/05/06 06:08:17 INFO : subdir-not/file20.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir-not/subdir-not2/file30.txt] 2024/05/06 06:08:17 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST] 2024/05/06 06:08:17 INFO : subdirX/file20.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdirX/subdirX1/file30.txt] 2024/05/06 06:08:17 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir/subdirB/RCLONE_TEST] 2024/05/06 06:08:17 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir/subdirB/file30.txt] 2024/05/06 06:08:17 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir/subdirA/RCLONE_TEST] 2024/05/06 06:08:17 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir/subdirA/file30.txt] 2024/05/06 06:08:17 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/05/06 06:08:17 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/05/06 06:08:17 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdirX] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir-not] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdirX/subdirX1] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir-not/subdir-not2] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir/subdirB] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir/subdirA] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2] 2024/05/06 06:08:17 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/RCLONE_TEST] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/file1.txt] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/file2.txt] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/file3.txt] 2024/05/06 06:08:17 DEBUG : subdir-not: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir-not] 2024/05/06 06:08:17 DEBUG : subdirX: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdirX] 2024/05/06 06:08:17 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirA: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir/subdirA] 2024/05/06 06:08:17 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2: Making directory 2024/05/06 06:08:17 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir-not/subdir-not2] 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdirX/subdirX1] 2024/05/06 06:08:17 DEBUG : subdir/subdirB: Making directory 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir/subdirB] 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: Waiting for checks to finish 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: Waiting for transfers to finish 2024/05/06 06:08:17 INFO : file1.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/file4.txt] 2024/05/06 06:08:17 INFO : file2.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir/RCLONE_TEST] 2024/05/06 06:08:17 INFO : file3.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir/file20.txt] 2024/05/06 06:08:17 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdirX/RCLONE_TEST] 2024/05/06 06:08:17 INFO : file4.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir-not/RCLONE_TEST] 2024/05/06 06:08:17 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir-not/file20.txt] 2024/05/06 06:08:17 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdirX/file20.txt] 2024/05/06 06:08:17 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST] 2024/05/06 06:08:17 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir-not/subdir-not2/file30.txt] 2024/05/06 06:08:17 INFO : subdir-not/file20.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdirX/subdirX1/RCLONE_TEST] 2024/05/06 06:08:17 INFO : subdirX/file20.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdirX/subdirX1/file30.txt] 2024/05/06 06:08:17 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir/subdirB/RCLONE_TEST] 2024/05/06 06:08:17 INFO : subdir-not/subdir-not2/file30.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir/subdirB/file30.txt] 2024/05/06 06:08:17 INFO : subdirX/subdirX1/RCLONE_TEST: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir/subdirA/RCLONE_TEST] 2024/05/06 06:08:17 INFO : subdirX/subdirX1/file30.txt: Copied (new) 2024/05/06 06:08:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir/subdirA/file30.txt] 2024/05/06 06:08:17 INFO : subdir/subdirB/RCLONE_TEST: Copied (new) 2024/05/06 06:08:18 INFO : subdir/subdirB/file30.txt: Copied (new) 2024/05/06 06:08:18 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/05/06 06:08:18 INFO : subdir/subdirA/file30.txt: Copied (new) 2024/05/06 06:08:18 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir-not] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdirX] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir-not/subdir-not2] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir/subdirB] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir/subdirA] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdirX/subdirX1] 2024/05/06 06:08:18 (01) : test check-access-filters 2024/05/06 06:08:18 (02) : test EXCLUDE - OTHER TESTS 2024/05/06 06:08:18 (03) : copy-file /tmp/060813ko/datadir/test_check_access_filters-nuleder3/exclude-other-filtersfile.txt /tmp/060813ko/workdir/ 2024/05/06 06:08:18 INFO : exclude-other-filtersfile.txt: Copied (new) 2024/05/06 06:08:18 (04) : test resync to get the filters file md5 built. 2024/05/06 06:08:18 (05) : bisync resync filters-file=/tmp/060813ko/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:18 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:18 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Using filters file /tmp/060813ko/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Storing filters file hash to /tmp/060813ko/workdir/exclude-other-filtersfile.txt.md5 2024/05/06 06:08:18 INFO : Copying Path2 files to Path1 2024/05/06 06:08:18 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:18 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:18 INFO : Resync updating listings 2024/05/06 06:08:18 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Bisync successful 2024/05/06 06:08:18 (06) : test EXCLUDE - test filters for check access 2024/05/06 06:08:18 (07) : bisync check-access filters-file=/tmp/060813ko/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:18 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:18 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Using filters file /tmp/060813ko/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:18 INFO : Path1 checking for diffs 2024/05/06 06:08:18 INFO : Path2 checking for diffs 2024/05/06 06:08:18 INFO : Checking access health 2024/05/06 06:08:18 INFO : Found 3 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:18 INFO : No changes found 2024/05/06 06:08:18 INFO : Updating listings 2024/05/06 06:08:18 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Bisync successful 2024/05/06 06:08:18 (08) : copy-listings exclude-initial 2024/05/06 06:08:18 (09) : test EXCLUDE - delete RCLONE_TEST files in excluded directories 2024/05/06 06:08:18 (10) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir/subdirA/RCLONE_TEST 2024/05/06 06:08:18 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:18 (11) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir-not/RCLONE_TEST 2024/05/06 06:08:18 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:18 (12) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST 2024/05/06 06:08:18 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:18 (13) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdirX/RCLONE_TEST 2024/05/06 06:08:18 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:18 (14) : test EXCLUDE - test should PASS 2024/05/06 06:08:18 (15) : bisync check-access filters-file=/tmp/060813ko/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:18 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:18 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Using filters file /tmp/060813ko/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:18 INFO : Path1 checking for diffs 2024/05/06 06:08:18 INFO : Path2 checking for diffs 2024/05/06 06:08:18 INFO : Checking access health 2024/05/06 06:08:18 INFO : Found 3 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:18 INFO : No changes found 2024/05/06 06:08:18 INFO : Updating listings 2024/05/06 06:08:18 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Bisync successful 2024/05/06 06:08:18 (16) : copy-listings exclude-pass-run 2024/05/06 06:08:18 (17) : test EXCLUDE - delete RCLONE_TEST files in included directories 2024/05/06 06:08:18 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/RCLONE_TEST 2024/05/06 06:08:18 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:18 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir/RCLONE_TEST 2024/05/06 06:08:18 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:18 (20) : test EXCLUDE - test should ABORT 2024/05/06 06:08:18 (21) : bisync check-access filters-file=/tmp/060813ko/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:18 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:18 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Using filters file /tmp/060813ko/workdir/exclude-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:18 INFO : Path1 checking for diffs 2024/05/06 06:08:18 INFO : - Path1 File was deleted - subdir/RCLONE_TEST 2024/05/06 06:08:18 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:18 INFO : Path2 checking for diffs 2024/05/06 06:08:18 INFO : - Path2 File was deleted - RCLONE_TEST 2024/05/06 06:08:18 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:18 INFO : Checking access health 2024/05/06 06:08:18 ERROR : -  Access test failed: Path1 file not found in Path2 - RCLONE_TEST 2024/05/06 06:08:18 ERROR : -  Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST 2024/05/06 06:08:18 ERROR : Bisync critical error: check file check failed 2024/05/06 06:08:18 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:18 Bisync error: bisync aborted 2024/05/06 06:08:18 (22) : move-listings exclude-error-run 2024/05/06 06:08:18 (23) : test INCLUDE - OTHER TESTS 2024/05/06 06:08:18 (24) : test reset to the initial state 2024/05/06 06:08:18 (25) : copy-dir /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/initial TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/ 2024/05/06 06:08:18 INFO : subdir/RCLONE_TEST: Copied (new) 2024/05/06 06:08:18 INFO : subdirX/RCLONE_TEST: Copied (new) 2024/05/06 06:08:18 INFO : subdir-not/RCLONE_TEST: Copied (new) 2024/05/06 06:08:18 (26) : sync-dir TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/ TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/ 2024/05/06 06:08:18 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:18 INFO : subdir-not/subdir-not2/RCLONE_TEST: Copied (new) 2024/05/06 06:08:18 INFO : subdir/subdirA/RCLONE_TEST: Copied (new) 2024/05/06 06:08:18 (27) : copy-file /tmp/060813ko/datadir/test_check_access_filters-nuleder3/include-other-filtersfile.txt /tmp/060813ko/workdir/ 2024/05/06 06:08:18 INFO : include-other-filtersfile.txt: Copied (new) 2024/05/06 06:08:18 (28) : bisync resync filters-file=/tmp/060813ko/workdir/include-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:18 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:18 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Using filters file /tmp/060813ko/workdir/include-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Storing filters file hash to /tmp/060813ko/workdir/include-other-filtersfile.txt.md5 2024/05/06 06:08:18 INFO : Copying Path2 files to Path1 2024/05/06 06:08:18 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:18 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:18 INFO : Resync updating listings 2024/05/06 06:08:18 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Bisync successful 2024/05/06 06:08:18 (29) : test INCLUDE - test include/exclude filters for check access 2024/05/06 06:08:18 (30) : bisync check-access filters-file=/tmp/060813ko/workdir/include-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:18 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:18 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Using filters file /tmp/060813ko/workdir/include-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:18 INFO : Path1 checking for diffs 2024/05/06 06:08:18 INFO : Path2 checking for diffs 2024/05/06 06:08:18 INFO : Checking access health 2024/05/06 06:08:18 INFO : Found 5 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:18 INFO : No changes found 2024/05/06 06:08:18 INFO : Updating listings 2024/05/06 06:08:18 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Bisync successful 2024/05/06 06:08:18 (31) : copy-listings include-initial 2024/05/06 06:08:18 (32) : test INCLUDE - delete RCLONE_TEST files in excluded directories 2024/05/06 06:08:18 (33) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir/subdirA/RCLONE_TEST 2024/05/06 06:08:18 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:18 (34) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir-not/RCLONE_TEST 2024/05/06 06:08:18 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:18 (35) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST 2024/05/06 06:08:18 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:18 (36) : test INCLUDE - test should PASS 2024/05/06 06:08:18 (37) : bisync check-access filters-file=/tmp/060813ko/workdir/include-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:18 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:18 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Using filters file /tmp/060813ko/workdir/include-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:18 INFO : Path1 checking for diffs 2024/05/06 06:08:18 INFO : Path2 checking for diffs 2024/05/06 06:08:18 INFO : Checking access health 2024/05/06 06:08:18 INFO : Found 5 matching "RCLONE_TEST" files on both paths 2024/05/06 06:08:18 INFO : No changes found 2024/05/06 06:08:18 INFO : Updating listings 2024/05/06 06:08:18 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Bisync successful 2024/05/06 06:08:18 (38) : copy-listings include-pass-run 2024/05/06 06:08:18 (39) : test INCLUDE - delete RCLONE_TEST files in included directories 2024/05/06 06:08:18 (40) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/RCLONE_TEST 2024/05/06 06:08:18 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:18 (41) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdir/RCLONE_TEST 2024/05/06 06:08:18 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:18 (42) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:08:18 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:18 (43) : test INCLUDE - test should ABORT 2024/05/06 06:08:18 (44) : bisync check-access filters-file=/tmp/060813ko/workdir/include-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:18 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:18 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_access_filters/path2/" 2024/05/06 06:08:18 INFO : Using filters file /tmp/060813ko/workdir/include-other-filtersfile.txt 2024/05/06 06:08:18 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:18 INFO : Path1 checking for diffs 2024/05/06 06:08:18 INFO : - Path1 File was deleted - subdir/RCLONE_TEST 2024/05/06 06:08:18 INFO : - Path1 File was deleted - subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:08:18 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2024/05/06 06:08:18 INFO : Path2 checking for diffs 2024/05/06 06:08:18 INFO : - Path2 File was deleted - RCLONE_TEST 2024/05/06 06:08:18 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:18 INFO : Checking access health 2024/05/06 06:08:18 ERROR : Access test failed: Path1 count 3, Path2 count 4 - RCLONE_TEST 2024/05/06 06:08:18 ERROR : -  Access test failed: Path1 file not found in Path2 - RCLONE_TEST 2024/05/06 06:08:18 ERROR : -  Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST 2024/05/06 06:08:18 ERROR : -  Access test failed: Path2 file not found in Path1 - subdirX/subdirX1/RCLONE_TEST 2024/05/06 06:08:18 ERROR : Bisync critical error: check file check failed 2024/05/06 06:08:18 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:18 Bisync error: bisync aborted 2024/05/06 06:08:18 (45) : move-listings include-error-run bisync_test.go:555: TEST check_access_filters PASSED === RUN TestBisyncRemoteRemote/check_filename 2024/05/06 06:08:18 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:18 DEBUG : path1: Making directory 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:18 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1" 2024/05/06 06:08:18 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:18 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:18 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:18 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:18 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:18 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:18 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1" 2024/05/06 06:08:18 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:18 DEBUG : path2: Making directory 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:18 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2" 2024/05/06 06:08:18 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:18 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:18 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:18 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:18 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:18 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:18 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2" 2024/05/06 06:08:18 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_check_filename-keqokow3" 2024/05/06 06:08:18 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:18 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:18 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:18 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : Local file system at /tmp/060813ko/initdir/test_check_filename-keqokow3: Waiting for checks to finish 2024/05/06 06:08:18 DEBUG : Local file system at /tmp/060813ko/initdir/test_check_filename-keqokow3: Waiting for transfers to finish 2024/05/06 06:08:18 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:18 DEBUG : .chk_file.zayuzal1.partial: renamed to: .chk_file 2024/05/06 06:08:18 INFO : .chk_file: Copied (new) 2024/05/06 06:08:18 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:18 DEBUG : file1.txt.payofov2.partial: renamed to: file1.txt 2024/05/06 06:08:18 INFO : file1.txt: Copied (new) 2024/05/06 06:08:18 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:18 DEBUG : file2.txt.camisew4.partial: renamed to: file2.txt 2024/05/06 06:08:18 INFO : file2.txt: Copied (new) 2024/05/06 06:08:18 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:18 DEBUG : file3.txt.nuhiwur4.partial: renamed to: file3.txt 2024/05/06 06:08:18 INFO : file3.txt: Copied (new) 2024/05/06 06:08:18 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:18 DEBUG : file4.txt.vicacum3.partial: renamed to: file4.txt 2024/05/06 06:08:18 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:18 INFO : file4.txt: Copied (new) 2024/05/06 06:08:18 DEBUG : subdir/.chk_file.vinegel8.partial: renamed to: subdir/.chk_file 2024/05/06 06:08:18 INFO : subdir/.chk_file: Copied (new) 2024/05/06 06:08:18 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:18 DEBUG : subdir/file20.txt.feqimor5.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:18 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:18 INFO : subdir: Updated directory metadata 2024/05/06 06:08:18 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_check_filename-veqemax1" 2024/05/06 06:08:18 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : Local file system at /tmp/060813ko/datadir/test_check_filename-veqemax1: Waiting for checks to finish 2024/05/06 06:08:18 DEBUG : Local file system at /tmp/060813ko/datadir/test_check_filename-veqemax1: Waiting for transfers to finish 2024/05/06 06:08:18 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:08:18 DEBUG : hold.txt.piqusuy3.partial: renamed to: hold.txt 2024/05/06 06:08:18 INFO : hold.txt: Copied (new) 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1] 2024/05/06 06:08:18 ERROR : : error listing: directory not found 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2] 2024/05/06 06:08:18 ERROR : : error listing: directory not found 2024/05/06 06:08:18 checking initFs Local file system at /tmp/060813ko/initdir/test_check_filename-keqokow3 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1] 2024/05/06 06:08:18 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : subdir: Making directory 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/subdir] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/.chk_file] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/file1.txt] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/file2.txt] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/file3.txt] 2024/05/06 06:08:18 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: Waiting for checks to finish 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: Waiting for transfers to finish 2024/05/06 06:08:18 INFO : file1.txt: Copied (new) 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/file4.txt] 2024/05/06 06:08:18 INFO : .chk_file: Copied (new) 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/subdir/.chk_file] 2024/05/06 06:08:18 INFO : file2.txt: Copied (new) 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/subdir/file20.txt] 2024/05/06 06:08:18 INFO : file3.txt: Copied (new) 2024/05/06 06:08:18 INFO : file4.txt: Copied (new) 2024/05/06 06:08:18 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/subdir/.chk_file: replication in progress) 2024/05/06 06:08:18 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/05/06 06:08:18 DEBUG : pacer: Reducing sleep to 30ms 2024/05/06 06:08:18 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:18 DEBUG : pacer: Reducing sleep to 22.5ms 2024/05/06 06:08:18 INFO : subdir/.chk_file: Copied (new) 2024/05/06 06:08:18 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/subdir] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2] 2024/05/06 06:08:18 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : subdir: Making directory 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/subdir] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/.chk_file] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/file1.txt] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/file2.txt] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/file3.txt] 2024/05/06 06:08:18 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: Waiting for checks to finish 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: Waiting for transfers to finish 2024/05/06 06:08:18 INFO : file1.txt: Copied (new) 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/file4.txt] 2024/05/06 06:08:18 INFO : file2.txt: Copied (new) 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/subdir/.chk_file] 2024/05/06 06:08:18 INFO : .chk_file: Copied (new) 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/subdir/file20.txt] 2024/05/06 06:08:18 INFO : file3.txt: Copied (new) 2024/05/06 06:08:18 INFO : file4.txt: Copied (new) 2024/05/06 06:08:18 INFO : subdir/.chk_file: Copied (new) 2024/05/06 06:08:18 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:18 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2] 2024/05/06 06:08:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/subdir] 2024/05/06 06:08:18 (01) : test check-filename 2024/05/06 06:08:18 (02) : test initial bisync 2024/05/06 06:08:18 (03) : bisync resync 2024/05/06 06:08:18 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:18 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:18 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/" 2024/05/06 06:08:18 INFO : Copying Path2 files to Path1 2024/05/06 06:08:18 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:18 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:18 INFO : Resync updating listings 2024/05/06 06:08:18 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/" 2024/05/06 06:08:18 INFO : Bisync successful 2024/05/06 06:08:18 (04) : test 1. see that check-access passes with the initial setup 2024/05/06 06:08:18 (05) : bisync check-access check-filename=.chk_file 2024/05/06 06:08:18 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:18 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:18 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/" 2024/05/06 06:08:18 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:18 INFO : Path1 checking for diffs 2024/05/06 06:08:18 INFO : Path2 checking for diffs 2024/05/06 06:08:18 INFO : Checking access health 2024/05/06 06:08:18 INFO : Found 2 matching ".chk_file" files on both paths 2024/05/06 06:08:18 INFO : No changes found 2024/05/06 06:08:18 INFO : Updating listings 2024/05/06 06:08:18 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/" 2024/05/06 06:08:18 INFO : Bisync successful 2024/05/06 06:08:18 (06) : copy-listings initial-pass 2024/05/06 06:08:18 (07) : test 2. delete the remote subdir .chk_file, run sync. should fail critical. 2024/05/06 06:08:18 (08) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/subdir/.chk_file 2024/05/06 06:08:18 INFO : .chk_file: Deleted 2024/05/06 06:08:18 (09) : bisync check-access check-filename=.chk_file 2024/05/06 06:08:19 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:19 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:19 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/" 2024/05/06 06:08:19 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:19 INFO : Path1 checking for diffs 2024/05/06 06:08:19 INFO : Path2 checking for diffs 2024/05/06 06:08:19 INFO : - Path2 File was deleted - subdir/.chk_file 2024/05/06 06:08:19 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:19 INFO : Checking access health 2024/05/06 06:08:19 ERROR : Access test failed: Path1 count 2, Path2 count 1 - .chk_file 2024/05/06 06:08:19 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/.chk_file 2024/05/06 06:08:19 ERROR : Bisync critical error: check file check failed 2024/05/06 06:08:19 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:19 Bisync error: bisync aborted 2024/05/06 06:08:19 (10) : move-listings path2-missing 2024/05/06 06:08:19 (11) : test 3. put the remote subdir .chk_file back, run resync. 2024/05/06 06:08:19 (12) : copy-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/subdir/.chk_file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/subdir/ 2024/05/06 06:08:19 INFO : .chk_file: Copied (new) 2024/05/06 06:08:19 (13) : bisync check-access resync check-filename=.chk_file 2024/05/06 06:08:19 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:19 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:19 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/" 2024/05/06 06:08:19 INFO : Copying Path2 files to Path1 2024/05/06 06:08:19 INFO : Checking access health 2024/05/06 06:08:19 INFO : Found 2 matching ".chk_file" files on both paths 2024/05/06 06:08:19 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:19 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:19 INFO : Resync updating listings 2024/05/06 06:08:19 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/" 2024/05/06 06:08:19 INFO : Bisync successful 2024/05/06 06:08:19 (14) : test 4. run sync with check-access. should pass. 2024/05/06 06:08:19 (15) : bisync check-access check-filename=.chk_file 2024/05/06 06:08:19 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:19 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:19 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/" 2024/05/06 06:08:19 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:19 INFO : Path1 checking for diffs 2024/05/06 06:08:19 INFO : Path2 checking for diffs 2024/05/06 06:08:19 INFO : Checking access health 2024/05/06 06:08:19 INFO : Found 2 matching ".chk_file" files on both paths 2024/05/06 06:08:19 INFO : No changes found 2024/05/06 06:08:19 INFO : Updating listings 2024/05/06 06:08:19 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_filename/path2/" 2024/05/06 06:08:19 INFO : Bisync successful bisync_test.go:555: TEST check_filename PASSED === RUN TestBisyncRemoteRemote/check_sync 2024/05/06 06:08:19 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:19 DEBUG : path1: Making directory 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:19 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1" 2024/05/06 06:08:19 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:19 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:19 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:19 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:19 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:19 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:19 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1" 2024/05/06 06:08:19 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:19 DEBUG : path2: Making directory 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:19 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2" 2024/05/06 06:08:19 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:19 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:19 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:19 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:19 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:19 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:19 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2" 2024/05/06 06:08:19 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_check_sync-loqoqil1" 2024/05/06 06:08:19 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : Local file system at /tmp/060813ko/initdir/test_check_sync-loqoqil1: Waiting for checks to finish 2024/05/06 06:08:19 DEBUG : Local file system at /tmp/060813ko/initdir/test_check_sync-loqoqil1: Waiting for transfers to finish 2024/05/06 06:08:19 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : file1.txt.sugadad0.partial: renamed to: file1.txt 2024/05/06 06:08:19 INFO : file1.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : file3.txt.votokah6.partial: renamed to: file3.txt 2024/05/06 06:08:19 INFO : file3.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : file4.txt.tineduj8.partial: renamed to: file4.txt 2024/05/06 06:08:19 INFO : file4.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file2.txt.diquqiq2.partial: renamed to: file2.txt 2024/05/06 06:08:19 INFO : file2.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:19 DEBUG : RCLONE_TEST.toqofup0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:19 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:19 DEBUG : file5.txt.joqelal3.partial: renamed to: file5.txt 2024/05/06 06:08:19 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 INFO : file5.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : file7.txt.yuxayos4.partial: renamed to: file7.txt 2024/05/06 06:08:19 INFO : file7.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file6.txt.wolidiw7.partial: renamed to: file6.txt 2024/05/06 06:08:19 INFO : file6.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : file8.txt.capicet8.partial: renamed to: file8.txt 2024/05/06 06:08:19 INFO : file8.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_check_sync-devutom3" 2024/05/06 06:08:19 DEBUG : _testdir_path1.._testdir_path2.path1.lst: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : _testdir_path1.._testdir_path2.path2.lst: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : Local file system at /tmp/060813ko/datadir/test_check_sync-devutom3: Waiting for checks to finish 2024/05/06 06:08:19 DEBUG : Local file system at /tmp/060813ko/datadir/test_check_sync-devutom3: Waiting for transfers to finish 2024/05/06 06:08:19 DEBUG : _testdir_path1.._testdir_path2.path2.lst: md5 = d6ce44a26af9c2110b1750fe88dc4b69 OK 2024/05/06 06:08:19 DEBUG : _testdir_path1.._testdir_path2.path2.lst.nijuruq7.partial: renamed to: _testdir_path1.._testdir_path2.path2.lst 2024/05/06 06:08:19 INFO : _testdir_path1.._testdir_path2.path2.lst: Copied (new) 2024/05/06 06:08:19 DEBUG : _testdir_path1.._testdir_path2.path1.lst: md5 = fdb18e0dff6961813e12c57227d2e854 OK 2024/05/06 06:08:19 DEBUG : _testdir_path1.._testdir_path2.path1.lst.qahivac7.partial: renamed to: _testdir_path1.._testdir_path2.path1.lst 2024/05/06 06:08:19 INFO : _testdir_path1.._testdir_path2.path1.lst: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1] 2024/05/06 06:08:19 ERROR : : error listing: directory not found 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2] 2024/05/06 06:08:19 ERROR : : error listing: directory not found 2024/05/06 06:08:19 checking initFs Local file system at /tmp/060813ko/initdir/test_check_sync-loqoqil1 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1] 2024/05/06 06:08:19 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: Waiting for checks to finish 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/RCLONE_TEST] 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/file1.txt] 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/file2.txt] 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: Waiting for transfers to finish 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/file3.txt] 2024/05/06 06:08:19 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/file4.txt] 2024/05/06 06:08:19 INFO : file1.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/file5.txt] 2024/05/06 06:08:19 INFO : file3.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/file6.txt] 2024/05/06 06:08:19 INFO : file2.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/file7.txt] 2024/05/06 06:08:19 INFO : file4.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/file8.txt] 2024/05/06 06:08:19 INFO : file5.txt: Copied (new) 2024/05/06 06:08:19 INFO : file6.txt: Copied (new) 2024/05/06 06:08:19 INFO : file7.txt: Copied (new) 2024/05/06 06:08:19 INFO : file8.txt: Copied (new) 2024/05/06 06:08:19 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1] 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2] 2024/05/06 06:08:19 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/file3.txt] 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/file2.txt] 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: Waiting for checks to finish 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/RCLONE_TEST] 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/file1.txt] 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: Waiting for transfers to finish 2024/05/06 06:08:19 INFO : file3.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/file4.txt] 2024/05/06 06:08:19 INFO : file2.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/file5.txt] 2024/05/06 06:08:19 INFO : file1.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/file6.txt] 2024/05/06 06:08:19 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/file7.txt] 2024/05/06 06:08:19 INFO : file4.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/file8.txt] 2024/05/06 06:08:19 INFO : file5.txt: Copied (new) 2024/05/06 06:08:19 INFO : file6.txt: Copied (new) 2024/05/06 06:08:19 INFO : file7.txt: Copied (new) 2024/05/06 06:08:19 INFO : file8.txt: Copied (new) 2024/05/06 06:08:19 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2] 2024/05/06 06:08:19 (01) : test check-sync 2024/05/06 06:08:19 (02) : test initial bisync 2024/05/06 06:08:19 (03) : bisync resync 2024/05/06 06:08:19 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:19 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:19 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/" 2024/05/06 06:08:19 INFO : Copying Path2 files to Path1 2024/05/06 06:08:19 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:19 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:19 INFO : Resync updating listings 2024/05/06 06:08:19 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/" 2024/05/06 06:08:19 INFO : Bisync successful 2024/05/06 06:08:19 (04) : test 1. run check-sync-only on a clean sync 2024/05/06 06:08:19 (05) : bisync check-sync-only 2024/05/06 06:08:19 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:19 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:19 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/" 2024/05/06 06:08:19 INFO : Bisync successful 2024/05/06 06:08:19 (06) : test 2. inject modified listings into the workdir 2024/05/06 06:08:19 (07) : copy-as /tmp/060813ko/datadir/test_check_sync-devutom3/_testdir_path1.._testdir_path2.path1.lst /tmp/060813ko/workdir/ TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path2.path1.lst 2024/05/06 06:08:19 INFO : _testdir_path1.._testdir_path2.path1.lst: Copied (replaced existing) to: TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path2.path1.lst 2024/05/06 06:08:19 (08) : copy-as /tmp/060813ko/datadir/test_check_sync-devutom3/_testdir_path1.._testdir_path2.path2.lst /tmp/060813ko/workdir/ TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path2.path2.lst 2024/05/06 06:08:19 INFO : _testdir_path1.._testdir_path2.path2.lst: Copied (replaced existing) to: TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path2.path2.lst 2024/05/06 06:08:19 (09) : test 3. run check-sync-only on modified listings 2024/05/06 06:08:19 (10) : bisync check-sync-only 2024/05/06 06:08:19 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:19 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:19 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/" 2024/05/06 06:08:19 ERROR : -  Path1 file not found in Path2 - file2.txt 2024/05/06 06:08:19 ERROR : -  Path2 file not found in Path1 - file1.txt 2024/05/06 06:08:19 ERROR : Bisync critical error: path1 and path2 are out of sync, run --resync to recover 2024/05/06 06:08:19 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:19 Bisync error: bisync aborted 2024/05/06 06:08:19 (11) : copy-listings check-sync-only 2024/05/06 06:08:19 (12) : test 4. run normal sync to check that it aborts 2024/05/06 06:08:19 (13) : bisync 2024/05/06 06:08:19 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:19 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:19 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/" 2024/05/06 06:08:19 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/060813ko/workdir/TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path2.path1.lst Path2: /tmp/060813ko/workdir/TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/060813ko/workdir" 2024/05/06 06:08:19 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:19 Bisync error: bisync aborted 2024/05/06 06:08:19 (14) : test 5. prune failure listings after critical abort 2024/05/06 06:08:19 (15) : delete-glob /tmp/060813ko/workdir/ *.lst 2024/05/06 06:08:19 (16) : delete-glob /tmp/060813ko/workdir/ *.lst-err 2024/05/06 06:08:19 INFO : TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path2.path1.lst-err: Deleted 2024/05/06 06:08:19 INFO : TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path2.path2.lst-err: Deleted 2024/05/06 06:08:19 (17) : delete-glob /tmp/060813ko/workdir/ *.lst-new 2024/05/06 06:08:19 INFO : TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path2.path1.lst-new: Deleted 2024/05/06 06:08:19 INFO : TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_check_sync_path2.path2.lst-new: Deleted 2024/05/06 06:08:19 (18) : test 6. run resync 2024/05/06 06:08:19 (19) : bisync resync 2024/05/06 06:08:19 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:19 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:19 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/" 2024/05/06 06:08:19 INFO : Copying Path2 files to Path1 2024/05/06 06:08:19 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:19 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:19 INFO : Resync updating listings 2024/05/06 06:08:19 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/" 2024/05/06 06:08:19 INFO : Bisync successful 2024/05/06 06:08:19 (20) : test 7. run normal sync with check-sync enabled (default) 2024/05/06 06:08:19 (21) : bisync 2024/05/06 06:08:19 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:19 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:19 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/" 2024/05/06 06:08:19 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:19 INFO : Path1 checking for diffs 2024/05/06 06:08:19 INFO : Path2 checking for diffs 2024/05/06 06:08:19 INFO : No changes found 2024/05/06 06:08:19 INFO : Updating listings 2024/05/06 06:08:19 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/" 2024/05/06 06:08:19 INFO : Bisync successful 2024/05/06 06:08:19 (22) : test 8. run normal sync with no-check-sync 2024/05/06 06:08:19 (23) : bisync no-check-sync 2024/05/06 06:08:19 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:19 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:19 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/check_sync/path2/" 2024/05/06 06:08:19 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:19 INFO : Path1 checking for diffs 2024/05/06 06:08:19 INFO : Path2 checking for diffs 2024/05/06 06:08:19 INFO : No changes found 2024/05/06 06:08:19 INFO : Updating listings 2024/05/06 06:08:19 INFO : Bisync successful bisync_test.go:555: TEST check_sync PASSED === RUN TestBisyncRemoteRemote/compare_all 2024/05/06 06:08:19 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:19 DEBUG : path1: Making directory 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:19 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1" 2024/05/06 06:08:19 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:19 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:19 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:19 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:19 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:19 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:19 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1" 2024/05/06 06:08:19 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:19 DEBUG : path2: Making directory 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:19 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2" 2024/05/06 06:08:19 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:19 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:19 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:19 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:19 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:19 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:19 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2" 2024/05/06 06:08:19 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_compare_all-gulirit6" 2024/05/06 06:08:19 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : Local file system at /tmp/060813ko/initdir/test_compare_all-gulirit6: Waiting for checks to finish 2024/05/06 06:08:19 DEBUG : Local file system at /tmp/060813ko/initdir/test_compare_all-gulirit6: Waiting for transfers to finish 2024/05/06 06:08:19 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : file2.txt.kayedud4.partial: renamed to: file2.txt 2024/05/06 06:08:19 INFO : file2.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file1.txt.tijutus6.partial: renamed to: file1.txt 2024/05/06 06:08:19 INFO : file1.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : file4.txt.xixedeq1.partial: renamed to: file4.txt 2024/05/06 06:08:19 INFO : file4.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : file5.txt.hihexiz5.partial: renamed to: file5.txt 2024/05/06 06:08:19 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 INFO : file5.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : file3.txt.lakazuq1.partial: renamed to: file3.txt 2024/05/06 06:08:19 DEBUG : file6.txt.zixepuf8.partial: renamed to: file6.txt 2024/05/06 06:08:19 INFO : file3.txt: Copied (new) 2024/05/06 06:08:19 INFO : file6.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:19 DEBUG : file8.txt.pilaceg4.partial: renamed to: file8.txt 2024/05/06 06:08:19 INFO : file8.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : RCLONE_TEST.nasisaz4.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:19 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:19 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:19 DEBUG : file7.txt.luxizim7.partial: renamed to: file7.txt 2024/05/06 06:08:19 INFO : file7.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_compare_all-vitakit7" 2024/05/06 06:08:19 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : Local file system at /tmp/060813ko/datadir/test_compare_all-vitakit7: Waiting for checks to finish 2024/05/06 06:08:19 DEBUG : Local file system at /tmp/060813ko/datadir/test_compare_all-vitakit7: Waiting for transfers to finish 2024/05/06 06:08:19 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:19 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:19 DEBUG : file2.txt.qojirip7.partial: renamed to: file2.txt 2024/05/06 06:08:19 INFO : file2.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file11.txt.ciniwic8.partial: renamed to: file11.txt 2024/05/06 06:08:19 INFO : file11.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:19 DEBUG : file1.txt.nugawij7.partial: renamed to: file1.txt 2024/05/06 06:08:19 INFO : file1.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:19 DEBUG : file5L.txt.mimijax6.partial: renamed to: file5L.txt 2024/05/06 06:08:19 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:19 DEBUG : file5R.txt.tiramop6.partial: renamed to: file5R.txt 2024/05/06 06:08:19 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:19 DEBUG : file10.txt.furuqaj6.partial: renamed to: file10.txt 2024/05/06 06:08:19 INFO : file10.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:19 DEBUG : file6.txt.gubolat4.partial: renamed to: file6.txt 2024/05/06 06:08:19 INFO : file6.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:19 DEBUG : file7.txt.gefeqew8.partial: renamed to: file7.txt 2024/05/06 06:08:19 INFO : file7.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1] 2024/05/06 06:08:19 ERROR : : error listing: directory not found 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2] 2024/05/06 06:08:19 ERROR : : error listing: directory not found 2024/05/06 06:08:19 checking initFs Local file system at /tmp/060813ko/initdir/test_compare_all-gulirit6 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1] 2024/05/06 06:08:19 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/RCLONE_TEST] 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: Waiting for checks to finish 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: Waiting for transfers to finish 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file1.txt] 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file3.txt] 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file2.txt] 2024/05/06 06:08:19 INFO : file3.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file4.txt] 2024/05/06 06:08:19 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file5.txt] 2024/05/06 06:08:19 INFO : file1.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file6.txt] 2024/05/06 06:08:19 INFO : file2.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file7.txt] 2024/05/06 06:08:19 INFO : file4.txt: Copied (new) 2024/05/06 06:08:19 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file8.txt] 2024/05/06 06:08:19 INFO : file5.txt: Copied (new) 2024/05/06 06:08:19 INFO : file6.txt: Copied (new) 2024/05/06 06:08:19 INFO : file7.txt: Copied (new) 2024/05/06 06:08:20 INFO : file8.txt: Copied (new) 2024/05/06 06:08:20 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1] 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2] 2024/05/06 06:08:20 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/RCLONE_TEST] 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file1.txt] 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file2.txt] 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: Waiting for checks to finish 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: Waiting for transfers to finish 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file3.txt] 2024/05/06 06:08:20 INFO : file1.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file4.txt] 2024/05/06 06:08:20 INFO : file2.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file5.txt] 2024/05/06 06:08:20 INFO : file3.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file6.txt] 2024/05/06 06:08:20 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file7.txt] 2024/05/06 06:08:20 INFO : file4.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file8.txt] 2024/05/06 06:08:20 INFO : file5.txt: Copied (new) 2024/05/06 06:08:20 INFO : file6.txt: Copied (new) 2024/05/06 06:08:20 INFO : file7.txt: Copied (new) 2024/05/06 06:08:20 INFO : file8.txt: Copied (new) 2024/05/06 06:08:20 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2] 2024/05/06 06:08:20 (01) : test changes compare-all 2024/05/06 06:08:20 (02) : test initial bisync 2024/05/06 06:08:20 (03) : bisync resync compare-all 2024/05/06 06:08:20 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/05/06 06:08:20 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/" 2024/05/06 06:08:20 INFO : Copying Path2 files to Path1 2024/05/06 06:08:20 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:20 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:20 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:20 INFO : Resync updating listings 2024/05/06 06:08:20 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/" 2024/05/06 06:08:20 INFO : Bisync successful 2024/05/06 06:08:20 (04) : test make modifications on both paths 2024/05/06 06:08:20 (05) : test new on path2 - file10 2024/05/06 06:08:20 (06) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_compare_all-vitakit7/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/ 2024/05/06 06:08:20 INFO : file10.txt: Copied (new) 2024/05/06 06:08:20 (07) : test newer on path2 - file1 2024/05/06 06:08:20 (08) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_compare_all-vitakit7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/ 2024/05/06 06:08:20 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:20 (09) : test new on path1 - file11 2024/05/06 06:08:20 (10) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_compare_all-vitakit7/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/ 2024/05/06 06:08:20 INFO : file11.txt: Copied (new) 2024/05/06 06:08:20 (11) : test newer on path1 - file2 2024/05/06 06:08:20 (12) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_compare_all-vitakit7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/ 2024/05/06 06:08:20 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:20 (13) : test deleted on path2 - file3 2024/05/06 06:08:20 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file3.txt 2024/05/06 06:08:20 INFO : file3.txt: Deleted 2024/05/06 06:08:20 (15) : test deleted on path1 - file4 2024/05/06 06:08:20 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file4.txt 2024/05/06 06:08:20 INFO : file4.txt: Deleted 2024/05/06 06:08:20 (17) : test deleted on both paths - file8 2024/05/06 06:08:20 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file8.txt 2024/05/06 06:08:20 INFO : file8.txt: Deleted 2024/05/06 06:08:20 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file8.txt 2024/05/06 06:08:20 INFO : file8.txt: Deleted 2024/05/06 06:08:20 (20) : test changed on both paths - file5 (file5R, file5L) 2024/05/06 06:08:20 (21) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_compare_all-vitakit7/ file5R.txt 2024/05/06 06:08:20 (22) : copy-as /tmp/060813ko/datadir/test_compare_all-vitakit7/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/ file5.txt 2024/05/06 06:08:20 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:20 (23) : touch-glob 2001-03-04 /tmp/060813ko/datadir/test_compare_all-vitakit7/ file5L.txt 2024/05/06 06:08:20 (24) : copy-as /tmp/060813ko/datadir/test_compare_all-vitakit7/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/ file5.txt 2024/05/06 06:08:20 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:20 (25) : test newer on path2 and deleted on path1 - file6 2024/05/06 06:08:20 (26) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_compare_all-vitakit7/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/ 2024/05/06 06:08:20 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:08:20 (27) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file6.txt 2024/05/06 06:08:20 INFO : file6.txt: Deleted 2024/05/06 06:08:20 (28) : test newer on path1 and deleted on path2 - file7 2024/05/06 06:08:20 (29) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_compare_all-vitakit7/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/ 2024/05/06 06:08:20 INFO : file7.txt: Copied (replaced existing) 2024/05/06 06:08:20 (30) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file7.txt 2024/05/06 06:08:20 INFO : file7.txt: Deleted 2024/05/06 06:08:20 (31) : test bisync run 2024/05/06 06:08:20 (32) : bisync compare-all 2024/05/06 06:08:20 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/05/06 06:08:20 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/" 2024/05/06 06:08:20 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:20 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:20 INFO : Path1 checking for diffs 2024/05/06 06:08:20 INFO : - Path1 File changed: size (larger), time (newer), hash - file2.txt 2024/05/06 06:08:20 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:08:20 INFO : - Path1 File changed: size (larger), time (newer), hash - file5.txt 2024/05/06 06:08:20 INFO : - Path1 File was deleted - file6.txt 2024/05/06 06:08:20 INFO : - Path1 File changed: size (larger), time (newer), hash - file7.txt 2024/05/06 06:08:20 INFO : - Path1 File was deleted - file8.txt 2024/05/06 06:08:20 INFO : - Path1 File is new - file11.txt 2024/05/06 06:08:20 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:08:20 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2024/05/06 06:08:20 INFO : Path2 checking for diffs 2024/05/06 06:08:20 INFO : - Path2 File changed: size (larger), time (newer), hash - file1.txt 2024/05/06 06:08:20 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:08:20 INFO : - Path2 File changed: size (larger), time (newer), hash - file5.txt 2024/05/06 06:08:20 INFO : - Path2 File changed: size (larger), time (newer), hash - file6.txt 2024/05/06 06:08:20 INFO : - Path2 File was deleted - file7.txt 2024/05/06 06:08:20 INFO : - Path2 File was deleted - file8.txt 2024/05/06 06:08:20 INFO : - Path2 File is new - file10.txt 2024/05/06 06:08:20 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:08:20 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller,  3 hash differs) 2024/05/06 06:08:20 INFO : Applying changes 2024/05/06 06:08:20 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file11.txt 2024/05/06 06:08:20 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file2.txt 2024/05/06 06:08:20 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file4.txt 2024/05/06 06:08:20 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:08:20 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file5.txt.conflict1 2024/05/06 06:08:20 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/05/06 06:08:20 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file5.txt.conflict1 2024/05/06 06:08:20 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file5.txt.conflict2 2024/05/06 06:08:20 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/05/06 06:08:20 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file5.txt.conflict2 2024/05/06 06:08:20 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file6.txt 2024/05/06 06:08:20 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/file7.txt 2024/05/06 06:08:20 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file1.txt 2024/05/06 06:08:20 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file10.txt 2024/05/06 06:08:20 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/file3.txt 2024/05/06 06:08:20 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:20 INFO : file10.txt: Copied (new) 2024/05/06 06:08:20 INFO : file5.txt.conflict2: Copied (new) 2024/05/06 06:08:20 INFO : file6.txt: Copied (new) 2024/05/06 06:08:20 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:20 INFO : file3.txt: Deleted 2024/05/06 06:08:20 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:20 INFO : file11.txt: Copied (new) 2024/05/06 06:08:20 INFO : file5.txt.conflict1: Copied (new) 2024/05/06 06:08:20 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:20 INFO : file7.txt: Copied (new) 2024/05/06 06:08:20 INFO : file4.txt: Deleted 2024/05/06 06:08:20 INFO : Updating listings 2024/05/06 06:08:20 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/compare_all/path2/" 2024/05/06 06:08:20 INFO : Bisync successful bisync_test.go:555: TEST compare_all PASSED === RUN TestBisyncRemoteRemote/createemptysrcdirs 2024/05/06 06:08:20 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:20 DEBUG : path1: Making directory 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:20 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1" 2024/05/06 06:08:20 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:20 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:20 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:20 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:20 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:20 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:20 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1" 2024/05/06 06:08:20 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:20 DEBUG : path2: Making directory 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:20 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2" 2024/05/06 06:08:20 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:20 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:20 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:20 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:20 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:20 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:20 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2" 2024/05/06 06:08:20 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_createemptysrcdirs-curarat4" 2024/05/06 06:08:20 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : Local file system at /tmp/060813ko/initdir/test_createemptysrcdirs-curarat4: Waiting for checks to finish 2024/05/06 06:08:20 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:20 DEBUG : RCLONE_TEST.weberiw5.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:20 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:20 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:20 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:20 DEBUG : file1.copy4.txt.munerel7.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:20 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : file1.copy1.txt.doxirot8.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:20 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : Local file system at /tmp/060813ko/initdir/test_createemptysrcdirs-curarat4: Waiting for transfers to finish 2024/05/06 06:08:20 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:20 DEBUG : file1.copy2.txt.safekem4.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:20 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:20 DEBUG : file1.copy5.txt.ziqativ4.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:20 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:20 DEBUG : file1.copy3.txt.repimuf8.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:20 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:20 DEBUG : file1.txt.wavejak5.partial: renamed to: file1.txt 2024/05/06 06:08:20 INFO : file1.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5" 2024/05/06 06:08:20 DEBUG : placeholder.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : Local file system at /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5: Waiting for checks to finish 2024/05/06 06:08:20 DEBUG : Local file system at /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5: Waiting for transfers to finish 2024/05/06 06:08:20 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:20 DEBUG : placeholder.txt.sulupuy4.partial: renamed to: placeholder.txt 2024/05/06 06:08:20 INFO : placeholder.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1] 2024/05/06 06:08:20 ERROR : : error listing: directory not found 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2] 2024/05/06 06:08:20 ERROR : : error listing: directory not found 2024/05/06 06:08:20 checking initFs Local file system at /tmp/060813ko/initdir/test_createemptysrcdirs-curarat4 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1] 2024/05/06 06:08:20 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/RCLONE_TEST] 2024/05/06 06:08:20 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/file1.copy1.txt] 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/file1.copy2.txt] 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1: Waiting for checks to finish 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1: Waiting for transfers to finish 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/file1.copy3.txt] 2024/05/06 06:08:20 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/file1.copy4.txt] 2024/05/06 06:08:20 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/file1.copy5.txt] 2024/05/06 06:08:20 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/file1.txt] 2024/05/06 06:08:20 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:20 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:20 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:20 INFO : file1.txt: Copied (new) 2024/05/06 06:08:20 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1] 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2] 2024/05/06 06:08:20 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2: Waiting for checks to finish 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/RCLONE_TEST] 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/file1.copy1.txt] 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/file1.copy2.txt] 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2: Waiting for transfers to finish 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/file1.copy3.txt] 2024/05/06 06:08:20 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/file1.copy4.txt] 2024/05/06 06:08:20 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/file1.copy5.txt] 2024/05/06 06:08:20 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/file1.txt] 2024/05/06 06:08:20 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:20 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:20 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:20 INFO : file1.txt: Copied (new) 2024/05/06 06:08:20 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2 2024/05/06 06:08:20 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2] 2024/05/06 06:08:20 (01) : test createemptysrcdirs 2024/05/06 06:08:20 (02) : test initial bisync 2024/05/06 06:08:20 (03) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/ placeholder.txt 2024/05/06 06:08:20 (04) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.txt 2024/05/06 06:08:20 INFO : placeholder.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:20 (05) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy1.txt 2024/05/06 06:08:20 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy1.txt 2024/05/06 06:08:20 (06) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy2.txt 2024/05/06 06:08:20 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy2.txt 2024/05/06 06:08:20 (07) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy3.txt 2024/05/06 06:08:20 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy3.txt 2024/05/06 06:08:20 (08) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy4.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy4.txt 2024/05/06 06:08:21 (09) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy5.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (replaced existing) to: file1.copy5.txt 2024/05/06 06:08:21 (10) : bisync resync 2024/05/06 06:08:21 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:21 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:21 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Copying Path2 files to Path1 2024/05/06 06:08:21 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:21 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:21 INFO : file1.copy4.txt: Copied (replaced existing) 2024/05/06 06:08:21 INFO : file1.copy1.txt: Copied (replaced existing) 2024/05/06 06:08:21 INFO : file1.copy2.txt: Copied (replaced existing) 2024/05/06 06:08:21 INFO : file1.copy3.txt: Copied (replaced existing) 2024/05/06 06:08:21 INFO : file1.copy5.txt: Copied (replaced existing) 2024/05/06 06:08:21 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:21 INFO : Resync updating listings 2024/05/06 06:08:21 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Bisync successful 2024/05/06 06:08:21 (11) : test 1. Create an empty dir on Path1 by creating subdir/placeholder.txt and then deleting the placeholder 2024/05/06 06:08:21 (12) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ subdir/placeholder.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: subdir/placeholder.txt 2024/05/06 06:08:21 (13) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ subdir 2024/05/06 06:08:21 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/subdir/placeholder.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Deleted 2024/05/06 06:08:21 (15) : test 2. Run bisync without --create-empty-src-dirs 2024/05/06 06:08:21 (16) : bisync 2024/05/06 06:08:21 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:21 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:21 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:21 INFO : Path1 checking for diffs 2024/05/06 06:08:21 INFO : Path2 checking for diffs 2024/05/06 06:08:21 INFO : No changes found 2024/05/06 06:08:21 INFO : Updating listings 2024/05/06 06:08:21 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Bisync successful 2024/05/06 06:08:21 (17) : test 3. Confirm the subdir exists only on Path1 and not Path2 2024/05/06 06:08:21 (18) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ 2024/05/06 06:08:21 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:21 (19) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/ 2024/05/06 06:08:21 (20) : test 4.Run bisync WITH --create-empty-src-dirs 2024/05/06 06:08:21 (21) : bisync create-empty-src-dirs 2024/05/06 06:08:21 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:21 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:21 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:21 INFO : Path1 checking for diffs 2024/05/06 06:08:21 INFO : - Path1 File is new - subdir 2024/05/06 06:08:21 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:21 INFO : Path2 checking for diffs 2024/05/06 06:08:21 INFO : Applying changes 2024/05/06 06:08:21 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/subdir 2024/05/06 06:08:21 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:21 INFO : Updating listings 2024/05/06 06:08:21 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Bisync successful 2024/05/06 06:08:21 (22) : test 5. Confirm the subdir exists on both paths 2024/05/06 06:08:21 (23) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ 2024/05/06 06:08:21 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:21 (24) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/ 2024/05/06 06:08:21 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:21 (25) : test 6. Delete the empty dir on Path1 using purge-children (and also add files so the path isn't empty) 2024/05/06 06:08:21 (26) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ 2024/05/06 06:08:21 (27) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: file1.txt 2024/05/06 06:08:21 (28) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy1.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2024/05/06 06:08:21 (29) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy2.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2024/05/06 06:08:21 (30) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy3.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2024/05/06 06:08:21 (31) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy4.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2024/05/06 06:08:21 (32) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy5.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2024/05/06 06:08:21 (33) : test 7. Run bisync without --create-empty-src-dirs 2024/05/06 06:08:21 (34) : bisync 2024/05/06 06:08:21 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:21 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:21 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:21 INFO : Path1 checking for diffs 2024/05/06 06:08:21 INFO : - Path1 File was deleted - RCLONE_TEST 2024/05/06 06:08:21 INFO : - Path1 File was deleted - subdir 2024/05/06 06:08:21 INFO : Path1: 2 changes:  0 new,  0 modified,  2 deleted 2024/05/06 06:08:21 INFO : Path2 checking for diffs 2024/05/06 06:08:21 INFO : - Path2 File was deleted - subdir 2024/05/06 06:08:21 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:21 INFO : Applying changes 2024/05/06 06:08:21 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/RCLONE_TEST 2024/05/06 06:08:21 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:21 INFO : RCLONE_TEST: Deleted 2024/05/06 06:08:21 INFO : Updating listings 2024/05/06 06:08:21 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Bisync successful 2024/05/06 06:08:21 (35) : test 8. Confirm the subdir exists only on Path2 and not Path1 2024/05/06 06:08:21 (36) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ 2024/05/06 06:08:21 (37) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/ 2024/05/06 06:08:21 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:21 (38) : test 9. Reset, do the delete again, and run bisync WITH --create-empty-src-dirs 2024/05/06 06:08:21 (39) : bisync resync create-empty-src-dirs 2024/05/06 06:08:21 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:21 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:21 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Copying Path2 files to Path1 2024/05/06 06:08:21 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:21 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:21 INFO : Resync updating listings 2024/05/06 06:08:21 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Bisync successful 2024/05/06 06:08:21 (40) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ 2024/05/06 06:08:21 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:21 (41) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/ 2024/05/06 06:08:21 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:21 (42) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ 2024/05/06 06:08:21 (43) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: file1.txt 2024/05/06 06:08:21 (44) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy1.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: file1.copy1.txt 2024/05/06 06:08:21 (45) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy2.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: file1.copy2.txt 2024/05/06 06:08:21 (46) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy3.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: file1.copy3.txt 2024/05/06 06:08:21 (47) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy4.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: file1.copy4.txt 2024/05/06 06:08:21 (48) : copy-as /tmp/060813ko/datadir/test_createemptysrcdirs-yapucok5/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ file1.copy5.txt 2024/05/06 06:08:21 INFO : placeholder.txt: Copied (new) to: file1.copy5.txt 2024/05/06 06:08:21 (49) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ 2024/05/06 06:08:21 (50) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/ 2024/05/06 06:08:21 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:21 (51) : bisync create-empty-src-dirs 2024/05/06 06:08:21 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:21 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:21 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:21 INFO : Path1 checking for diffs 2024/05/06 06:08:21 INFO : - Path1 File was deleted - subdir 2024/05/06 06:08:21 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:21 INFO : Path2 checking for diffs 2024/05/06 06:08:21 INFO : Applying changes 2024/05/06 06:08:21 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/subdir 2024/05/06 06:08:21 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:21 INFO : subdir: Removing directory 2024/05/06 06:08:21 INFO : Updating listings 2024/05/06 06:08:21 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Bisync successful 2024/05/06 06:08:21 (52) : test 10. Confirm the subdir has been removed on both paths 2024/05/06 06:08:21 (53) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/ 2024/05/06 06:08:21 (54) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/ 2024/05/06 06:08:21 (55) : test 11. bisync again (because if we leave subdir in listings, test will fail due to mismatched modtime) 2024/05/06 06:08:21 (56) : bisync create-empty-src-dirs 2024/05/06 06:08:21 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:21 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:21 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:21 INFO : Path1 checking for diffs 2024/05/06 06:08:21 INFO : Path2 checking for diffs 2024/05/06 06:08:21 INFO : No changes found 2024/05/06 06:08:21 INFO : Updating listings 2024/05/06 06:08:21 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/createemptysrcdirs/path2/" 2024/05/06 06:08:21 INFO : Bisync successful bisync_test.go:555: TEST createemptysrcdirs PASSED === RUN TestBisyncRemoteRemote/dry_run 2024/05/06 06:08:21 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:21 DEBUG : path1: Making directory 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:21 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1" 2024/05/06 06:08:21 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:21 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:21 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:21 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:21 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:21 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:21 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1" 2024/05/06 06:08:21 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:21 DEBUG : path2: Making directory 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:21 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2" 2024/05/06 06:08:21 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:21 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:21 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:21 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:21 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:21 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:21 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2" 2024/05/06 06:08:21 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_dry_run-luzoyod3" 2024/05/06 06:08:21 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : Local file system at /tmp/060813ko/initdir/test_dry_run-luzoyod3: Waiting for checks to finish 2024/05/06 06:08:21 DEBUG : Local file system at /tmp/060813ko/initdir/test_dry_run-luzoyod3: Waiting for transfers to finish 2024/05/06 06:08:21 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:21 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:21 DEBUG : file1.txt.darapoz6.partial: renamed to: file1.txt 2024/05/06 06:08:21 INFO : file1.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : file2.txt.sicideh4.partial: renamed to: file2.txt 2024/05/06 06:08:21 INFO : file2.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:21 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:21 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:21 DEBUG : file3.txt.hobupen8.partial: renamed to: file3.txt 2024/05/06 06:08:21 INFO : file3.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : file4.txt.tuhotiy9.partial: renamed to: file4.txt 2024/05/06 06:08:21 INFO : file4.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : file5.txt.rocacoq6.partial: renamed to: file5.txt 2024/05/06 06:08:21 INFO : file5.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:21 DEBUG : file6.txt.qinapic9.partial: renamed to: file6.txt 2024/05/06 06:08:21 INFO : file6.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:21 DEBUG : file7.txt.lahajaj8.partial: renamed to: file7.txt 2024/05/06 06:08:21 INFO : file7.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:21 DEBUG : RCLONE_TEST.suceniv8.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:21 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:21 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_dry_run-judupik8" 2024/05/06 06:08:21 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : Local file system at /tmp/060813ko/datadir/test_dry_run-judupik8: Waiting for checks to finish 2024/05/06 06:08:21 DEBUG : Local file system at /tmp/060813ko/datadir/test_dry_run-judupik8: Waiting for transfers to finish 2024/05/06 06:08:21 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:21 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:21 DEBUG : file10.txt.guwepow8.partial: renamed to: file10.txt 2024/05/06 06:08:21 DEBUG : file1.txt.gobeham2.partial: renamed to: file1.txt 2024/05/06 06:08:21 INFO : file10.txt: Copied (new) 2024/05/06 06:08:21 INFO : file1.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:21 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:21 DEBUG : file11.txt.gadatah1.partial: renamed to: file11.txt 2024/05/06 06:08:21 INFO : file11.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : file2.txt.zowahol3.partial: renamed to: file2.txt 2024/05/06 06:08:21 INFO : file2.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:21 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:21 DEBUG : file5R.txt.nifijid6.partial: renamed to: file5R.txt 2024/05/06 06:08:21 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:21 DEBUG : file5L.txt.rijegab1.partial: renamed to: file5L.txt 2024/05/06 06:08:21 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : file7.txt.vabikar9.partial: renamed to: file7.txt 2024/05/06 06:08:21 INFO : file7.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:21 DEBUG : file6.txt.qozapag9.partial: renamed to: file6.txt 2024/05/06 06:08:21 INFO : file6.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1] 2024/05/06 06:08:21 ERROR : : error listing: directory not found 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2] 2024/05/06 06:08:21 ERROR : : error listing: directory not found 2024/05/06 06:08:21 checking initFs Local file system at /tmp/060813ko/initdir/test_dry_run-luzoyod3 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1] 2024/05/06 06:08:21 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/RCLONE_TEST] 2024/05/06 06:08:21 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: Waiting for checks to finish 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file1.txt] 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file2.txt] 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file3.txt] 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: Waiting for transfers to finish 2024/05/06 06:08:21 INFO : file1.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file4.txt] 2024/05/06 06:08:21 INFO : file2.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file5.txt] 2024/05/06 06:08:21 INFO : file3.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file6.txt] 2024/05/06 06:08:21 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file7.txt] 2024/05/06 06:08:21 INFO : file4.txt: Copied (new) 2024/05/06 06:08:21 INFO : file5.txt: Copied (new) 2024/05/06 06:08:21 INFO : file6.txt: Copied (new) 2024/05/06 06:08:21 INFO : file7.txt: Copied (new) 2024/05/06 06:08:21 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1] 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2] 2024/05/06 06:08:21 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: Waiting for checks to finish 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/RCLONE_TEST] 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file1.txt] 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: Waiting for transfers to finish 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file3.txt] 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file2.txt] 2024/05/06 06:08:21 INFO : file1.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file4.txt] 2024/05/06 06:08:21 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file5.txt] 2024/05/06 06:08:21 INFO : file3.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file6.txt] 2024/05/06 06:08:21 INFO : file2.txt: Copied (new) 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file7.txt] 2024/05/06 06:08:21 INFO : file4.txt: Copied (new) 2024/05/06 06:08:21 INFO : file5.txt: Copied (new) 2024/05/06 06:08:21 INFO : file6.txt: Copied (new) 2024/05/06 06:08:21 INFO : file7.txt: Copied (new) 2024/05/06 06:08:21 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2 2024/05/06 06:08:21 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2] 2024/05/06 06:08:21 (01) : test dry-run 2024/05/06 06:08:21 (02) : test initial bisync 2024/05/06 06:08:21 (03) : bisync resync 2024/05/06 06:08:21 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:21 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:21 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/" 2024/05/06 06:08:21 INFO : Copying Path2 files to Path1 2024/05/06 06:08:21 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:21 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:21 INFO : Resync updating listings 2024/05/06 06:08:21 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/" 2024/05/06 06:08:21 INFO : Bisync successful 2024/05/06 06:08:21 (04) : test new on path2 - file10 2024/05/06 06:08:21 (05) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_dry_run-judupik8/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/ 2024/05/06 06:08:21 INFO : file10.txt: Copied (new) 2024/05/06 06:08:21 (06) : test newer on path2 - file1 2024/05/06 06:08:21 (07) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_dry_run-judupik8/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/ 2024/05/06 06:08:21 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:21 (08) : test new on path1 - file11 2024/05/06 06:08:21 (09) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_dry_run-judupik8/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/ 2024/05/06 06:08:21 INFO : file11.txt: Copied (new) 2024/05/06 06:08:21 (10) : test newer on path1 - file2 2024/05/06 06:08:21 (11) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_dry_run-judupik8/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/ 2024/05/06 06:08:21 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:21 (12) : test deleted on path2 - file3 2024/05/06 06:08:21 (13) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file3.txt 2024/05/06 06:08:21 INFO : file3.txt: Deleted 2024/05/06 06:08:21 (14) : test deleted on path1 - file4 2024/05/06 06:08:21 (15) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file4.txt 2024/05/06 06:08:21 INFO : file4.txt: Deleted 2024/05/06 06:08:21 (16) : test changed on path2 and on path1 - file5 (file5R, file5L) 2024/05/06 06:08:21 (17) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_dry_run-judupik8/ file5R.txt 2024/05/06 06:08:21 (18) : copy-as /tmp/060813ko/datadir/test_dry_run-judupik8/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/ file5.txt 2024/05/06 06:08:21 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:21 (19) : touch-glob 2001-03-04 /tmp/060813ko/datadir/test_dry_run-judupik8/ file5L.txt 2024/05/06 06:08:21 (20) : copy-as /tmp/060813ko/datadir/test_dry_run-judupik8/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/ file5.txt 2024/05/06 06:08:21 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:21 (21) : test newer on path2 and deleted on path1 - file6 2024/05/06 06:08:21 (22) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_dry_run-judupik8/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/ 2024/05/06 06:08:21 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:08:21 (23) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file6.txt 2024/05/06 06:08:21 INFO : file6.txt: Deleted 2024/05/06 06:08:21 (24) : test newer on path1 and deleted on path2 - file7 2024/05/06 06:08:21 (25) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_dry_run-judupik8/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/ 2024/05/06 06:08:21 INFO : file7.txt: Copied (replaced existing) 2024/05/06 06:08:21 (26) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file7.txt 2024/05/06 06:08:21 INFO : file7.txt: Deleted 2024/05/06 06:08:21 (27) : test sync with dry-run and resync 2024/05/06 06:08:21 (28) : bisync dry-run resync 2024/05/06 06:08:22 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:22 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:22 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/" 2024/05/06 06:08:22 INFO : Copying Path2 files to Path1 2024/05/06 06:08:22 NOTICE: - Path2 Resync is copying files to - Path1 2024/05/06 06:08:22 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:22 NOTICE: file4.txt: Skipped copy as --dry-run is set (size 0) 2024/05/06 06:08:22 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:22 NOTICE: - Path1 Resync is copying files to - Path2 2024/05/06 06:08:22 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:22 NOTICE: file3.txt: Skipped copy as --dry-run is set (size 0) 2024/05/06 06:08:22 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:22 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 0) 2024/05/06 06:08:22 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13) 2024/05/06 06:08:22 NOTICE: file5.txt: Skipped copy as --dry-run is set (size 39) 2024/05/06 06:08:22 INFO : Resync updating listings 2024/05/06 06:08:22 INFO : Bisync successful 2024/05/06 06:08:22 (29) : copy-listings dryrun-resync 2024/05/06 06:08:22 (30) : test sync with dry-run 2024/05/06 06:08:22 (31) : bisync dry-run 2024/05/06 06:08:22 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:22 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:22 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/" 2024/05/06 06:08:22 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:22 INFO : Path1 checking for diffs 2024/05/06 06:08:22 NOTICE: - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:22 NOTICE: - Path1 File was deleted - file4.txt 2024/05/06 06:08:22 NOTICE: - Path1 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:08:22 NOTICE: - Path1 File was deleted - file6.txt 2024/05/06 06:08:22 NOTICE: - Path1 File changed: size (larger), time (newer) - file7.txt 2024/05/06 06:08:22 NOTICE: - Path1 File is new - file11.txt 2024/05/06 06:08:22 INFO : Path1: 6 changes:  1 new,  3 modified,  2 deleted 2024/05/06 06:08:22 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:08:22 INFO : Path2 checking for diffs 2024/05/06 06:08:22 NOTICE: - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:22 NOTICE: - Path2 File was deleted - file3.txt 2024/05/06 06:08:22 NOTICE: - Path2 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:08:22 NOTICE: - Path2 File changed: size (larger), time (newer) - file6.txt 2024/05/06 06:08:22 NOTICE: - Path2 File was deleted - file7.txt 2024/05/06 06:08:22 NOTICE: - Path2 File is new - file10.txt 2024/05/06 06:08:22 INFO : Path2: 6 changes:  1 new,  3 modified,  2 deleted 2024/05/06 06:08:22 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:08:22 INFO : Applying changes 2024/05/06 06:08:22 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:22 INFO : Checking potential conflicts... 2024/05/06 06:08:22 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: 1 differences found 2024/05/06 06:08:22 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: 1 errors while checking 2024/05/06 06:08:22 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:22 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file11.txt 2024/05/06 06:08:22 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file2.txt 2024/05/06 06:08:22 NOTICE: - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file4.txt 2024/05/06 06:08:22 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:08:22 NOTICE: file5.txt: Skipped rename as --dry-run is set 2024/05/06 06:08:22 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file5.txt.conflict1 2024/05/06 06:08:22 NOTICE: file5.txt: Skipped rename as --dry-run is set 2024/05/06 06:08:22 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file5.txt.conflict2 2024/05/06 06:08:22 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file6.txt 2024/05/06 06:08:22 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file7.txt 2024/05/06 06:08:22 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file1.txt 2024/05/06 06:08:22 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file10.txt 2024/05/06 06:08:22 NOTICE: - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file3.txt 2024/05/06 06:08:22 NOTICE: - Path2 Do queued copies to - Path1 2024/05/06 06:08:22 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:22 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:22 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:22 NOTICE: file3.txt: Skipped delete as --dry-run is set (size 0) 2024/05/06 06:08:22 NOTICE: - Path1 Do queued copies to - Path2 2024/05/06 06:08:22 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:22 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19) 2024/05/06 06:08:22 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13) 2024/05/06 06:08:22 NOTICE: file4.txt: Skipped delete as --dry-run is set (size 0) 2024/05/06 06:08:22 INFO : Updating listings 2024/05/06 06:08:22 INFO : Bisync successful 2024/05/06 06:08:22 (32) : copy-listings dryrun 2024/05/06 06:08:22 (33) : test sync without dry-run 2024/05/06 06:08:22 (34) : bisync 2024/05/06 06:08:22 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:22 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:22 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/" 2024/05/06 06:08:22 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:22 INFO : Path1 checking for diffs 2024/05/06 06:08:22 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:22 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:08:22 INFO : - Path1 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:08:22 INFO : - Path1 File was deleted - file6.txt 2024/05/06 06:08:22 INFO : - Path1 File changed: size (larger), time (newer) - file7.txt 2024/05/06 06:08:22 INFO : - Path1 File is new - file11.txt 2024/05/06 06:08:22 INFO : Path1: 6 changes:  1 new,  3 modified,  2 deleted 2024/05/06 06:08:22 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:08:22 INFO : Path2 checking for diffs 2024/05/06 06:08:22 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:22 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:08:22 INFO : - Path2 File changed: size (larger), time (newer) - file5.txt 2024/05/06 06:08:22 INFO : - Path2 File changed: size (larger), time (newer) - file6.txt 2024/05/06 06:08:22 INFO : - Path2 File was deleted - file7.txt 2024/05/06 06:08:22 INFO : - Path2 File is new - file10.txt 2024/05/06 06:08:22 INFO : Path2: 6 changes:  1 new,  3 modified,  2 deleted 2024/05/06 06:08:22 INFO : (Modified:  3 newer,  0 older,  3 larger,  0 smaller) 2024/05/06 06:08:22 INFO : Applying changes 2024/05/06 06:08:22 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:22 INFO : Checking potential conflicts... 2024/05/06 06:08:22 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: 1 differences found 2024/05/06 06:08:22 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2: 1 errors while checking 2024/05/06 06:08:22 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:22 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file11.txt 2024/05/06 06:08:22 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file2.txt 2024/05/06 06:08:22 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file4.txt 2024/05/06 06:08:22 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:08:22 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file5.txt.conflict1 2024/05/06 06:08:22 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/05/06 06:08:22 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file5.txt.conflict1 2024/05/06 06:08:22 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file5.txt.conflict2 2024/05/06 06:08:22 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/05/06 06:08:22 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file5.txt.conflict2 2024/05/06 06:08:22 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file6.txt 2024/05/06 06:08:22 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/file7.txt 2024/05/06 06:08:22 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file1.txt 2024/05/06 06:08:22 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file10.txt 2024/05/06 06:08:22 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/file3.txt 2024/05/06 06:08:22 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:22 INFO : file10.txt: Copied (new) 2024/05/06 06:08:22 INFO : file5.txt.conflict2: Copied (new) 2024/05/06 06:08:22 INFO : file6.txt: Copied (new) 2024/05/06 06:08:22 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:22 INFO : file3.txt: Deleted 2024/05/06 06:08:22 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:22 INFO : file11.txt: Copied (new) 2024/05/06 06:08:22 INFO : file5.txt.conflict1: Copied (new) 2024/05/06 06:08:22 INFO : file7.txt: Copied (new) 2024/05/06 06:08:22 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:22 INFO : file4.txt: Deleted 2024/05/06 06:08:22 INFO : Updating listings 2024/05/06 06:08:22 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/dry_run/path2/" 2024/05/06 06:08:22 INFO : Bisync successful bisync_test.go:555: TEST dry_run PASSED === RUN TestBisyncRemoteRemote/equal 2024/05/06 06:08:22 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:22 DEBUG : path1: Making directory 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:22 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1" 2024/05/06 06:08:22 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:22 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:22 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:22 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:22 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:22 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:22 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1" 2024/05/06 06:08:22 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:22 DEBUG : path2: Making directory 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:22 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2" 2024/05/06 06:08:22 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:22 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:22 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:22 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:22 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:22 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:22 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2" 2024/05/06 06:08:22 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_equal-konalet1" 2024/05/06 06:08:22 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : Local file system at /tmp/060813ko/initdir/test_equal-konalet1: Waiting for checks to finish 2024/05/06 06:08:22 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:22 DEBUG : Local file system at /tmp/060813ko/initdir/test_equal-konalet1: Waiting for transfers to finish 2024/05/06 06:08:22 DEBUG : file1.txt.vajihim3.partial: renamed to: file1.txt 2024/05/06 06:08:22 INFO : file1.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:22 DEBUG : file2.txt.gozesiz2.partial: renamed to: file2.txt 2024/05/06 06:08:22 INFO : file2.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:22 DEBUG : RCLONE_TEST.firetaw2.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:22 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:22 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_equal-huyadeb1" 2024/05/06 06:08:22 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : Local file system at /tmp/060813ko/datadir/test_equal-huyadeb1: Waiting for checks to finish 2024/05/06 06:08:22 DEBUG : Local file system at /tmp/060813ko/datadir/test_equal-huyadeb1: Waiting for transfers to finish 2024/05/06 06:08:22 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/05/06 06:08:22 DEBUG : file1L.txt.vugakoh7.partial: renamed to: file1L.txt 2024/05/06 06:08:22 INFO : file1L.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK 2024/05/06 06:08:22 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/05/06 06:08:22 DEBUG : file1R.txt.titarox9.partial: renamed to: file1R.txt 2024/05/06 06:08:22 INFO : file1R.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : file2.txt.jetoden5.partial: renamed to: file2.txt 2024/05/06 06:08:22 INFO : file2.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1] 2024/05/06 06:08:22 ERROR : : error listing: directory not found 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2] 2024/05/06 06:08:22 ERROR : : error listing: directory not found 2024/05/06 06:08:22 checking initFs Local file system at /tmp/060813ko/initdir/test_equal-konalet1 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1] 2024/05/06 06:08:22 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1/RCLONE_TEST] 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1: Waiting for checks to finish 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1/file1.txt] 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1: Waiting for transfers to finish 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1/file2.txt] 2024/05/06 06:08:22 INFO : file1.txt: Copied (new) 2024/05/06 06:08:22 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:22 INFO : file2.txt: Copied (new) 2024/05/06 06:08:22 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1] 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2] 2024/05/06 06:08:22 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2/RCLONE_TEST] 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2/file1.txt] 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2: Waiting for checks to finish 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2/file2.txt] 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2: Waiting for transfers to finish 2024/05/06 06:08:22 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:22 INFO : file1.txt: Copied (new) 2024/05/06 06:08:22 INFO : file2.txt: Copied (new) 2024/05/06 06:08:22 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2] 2024/05/06 06:08:22 (01) : test equal 2024/05/06 06:08:22 (02) : test initial bisync 2024/05/06 06:08:22 (03) : bisync resync 2024/05/06 06:08:22 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:22 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:22 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2/" 2024/05/06 06:08:22 INFO : Copying Path2 files to Path1 2024/05/06 06:08:22 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:22 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:22 INFO : Resync updating listings 2024/05/06 06:08:22 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2/" 2024/05/06 06:08:22 INFO : Bisync successful 2024/05/06 06:08:22 (04) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:22 (05) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_equal-huyadeb1/ file1R.txt 2024/05/06 06:08:22 (06) : copy-as /tmp/060813ko/datadir/test_equal-huyadeb1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2/ file1.txt 2024/05/06 06:08:22 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:22 (07) : touch-glob 2001-03-04 /tmp/060813ko/datadir/test_equal-huyadeb1/ file1L.txt 2024/05/06 06:08:22 (08) : copy-as /tmp/060813ko/datadir/test_equal-huyadeb1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1/ file1.txt 2024/05/06 06:08:22 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:22 (09) : test changed on both paths and identical - file2 2024/05/06 06:08:22 (10) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_equal-huyadeb1/ file2.txt 2024/05/06 06:08:22 (11) : copy-as /tmp/060813ko/datadir/test_equal-huyadeb1/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1/ file2.txt 2024/05/06 06:08:22 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:22 (12) : copy-as /tmp/060813ko/datadir/test_equal-huyadeb1/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2/ file2.txt 2024/05/06 06:08:22 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:22 (13) : test bisync run 2024/05/06 06:08:22 (14) : bisync 2024/05/06 06:08:22 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:22 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:22 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2/" 2024/05/06 06:08:22 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:22 INFO : Path1 checking for diffs 2024/05/06 06:08:22 INFO : - Path1 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:22 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:22 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:08:22 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/05/06 06:08:22 INFO : Path2 checking for diffs 2024/05/06 06:08:22 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:22 INFO : - Path2 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:22 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:08:22 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/05/06 06:08:22 INFO : Applying changes 2024/05/06 06:08:22 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:22 INFO : Checking potential conflicts... 2024/05/06 06:08:22 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2: 1 differences found 2024/05/06 06:08:22 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2: 1 errors while checking 2024/05/06 06:08:22 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2: 1 matching files 2024/05/06 06:08:22 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:22 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:22 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1/file1.txt.conflict1 2024/05/06 06:08:22 INFO : file1.txt: Moved (server-side) to: file1.txt.conflict1 2024/05/06 06:08:22 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2/file1.txt.conflict1 2024/05/06 06:08:22 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2/file1.txt.conflict2 2024/05/06 06:08:22 INFO : file1.txt: Moved (server-side) to: file1.txt.conflict2 2024/05/06 06:08:22 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1/file1.txt.conflict2 2024/05/06 06:08:22 NOTICE: - WARNING New or changed in both paths - file2.txt 2024/05/06 06:08:22 INFO : Files are equal! Skipping: file2.txt 2024/05/06 06:08:22 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:22 INFO : file1.txt.conflict2: Copied (new) 2024/05/06 06:08:22 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:22 INFO : file1.txt.conflict1: Copied (new) 2024/05/06 06:08:22 INFO : Updating listings 2024/05/06 06:08:22 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:22 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:22 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/equal/path2/" 2024/05/06 06:08:22 INFO : Bisync successful bisync_test.go:555: TEST equal PASSED === RUN TestBisyncRemoteRemote/ext_paths 2024/05/06 06:08:22 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:22 DEBUG : path1: Making directory 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:22 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1" 2024/05/06 06:08:22 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:22 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:22 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:22 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:22 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:22 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:22 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1" 2024/05/06 06:08:22 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:22 DEBUG : path2: Making directory 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:22 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2" 2024/05/06 06:08:22 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:22 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:22 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:22 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:22 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:22 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:22 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2" 2024/05/06 06:08:22 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_ext_paths-lenuror0" 2024/05/06 06:08:22 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ: Making directory with metadata 2024/05/06 06:08:22 INFO : 測試РуÑÑкий ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z) 2024/05/06 06:08:22 DEBUG : Added delayed dir = "測試РуÑÑкий ěáñ", newDst=測試РуÑÑкий ěáñ 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : Local file system at /tmp/060813ko/initdir/test_ext_paths-lenuror0: Waiting for checks to finish 2024/05/06 06:08:22 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:22 DEBUG : Local file system at /tmp/060813ko/initdir/test_ext_paths-lenuror0: Waiting for transfers to finish 2024/05/06 06:08:22 DEBUG : file_enconde_mañana_funcionará.txt.qugufon5.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/05/06 06:08:22 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:22 DEBUG : file1.txt.cucomag3.partial: renamed to: file1.txt 2024/05/06 06:08:22 INFO : file1.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:22 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:22 DEBUG : RCLONE_TEST.fiwiwok6.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:22 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:22 DEBUG : РуÑÑкий.txt.rapirud9.partial: renamed to: РуÑÑкий.txt 2024/05/06 06:08:22 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:22 DEBUG : 測試_check file.hodayif3.partial: renamed to: 測試_check file 2024/05/06 06:08:22 INFO : 測試_check file: Copied (new) 2024/05/06 06:08:22 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:22 DEBUG : filename_contains_ࢺ_.txt.qahopex3.partial: renamed to: filename_contains_ࢺ_.txt 2024/05/06 06:08:22 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ/測試_check file.vomajel6.partial: renamed to: 測試РуÑÑкий ěáñ/測試_check file 2024/05/06 06:08:22 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:22 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:22 DEBUG : filename_contains_Ä›_.txt.gewujup2.partial: renamed to: filename_contains_Ä›_.txt 2024/05/06 06:08:22 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt.qosubad8.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt 2024/05/06 06:08:22 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt.vapaneb6.partial: renamed to: 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt 2024/05/06 06:08:22 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:22 INFO : 測試РуÑÑкий ěáñ: Updated directory metadata 2024/05/06 06:08:22 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_ext_paths-xaruguk4" 2024/05/06 06:08:22 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : Local file system at /tmp/060813ko/datadir/test_ext_paths-xaruguk4: Waiting for checks to finish 2024/05/06 06:08:22 DEBUG : Local file system at /tmp/060813ko/datadir/test_ext_paths-xaruguk4: Waiting for transfers to finish 2024/05/06 06:08:22 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/05/06 06:08:22 DEBUG : 測試_filtersfile.txt.hakakug5.partial: renamed to: 測試_filtersfile.txt 2024/05/06 06:08:22 INFO : 測試_filtersfile.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:22 DEBUG : file1.txt.fogexix0.partial: renamed to: file1.txt 2024/05/06 06:08:22 INFO : file1.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1] 2024/05/06 06:08:22 ERROR : : error listing: directory not found 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2] 2024/05/06 06:08:22 ERROR : : error listing: directory not found 2024/05/06 06:08:22 checking initFs Local file system at /tmp/060813ko/initdir/test_ext_paths-lenuror0 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1] 2024/05/06 06:08:22 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ: Making directory 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ] 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/RCLONE_TEST] 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/file1.txt] 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/file_enconde_mañana_funcionará.txt] 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/filename_contains_Ä›_.txt] 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: Waiting for checks to finish 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: Waiting for transfers to finish 2024/05/06 06:08:22 INFO : file1.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/filename_contains_ࢺ_.txt] 2024/05/06 06:08:22 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/РуÑÑкий.txt] 2024/05/06 06:08:22 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試_check file] 2024/05/06 06:08:22 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt] 2024/05/06 06:08:22 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:22 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt] 2024/05/06 06:08:23 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ/測試_check file] 2024/05/06 06:08:23 INFO : 測試_check file: Copied (new) 2024/05/06 06:08:23 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:23 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:23 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/05/06 06:08:23 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1] 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ] 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2] 2024/05/06 06:08:23 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : 測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : 測試РуÑÑкий ěáñ: Making directory 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ] 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/RCLONE_TEST] 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/file_enconde_mañana_funcionará.txt] 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/file1.txt] 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/filename_contains_Ä›_.txt] 2024/05/06 06:08:23 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : 測試РуÑÑкий ěáñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: Waiting for checks to finish 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: Waiting for transfers to finish 2024/05/06 06:08:23 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/filename_contains_ࢺ_.txt] 2024/05/06 06:08:23 INFO : file1.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/РуÑÑкий.txt] 2024/05/06 06:08:23 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試_check file] 2024/05/06 06:08:23 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt] 2024/05/06 06:08:23 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt] 2024/05/06 06:08:23 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ/測試_check file] 2024/05/06 06:08:23 INFO : 測試_check file: Copied (new) 2024/05/06 06:08:23 INFO : 測試РуÑÑкий ěáñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:23 INFO : 測試РуÑÑкий ěáñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:23 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/05/06 06:08:23 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2] 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ] 2024/05/06 06:08:23 (01) : test extended-char-paths 2024/05/06 06:08:23 (02) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/ 2024/05/06 06:08:23 ERROR : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-mulijot5: Server side directory move failed: rename /rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий eÌŒaÌñ: file does not exist 2024/05/06 06:08:23 INFO : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ/: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2024/05/06 06:08:23 ERROR : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ-rclone-move-mulijot5: error reading source root directory: directory not found 2024/05/06 06:08:23 (03) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/ 2024/05/06 06:08:23 ERROR : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-xawugam0: Server side directory move failed: rename /rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий eÌŒaÌñ: file does not exist 2024/05/06 06:08:23 INFO : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ/: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2024/05/06 06:08:23 ERROR : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ-rclone-move-xawugam0: error reading source root directory: directory not found 2024/05/06 06:08:23 (04) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:08:23 (05) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:08:23 (06) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/filename_contains_Ä›_.txt 2024/05/06 06:08:23 (07) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/filename_contains_Ä›_.txt 2024/05/06 06:08:23 (08) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試_check{spc}file 2024/05/06 06:08:23 (09) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試_check{spc}file 2024/05/06 06:08:23 (10) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:08:23 (11) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:08:23 (12) : test resync subdirs with extended chars 2024/05/06 06:08:23 (13) : bisync subdir=測試РуÑÑкий{spc}{spc}ěáñ resync 2024/05/06 06:08:23 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:23 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:23 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/05/06 06:08:23 INFO : Copying Path2 files to Path1 2024/05/06 06:08:23 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:23 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:23 INFO : Resync updating listings 2024/05/06 06:08:23 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/05/06 06:08:23 INFO : Bisync successful 2024/05/06 06:08:23 (14) : copy-listings resync 2024/05/06 06:08:23 (15) : test place new files with extended chars on each side 2024/05/06 06:08:23 (16) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_ext_paths-xaruguk4/ file1.txt 2024/05/06 06:08:23 (17) : copy-as /tmp/060813ko/datadir/test_ext_paths-xaruguk4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ 測試_file1p1 2024/05/06 06:08:23 INFO : file1.txt: Copied (new) to: 測試_file1p1 2024/05/06 06:08:23 (18) : copy-as /tmp/060813ko/datadir/test_ext_paths-xaruguk4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий{spc}{spc}ěáñ 測試_file1p2 2024/05/06 06:08:23 INFO : file1.txt: Copied (new) to: 測試_file1p2 2024/05/06 06:08:23 (19) : test normal sync of subdirs with extended chars 2024/05/06 06:08:23 (20) : bisync subdir=測試РуÑÑкий{spc}{spc}ěáñ 2024/05/06 06:08:23 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:23 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:23 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/05/06 06:08:23 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:23 INFO : Path1 checking for diffs 2024/05/06 06:08:23 INFO : - Path1 File is new - 測試_file1p1 2024/05/06 06:08:23 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:23 INFO : Path2 checking for diffs 2024/05/06 06:08:23 INFO : - Path2 File is new - 測試_file1p2 2024/05/06 06:08:23 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:23 INFO : Applying changes 2024/05/06 06:08:23 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ/測試_file1p1 2024/05/06 06:08:23 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ/測試_file1p2 2024/05/06 06:08:23 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:23 INFO : 測試_file1p2: Copied (new) 2024/05/06 06:08:23 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:23 INFO : 測試_file1p1: Copied (new) 2024/05/06 06:08:23 INFO : Updating listings 2024/05/06 06:08:23 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий ěáñ/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/測試РуÑÑкий ěáñ/" 2024/05/06 06:08:23 INFO : Bisync successful 2024/05/06 06:08:23 (21) : move-listings normal-sync 2024/05/06 06:08:23 (22) : test check-filename with extended chars. check should fail. 2024/05/06 06:08:23 (23) : bisync resync 2024/05/06 06:08:23 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:23 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:23 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/" 2024/05/06 06:08:23 INFO : Copying Path2 files to Path1 2024/05/06 06:08:23 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:23 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:23 INFO : Resync updating listings 2024/05/06 06:08:23 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/" 2024/05/06 06:08:23 INFO : Bisync successful 2024/05/06 06:08:23 (24) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/測試РуÑÑкий{spc}{spc}ěáñ/測試_check{spc}file 2024/05/06 06:08:23 INFO : 測試_check file: Deleted 2024/05/06 06:08:23 (25) : bisync check-access check-filename=測試_check{spc}file 2024/05/06 06:08:23 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:23 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:23 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/" 2024/05/06 06:08:23 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:23 INFO : Path1 checking for diffs 2024/05/06 06:08:23 INFO : - Path1 File was deleted - 測試РуÑÑкий ěáñ/測試_check file 2024/05/06 06:08:23 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:23 INFO : Path2 checking for diffs 2024/05/06 06:08:23 INFO : Checking access health 2024/05/06 06:08:23 ERROR : Access test failed: Path1 count 1, Path2 count 2 - 測試_check file 2024/05/06 06:08:23 ERROR : -  Access test failed: Path2 file not found in Path1 - 測試РуÑÑкий ěáñ/測試_check file 2024/05/06 06:08:23 ERROR : Bisync critical error: check file check failed 2024/05/06 06:08:23 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:23 Bisync error: bisync aborted 2024/05/06 06:08:23 (26) : copy-listings check-access-fail 2024/05/06 06:08:23 (27) : test check-filename with extended chars. check should pass. 2024/05/06 06:08:23 (28) : bisync resync 2024/05/06 06:08:23 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:23 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:23 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/" 2024/05/06 06:08:23 INFO : Copying Path2 files to Path1 2024/05/06 06:08:23 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:23 INFO : 測試РуÑÑкий ěáñ/測試_check file: Copied (new) 2024/05/06 06:08:23 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:23 INFO : Resync updating listings 2024/05/06 06:08:23 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/" 2024/05/06 06:08:23 INFO : Bisync successful 2024/05/06 06:08:23 (29) : bisync check-access check-filename=測試_check{spc}file 2024/05/06 06:08:23 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:23 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:23 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/" 2024/05/06 06:08:23 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:23 INFO : Path1 checking for diffs 2024/05/06 06:08:23 INFO : Path2 checking for diffs 2024/05/06 06:08:23 INFO : Checking access health 2024/05/06 06:08:23 INFO : Found 2 matching "測試_check file" files on both paths 2024/05/06 06:08:23 INFO : No changes found 2024/05/06 06:08:23 INFO : Updating listings 2024/05/06 06:08:23 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/" 2024/05/06 06:08:23 INFO : Bisync successful 2024/05/06 06:08:23 (30) : move-listings check-access-pass 2024/05/06 06:08:23 (31) : test filters-file path with extended chars - masks /fileZ.txt 2024/05/06 06:08:23 (32) : copy-file /tmp/060813ko/datadir/test_ext_paths-xaruguk4/測試_filtersfile.txt /tmp/060813ko/workdir/ 2024/05/06 06:08:23 INFO : 測試_filtersfile.txt: Copied (new) 2024/05/06 06:08:23 (33) : bisync filters-file=/tmp/060813ko/workdir/測試_filtersfile.txt resync 2024/05/06 06:08:23 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:23 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:23 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/" 2024/05/06 06:08:23 INFO : Using filters file /tmp/060813ko/workdir/測試_filtersfile.txt 2024/05/06 06:08:23 INFO : Storing filters file hash to /tmp/060813ko/workdir/測試_filtersfile.txt.md5 2024/05/06 06:08:23 INFO : Copying Path2 files to Path1 2024/05/06 06:08:23 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:23 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:23 INFO : Resync updating listings 2024/05/06 06:08:23 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/" 2024/05/06 06:08:23 INFO : Bisync successful 2024/05/06 06:08:23 (34) : copy-as /tmp/060813ko/datadir/test_ext_paths-xaruguk4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/ fileZ.txt 2024/05/06 06:08:23 INFO : file1.txt: Copied (new) to: fileZ.txt 2024/05/06 06:08:23 (35) : bisync filters-file=/tmp/060813ko/workdir/測試_filtersfile.txt 2024/05/06 06:08:23 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:23 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:23 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/" 2024/05/06 06:08:23 INFO : Using filters file /tmp/060813ko/workdir/測試_filtersfile.txt 2024/05/06 06:08:23 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:23 INFO : Path1 checking for diffs 2024/05/06 06:08:23 INFO : Path2 checking for diffs 2024/05/06 06:08:23 INFO : No changes found 2024/05/06 06:08:23 INFO : Updating listings 2024/05/06 06:08:23 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ext_paths/path2/" 2024/05/06 06:08:23 INFO : Bisync successful bisync_test.go:555: TEST ext_paths PASSED === RUN TestBisyncRemoteRemote/extended_filenames 2024/05/06 06:08:23 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:23 DEBUG : path1: Making directory 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:23 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1" 2024/05/06 06:08:23 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:23 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:23 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:23 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:23 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:23 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:23 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1" 2024/05/06 06:08:23 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:23 DEBUG : path2: Making directory 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:23 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2" 2024/05/06 06:08:23 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:23 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:23 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:23 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:23 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:23 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:23 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2" 2024/05/06 06:08:23 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_extended_filenames-bumiliz3" 2024/05/06 06:08:23 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : subdir_with_ࢺ_: Making directory with metadata 2024/05/06 06:08:23 INFO : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:23 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_ 2024/05/06 06:08:23 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : Local file system at /tmp/060813ko/initdir/test_extended_filenames-bumiliz3: Waiting for checks to finish 2024/05/06 06:08:23 DEBUG : Local file system at /tmp/060813ko/initdir/test_extended_filenames-bumiliz3: Waiting for transfers to finish 2024/05/06 06:08:23 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:23 DEBUG : file1 - Copy (2).txt.cabafod3.partial: renamed to: file1 - Copy (2).txt 2024/05/06 06:08:23 INFO : file1 - Copy (2).txt: Copied (new) 2024/05/06 06:08:23 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:23 DEBUG : file1 - Copy.txt.nudaxuq7.partial: renamed to: file1 - Copy.txt 2024/05/06 06:08:23 INFO : file1 - Copy.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:23 DEBUG : file1.txt.samesij6.partial: renamed to: file1.txt 2024/05/06 06:08:23 INFO : file1.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:23 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:23 DEBUG : file_enconde_mañana_funcionará.txt.pugafiy9.partial: renamed to: file_enconde_mañana_funcionará.txt 2024/05/06 06:08:23 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : RCLONE_TEST.pavigam0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:23 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:23 DEBUG : РуÑÑкий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:23 DEBUG : РуÑÑкий.txt.xaleraj0.partial: renamed to: РуÑÑкий.txt 2024/05/06 06:08:23 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:23 DEBUG : filename_contains_ࢺ_.txt.tefezed0.partial: renamed to: filename_contains_ࢺ_.txt 2024/05/06 06:08:23 DEBUG : filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:23 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : filename_contains_Ä›_.txt.wexidob8.partial: renamed to: filename_contains_Ä›_.txt 2024/05/06 06:08:23 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:23 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt.kijodag0.partial: renamed to: subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:08:23 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:23 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.culinuj4.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt 2024/05/06 06:08:23 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:23 INFO : subdir_with_ࢺ_: Updated directory metadata 2024/05/06 06:08:23 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_extended_filenames-hogokuv4" 2024/05/06 06:08:23 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : Local file system at /tmp/060813ko/datadir/test_extended_filenames-hogokuv4: Waiting for checks to finish 2024/05/06 06:08:23 DEBUG : Local file system at /tmp/060813ko/datadir/test_extended_filenames-hogokuv4: Waiting for transfers to finish 2024/05/06 06:08:23 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:23 DEBUG : file2.txt: md5 = 40b811fb5009223b6da573f169619d8e OK 2024/05/06 06:08:23 DEBUG : file1.txt.fujenin9.partial: renamed to: file1.txt 2024/05/06 06:08:23 INFO : file1.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : file2.txt.qoxotug0.partial: renamed to: file2.txt 2024/05/06 06:08:23 INFO : file2.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1] 2024/05/06 06:08:23 ERROR : : error listing: directory not found 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2] 2024/05/06 06:08:23 ERROR : : error listing: directory not found 2024/05/06 06:08:23 checking initFs Local file system at /tmp/060813ko/initdir/test_extended_filenames-bumiliz3 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1] 2024/05/06 06:08:23 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : subdir_with_ࢺ_: Making directory 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_] 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/RCLONE_TEST] 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/file1 - Copy.txt] 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/file1 - Copy (2).txt] 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/file1.txt] 2024/05/06 06:08:23 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: Waiting for checks to finish 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: Waiting for transfers to finish 2024/05/06 06:08:23 INFO : file1 - Copy.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/file_enconde_mañana_funcionará.txt] 2024/05/06 06:08:23 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/filename_contains_Ä›_.txt] 2024/05/06 06:08:23 INFO : file1 - Copy (2).txt: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/filename_contains_ࢺ_.txt] 2024/05/06 06:08:23 INFO : file1.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/РуÑÑкий.txt] 2024/05/06 06:08:23 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_Ä›_.txt] 2024/05/06 06:08:23 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:23 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ࢺ_.txt] 2024/05/06 06:08:23 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:23 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:23 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:24 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:24 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1] 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_] 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2] 2024/05/06 06:08:24 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : subdir_with_ࢺ_: Making directory 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_] 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/RCLONE_TEST] 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/file1 - Copy.txt] 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/file1 - Copy (2).txt] 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/file1.txt] 2024/05/06 06:08:24 DEBUG : РуÑÑкий.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: Waiting for checks to finish 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: Waiting for transfers to finish 2024/05/06 06:08:24 INFO : file1 - Copy.txt: Copied (new) 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/file_enconde_mañana_funcionará.txt] 2024/05/06 06:08:24 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/filename_contains_Ä›_.txt] 2024/05/06 06:08:24 INFO : file1 - Copy (2).txt: Copied (new) 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/filename_contains_ࢺ_.txt] 2024/05/06 06:08:24 INFO : file1.txt: Copied (new) 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/РуÑÑкий.txt] 2024/05/06 06:08:24 INFO : file_enconde_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_Ä›_.txt] 2024/05/06 06:08:24 INFO : filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ࢺ_.txt] 2024/05/06 06:08:24 INFO : filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:24 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:24 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:24 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:24 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2] 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_] 2024/05/06 06:08:24 (01) : test extended-filenames 2024/05/06 06:08:24 (02) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_/ 2024/05/06 06:08:24 (03) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_/ 2024/05/06 06:08:24 (04) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:08:24 (05) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:08:24 (06) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/РуÑÑкий.txt 2024/05/06 06:08:24 (07) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/РуÑÑкий.txt 2024/05/06 06:08:24 (08) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/file_enconde_mañana_funcionará.txt 2024/05/06 06:08:24 (09) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/file_enconde_mañana_funcionará.txt 2024/05/06 06:08:24 (10) : test initial bisync 2024/05/06 06:08:24 (11) : bisync resync 2024/05/06 06:08:24 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:08:24 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/05/06 06:08:24 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:24 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:24 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/" 2024/05/06 06:08:24 INFO : Copying Path2 files to Path1 2024/05/06 06:08:24 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:24 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:24 INFO : Resync updating listings 2024/05/06 06:08:24 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/" 2024/05/06 06:08:24 INFO : Bisync successful 2024/05/06 06:08:24 (12) : test place a newer files on both paths 2024/05/06 06:08:24 (13) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/ file1.txt 2024/05/06 06:08:24 (14) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/ file2.txt 2024/05/06 06:08:24 (15) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/ New_top_level_mañana_funcionará.txt 2024/05/06 06:08:24 INFO : file1.txt: Copied (new) to: New_top_level_mañana_funcionará.txt 2024/05/06 06:08:24 (16) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/ file_enconde_mañana_funcionará.txt 2024/05/06 06:08:24 INFO : file1.txt: Copied (replaced existing) to: file_enconde_mañana_funcionará.txt 2024/05/06 06:08:24 (17) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/ filename_contains_ࢺ_p1m.txt 2024/05/06 06:08:24 INFO : file1.txt: Copied (new) to: filename_contains_ࢺ_p1m.txt 2024/05/06 06:08:24 (18) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/ РуÑÑкий.txt 2024/05/06 06:08:24 INFO : file1.txt: Copied (replaced existing) to: РуÑÑкий.txt 2024/05/06 06:08:24 (19) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/ file1_with{spc}white{spc}space.txt 2024/05/06 06:08:24 INFO : file1.txt: Copied (new) to: file1_with white space.txt 2024/05/06 06:08:24 (20) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_ test.txt 2024/05/06 06:08:24 INFO : file1.txt: Copied (new) to: test.txt 2024/05/06 06:08:24 (21) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_ mañana_funcionará.txt 2024/05/06 06:08:24 INFO : file1.txt: Copied (new) to: mañana_funcionará.txt 2024/05/06 06:08:24 (22) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_ file_with_測試_.txt 2024/05/06 06:08:24 INFO : file1.txt: Copied (new) to: file_with_測試_.txt 2024/05/06 06:08:24 (23) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_ filename_contains_ࢺ_p2s.txt 2024/05/06 06:08:24 INFO : file1.txt: Copied (new) to: filename_contains_ࢺ_p2s.txt 2024/05/06 06:08:24 (24) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir{spc}with{eol}white{spc}space.txt file2{spc}with{eol}white{spc}space.txt 2024/05/06 06:08:24 INFO : file1.txt: Copied (new) to: file2 with white space.txt 2024/05/06 06:08:24 (25) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_rawchars_{chr:19}_{chr:81}_{chr:fe} file3_{chr:19}_{chr:81}_{chr:fe} 2024/05/06 06:08:24 INFO : file1.txt: Copied (new) to: file3___þ 2024/05/06 06:08:24 (26) : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir{spc}with{eol}white{spc}space.txt/file2{spc}with{eol}white{spc}space.txt 2024/05/06 06:08:24 (27) : test place a new file on both paths 2024/05/06 06:08:24 (28) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_ filechangedbothpaths_ࢺ_.txt 2024/05/06 06:08:24 INFO : file2.txt: Copied (new) to: filechangedbothpaths_ࢺ_.txt 2024/05/06 06:08:24 (29) : touch-glob 2001-01-03 /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/ file1.txt 2024/05/06 06:08:24 (30) : copy-as /tmp/060813ko/datadir/test_extended_filenames-hogokuv4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_ filechangedbothpaths_ࢺ_.txt 2024/05/06 06:08:24 INFO : file1.txt: Copied (new) to: filechangedbothpaths_ࢺ_.txt 2024/05/06 06:08:24 (31) : test delete files on both paths 2024/05/06 06:08:24 (32) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/filename_contains_ࢺ_.txt 2024/05/06 06:08:24 INFO : filename_contains_ࢺ_.txt: Deleted 2024/05/06 06:08:24 (33) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:08:24 INFO : filename_contains_Ä›_.txt: Deleted 2024/05/06 06:08:24 (34) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/РуÑÑкий.txt 2024/05/06 06:08:24 INFO : РуÑÑкий.txt: Deleted 2024/05/06 06:08:24 (35) : test bisync run 2024/05/06 06:08:24 (36) : bisync 2024/05/06 06:08:24 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:08:24 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/05/06 06:08:24 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:24 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:24 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/" 2024/05/06 06:08:24 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:24 INFO : Path1 checking for diffs 2024/05/06 06:08:24 INFO : - Path1 File was deleted - РуÑÑкий.txt 2024/05/06 06:08:24 INFO : - Path1 File is new - file1_with white space.txt 2024/05/06 06:08:24 INFO : - Path1 File is new - filename_contains_ࢺ_p1m.txt 2024/05/06 06:08:24 INFO : - Path1 File is new - subdir_with_ࢺ_/file_with_測試_.txt 2024/05/06 06:08:24 INFO : - Path1 File is new - subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt 2024/05/06 06:08:24 INFO : - Path1 File is new - subdir_with_ࢺ_/mañana_funcionará.txt 2024/05/06 06:08:24 INFO : - Path1 File is new - subdir_with_ࢺ_/test.txt 2024/05/06 06:08:24 INFO : Path1: 7 changes:  6 new,  0 modified,  1 deleted 2024/05/06 06:08:24 INFO : Path2 checking for diffs 2024/05/06 06:08:24 INFO : - Path2 File changed: size (larger), time (newer) - file_enconde_mañana_funcionará.txt 2024/05/06 06:08:24 INFO : - Path2 File was deleted - filename_contains_ࢺ_.txt 2024/05/06 06:08:24 INFO : - Path2 File was deleted - subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:08:24 INFO : - Path2 File changed: size (larger), time (newer) - РуÑÑкий.txt 2024/05/06 06:08:24 INFO : - Path2 File is new - New_top_level_mañana_funcionará.txt 2024/05/06 06:08:24 INFO : - Path2 File is new - subdir withâŠwhite space.txt/file2 withâŠwhite space.txt 2024/05/06 06:08:24 INFO : - Path2 File is new - "subdir_rawchars_â™_\x81_\xfe/file3_â™_\x81_\xfe" 2024/05/06 06:08:24 INFO : - Path2 File is new - subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt 2024/05/06 06:08:24 INFO : - Path2 File is new - subdir_with_ࢺ_/filename_contains_ࢺ_p2s.txt 2024/05/06 06:08:24 INFO : Path2: 9 changes:  5 new,  2 modified,  2 deleted 2024/05/06 06:08:24 INFO : (Modified:  2 newer,  0 older,  2 larger,  0 smaller) 2024/05/06 06:08:24 INFO : Applying changes 2024/05/06 06:08:24 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/file1_with white space.txt 2024/05/06 06:08:24 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/filename_contains_ࢺ_p1m.txt 2024/05/06 06:08:24 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_/file_with_測試_.txt 2024/05/06 06:08:24 NOTICE: - WARNING New or changed in both paths - subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt 2024/05/06 06:08:24 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict1 2024/05/06 06:08:24 INFO : subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt: Moved (server-side) to: subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict1 2024/05/06 06:08:24 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict1 2024/05/06 06:08:24 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict2 2024/05/06 06:08:24 INFO : subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt: Moved (server-side) to: subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict2 2024/05/06 06:08:24 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict2 2024/05/06 06:08:24 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_/mañana_funcionará.txt 2024/05/06 06:08:24 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/subdir_with_ࢺ_/test.txt 2024/05/06 06:08:24 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/РуÑÑкий.txt 2024/05/06 06:08:24 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/New_top_level_mañana_funcionará.txt 2024/05/06 06:08:24 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/file_enconde_mañana_funcionará.txt 2024/05/06 06:08:24 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/filename_contains_ࢺ_.txt 2024/05/06 06:08:24 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir withâŠwhite space.txt/file2 withâŠwhite space.txt 2024/05/06 06:08:24 INFO : - Path2 Queue copy to Path1 - "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_rawchars_â™_\x81_\xfe/file3_â™_\x81_\xfe" 2024/05/06 06:08:24 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_Ä›_.txt 2024/05/06 06:08:24 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ࢺ_p2s.txt 2024/05/06 06:08:24 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:24 INFO : New_top_level_mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:24 INFO : РуÑÑкий.txt: Copied (new) 2024/05/06 06:08:24 INFO : subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict2: Copied (new) 2024/05/06 06:08:24 INFO : file_enconde_mañana_funcionará.txt: Copied (replaced existing) 2024/05/06 06:08:24 INFO : subdir_with_ࢺ_/filename_contains_ࢺ_p2s.txt: Copied (new) 2024/05/06 06:08:24 INFO : subdir_rawchars_â™__þ/file3_â™__þ: Copied (new) 2024/05/06 06:08:24 INFO : subdir withâŠwhite space.txt/file2 withâŠwhite space.txt: Copied (new) 2024/05/06 06:08:24 INFO : filename_contains_ࢺ_.txt: Deleted 2024/05/06 06:08:24 INFO : subdir_with_ࢺ_/filename_contains_Ä›_.txt: Deleted 2024/05/06 06:08:24 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:24 INFO : filename_contains_ࢺ_p1m.txt: Copied (new) 2024/05/06 06:08:24 INFO : file1_with white space.txt: Copied (new) 2024/05/06 06:08:24 INFO : subdir_with_ࢺ_/file_with_測試_.txt: Copied (new) 2024/05/06 06:08:24 INFO : subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict1: Copied (new) 2024/05/06 06:08:24 INFO : subdir_with_ࢺ_/mañana_funcionará.txt: Copied (new) 2024/05/06 06:08:24 INFO : subdir_with_ࢺ_/test.txt: Copied (new) 2024/05/06 06:08:24 INFO : Updating listings 2024/05/06 06:08:24 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/extended_filenames/path2/" 2024/05/06 06:08:24 INFO : Bisync successful bisync_test.go:555: TEST extended_filenames PASSED === RUN TestBisyncRemoteRemote/filters 2024/05/06 06:08:24 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:24 DEBUG : path1: Making directory 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:24 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1" 2024/05/06 06:08:24 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:24 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:24 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:24 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:24 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:24 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:24 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1" 2024/05/06 06:08:24 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:24 DEBUG : path2: Making directory 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:24 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2" 2024/05/06 06:08:24 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:24 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:24 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:24 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:24 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:24 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:24 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2" 2024/05/06 06:08:24 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_filters-hecuvom4" 2024/05/06 06:08:24 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:24 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:24 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:24 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : Local file system at /tmp/060813ko/initdir/test_filters-hecuvom4: Waiting for checks to finish 2024/05/06 06:08:24 DEBUG : Local file system at /tmp/060813ko/initdir/test_filters-hecuvom4: Waiting for transfers to finish 2024/05/06 06:08:24 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:24 DEBUG : RCLONE_TEST.pocobux8.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:24 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:24 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:24 DEBUG : file2.txt.lisiyuz4.partial: renamed to: file2.txt 2024/05/06 06:08:24 INFO : file2.txt: Copied (new) 2024/05/06 06:08:24 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:24 DEBUG : file4.txt.wutofat5.partial: renamed to: file4.txt 2024/05/06 06:08:24 INFO : file4.txt: Copied (new) 2024/05/06 06:08:24 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:24 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:24 DEBUG : file6.txt.wuyahod1.partial: renamed to: file6.txt 2024/05/06 06:08:24 INFO : file6.txt: Copied (new) 2024/05/06 06:08:24 DEBUG : file1.txt.fakuqub8.partial: renamed to: file1.txt 2024/05/06 06:08:24 INFO : file1.txt: Copied (new) 2024/05/06 06:08:24 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:24 DEBUG : file7.txt.beriroc4.partial: renamed to: file7.txt 2024/05/06 06:08:24 INFO : file7.txt: Copied (new) 2024/05/06 06:08:24 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:24 DEBUG : subdir/file20.txt.lokixuy7.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:24 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:24 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:24 DEBUG : file5.txt.kuqumed8.partial: renamed to: file5.txt 2024/05/06 06:08:24 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:24 INFO : file5.txt: Copied (new) 2024/05/06 06:08:24 DEBUG : file3.txt.leneqah9.partial: renamed to: file3.txt 2024/05/06 06:08:24 INFO : file3.txt: Copied (new) 2024/05/06 06:08:24 INFO : subdir: Updated directory metadata 2024/05/06 06:08:24 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_filters-miquroy0" 2024/05/06 06:08:24 DEBUG : fileZ.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : filtersfile.flt: Need to transfer - File not found at Destination 2024/05/06 06:08:24 DEBUG : Local file system at /tmp/060813ko/datadir/test_filters-miquroy0: Waiting for checks to finish 2024/05/06 06:08:24 DEBUG : fileZ.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:24 DEBUG : fileZ.txt.loveveh3.partial: renamed to: fileZ.txt 2024/05/06 06:08:24 INFO : fileZ.txt: Copied (new) 2024/05/06 06:08:24 DEBUG : Local file system at /tmp/060813ko/datadir/test_filters-miquroy0: Waiting for transfers to finish 2024/05/06 06:08:24 DEBUG : filtersfile.flt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/05/06 06:08:24 DEBUG : filtersfile.flt.jaruxoc3.partial: renamed to: filtersfile.flt 2024/05/06 06:08:24 INFO : filtersfile.flt: Copied (new) 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1] 2024/05/06 06:08:24 ERROR : : error listing: directory not found 2024/05/06 06:08:24 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2] 2024/05/06 06:08:24 ERROR : : error listing: directory not found 2024/05/06 06:08:25 checking initFs Local file system at /tmp/060813ko/initdir/test_filters-hecuvom4 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1] 2024/05/06 06:08:25 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : subdir: Making directory 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/subdir] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/RCLONE_TEST] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/file3.txt] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/file2.txt] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/file1.txt] 2024/05/06 06:08:25 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: Waiting for checks to finish 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: Waiting for transfers to finish 2024/05/06 06:08:25 INFO : file3.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/file4.txt] 2024/05/06 06:08:25 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/file5.txt] 2024/05/06 06:08:25 INFO : file2.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/file6.txt] 2024/05/06 06:08:25 INFO : file1.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/file7.txt] 2024/05/06 06:08:25 INFO : file4.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/subdir/file20.txt] 2024/05/06 06:08:25 INFO : file5.txt: Copied (new) 2024/05/06 06:08:25 INFO : file6.txt: Copied (new) 2024/05/06 06:08:25 INFO : file7.txt: Copied (new) 2024/05/06 06:08:25 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:25 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/subdir] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2] 2024/05/06 06:08:25 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : subdir: Making directory 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/RCLONE_TEST] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/subdir] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/file1.txt] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/file2.txt] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/file3.txt] 2024/05/06 06:08:25 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: Waiting for checks to finish 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: Waiting for transfers to finish 2024/05/06 06:08:25 INFO : file1.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/file4.txt] 2024/05/06 06:08:25 INFO : file2.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/file5.txt] 2024/05/06 06:08:25 INFO : file3.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/file6.txt] 2024/05/06 06:08:25 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/file7.txt] 2024/05/06 06:08:25 INFO : file4.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/subdir/file20.txt] 2024/05/06 06:08:25 INFO : file5.txt: Copied (new) 2024/05/06 06:08:25 INFO : file6.txt: Copied (new) 2024/05/06 06:08:25 INFO : file7.txt: Copied (new) 2024/05/06 06:08:25 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:25 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/subdir] 2024/05/06 06:08:25 (01) : test filters 2024/05/06 06:08:25 (02) : copy-file /tmp/060813ko/datadir/test_filters-miquroy0/filtersfile.flt /tmp/060813ko/workdir/ 2024/05/06 06:08:25 INFO : filtersfile.flt: Copied (new) 2024/05/06 06:08:25 (03) : test resync to force building of the filters md5 hash 2024/05/06 06:08:25 (04) : bisync filters-file=/tmp/060813ko/workdir/filtersfile.flt resync 2024/05/06 06:08:25 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:25 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:25 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/" 2024/05/06 06:08:25 INFO : Using filters file /tmp/060813ko/workdir/filtersfile.flt 2024/05/06 06:08:25 INFO : Storing filters file hash to /tmp/060813ko/workdir/filtersfile.flt.md5 2024/05/06 06:08:25 INFO : Copying Path2 files to Path1 2024/05/06 06:08:25 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:25 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:25 INFO : Resync updating listings 2024/05/06 06:08:25 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/" 2024/05/06 06:08:25 INFO : Bisync successful 2024/05/06 06:08:25 (05) : copy-listings resync 2024/05/06 06:08:25 (06) : test place new files on the remote 2024/05/06 06:08:25 (07) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_filters-miquroy0/ fileZ.txt 2024/05/06 06:08:25 (08) : copy-as /tmp/060813ko/datadir/test_filters-miquroy0/fileZ.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/ fileZ.txt 2024/05/06 06:08:25 INFO : fileZ.txt: Copied (new) 2024/05/06 06:08:25 (09) : copy-as /tmp/060813ko/datadir/test_filters-miquroy0/fileZ.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/subdir fileZ.txt 2024/05/06 06:08:25 INFO : fileZ.txt: Copied (new) 2024/05/06 06:08:25 (10) : test bisync with filters-file. path2-side fileZ.txt will be filtered. 2024/05/06 06:08:25 (11) : bisync filters-file=/tmp/060813ko/workdir/filtersfile.flt 2024/05/06 06:08:25 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:25 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:25 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/" 2024/05/06 06:08:25 INFO : Using filters file /tmp/060813ko/workdir/filtersfile.flt 2024/05/06 06:08:25 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:25 INFO : Path1 checking for diffs 2024/05/06 06:08:25 INFO : - Path1 File is new - subdir/fileZ.txt 2024/05/06 06:08:25 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:25 INFO : Path2 checking for diffs 2024/05/06 06:08:25 INFO : Applying changes 2024/05/06 06:08:25 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/subdir/fileZ.txt 2024/05/06 06:08:25 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:25 INFO : subdir/fileZ.txt: Copied (new) 2024/05/06 06:08:25 INFO : Updating listings 2024/05/06 06:08:25 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filters/path2/" 2024/05/06 06:08:25 INFO : Bisync successful bisync_test.go:555: TEST filters PASSED === RUN TestBisyncRemoteRemote/filtersfile_checks 2024/05/06 06:08:25 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:25 DEBUG : path1: Making directory 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:25 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1" 2024/05/06 06:08:25 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:25 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:25 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:25 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:25 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:25 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:25 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1" 2024/05/06 06:08:25 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:25 DEBUG : path2: Making directory 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:25 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2" 2024/05/06 06:08:25 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:25 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:25 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:25 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:25 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:25 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:25 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2" 2024/05/06 06:08:25 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_filtersfile_checks-xoloruz2" 2024/05/06 06:08:25 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:25 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:25 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:25 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:25 DEBUG : file1.txt.buraric8.partial: renamed to: file1.txt 2024/05/06 06:08:25 INFO : file1.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:25 DEBUG : file2.txt.tusiqeb2.partial: renamed to: file2.txt 2024/05/06 06:08:25 INFO : file2.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : Local file system at /tmp/060813ko/initdir/test_filtersfile_checks-xoloruz2: Waiting for checks to finish 2024/05/06 06:08:25 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:25 DEBUG : Local file system at /tmp/060813ko/initdir/test_filtersfile_checks-xoloruz2: Waiting for transfers to finish 2024/05/06 06:08:25 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:25 DEBUG : RCLONE_TEST.vumuwej0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:25 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:25 DEBUG : subdir/file20.txt.dijalup3.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:25 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:25 INFO : subdir: Updated directory metadata 2024/05/06 06:08:25 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_filtersfile_checks-yifeqiv2" 2024/05/06 06:08:25 DEBUG : filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : filtersfile2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : Local file system at /tmp/060813ko/datadir/test_filtersfile_checks-yifeqiv2: Waiting for checks to finish 2024/05/06 06:08:25 DEBUG : Local file system at /tmp/060813ko/datadir/test_filtersfile_checks-yifeqiv2: Waiting for transfers to finish 2024/05/06 06:08:25 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:08:25 DEBUG : filtersfile2.txt: md5 = 95acc1e3b5beda465d9b2cb32808588c OK 2024/05/06 06:08:25 DEBUG : filtersfile2.txt.tayanox0.partial: renamed to: filtersfile2.txt 2024/05/06 06:08:25 INFO : filtersfile2.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hold.txt.pesezer4.partial: renamed to: hold.txt 2024/05/06 06:08:25 DEBUG : filtersfile.txt: md5 = cbf4389cb34d9e160689d1578eb5707f OK 2024/05/06 06:08:25 INFO : hold.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : filtersfile.txt.cojinuc8.partial: renamed to: filtersfile.txt 2024/05/06 06:08:25 INFO : filtersfile.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1] 2024/05/06 06:08:25 ERROR : : error listing: directory not found 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2] 2024/05/06 06:08:25 ERROR : : error listing: directory not found 2024/05/06 06:08:25 checking initFs Local file system at /tmp/060813ko/initdir/test_filtersfile_checks-xoloruz2 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1] 2024/05/06 06:08:25 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : subdir: Making directory 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/subdir] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/RCLONE_TEST] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/file2.txt] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/file1.txt] 2024/05/06 06:08:25 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/subdir/file20.txt] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1: Waiting for checks to finish 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1: Waiting for transfers to finish 2024/05/06 06:08:25 INFO : file2.txt: Copied (new) 2024/05/06 06:08:25 INFO : file1.txt: Copied (new) 2024/05/06 06:08:25 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:25 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:25 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/subdir] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2] 2024/05/06 06:08:25 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : subdir: Making directory 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/subdir] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/RCLONE_TEST] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/file1.txt] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/file2.txt] 2024/05/06 06:08:25 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2: Waiting for checks to finish 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2: Waiting for transfers to finish 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/subdir/file20.txt] 2024/05/06 06:08:25 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:25 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:25 INFO : file1.txt: Copied (new) 2024/05/06 06:08:25 INFO : file2.txt: Copied (new) 2024/05/06 06:08:25 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/subdir] 2024/05/06 06:08:25 (01) : test filtersfile-checks 2024/05/06 06:08:25 (02) : test initial bisync 2024/05/06 06:08:25 (03) : bisync resync 2024/05/06 06:08:25 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:25 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:25 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/" 2024/05/06 06:08:25 INFO : Copying Path2 files to Path1 2024/05/06 06:08:25 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:25 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:25 INFO : Resync updating listings 2024/05/06 06:08:25 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/" 2024/05/06 06:08:25 INFO : Bisync successful 2024/05/06 06:08:25 (04) : test 1. inject filters file in workdir. 2024/05/06 06:08:25 (05) : copy-file /tmp/060813ko/datadir/test_filtersfile_checks-yifeqiv2/filtersfile.txt /tmp/060813ko/workdir/ 2024/05/06 06:08:25 INFO : filtersfile.txt: Copied (new) 2024/05/06 06:08:25 (06) : test 2. run with filters-file but without md5. should abort. 2024/05/06 06:08:25 (07) : bisync filters-file=/tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:25 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:25 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/" 2024/05/06 06:08:25 INFO : Using filters file /tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 ERROR : Bisync critical error: filters file md5 hash not found (must run --resync): /tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:25 Bisync error: bisync aborted 2024/05/06 06:08:25 (08) : test 3. run without filters-file. should be blocked due to prior abort. 2024/05/06 06:08:25 (09) : bisync 2024/05/06 06:08:25 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:25 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:25 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/" 2024/05/06 06:08:25 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/060813ko/workdir/TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_filtersfile_checks_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_filtersfile_checks_path2.path1.lst Path2: /tmp/060813ko/workdir/TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_filtersfile_checks_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_filtersfile_checks_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/060813ko/workdir" 2024/05/06 06:08:25 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:25 Bisync error: bisync aborted 2024/05/06 06:08:25 (10) : test 4. run with filters-file and resync. 2024/05/06 06:08:25 (11) : bisync filters-file=/tmp/060813ko/workdir/filtersfile.txt resync 2024/05/06 06:08:25 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:25 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:25 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/" 2024/05/06 06:08:25 INFO : Using filters file /tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 INFO : Storing filters file hash to /tmp/060813ko/workdir/filtersfile.txt.md5 2024/05/06 06:08:25 INFO : Copying Path2 files to Path1 2024/05/06 06:08:25 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:25 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:25 INFO : Resync updating listings 2024/05/06 06:08:25 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/" 2024/05/06 06:08:25 INFO : Bisync successful 2024/05/06 06:08:25 (12) : test 5. run with filters-file alone. should run. 2024/05/06 06:08:25 (13) : bisync filters-file=/tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:25 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:25 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/" 2024/05/06 06:08:25 INFO : Using filters file /tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:25 INFO : Path1 checking for diffs 2024/05/06 06:08:25 INFO : Path2 checking for diffs 2024/05/06 06:08:25 INFO : No changes found 2024/05/06 06:08:25 INFO : Updating listings 2024/05/06 06:08:25 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/" 2024/05/06 06:08:25 INFO : Bisync successful 2024/05/06 06:08:25 (14) : test 6. push changed filters-file to workdir. 2024/05/06 06:08:25 (15) : copy-as /tmp/060813ko/datadir/test_filtersfile_checks-yifeqiv2/filtersfile2.txt /tmp/060813ko/workdir/ filtersfile.txt 2024/05/06 06:08:25 INFO : filtersfile2.txt: Copied (replaced existing) to: filtersfile.txt 2024/05/06 06:08:25 (16) : test 7. run with filters-file alone. should abort. 2024/05/06 06:08:25 (17) : bisync filters-file=/tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:25 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:25 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/" 2024/05/06 06:08:25 INFO : Using filters file /tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:25 Bisync error: bisync aborted 2024/05/06 06:08:25 (18) : test 8. run with filters-file and resync and dry-run. should do the dry-run but still cause next non-resync run to abort. 2024/05/06 06:08:25 (19) : bisync filters-file=/tmp/060813ko/workdir/filtersfile.txt resync dry-run 2024/05/06 06:08:25 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:25 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:25 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/" 2024/05/06 06:08:25 INFO : Using filters file /tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 INFO : Skipped storing filters file hash to /tmp/060813ko/workdir/filtersfile.txt.md5 as --dry-run is set 2024/05/06 06:08:25 INFO : Copying Path2 files to Path1 2024/05/06 06:08:25 NOTICE: - Path2 Resync is copying files to - Path1 2024/05/06 06:08:25 NOTICE: - Path1 Resync is copying files to - Path2 2024/05/06 06:08:25 INFO : Resync updating listings 2024/05/06 06:08:25 INFO : Bisync successful 2024/05/06 06:08:25 (20) : test 9. run with filters-file alone. should abort. 2024/05/06 06:08:25 (21) : bisync filters-file=/tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:25 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:25 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/filtersfile_checks/path2/" 2024/05/06 06:08:25 INFO : Using filters file /tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/060813ko/workdir/filtersfile.txt 2024/05/06 06:08:25 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:25 Bisync error: bisync aborted bisync_test.go:555: TEST filtersfile_checks PASSED === RUN TestBisyncRemoteRemote/ignorelistingchecksum 2024/05/06 06:08:25 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:25 DEBUG : path1: Making directory 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:25 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1" 2024/05/06 06:08:25 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:25 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:25 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:25 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:25 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:25 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:25 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1" 2024/05/06 06:08:25 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:25 DEBUG : path2: Making directory 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:25 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2" 2024/05/06 06:08:25 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:25 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:25 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:25 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:25 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:25 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:25 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2" 2024/05/06 06:08:25 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_ignorelistingchecksum-cevujep1" 2024/05/06 06:08:25 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:25 INFO : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/05/06 06:08:25 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:25 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:25 DEBUG : RCLONE_TEST.jehuceb0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:25 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:25 DEBUG : Local file system at /tmp/060813ko/initdir/test_ignorelistingchecksum-cevujep1: Waiting for checks to finish 2024/05/06 06:08:25 DEBUG : Local file system at /tmp/060813ko/initdir/test_ignorelistingchecksum-cevujep1: Waiting for transfers to finish 2024/05/06 06:08:25 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:25 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:25 DEBUG : file1.copy1.txt.jucalox1.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:25 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : file1.copy4.txt.hewuwum8.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:25 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:25 DEBUG : file1.copy2.txt.ligaces6.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:25 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:25 DEBUG : file1.copy5.txt.yodofak9.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:25 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:25 DEBUG : file1.copy3.txt.tecepub7.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:25 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:25 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : file1.txt.kiwanan4.partial: renamed to: file1.txt 2024/05/06 06:08:25 INFO : file1.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:25 DEBUG : subdir/file20.txt.barowib8.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:25 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:25 INFO : subdir: Updated directory metadata 2024/05/06 06:08:25 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_ignorelistingchecksum-gawalux4" 2024/05/06 06:08:25 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : Local file system at /tmp/060813ko/datadir/test_ignorelistingchecksum-gawalux4: Waiting for checks to finish 2024/05/06 06:08:25 DEBUG : Local file system at /tmp/060813ko/datadir/test_ignorelistingchecksum-gawalux4: Waiting for transfers to finish 2024/05/06 06:08:25 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:25 DEBUG : file1.txt.nuvulaq6.partial: renamed to: file1.txt 2024/05/06 06:08:25 INFO : file1.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1] 2024/05/06 06:08:25 ERROR : : error listing: directory not found 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2] 2024/05/06 06:08:25 ERROR : : error listing: directory not found 2024/05/06 06:08:25 checking initFs Local file system at /tmp/060813ko/initdir/test_ignorelistingchecksum-cevujep1 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1] 2024/05/06 06:08:25 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : subdir: Making directory 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/subdir] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/RCLONE_TEST] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/file1.copy1.txt] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/file1.copy2.txt] 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/file1.copy3.txt] 2024/05/06 06:08:25 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: Waiting for checks to finish 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: Waiting for transfers to finish 2024/05/06 06:08:25 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/file1.copy4.txt] 2024/05/06 06:08:25 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:25 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/file1.copy5.txt] 2024/05/06 06:08:26 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/file1.txt] 2024/05/06 06:08:26 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/subdir/file20.txt] 2024/05/06 06:08:26 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:26 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:26 INFO : file1.txt: Copied (new) 2024/05/06 06:08:26 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:26 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/subdir] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2] 2024/05/06 06:08:26 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : subdir: Making directory 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/subdir] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/RCLONE_TEST] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/file1.copy2.txt] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/file1.copy3.txt] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/file1.copy1.txt] 2024/05/06 06:08:26 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: Waiting for checks to finish 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: Waiting for transfers to finish 2024/05/06 06:08:26 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/file1.copy4.txt] 2024/05/06 06:08:26 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/file1.copy5.txt] 2024/05/06 06:08:26 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/file1.txt] 2024/05/06 06:08:26 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/subdir/file20.txt] 2024/05/06 06:08:26 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:26 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:26 INFO : file1.txt: Copied (new) 2024/05/06 06:08:26 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:26 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/subdir] 2024/05/06 06:08:26 (01) : test basic 2024/05/06 06:08:26 (02) : test initial bisync 2024/05/06 06:08:26 (03) : bisync resync 2024/05/06 06:08:26 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:26 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:26 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/" 2024/05/06 06:08:26 INFO : Copying Path2 files to Path1 2024/05/06 06:08:26 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:26 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:26 INFO : Resync updating listings 2024/05/06 06:08:26 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/" 2024/05/06 06:08:26 INFO : Bisync successful 2024/05/06 06:08:26 (04) : bisync resync ignore-listing-checksum 2024/05/06 06:08:26 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:26 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/" 2024/05/06 06:08:26 INFO : Copying Path2 files to Path1 2024/05/06 06:08:26 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:26 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:26 INFO : Resync updating listings 2024/05/06 06:08:26 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/" 2024/05/06 06:08:26 INFO : Bisync successful 2024/05/06 06:08:26 (05) : test place newer files on both paths 2024/05/06 06:08:26 (06) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_ignorelistingchecksum-gawalux4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/ 2024/05/06 06:08:26 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:26 (07) : copy-as /tmp/060813ko/datadir/test_ignorelistingchecksum-gawalux4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/subdir file20.txt 2024/05/06 06:08:26 INFO : file1.txt: Copied (replaced existing) to: file20.txt 2024/05/06 06:08:26 (08) : test bisync run 2024/05/06 06:08:26 (09) : bisync ignore-listing-checksum 2024/05/06 06:08:26 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:26 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/" 2024/05/06 06:08:26 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:26 INFO : Path1 checking for diffs 2024/05/06 06:08:26 INFO : - Path1 File changed: size (larger), time (newer) - subdir/file20.txt 2024/05/06 06:08:26 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:26 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:26 INFO : Path2 checking for diffs 2024/05/06 06:08:26 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:26 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:26 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:26 INFO : Applying changes 2024/05/06 06:08:26 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/subdir/file20.txt 2024/05/06 06:08:26 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/file1.txt 2024/05/06 06:08:26 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:26 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:26 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:26 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:26 INFO : Updating listings 2024/05/06 06:08:26 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/ignorelistingchecksum/path2/" 2024/05/06 06:08:26 INFO : Bisync successful bisync_test.go:555: TEST ignorelistingchecksum PASSED === RUN TestBisyncRemoteRemote/max_delete_path1 2024/05/06 06:08:26 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:26 DEBUG : path1: Making directory 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:26 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1" 2024/05/06 06:08:26 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:26 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:26 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:26 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:26 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:26 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:26 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1" 2024/05/06 06:08:26 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:26 DEBUG : path2: Making directory 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:26 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2" 2024/05/06 06:08:26 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:26 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:26 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:26 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:26 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:26 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:26 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2" 2024/05/06 06:08:26 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_max_delete_path1-fazukij2" 2024/05/06 06:08:26 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:26 DEBUG : file1.txt.vamuheh9.partial: renamed to: file1.txt 2024/05/06 06:08:26 DEBUG : Local file system at /tmp/060813ko/initdir/test_max_delete_path1-fazukij2: Waiting for checks to finish 2024/05/06 06:08:26 INFO : file1.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : Local file system at /tmp/060813ko/initdir/test_max_delete_path1-fazukij2: Waiting for transfers to finish 2024/05/06 06:08:26 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:26 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:26 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:26 DEBUG : file5.txt.fuxilag0.partial: renamed to: file5.txt 2024/05/06 06:08:26 INFO : file5.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : file3.txt.redozij5.partial: renamed to: file3.txt 2024/05/06 06:08:26 INFO : file3.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : file2.txt.tozugor8.partial: renamed to: file2.txt 2024/05/06 06:08:26 INFO : file2.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:26 DEBUG : file4.txt.migukiy5.partial: renamed to: file4.txt 2024/05/06 06:08:26 INFO : file4.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:26 DEBUG : file6.txt.detepob8.partial: renamed to: file6.txt 2024/05/06 06:08:26 INFO : file6.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:26 DEBUG : file8.txt.cenopip3.partial: renamed to: file8.txt 2024/05/06 06:08:26 INFO : file8.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:26 DEBUG : file7.txt.movezuf7.partial: renamed to: file7.txt 2024/05/06 06:08:26 INFO : file7.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:26 DEBUG : file9.txt.mufequh0.partial: renamed to: file9.txt 2024/05/06 06:08:26 INFO : file9.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_max_delete_path1-bogudig9" 2024/05/06 06:08:26 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : Local file system at /tmp/060813ko/datadir/test_max_delete_path1-bogudig9: Waiting for checks to finish 2024/05/06 06:08:26 DEBUG : Local file system at /tmp/060813ko/datadir/test_max_delete_path1-bogudig9: Waiting for transfers to finish 2024/05/06 06:08:26 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:08:26 DEBUG : hold.txt.vunosof9.partial: renamed to: hold.txt 2024/05/06 06:08:26 INFO : hold.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1] 2024/05/06 06:08:26 ERROR : : error listing: directory not found 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2] 2024/05/06 06:08:26 ERROR : : error listing: directory not found 2024/05/06 06:08:26 checking initFs Local file system at /tmp/060813ko/initdir/test_max_delete_path1-fazukij2 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1] 2024/05/06 06:08:26 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: Waiting for checks to finish 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file2.txt] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file1.txt] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file3.txt] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file4.txt] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: Waiting for transfers to finish 2024/05/06 06:08:26 INFO : file2.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file5.txt] 2024/05/06 06:08:26 INFO : file1.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file6.txt] 2024/05/06 06:08:26 INFO : file3.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file7.txt] 2024/05/06 06:08:26 INFO : file4.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file8.txt] 2024/05/06 06:08:26 INFO : file5.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file9.txt] 2024/05/06 06:08:26 INFO : file6.txt: Copied (new) 2024/05/06 06:08:26 INFO : file7.txt: Copied (new) 2024/05/06 06:08:26 INFO : file8.txt: Copied (new) 2024/05/06 06:08:26 INFO : file9.txt: Copied (new) 2024/05/06 06:08:26 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2] 2024/05/06 06:08:26 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file2.txt] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file1.txt] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: Waiting for checks to finish 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: Waiting for transfers to finish 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file3.txt] 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file4.txt] 2024/05/06 06:08:26 INFO : file3.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file5.txt] 2024/05/06 06:08:26 INFO : file2.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file6.txt] 2024/05/06 06:08:26 INFO : file1.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file7.txt] 2024/05/06 06:08:26 INFO : file4.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file8.txt] 2024/05/06 06:08:26 INFO : file5.txt: Copied (new) 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file9.txt] 2024/05/06 06:08:26 INFO : file6.txt: Copied (new) 2024/05/06 06:08:26 INFO : file7.txt: Copied (new) 2024/05/06 06:08:26 INFO : file8.txt: Copied (new) 2024/05/06 06:08:26 INFO : file9.txt: Copied (new) 2024/05/06 06:08:26 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2 2024/05/06 06:08:26 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2] 2024/05/06 06:08:26 (01) : test max-delete-path1 2024/05/06 06:08:26 (02) : test initial bisync 2024/05/06 06:08:26 (03) : bisync resync 2024/05/06 06:08:26 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:26 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:26 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/" 2024/05/06 06:08:26 INFO : Copying Path2 files to Path1 2024/05/06 06:08:26 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:26 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:26 INFO : Resync updating listings 2024/05/06 06:08:26 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/" 2024/05/06 06:08:26 INFO : Bisync successful 2024/05/06 06:08:26 (04) : test delete >50% of local files 2024/05/06 06:08:26 (05) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file1.txt 2024/05/06 06:08:26 INFO : file1.txt: Deleted 2024/05/06 06:08:26 (06) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file2.txt 2024/05/06 06:08:26 INFO : file2.txt: Deleted 2024/05/06 06:08:26 (07) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file3.txt 2024/05/06 06:08:26 INFO : file3.txt: Deleted 2024/05/06 06:08:26 (08) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file4.txt 2024/05/06 06:08:26 INFO : file4.txt: Deleted 2024/05/06 06:08:26 (09) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/file5.txt 2024/05/06 06:08:26 INFO : file5.txt: Deleted 2024/05/06 06:08:26 (10) : test sync should fail due to too many local deletes 2024/05/06 06:08:26 (11) : bisync 2024/05/06 06:08:26 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:26 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:26 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/" 2024/05/06 06:08:26 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:26 INFO : Path1 checking for diffs 2024/05/06 06:08:26 INFO : - Path1 File was deleted - file1.txt 2024/05/06 06:08:26 INFO : - Path1 File was deleted - file2.txt 2024/05/06 06:08:26 INFO : - Path1 File was deleted - file3.txt 2024/05/06 06:08:26 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:08:26 INFO : - Path1 File was deleted - file5.txt 2024/05/06 06:08:26 INFO : Path1: 5 changes:  0 new,  0 modified,  5 deleted 2024/05/06 06:08:26 INFO : Path2 checking for diffs 2024/05/06 06:08:26 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/". Run with --force if desired. 2024/05/06 06:08:26 NOTICE: Bisync aborted. Please try again. 2024/05/06 06:08:26 Bisync error: too many deletes 2024/05/06 06:08:26 (12) : copy-listings initial-fail 2024/05/06 06:08:26 (13) : test change max-delete limit to 60%. sync should run. 2024/05/06 06:08:26 (14) : bisync max-delete=60 2024/05/06 06:08:26 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:26 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:26 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/" 2024/05/06 06:08:26 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:26 INFO : Path1 checking for diffs 2024/05/06 06:08:26 INFO : - Path1 File was deleted - file1.txt 2024/05/06 06:08:26 INFO : - Path1 File was deleted - file2.txt 2024/05/06 06:08:26 INFO : - Path1 File was deleted - file3.txt 2024/05/06 06:08:26 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:08:26 INFO : - Path1 File was deleted - file5.txt 2024/05/06 06:08:26 INFO : Path1: 5 changes:  0 new,  0 modified,  5 deleted 2024/05/06 06:08:26 INFO : Path2 checking for diffs 2024/05/06 06:08:26 INFO : Applying changes 2024/05/06 06:08:26 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file1.txt 2024/05/06 06:08:26 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file2.txt 2024/05/06 06:08:26 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file3.txt 2024/05/06 06:08:26 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file4.txt 2024/05/06 06:08:26 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/file5.txt 2024/05/06 06:08:26 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:26 INFO : file3.txt: Deleted 2024/05/06 06:08:26 INFO : file4.txt: Deleted 2024/05/06 06:08:26 INFO : file5.txt: Deleted 2024/05/06 06:08:26 INFO : file1.txt: Deleted 2024/05/06 06:08:26 INFO : file2.txt: Deleted 2024/05/06 06:08:26 INFO : Updating listings 2024/05/06 06:08:26 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path1/path2/" 2024/05/06 06:08:26 INFO : Bisync successful bisync_test.go:555: TEST max_delete_path1 PASSED === RUN TestBisyncRemoteRemote/max_delete_path2_force 2024/05/06 06:08:27 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:27 DEBUG : path1: Making directory 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:27 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1" 2024/05/06 06:08:27 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:27 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:27 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:27 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:27 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:27 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:27 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1" 2024/05/06 06:08:27 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:27 DEBUG : path2: Making directory 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:27 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2" 2024/05/06 06:08:27 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:27 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:27 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:27 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:27 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:27 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:27 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2" 2024/05/06 06:08:27 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_max_delete_path2_force-cuhacoc6" 2024/05/06 06:08:27 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : Local file system at /tmp/060813ko/initdir/test_max_delete_path2_force-cuhacoc6: Waiting for checks to finish 2024/05/06 06:08:27 DEBUG : Local file system at /tmp/060813ko/initdir/test_max_delete_path2_force-cuhacoc6: Waiting for transfers to finish 2024/05/06 06:08:27 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file2.txt.meruvug5.partial: renamed to: file2.txt 2024/05/06 06:08:27 INFO : file2.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file4.txt.zovujiq2.partial: renamed to: file4.txt 2024/05/06 06:08:27 INFO : file4.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file1.txt.nujeged0.partial: renamed to: file1.txt 2024/05/06 06:08:27 INFO : file1.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file3.txt.yiqajok7.partial: renamed to: file3.txt 2024/05/06 06:08:27 INFO : file3.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file6.txt.mulevif0.partial: renamed to: file6.txt 2024/05/06 06:08:27 INFO : file6.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file5.txt.pahocup1.partial: renamed to: file5.txt 2024/05/06 06:08:27 INFO : file5.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file7.txt.seloqay9.partial: renamed to: file7.txt 2024/05/06 06:08:27 INFO : file7.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file8.txt.vezocon8.partial: renamed to: file8.txt 2024/05/06 06:08:27 INFO : file8.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:27 DEBUG : file9.txt.mebaxig5.partial: renamed to: file9.txt 2024/05/06 06:08:27 INFO : file9.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_max_delete_path2_force-marosok8" 2024/05/06 06:08:27 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : Local file system at /tmp/060813ko/datadir/test_max_delete_path2_force-marosok8: Waiting for checks to finish 2024/05/06 06:08:27 DEBUG : Local file system at /tmp/060813ko/datadir/test_max_delete_path2_force-marosok8: Waiting for transfers to finish 2024/05/06 06:08:27 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/05/06 06:08:27 DEBUG : hold.txt.devemap3.partial: renamed to: hold.txt 2024/05/06 06:08:27 INFO : hold.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1] 2024/05/06 06:08:27 ERROR : : error listing: directory not found 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2] 2024/05/06 06:08:27 ERROR : : error listing: directory not found 2024/05/06 06:08:27 checking initFs Local file system at /tmp/060813ko/initdir/test_max_delete_path2_force-cuhacoc6 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1] 2024/05/06 06:08:27 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file1.txt] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file2.txt] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file3.txt] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: Waiting for checks to finish 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: Waiting for transfers to finish 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file4.txt] 2024/05/06 06:08:27 INFO : file4.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file5.txt] 2024/05/06 06:08:27 INFO : file1.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file6.txt] 2024/05/06 06:08:27 INFO : file2.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file7.txt] 2024/05/06 06:08:27 INFO : file3.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file8.txt] 2024/05/06 06:08:27 INFO : file5.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file9.txt] 2024/05/06 06:08:27 INFO : file6.txt: Copied (new) 2024/05/06 06:08:27 INFO : file7.txt: Copied (new) 2024/05/06 06:08:27 INFO : file8.txt: Copied (new) 2024/05/06 06:08:27 INFO : file9.txt: Copied (new) 2024/05/06 06:08:27 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2] 2024/05/06 06:08:27 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file1.txt] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file2.txt] 2024/05/06 06:08:27 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file9.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: Waiting for checks to finish 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: Waiting for transfers to finish 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file4.txt] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file3.txt] 2024/05/06 06:08:27 INFO : file2.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file5.txt] 2024/05/06 06:08:27 INFO : file1.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file6.txt] 2024/05/06 06:08:27 INFO : file4.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file7.txt] 2024/05/06 06:08:27 INFO : file3.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file8.txt] 2024/05/06 06:08:27 INFO : file5.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file9.txt] 2024/05/06 06:08:27 INFO : file6.txt: Copied (new) 2024/05/06 06:08:27 INFO : file7.txt: Copied (new) 2024/05/06 06:08:27 INFO : file8.txt: Copied (new) 2024/05/06 06:08:27 INFO : file9.txt: Copied (new) 2024/05/06 06:08:27 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2] 2024/05/06 06:08:27 (01) : test max-delete-path2-force 2024/05/06 06:08:27 (02) : test initial bisync 2024/05/06 06:08:27 (03) : bisync resync 2024/05/06 06:08:27 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:27 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:27 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/" 2024/05/06 06:08:27 INFO : Copying Path2 files to Path1 2024/05/06 06:08:27 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:27 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:27 INFO : Resync updating listings 2024/05/06 06:08:27 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/" 2024/05/06 06:08:27 INFO : Bisync successful 2024/05/06 06:08:27 (04) : test delete >50% of remote files 2024/05/06 06:08:27 (05) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file1.txt 2024/05/06 06:08:27 INFO : file1.txt: Deleted 2024/05/06 06:08:27 (06) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file2.txt 2024/05/06 06:08:27 INFO : file2.txt: Deleted 2024/05/06 06:08:27 (07) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file3.txt 2024/05/06 06:08:27 INFO : file3.txt: Deleted 2024/05/06 06:08:27 (08) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file4.txt 2024/05/06 06:08:27 INFO : file4.txt: Deleted 2024/05/06 06:08:27 (09) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/file5.txt 2024/05/06 06:08:27 INFO : file5.txt: Deleted 2024/05/06 06:08:27 (10) : test sync should fail due to too many path2 deletes 2024/05/06 06:08:27 (11) : bisync 2024/05/06 06:08:27 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:27 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:27 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/" 2024/05/06 06:08:27 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:27 INFO : Path1 checking for diffs 2024/05/06 06:08:27 INFO : Path2 checking for diffs 2024/05/06 06:08:27 INFO : - Path2 File was deleted - file1.txt 2024/05/06 06:08:27 INFO : - Path2 File was deleted - file2.txt 2024/05/06 06:08:27 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:08:27 INFO : - Path2 File was deleted - file4.txt 2024/05/06 06:08:27 INFO : - Path2 File was deleted - file5.txt 2024/05/06 06:08:27 INFO : Path2: 5 changes:  0 new,  0 modified,  5 deleted 2024/05/06 06:08:27 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/". Run with --force if desired. 2024/05/06 06:08:27 NOTICE: Bisync aborted. Please try again. 2024/05/06 06:08:27 Bisync error: too many deletes 2024/05/06 06:08:27 (12) : copy-listings initial-fail 2024/05/06 06:08:27 (13) : test apply force option. sync should run. 2024/05/06 06:08:27 (14) : bisync force 2024/05/06 06:08:27 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:27 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:27 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/" 2024/05/06 06:08:27 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:27 INFO : Path1 checking for diffs 2024/05/06 06:08:27 INFO : Path2 checking for diffs 2024/05/06 06:08:27 INFO : - Path2 File was deleted - file1.txt 2024/05/06 06:08:27 INFO : - Path2 File was deleted - file2.txt 2024/05/06 06:08:27 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:08:27 INFO : - Path2 File was deleted - file4.txt 2024/05/06 06:08:27 INFO : - Path2 File was deleted - file5.txt 2024/05/06 06:08:27 INFO : Path2: 5 changes:  0 new,  0 modified,  5 deleted 2024/05/06 06:08:27 INFO : Applying changes 2024/05/06 06:08:27 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file1.txt 2024/05/06 06:08:27 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file2.txt 2024/05/06 06:08:27 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file3.txt 2024/05/06 06:08:27 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file4.txt 2024/05/06 06:08:27 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/file5.txt 2024/05/06 06:08:27 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:27 INFO : file5.txt: Deleted 2024/05/06 06:08:27 INFO : file1.txt: Deleted 2024/05/06 06:08:27 INFO : file2.txt: Deleted 2024/05/06 06:08:27 INFO : file4.txt: Deleted 2024/05/06 06:08:27 INFO : file3.txt: Deleted 2024/05/06 06:08:27 INFO : Updating listings 2024/05/06 06:08:27 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/max_delete_path2_force/path2/" 2024/05/06 06:08:27 INFO : Bisync successful bisync_test.go:555: TEST max_delete_path2_force PASSED === RUN TestBisyncRemoteRemote/nomodtime 2024/05/06 06:08:27 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:27 DEBUG : path1: Making directory 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:27 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1" 2024/05/06 06:08:27 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:27 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:27 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:27 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:27 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:27 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:27 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1" 2024/05/06 06:08:27 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:27 DEBUG : path2: Making directory 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:27 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2" 2024/05/06 06:08:27 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:27 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:27 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:27 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:27 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:27 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:27 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2" 2024/05/06 06:08:27 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_nomodtime-yeyiqiq2" 2024/05/06 06:08:27 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file3.txt.sabudug7.partial: renamed to: file3.txt 2024/05/06 06:08:27 INFO : file3.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : Local file system at /tmp/060813ko/initdir/test_nomodtime-yeyiqiq2: Waiting for checks to finish 2024/05/06 06:08:27 DEBUG : Local file system at /tmp/060813ko/initdir/test_nomodtime-yeyiqiq2: Waiting for transfers to finish 2024/05/06 06:08:27 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file4.txt.hewazen5.partial: renamed to: file4.txt 2024/05/06 06:08:27 INFO : file4.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file2.txt.gaxikik9.partial: renamed to: file2.txt 2024/05/06 06:08:27 INFO : file2.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file5.txt.wulunog5.partial: renamed to: file5.txt 2024/05/06 06:08:27 INFO : file5.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:27 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file1.txt.bayomap7.partial: renamed to: file1.txt 2024/05/06 06:08:27 INFO : file1.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file7.txt.xarireq2.partial: renamed to: file7.txt 2024/05/06 06:08:27 INFO : file7.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:27 DEBUG : file6.txt.vicasek1.partial: renamed to: file6.txt 2024/05/06 06:08:27 INFO : file6.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : RCLONE_TEST.jozabip8.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:27 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:27 DEBUG : file8.txt.guliguz2.partial: renamed to: file8.txt 2024/05/06 06:08:27 INFO : file8.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_nomodtime-timijas8" 2024/05/06 06:08:27 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : Local file system at /tmp/060813ko/datadir/test_nomodtime-timijas8: Waiting for checks to finish 2024/05/06 06:08:27 DEBUG : Local file system at /tmp/060813ko/datadir/test_nomodtime-timijas8: Waiting for transfers to finish 2024/05/06 06:08:27 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:27 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:27 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:27 DEBUG : file11.txt.kojapap5.partial: renamed to: file11.txt 2024/05/06 06:08:27 INFO : file11.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file10.txt.dejavaw5.partial: renamed to: file10.txt 2024/05/06 06:08:27 INFO : file10.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:27 DEBUG : file2.txt.qipamib7.partial: renamed to: file2.txt 2024/05/06 06:08:27 INFO : file2.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:27 DEBUG : file5L.txt.meqicuq9.partial: renamed to: file5L.txt 2024/05/06 06:08:27 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file1.txt.jovakeq6.partial: renamed to: file1.txt 2024/05/06 06:08:27 INFO : file1.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:27 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:27 DEBUG : file5R.txt.yonawud7.partial: renamed to: file5R.txt 2024/05/06 06:08:27 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file6.txt.pakonux4.partial: renamed to: file6.txt 2024/05/06 06:08:27 INFO : file6.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:27 DEBUG : file7.txt.qamesaq2.partial: renamed to: file7.txt 2024/05/06 06:08:27 INFO : file7.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1] 2024/05/06 06:08:27 ERROR : : error listing: directory not found 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2] 2024/05/06 06:08:27 ERROR : : error listing: directory not found 2024/05/06 06:08:27 checking initFs Local file system at /tmp/060813ko/initdir/test_nomodtime-yeyiqiq2 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1] 2024/05/06 06:08:27 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/RCLONE_TEST] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file1.txt] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file3.txt] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: Waiting for checks to finish 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file2.txt] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: Waiting for transfers to finish 2024/05/06 06:08:27 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file4.txt] 2024/05/06 06:08:27 INFO : file3.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file5.txt] 2024/05/06 06:08:27 INFO : file1.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file6.txt] 2024/05/06 06:08:27 INFO : file2.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file7.txt] 2024/05/06 06:08:27 INFO : file4.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file8.txt] 2024/05/06 06:08:27 INFO : file5.txt: Copied (new) 2024/05/06 06:08:27 INFO : file6.txt: Copied (new) 2024/05/06 06:08:27 INFO : file7.txt: Copied (new) 2024/05/06 06:08:27 INFO : file8.txt: Copied (new) 2024/05/06 06:08:27 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2] 2024/05/06 06:08:27 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/RCLONE_TEST] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file1.txt] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: Waiting for checks to finish 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: Waiting for transfers to finish 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file2.txt] 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file3.txt] 2024/05/06 06:08:27 INFO : file1.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file4.txt] 2024/05/06 06:08:27 INFO : file2.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file5.txt] 2024/05/06 06:08:27 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file6.txt] 2024/05/06 06:08:27 INFO : file3.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file7.txt] 2024/05/06 06:08:27 INFO : file4.txt: Copied (new) 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file8.txt] 2024/05/06 06:08:27 INFO : file5.txt: Copied (new) 2024/05/06 06:08:27 INFO : file6.txt: Copied (new) 2024/05/06 06:08:27 INFO : file7.txt: Copied (new) 2024/05/06 06:08:27 INFO : file8.txt: Copied (new) 2024/05/06 06:08:27 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2 2024/05/06 06:08:27 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2] 2024/05/06 06:08:27 (01) : test changes 2024/05/06 06:08:27 (02) : test initial bisync 2024/05/06 06:08:27 (03) : bisync resync nomodtime 2024/05/06 06:08:28 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/05/06 06:08:28 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/" 2024/05/06 06:08:28 INFO : Copying Path2 files to Path1 2024/05/06 06:08:28 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:28 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:28 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:28 INFO : Resync updating listings 2024/05/06 06:08:28 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/" 2024/05/06 06:08:28 INFO : Bisync successful 2024/05/06 06:08:28 (04) : test make modifications on both paths 2024/05/06 06:08:28 (05) : test new on path2 - file10 2024/05/06 06:08:28 (06) : copy-file /tmp/060813ko/datadir/test_nomodtime-timijas8/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/ 2024/05/06 06:08:28 INFO : file10.txt: Copied (new) 2024/05/06 06:08:28 (07) : test changed on path2 - file1 2024/05/06 06:08:28 (08) : copy-file /tmp/060813ko/datadir/test_nomodtime-timijas8/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/ 2024/05/06 06:08:28 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:28 (09) : test new on path1 - file11 2024/05/06 06:08:28 (10) : copy-file /tmp/060813ko/datadir/test_nomodtime-timijas8/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/ 2024/05/06 06:08:28 INFO : file11.txt: Copied (new) 2024/05/06 06:08:28 (11) : test changed on path1 - file2 2024/05/06 06:08:28 (12) : copy-file /tmp/060813ko/datadir/test_nomodtime-timijas8/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/ 2024/05/06 06:08:28 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:28 (13) : test deleted on path2 - file3 2024/05/06 06:08:28 (14) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file3.txt 2024/05/06 06:08:28 INFO : file3.txt: Deleted 2024/05/06 06:08:28 (15) : test deleted on path1 - file4 2024/05/06 06:08:28 (16) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file4.txt 2024/05/06 06:08:28 INFO : file4.txt: Deleted 2024/05/06 06:08:28 (17) : test deleted on both paths - file8 2024/05/06 06:08:28 (18) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file8.txt 2024/05/06 06:08:28 INFO : file8.txt: Deleted 2024/05/06 06:08:28 (19) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file8.txt 2024/05/06 06:08:28 INFO : file8.txt: Deleted 2024/05/06 06:08:28 (20) : test changed on both paths - file5 (file5R, file5L) 2024/05/06 06:08:28 (21) : copy-as /tmp/060813ko/datadir/test_nomodtime-timijas8/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/ file5.txt 2024/05/06 06:08:28 INFO : file5R.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:28 (22) : copy-as /tmp/060813ko/datadir/test_nomodtime-timijas8/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/ file5.txt 2024/05/06 06:08:28 INFO : file5L.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:28 (23) : test changed on path2 and deleted on path1 - file6 2024/05/06 06:08:28 (24) : copy-file /tmp/060813ko/datadir/test_nomodtime-timijas8/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/ 2024/05/06 06:08:28 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:08:28 (25) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file6.txt 2024/05/06 06:08:28 INFO : file6.txt: Deleted 2024/05/06 06:08:28 (26) : test changed on path1 and deleted on path2 - file7 2024/05/06 06:08:28 (27) : copy-file /tmp/060813ko/datadir/test_nomodtime-timijas8/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/ 2024/05/06 06:08:28 INFO : file7.txt: Copied (replaced existing) 2024/05/06 06:08:28 (28) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file7.txt 2024/05/06 06:08:28 INFO : file7.txt: Deleted 2024/05/06 06:08:28 (29) : test bisync run 2024/05/06 06:08:28 (30) : bisync nomodtime 2024/05/06 06:08:28 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/05/06 06:08:28 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/" 2024/05/06 06:08:28 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:28 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:28 INFO : Path1 checking for diffs 2024/05/06 06:08:28 INFO : - Path1 File changed: size (larger), hash - file2.txt 2024/05/06 06:08:28 INFO : - Path1 File was deleted - file4.txt 2024/05/06 06:08:28 INFO : - Path1 File changed: size (larger), hash - file5.txt 2024/05/06 06:08:28 INFO : - Path1 File was deleted - file6.txt 2024/05/06 06:08:28 INFO : - Path1 File changed: size (larger), hash - file7.txt 2024/05/06 06:08:28 INFO : - Path1 File was deleted - file8.txt 2024/05/06 06:08:28 INFO : - Path1 File is new - file11.txt 2024/05/06 06:08:28 INFO : Path1: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:08:28 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2024/05/06 06:08:28 INFO : Path2 checking for diffs 2024/05/06 06:08:28 INFO : - Path2 File changed: size (larger), hash - file1.txt 2024/05/06 06:08:28 INFO : - Path2 File was deleted - file3.txt 2024/05/06 06:08:28 INFO : - Path2 File changed: size (larger), hash - file5.txt 2024/05/06 06:08:28 INFO : - Path2 File changed: size (larger), hash - file6.txt 2024/05/06 06:08:28 INFO : - Path2 File was deleted - file7.txt 2024/05/06 06:08:28 INFO : - Path2 File was deleted - file8.txt 2024/05/06 06:08:28 INFO : - Path2 File is new - file10.txt 2024/05/06 06:08:28 INFO : Path2: 7 changes:  1 new,  3 modified,  3 deleted 2024/05/06 06:08:28 INFO : (Modified:  3 larger,  0 smaller,  3 hash differs) 2024/05/06 06:08:28 INFO : Applying changes 2024/05/06 06:08:28 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file11.txt 2024/05/06 06:08:28 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file2.txt 2024/05/06 06:08:28 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file4.txt 2024/05/06 06:08:28 NOTICE: - WARNING New or changed in both paths - file5.txt 2024/05/06 06:08:28 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file5.txt.conflict1 2024/05/06 06:08:28 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict1 2024/05/06 06:08:28 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file5.txt.conflict1 2024/05/06 06:08:28 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file5.txt.conflict2 2024/05/06 06:08:28 INFO : file5.txt: Moved (server-side) to: file5.txt.conflict2 2024/05/06 06:08:28 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file5.txt.conflict2 2024/05/06 06:08:28 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file6.txt 2024/05/06 06:08:28 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/file7.txt 2024/05/06 06:08:28 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file1.txt 2024/05/06 06:08:28 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file10.txt 2024/05/06 06:08:28 INFO : - Path1 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/file3.txt 2024/05/06 06:08:28 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:28 INFO : file10.txt: Copied (new) 2024/05/06 06:08:28 INFO : file5.txt.conflict2: Copied (new) 2024/05/06 06:08:28 INFO : file6.txt: Copied (new) 2024/05/06 06:08:28 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:28 INFO : file3.txt: Deleted 2024/05/06 06:08:28 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:28 INFO : file11.txt: Copied (new) 2024/05/06 06:08:28 INFO : file7.txt: Copied (new) 2024/05/06 06:08:28 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:28 INFO : file5.txt.conflict1: Copied (new) 2024/05/06 06:08:28 INFO : file4.txt: Deleted 2024/05/06 06:08:28 INFO : Updating listings 2024/05/06 06:08:28 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/nomodtime/path2/" 2024/05/06 06:08:28 INFO : Bisync successful bisync_test.go:555: TEST nomodtime PASSED === RUN TestBisyncRemoteRemote/normalization 2024/05/06 06:08:28 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:28 DEBUG : path1: Making directory 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:28 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1" 2024/05/06 06:08:28 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:28 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:28 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:28 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:28 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:28 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:28 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1" 2024/05/06 06:08:28 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:28 DEBUG : path2: Making directory 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:28 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2" 2024/05/06 06:08:28 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:28 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:28 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:28 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:28 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:28 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:28 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2" 2024/05/06 06:08:28 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_normalization-mipinay6" 2024/05/06 06:08:28 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory with metadata 2024/05/06 06:08:28 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z) 2024/05/06 06:08:28 DEBUG : Added delayed dir = "測試_РуÑÑкий_ _ _Ä›_áñ", newDst=測試_РуÑÑкий_ _ _Ä›_áñ 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:28 DEBUG : file1.txt.zedawaq4.partial: renamed to: file1.txt 2024/05/06 06:08:28 INFO : file1.txt: Copied (new) 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:28 DEBUG : Local file system at /tmp/060813ko/initdir/test_normalization-mipinay6: Waiting for checks to finish 2024/05/06 06:08:28 DEBUG : Local file system at /tmp/060813ko/initdir/test_normalization-mipinay6: Waiting for transfers to finish 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file.xilahip7.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file 2024/05/06 06:08:28 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/05/06 06:08:28 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:28 DEBUG : RCLONE_TEST.bawepad0.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:28 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt.womiwud3.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt 2024/05/06 06:08:28 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt.fetakix1.partial: renamed to: 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt 2024/05/06 06:08:28 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:28 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ: Updated directory metadata 2024/05/06 06:08:28 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_normalization-bureyom5" 2024/05/06 06:08:28 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : Local file system at /tmp/060813ko/datadir/test_normalization-bureyom5: Waiting for checks to finish 2024/05/06 06:08:28 DEBUG : Local file system at /tmp/060813ko/datadir/test_normalization-bureyom5: Waiting for transfers to finish 2024/05/06 06:08:28 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/05/06 06:08:28 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:28 DEBUG : 測試_filtersfile.txt.yemafuw0.partial: renamed to: 測試_filtersfile.txt 2024/05/06 06:08:28 DEBUG : file1.txt.bofofac5.partial: renamed to: file1.txt 2024/05/06 06:08:28 INFO : 測試_filtersfile.txt: Copied (new) 2024/05/06 06:08:28 INFO : file1.txt: Copied (new) 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1] 2024/05/06 06:08:28 ERROR : : error listing: directory not found 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2] 2024/05/06 06:08:28 ERROR : : error listing: directory not found 2024/05/06 06:08:28 checking initFs Local file system at /tmp/060813ko/initdir/test_normalization-mipinay6 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1] 2024/05/06 06:08:28 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/RCLONE_TEST] 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/file1.txt] 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt] 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt] 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1: Waiting for checks to finish 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1: Waiting for transfers to finish 2024/05/06 06:08:28 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file] 2024/05/06 06:08:28 INFO : file1.txt: Copied (new) 2024/05/06 06:08:28 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:28 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:28 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/05/06 06:08:28 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1] 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2] 2024/05/06 06:08:28 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ: Making directory 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/RCLONE_TEST] 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/file1.txt] 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Need to transfer - File not found at Destination 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt] 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: Waiting for checks to finish 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: Waiting for transfers to finish 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt] 2024/05/06 06:08:28 INFO : file1.txt: Copied (new) 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file] 2024/05/06 06:08:28 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:28 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_Ä›_.txt: Copied (new) 2024/05/06 06:08:28 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/filename_contains_ࢺ_.txt: Copied (new) 2024/05/06 06:08:28 INFO : 測試_РуÑÑкий_ _ _Ä›_áñ/測試_check file: Copied (new) 2024/05/06 06:08:28 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2] 2024/05/06 06:08:28 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/測試_РуÑÑкий_ _ _Ä›_áñ] 2024/05/06 06:08:28 (01) : test normalization 2024/05/06 06:08:28 (02) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/ 2024/05/06 06:08:28 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:28 (03) : test initial bisync 2024/05/06 06:08:28 (04) : bisync resync 2024/05/06 06:08:28 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:08:28 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/05/06 06:08:28 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:28 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:28 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/" 2024/05/06 06:08:28 INFO : Copying Path2 files to Path1 2024/05/06 06:08:28 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:28 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:28 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:28 INFO : Resync updating listings 2024/05/06 06:08:28 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/" 2024/05/06 06:08:28 INFO : Bisync successful 2024/05/06 06:08:28 (05) : copy-as-NFC /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/測試_РуÑÑкий___eÌŒ_aÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö 測試_РуÑÑкий___eÌŒ_aÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö.txt 2024/05/06 06:08:28 INFO : file1.txt: Copied (new) to: 測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶.txt 2024/05/06 06:08:28 (06) : copy-as-NFC /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/folder eÌeÌeÌö.txt 2024/05/06 06:08:28 INFO : file1.txt: Copied (new) to: éééö.txt 2024/05/06 06:08:28 (07) : copy-as-NFC /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/folder HeLlO,wOrLd!.txt 2024/05/06 06:08:28 INFO : file1.txt: Copied (new) to: HeLlO,wOrLd!.txt 2024/05/06 06:08:28 (08) : touch-copy 2001-01-03 /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/ 2024/05/06 06:08:28 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:28 (09) : copy-as-NFD /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/folder eÌeÌeÌö.txt 2024/05/06 06:08:28 INFO : file1.txt: Copied (new) to: eÌeÌeÌö.txt 2024/05/06 06:08:28 (10) : copy-as-NFD /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/folder hello,WORLD!.txt 2024/05/06 06:08:28 INFO : file1.txt: Copied (new) to: hello,WORLD!.txt 2024/05/06 06:08:28 (11) : test bisync run with fix-case 2024/05/06 06:08:28 (12) : bisync fix-case 2024/05/06 06:08:29 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:08:29 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/05/06 06:08:29 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:29 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:29 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/" 2024/05/06 06:08:29 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:29 INFO : Path1 checking for diffs 2024/05/06 06:08:29 INFO : - Path1 File is new - folder/HeLlO,wOrLd!.txt 2024/05/06 06:08:29 INFO : - Path1 File is new - folder/éééö.txt 2024/05/06 06:08:29 INFO : - Path1 File is new - "測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö/測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö.txt" 2024/05/06 06:08:29 INFO : Path1: 3 changes:  3 new,  0 modified,  0 deleted 2024/05/06 06:08:29 INFO : Path2 checking for diffs 2024/05/06 06:08:29 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:29 INFO : - Path2 File is new - folder/eÌeÌeÌö.txt 2024/05/06 06:08:29 INFO : - Path2 File is new - folder/hello,WORLD!.txt 2024/05/06 06:08:29 INFO : Path2: 3 changes:  2 new,  1 modified,  0 deleted 2024/05/06 06:08:29 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:29 INFO : Applying changes 2024/05/06 06:08:29 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:29 INFO : Checking potential conflicts... 2024/05/06 06:08:29 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: 0 differences found 2024/05/06 06:08:29 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: 2 matching files 2024/05/06 06:08:29 INFO : Finished checking the potential conflicts. %!s() 2024/05/06 06:08:29 NOTICE: - WARNING New or changed in both paths - folder/HeLlO,wOrLd!.txt 2024/05/06 06:08:29 INFO : folder/hello,WORLD!.txt: Files are equal but will copy anyway to fix case to folder/HeLlO,wOrLd!.txt 2024/05/06 06:08:29 NOTICE: - WARNING New or changed in both paths - folder/éééö.txt 2024/05/06 06:08:29 INFO : folder/eÌeÌeÌö.txt: Files are equal but will copy anyway to fix case to folder/éééö.txt 2024/05/06 06:08:29 INFO : - Path1 Queue copy to Path2 - "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö/測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö.txt" 2024/05/06 06:08:29 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/file1.txt 2024/05/06 06:08:29 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:29 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:29 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:29 INFO : folder/hello,WORLD!.txt: Moved (server-side) to: folder/HeLlO,wOrLd!.txt 2024/05/06 06:08:29 INFO : folder/hello,WORLD!.txt: Fixed case by renaming to: folder/HeLlO,wOrLd!.txt 2024/05/06 06:08:29 INFO : folder/eÌeÌeÌö.txt: Moved (server-side) to: folder/éééö.txt 2024/05/06 06:08:29 INFO : folder/eÌeÌeÌö.txt: Fixed case by renaming to: folder/éééö.txt 2024/05/06 06:08:29 INFO : 測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶/測試_РуÑÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶.txt: Copied (new) 2024/05/06 06:08:29 INFO : folder/HeLlO,wOrLd!.txt: Copied (replaced existing) 2024/05/06 06:08:29 INFO : folder/éééö.txt: Copied (replaced existing) 2024/05/06 06:08:29 INFO : Updating listings 2024/05/06 06:08:29 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/" 2024/05/06 06:08:29 INFO : Bisync successful 2024/05/06 06:08:29 (13) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/ 2024/05/06 06:08:29 (14) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/ 2024/05/06 06:08:29 (15) : touch-copy 2001-01-02 /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/ 2024/05/06 06:08:29 INFO : file1.txt: Copied (new) 2024/05/06 06:08:29 (16) : copy-as-NFC /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/ file2.txt 2024/05/06 06:08:29 INFO : file1.txt: Copied (new) to: file2.txt 2024/05/06 06:08:29 (17) : copy-as-NFC /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/ file3.txt 2024/05/06 06:08:29 INFO : file1.txt: Copied (new) to: file3.txt 2024/05/06 06:08:29 (18) : bisync resync 2024/05/06 06:08:29 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:08:29 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/05/06 06:08:29 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:29 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:29 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/" 2024/05/06 06:08:29 INFO : Copying Path2 files to Path1 2024/05/06 06:08:29 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:29 INFO : file2.txt: Copied (new) 2024/05/06 06:08:29 INFO : file1.txt: Copied (new) 2024/05/06 06:08:29 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:29 INFO : file3.txt: Copied (new) 2024/05/06 06:08:29 INFO : Resync updating listings 2024/05/06 06:08:29 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/" 2024/05/06 06:08:29 INFO : Bisync successful 2024/05/06 06:08:29 (19) : copy-as-NFC /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/測試_РуÑкий___eÌŒ_aÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö 測試_РуÑкий___eÌŒ_aÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö.txt 2024/05/06 06:08:29 INFO : file1.txt: Copied (new) to: 測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶.txt 2024/05/06 06:08:29 (20) : copy-as-NFC /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/newfolder eÌeÌeÌö.txt 2024/05/06 06:08:29 INFO : file1.txt: Copied (new) to: éééö.txt 2024/05/06 06:08:29 (21) : copy-as-NFC /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/newfolder HeLlO,wOrLd!.txt 2024/05/06 06:08:29 INFO : file1.txt: Copied (new) to: HeLlO,wOrLd!.txt 2024/05/06 06:08:29 (22) : touch-copy 2001-01-03 /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/ 2024/05/06 06:08:29 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:29 (23) : copy-as-NFD /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/newfolder eÌeÌeÌö.txt 2024/05/06 06:08:29 INFO : file1.txt: Copied (new) to: eÌeÌeÌö.txt 2024/05/06 06:08:29 (24) : copy-as-NFD /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/newfolder hello,WORLD!.txt 2024/05/06 06:08:29 INFO : file1.txt: Copied (new) to: hello,WORLD!.txt 2024/05/06 06:08:29 (25) : test bisync run with normalization 2024/05/06 06:08:29 (26) : bisync norm force 2024/05/06 06:08:29 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:08:29 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/05/06 06:08:29 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:29 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:29 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/" 2024/05/06 06:08:29 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:29 INFO : Path1 checking for diffs 2024/05/06 06:08:29 INFO : - Path1 File is new - newfolder/HeLlO,wOrLd!.txt 2024/05/06 06:08:29 INFO : - Path1 File is new - newfolder/éééö.txt 2024/05/06 06:08:29 INFO : - Path1 File is new - "測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö.txt" 2024/05/06 06:08:29 INFO : Path1: 3 changes:  3 new,  0 modified,  0 deleted 2024/05/06 06:08:29 INFO : Path2 checking for diffs 2024/05/06 06:08:29 INFO : - Path2 File changed: time (newer) - file1.txt 2024/05/06 06:08:29 INFO : - Path2 File is new - newfolder/eÌeÌeÌö.txt 2024/05/06 06:08:29 INFO : - Path2 File is new - newfolder/hello,WORLD!.txt 2024/05/06 06:08:29 INFO : Path2: 3 changes:  2 new,  1 modified,  0 deleted 2024/05/06 06:08:29 INFO : (Modified:  1 newer,  0 older) 2024/05/06 06:08:29 INFO : Applying changes 2024/05/06 06:08:29 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:29 INFO : Checking potential conflicts... 2024/05/06 06:08:29 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: 0 differences found 2024/05/06 06:08:29 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2: 2 matching files 2024/05/06 06:08:29 INFO : Finished checking the potential conflicts. %!s() 2024/05/06 06:08:29 NOTICE: - WARNING New or changed in both paths - newfolder/HeLlO,wOrLd!.txt 2024/05/06 06:08:29 INFO : newfolder/HeLlO,wOrLd!.txt: Files are equal but will copy anyway to update modtime (will not rename) 2024/05/06 06:08:29 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/newfolder/HeLlO,wOrLd!.txt 2024/05/06 06:08:29 NOTICE: - WARNING New or changed in both paths - newfolder/éééö.txt 2024/05/06 06:08:29 INFO : newfolder/éééö.txt: Files are equal but will copy anyway to update modtime (will not rename) 2024/05/06 06:08:29 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/newfolder/éééö.txt 2024/05/06 06:08:29 INFO : - Path1 Queue copy to Path2 - "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö.txt" 2024/05/06 06:08:29 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/file1.txt 2024/05/06 06:08:29 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:29 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:29 INFO : newfolder/hello,WORLD!.txt: Copied (replaced existing) to: newfolder/HeLlO,wOrLd!.txt 2024/05/06 06:08:29 INFO : newfolder/eÌeÌeÌö.txt: Copied (replaced existing) to: newfolder/éééö.txt 2024/05/06 06:08:29 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:29 INFO : 測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶.txt: Copied (new) 2024/05/06 06:08:29 INFO : Updating listings 2024/05/06 06:08:29 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/" 2024/05/06 06:08:29 INFO : Bisync successful 2024/05/06 06:08:29 (27) : test resync 2024/05/06 06:08:29 (28) : bisync resync norm 2024/05/06 06:08:29 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:08:29 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/05/06 06:08:29 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:29 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:29 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/" 2024/05/06 06:08:29 INFO : Copying Path2 files to Path1 2024/05/06 06:08:29 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:29 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:29 INFO : Resync updating listings 2024/05/06 06:08:29 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:29 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:29 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/" 2024/05/06 06:08:29 INFO : Bisync successful 2024/05/06 06:08:29 (29) : test changed on one path 2024/05/06 06:08:29 (30) : touch-copy 2001-01-05 /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/ 2024/05/06 06:08:29 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:29 (31) : copy-as-NFC /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/測試_РуÑкий___eÌŒ_aÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö 測試_РуÑкий___eÌŒ_aÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö.txt 2024/05/06 06:08:29 INFO : file1.txt: Copied (replaced existing) to: 測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶.txt 2024/05/06 06:08:29 (32) : copy-as-NFC /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/newfolder eÌeÌeÌö.txt 2024/05/06 06:08:29 INFO : file1.txt: Copied (replaced existing) to: éééö.txt 2024/05/06 06:08:29 (33) : copy-as-NFC /tmp/060813ko/datadir/test_normalization-bureyom5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/newfolder HeLlO,wOrLd!.txt 2024/05/06 06:08:29 INFO : file1.txt: Copied (replaced existing) to: HeLlO,wOrLd!.txt 2024/05/06 06:08:29 (34) : bisync norm 2024/05/06 06:08:29 INFO : ě�� aÌñhࢺ_測試руÑкийeÌŒaÌñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬eÌö: Copied (new) 2024/05/06 06:08:29 INFO : � áñhࢺ_測試руÑкийěáñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶: Copied (new) 2024/05/06 06:08:29 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:29 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:29 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/" 2024/05/06 06:08:29 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:29 INFO : Path1 checking for diffs 2024/05/06 06:08:29 INFO : - Path1 File changed: time (newer) - newfolder/HeLlO,wOrLd!.txt 2024/05/06 06:08:29 INFO : - Path1 File changed: time (newer) - newfolder/éééö.txt 2024/05/06 06:08:29 INFO : - Path1 File changed: time (newer) - "測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö.txt" 2024/05/06 06:08:29 INFO : Path1: 3 changes:  0 new,  3 modified,  0 deleted 2024/05/06 06:08:29 INFO : (Modified:  3 newer,  0 older) 2024/05/06 06:08:29 INFO : Path2 checking for diffs 2024/05/06 06:08:29 INFO : - Path2 File changed: time (newer) - file1.txt 2024/05/06 06:08:29 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:29 INFO : (Modified:  1 newer,  0 older) 2024/05/06 06:08:29 INFO : Applying changes 2024/05/06 06:08:29 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/newfolder/hello,WORLD!.txt 2024/05/06 06:08:29 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/newfolder/eÌeÌeÌö.txt 2024/05/06 06:08:29 INFO : - Path1 Queue copy to Path2 - "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾\u200d♀ï¸ðŸ’†ðŸ¿\u200d♂ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»\u200d🔧🧑\u200d🔬éö.txt" 2024/05/06 06:08:29 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/file1.txt 2024/05/06 06:08:29 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:29 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:29 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:29 INFO : 測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶/測試_РуÑкий___Ä›_áñ👸ðŸ¼ðŸ§ðŸ¾â€â™€ï¸ðŸ’†ðŸ¿â€â™‚ï¸ðŸ¨ðŸ¤™ðŸ¼ðŸ¤®ðŸ§‘ðŸ»â€ðŸ”§ðŸ§‘â€ðŸ”¬Ã©Ã¶.txt: Copied (replaced existing) 2024/05/06 06:08:29 INFO : newfolder/éééö.txt: Copied (replaced existing) to: newfolder/eÌeÌeÌö.txt 2024/05/06 06:08:29 INFO : newfolder/HeLlO,wOrLd!.txt: Copied (replaced existing) to: newfolder/hello,WORLD!.txt 2024/05/06 06:08:29 INFO : Updating listings 2024/05/06 06:08:29 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/normalization/path2/" 2024/05/06 06:08:29 INFO : Bisync successful bisync_test.go:555: TEST normalization PASSED === RUN TestBisyncRemoteRemote/rclone_args 2024/05/06 06:08:30 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:30 DEBUG : path1: Making directory 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:30 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1" 2024/05/06 06:08:30 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:30 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:30 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1" 2024/05/06 06:08:30 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:30 DEBUG : path2: Making directory 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:30 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2" 2024/05/06 06:08:30 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:30 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:30 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:30 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:30 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2" 2024/05/06 06:08:30 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_rclone_args-mulosoc5" 2024/05/06 06:08:30 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:30 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:30 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:30 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : Local file system at /tmp/060813ko/initdir/test_rclone_args-mulosoc5: Waiting for checks to finish 2024/05/06 06:08:30 DEBUG : Local file system at /tmp/060813ko/initdir/test_rclone_args-mulosoc5: Waiting for transfers to finish 2024/05/06 06:08:30 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:30 DEBUG : file2.txt.yexehuw9.partial: renamed to: file2.txt 2024/05/06 06:08:30 INFO : file2.txt: Copied (new) 2024/05/06 06:08:30 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:30 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:30 DEBUG : subdir/file20.txt.zuxukov5.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:30 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:30 DEBUG : subdir/file21.txt.muvuxup0.partial: renamed to: subdir/file21.txt 2024/05/06 06:08:30 INFO : subdir/file21.txt: Copied (new) 2024/05/06 06:08:30 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:30 DEBUG : RCLONE_TEST.nolomiv8.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:30 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:30 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK 2024/05/06 06:08:30 DEBUG : file1.txt.dacipaq1.partial: renamed to: file1.txt 2024/05/06 06:08:30 INFO : file1.txt: Copied (new) 2024/05/06 06:08:30 INFO : subdir: Updated directory metadata 2024/05/06 06:08:30 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_rclone_args-tofotiy5" 2024/05/06 06:08:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : file21.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:30 DEBUG : file21.txt.vodarav6.partial: renamed to: file21.txt 2024/05/06 06:08:30 INFO : file21.txt: Copied (new) 2024/05/06 06:08:30 DEBUG : Local file system at /tmp/060813ko/datadir/test_rclone_args-tofotiy5: Waiting for checks to finish 2024/05/06 06:08:30 DEBUG : Local file system at /tmp/060813ko/datadir/test_rclone_args-tofotiy5: Waiting for transfers to finish 2024/05/06 06:08:30 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:30 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:30 DEBUG : file2.txt.bomisay4.partial: renamed to: file2.txt 2024/05/06 06:08:30 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:30 INFO : file2.txt: Copied (new) 2024/05/06 06:08:30 DEBUG : file20.txt.foporox8.partial: renamed to: file20.txt 2024/05/06 06:08:30 INFO : file20.txt: Copied (new) 2024/05/06 06:08:30 DEBUG : file1.txt.hojikip3.partial: renamed to: file1.txt 2024/05/06 06:08:30 INFO : file1.txt: Copied (new) 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1] 2024/05/06 06:08:30 ERROR : : error listing: directory not found 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2] 2024/05/06 06:08:30 ERROR : : error listing: directory not found 2024/05/06 06:08:30 checking initFs Local file system at /tmp/060813ko/initdir/test_rclone_args-mulosoc5 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1] 2024/05/06 06:08:30 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : subdir: Making directory 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir] 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/RCLONE_TEST] 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/file1.txt] 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/file2.txt] 2024/05/06 06:08:30 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1: Waiting for checks to finish 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1: Waiting for transfers to finish 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir/file20.txt] 2024/05/06 06:08:30 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir/file21.txt] 2024/05/06 06:08:30 INFO : file2.txt: Copied (new) 2024/05/06 06:08:30 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:30 INFO : subdir/file21.txt: Copied (new) 2024/05/06 06:08:30 INFO : file1.txt: Copied (new) 2024/05/06 06:08:30 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1] 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir] 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2] 2024/05/06 06:08:30 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : subdir: Making directory 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/subdir] 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/RCLONE_TEST] 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/file1.txt] 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/file2.txt] 2024/05/06 06:08:30 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2: Waiting for checks to finish 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/subdir/file20.txt] 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2: Waiting for transfers to finish 2024/05/06 06:08:30 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/subdir/file21.txt] 2024/05/06 06:08:30 INFO : file2.txt: Copied (new) 2024/05/06 06:08:30 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:30 INFO : file1.txt: Copied (new) 2024/05/06 06:08:30 INFO : subdir/file21.txt: Copied (new) 2024/05/06 06:08:30 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2] 2024/05/06 06:08:30 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/subdir] 2024/05/06 06:08:30 (01) : test rclone-args 2024/05/06 06:08:30 (02) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_rclone_args-tofotiy5/ * 2024/05/06 06:08:30 (03) : test initial bisync 2024/05/06 06:08:30 (04) : bisync resync checksum 2024/05/06 06:08:30 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/05/06 06:08:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Copying Path2 files to Path1 2024/05/06 06:08:30 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:30 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:30 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:30 INFO : Resync updating listings 2024/05/06 06:08:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Bisync successful 2024/05/06 06:08:30 (05) : test place newer files on both paths 2024/05/06 06:08:30 (06) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/ 2024/05/06 06:08:30 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:30 (07) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/ 2024/05/06 06:08:30 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:30 (08) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir 2024/05/06 06:08:30 INFO : file20.txt: Copied (replaced existing) 2024/05/06 06:08:30 (09) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/subdir 2024/05/06 06:08:30 INFO : file21.txt: Copied (replaced existing) 2024/05/06 06:08:30 (10) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/ file1.txt 2024/05/06 06:08:30 (11) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/ file2.txt 2024/05/06 06:08:30 (12) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir/ file20.txt 2024/05/06 06:08:30 (13) : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/subdir/ file21.txt 2024/05/06 06:08:30 (14) : test run bisync with custom options 2024/05/06 06:08:30 (15) : bisync checksum 2024/05/06 06:08:30 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/05/06 06:08:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:30 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:30 INFO : Path1 checking for diffs 2024/05/06 06:08:30 INFO : - Path1 File changed: hash - file1.txt 2024/05/06 06:08:30 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:30 INFO : (Modified:  1 hash differs) 2024/05/06 06:08:30 INFO : Path2 checking for diffs 2024/05/06 06:08:30 INFO : - Path2 File changed: size (larger), hash - file2.txt 2024/05/06 06:08:30 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:30 INFO : (Modified:  1 larger,  0 smaller,  1 hash differs) 2024/05/06 06:08:30 INFO : Applying changes 2024/05/06 06:08:30 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/file1.txt 2024/05/06 06:08:30 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/file2.txt 2024/05/06 06:08:30 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:30 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:30 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : Updating listings 2024/05/06 06:08:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Bisync successful 2024/05/06 06:08:30 (16) : touch-glob 2007-07-23 /tmp/060813ko/datadir/test_rclone_args-tofotiy5/ * 2024/05/06 06:08:30 (17) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/ 2024/05/06 06:08:30 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:30 (18) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/ 2024/05/06 06:08:30 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:30 (19) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir 2024/05/06 06:08:30 INFO : file20.txt: Copied (replaced existing) 2024/05/06 06:08:30 (20) : copy-as /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/ file1.txt 2024/05/06 06:08:30 INFO : file21.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:30 (21) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/ file1.txt 2024/05/06 06:08:30 (22) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/ file2.txt 2024/05/06 06:08:30 (23) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir/ file20.txt 2024/05/06 06:08:30 (24) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/subdir/ file21.txt 2024/05/06 06:08:30 (25) : bisync size-only 2024/05/06 06:08:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:30 INFO : Bisyncing with Comparison Settings: { "Modtime": false, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:30 INFO : Path1 checking for diffs 2024/05/06 06:08:30 INFO : Path2 checking for diffs 2024/05/06 06:08:30 INFO : - Path2 File changed: size (smaller) - file1.txt 2024/05/06 06:08:30 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:30 INFO : (Modified:  0 larger,  1 smaller) 2024/05/06 06:08:30 INFO : Applying changes 2024/05/06 06:08:30 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/file1.txt 2024/05/06 06:08:30 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:30 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : Updating listings 2024/05/06 06:08:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Bisync successful 2024/05/06 06:08:30 (26) : bisync resync 2024/05/06 06:08:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Copying Path2 files to Path1 2024/05/06 06:08:30 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:30 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:30 INFO : subdir/file21.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : Resync updating listings 2024/05/06 06:08:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Bisync successful 2024/05/06 06:08:30 (27) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/ 2024/05/06 06:08:30 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:30 (28) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/ 2024/05/06 06:08:30 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:30 (29) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir 2024/05/06 06:08:30 (30) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/subdir 2024/05/06 06:08:30 INFO : file21.txt: Copied (replaced existing) 2024/05/06 06:08:30 (31) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/ file1.txt 2024/05/06 06:08:30 (32) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/ file2.txt 2024/05/06 06:08:30 (33) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir/ file20.txt 2024/05/06 06:08:30 (34) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/subdir/ file21.txt 2024/05/06 06:08:30 (35) : bisync ignore-size 2024/05/06 06:08:30 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": false, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:30 INFO : Path1 checking for diffs 2024/05/06 06:08:30 INFO : Path2 checking for diffs 2024/05/06 06:08:30 INFO : - Path2 File changed: time (newer) - file2.txt 2024/05/06 06:08:30 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2024/05/06 06:08:30 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:08:30 INFO : (Modified:  2 newer,  0 older) 2024/05/06 06:08:30 INFO : Applying changes 2024/05/06 06:08:30 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/file2.txt 2024/05/06 06:08:30 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir/file21.txt 2024/05/06 06:08:30 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:30 INFO : subdir/file21.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : Updating listings 2024/05/06 06:08:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Bisync successful 2024/05/06 06:08:30 (36) : bisync resync compare-all 2024/05/06 06:08:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/05/06 06:08:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Copying Path2 files to Path1 2024/05/06 06:08:30 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:30 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:30 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:30 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : Resync updating listings 2024/05/06 06:08:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Bisync successful 2024/05/06 06:08:30 (37) : copy-as /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/ file2.txt 2024/05/06 06:08:30 INFO : file21.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:30 (38) : touch-glob 2023-08-26 /tmp/060813ko/datadir/test_rclone_args-tofotiy5/ * 2024/05/06 06:08:30 (39) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/ 2024/05/06 06:08:30 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:30 (40) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir 2024/05/06 06:08:30 INFO : file20.txt: Copied (replaced existing) 2024/05/06 06:08:30 (41) : copy-file /tmp/060813ko/datadir/test_rclone_args-tofotiy5/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/subdir 2024/05/06 06:08:30 INFO : file21.txt: Copied (replaced existing) 2024/05/06 06:08:30 (42) : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/ file2.txt 2024/05/06 06:08:30 (43) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/ file1.txt 2024/05/06 06:08:30 (44) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir/ file20.txt 2024/05/06 06:08:30 (45) : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/subdir/ file21.txt 2024/05/06 06:08:30 (46) : bisync compare-all 2024/05/06 06:08:30 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": true, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": true } 2024/05/06 06:08:30 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:30 INFO : TestHdfs{cNNQW}: Downloading hashes... 2024/05/06 06:08:30 INFO : Path1 checking for diffs 2024/05/06 06:08:30 INFO : - Path1 File changed: time (newer) - file1.txt 2024/05/06 06:08:30 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2024/05/06 06:08:30 INFO : Path1: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:08:30 INFO : (Modified:  2 newer,  0 older) 2024/05/06 06:08:30 INFO : Path2 checking for diffs 2024/05/06 06:08:30 INFO : - Path2 File changed: size (smaller), hash - file2.txt 2024/05/06 06:08:30 INFO : - Path2 File changed: time (newer) - subdir/file21.txt 2024/05/06 06:08:30 INFO : Path2: 2 changes:  0 new,  2 modified,  0 deleted 2024/05/06 06:08:30 INFO : (Modified:  1 newer,  0 older,  0 larger,  1 smaller,  1 hash differs) 2024/05/06 06:08:30 INFO : Applying changes 2024/05/06 06:08:30 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/file1.txt 2024/05/06 06:08:30 INFO : - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/subdir/file20.txt 2024/05/06 06:08:30 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/file2.txt 2024/05/06 06:08:30 INFO : - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/subdir/file21.txt 2024/05/06 06:08:30 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:30 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : subdir/file21.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:30 INFO : subdir/file20.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:30 INFO : Updating listings 2024/05/06 06:08:30 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rclone_args/path2/" 2024/05/06 06:08:30 INFO : Bisync successful bisync_test.go:555: TEST rclone_args PASSED === RUN TestBisyncRemoteRemote/resolve 2024/05/06 06:08:31 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:31 DEBUG : path1: Making directory 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:31 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1" 2024/05/06 06:08:31 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:31 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:31 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1" 2024/05/06 06:08:31 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:31 DEBUG : path2: Making directory 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:31 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2" 2024/05/06 06:08:31 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:31 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:31 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2" 2024/05/06 06:08:31 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_resolve-limiwap6" 2024/05/06 06:08:31 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:31 DEBUG : file1.txt.nijumav1.partial: renamed to: file1.txt 2024/05/06 06:08:31 INFO : file1.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : Local file system at /tmp/060813ko/initdir/test_resolve-limiwap6: Waiting for checks to finish 2024/05/06 06:08:31 DEBUG : Local file system at /tmp/060813ko/initdir/test_resolve-limiwap6: Waiting for transfers to finish 2024/05/06 06:08:31 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:31 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:31 DEBUG : file2.txt.zutavos2.partial: renamed to: file2.txt 2024/05/06 06:08:31 DEBUG : RCLONE_TEST.cadowum7.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:31 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:31 INFO : file2.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_resolve-pafuvig2" 2024/05/06 06:08:31 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/05/06 06:08:31 DEBUG : file1L.txt.rejuheb4.partial: renamed to: file1L.txt 2024/05/06 06:08:31 INFO : file1L.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : Local file system at /tmp/060813ko/datadir/test_resolve-pafuvig2: Waiting for checks to finish 2024/05/06 06:08:31 DEBUG : Local file system at /tmp/060813ko/datadir/test_resolve-pafuvig2: Waiting for transfers to finish 2024/05/06 06:08:31 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK 2024/05/06 06:08:31 DEBUG : file1R.txt.miyowum1.partial: renamed to: file1R.txt 2024/05/06 06:08:31 INFO : file1R.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/05/06 06:08:31 DEBUG : file2.txt.sigikeb3.partial: renamed to: file2.txt 2024/05/06 06:08:31 INFO : file2.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1] 2024/05/06 06:08:31 ERROR : : error listing: directory not found 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2] 2024/05/06 06:08:31 ERROR : : error listing: directory not found 2024/05/06 06:08:31 checking initFs Local file system at /tmp/060813ko/initdir/test_resolve-limiwap6 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1] 2024/05/06 06:08:31 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/RCLONE_TEST] 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/file2.txt] 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1: Waiting for checks to finish 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1: Waiting for transfers to finish 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/file1.txt] 2024/05/06 06:08:31 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:31 INFO : file2.txt: Copied (new) 2024/05/06 06:08:31 INFO : file1.txt: Copied (new) 2024/05/06 06:08:31 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1] 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2] 2024/05/06 06:08:31 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/RCLONE_TEST] 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: Waiting for checks to finish 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: Waiting for transfers to finish 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/file1.txt] 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/file2.txt] 2024/05/06 06:08:31 INFO : file2.txt: Copied (new) 2024/05/06 06:08:31 INFO : file1.txt: Copied (new) 2024/05/06 06:08:31 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:31 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2] 2024/05/06 06:08:31 (01) : test resolve 2024/05/06 06:08:31 (02) : test initial bisync 2024/05/06 06:08:31 (03) : bisync resync 2024/05/06 06:08:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Copying Path2 files to Path1 2024/05/06 06:08:31 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:31 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:31 INFO : Resync updating listings 2024/05/06 06:08:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Bisync successful 2024/05/06 06:08:31 (04) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:31 (05) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_resolve-pafuvig2/ file1R.txt 2024/05/06 06:08:31 (06) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/ file1.txt 2024/05/06 06:08:31 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:31 (07) : touch-glob 2001-03-04 /tmp/060813ko/datadir/test_resolve-pafuvig2/ file1L.txt 2024/05/06 06:08:31 (08) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/ file1.txt 2024/05/06 06:08:31 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:31 (09) : test bisync run with --conflict-resolve=newer --conflict-loser=delete --conflict-suffix=potato 2024/05/06 06:08:31 (10) : bisync conflict-resolve=newer conflict-loser=delete conflict-suffix=potato 2024/05/06 06:08:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:31 INFO : Path1 checking for diffs 2024/05/06 06:08:31 INFO : - Path1 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:31 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:31 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:31 INFO : Path2 checking for diffs 2024/05/06 06:08:31 INFO : - Path2 File changed: size (larger), time (newer) - file1.txt 2024/05/06 06:08:31 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:31 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:31 INFO : Applying changes 2024/05/06 06:08:31 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:31 INFO : Checking potential conflicts... 2024/05/06 06:08:31 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: 1 differences found 2024/05/06 06:08:31 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: 1 errors while checking 2024/05/06 06:08:31 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:31 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:31 INFO : file1.txt: Path1 is newer. Path1: 2001-03-04 00:00:00 +0000 UTC, Path2: 2001-01-02 00:00:00 +0000 UTC, Difference: 1464h0m0s 2024/05/06 06:08:31 INFO : file1.txt: The winner is: Path1 2024/05/06 06:08:31 NOTICE: - Path2 Deleting Path2 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/file1.txt 2024/05/06 06:08:31 INFO : file1.txt: Deleted 2024/05/06 06:08:31 INFO : - Path1 Queue copy to Path2 - file1.txt 2024/05/06 06:08:31 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:31 INFO : file1.txt: Copied (new) 2024/05/06 06:08:31 INFO : Updating listings 2024/05/06 06:08:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Bisync successful 2024/05/06 06:08:31 (11) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:31 (12) : touch-glob 2001-07-23 /tmp/060813ko/datadir/test_resolve-pafuvig2/ file1R.txt 2024/05/06 06:08:31 (13) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/ file1.txt 2024/05/06 06:08:31 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:31 (14) : touch-glob 2001-08-26 /tmp/060813ko/datadir/test_resolve-pafuvig2/ file1L.txt 2024/05/06 06:08:31 (15) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/ file1.txt 2024/05/06 06:08:31 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:31 (16) : test bisync run with --conflict-resolve=path2 --conflict-loser=num --conflict-suffix=dinosaur 2024/05/06 06:08:31 (17) : bisync conflict-resolve=path2 conflict-loser=num conflict-suffix=dinosaur 2024/05/06 06:08:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:31 INFO : Path1 checking for diffs 2024/05/06 06:08:31 INFO : - Path1 File changed: time (newer) - file1.txt 2024/05/06 06:08:31 INFO : Path1: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:31 INFO : (Modified:  1 newer,  0 older) 2024/05/06 06:08:31 INFO : Path2 checking for diffs 2024/05/06 06:08:31 INFO : - Path2 File changed: time (newer) - file1.txt 2024/05/06 06:08:31 INFO : Path2: 1 changes:  0 new,  1 modified,  0 deleted 2024/05/06 06:08:31 INFO : (Modified:  1 newer,  0 older) 2024/05/06 06:08:31 INFO : Applying changes 2024/05/06 06:08:31 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:31 INFO : Checking potential conflicts... 2024/05/06 06:08:31 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: 1 differences found 2024/05/06 06:08:31 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: 1 errors while checking 2024/05/06 06:08:31 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:31 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:31 INFO : file1.txt: The winner is: Path2 2024/05/06 06:08:31 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/file1.txt.dinosaur1 2024/05/06 06:08:31 INFO : file1.txt: Moved (server-side) to: file1.txt.dinosaur1 2024/05/06 06:08:31 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/file1.txt.dinosaur1 2024/05/06 06:08:31 NOTICE: - Path2 Not renaming Path2 copy, as it was determined the winner - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/file1.txt 2024/05/06 06:08:31 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/file1.txt 2024/05/06 06:08:31 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:31 INFO : file1.txt: Copied (new) 2024/05/06 06:08:31 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:31 INFO : file1.txt.dinosaur1: Copied (new) 2024/05/06 06:08:31 INFO : Updating listings 2024/05/06 06:08:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Bisync successful 2024/05/06 06:08:31 (18) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:31 (19) : touch-glob 2002-07-23 /tmp/060813ko/datadir/test_resolve-pafuvig2/ file1R.txt 2024/05/06 06:08:31 (20) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/ file1.txt 2024/05/06 06:08:31 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:31 (21) : touch-glob 2002-08-26 /tmp/060813ko/datadir/test_resolve-pafuvig2/ file1L.txt 2024/05/06 06:08:31 (22) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/ file1.txt 2024/05/06 06:08:31 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:31 (23) : test bisync run with --conflict-resolve=larger --conflict-loser=num --conflict-suffix=apple 2024/05/06 06:08:31 (24) : bisync conflict-resolve=larger conflict-loser=num conflict-suffix=apple 2024/05/06 06:08:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:31 INFO : Path1 checking for diffs 2024/05/06 06:08:31 INFO : - Path1 File is new - file1.txt 2024/05/06 06:08:31 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:31 INFO : Path2 checking for diffs 2024/05/06 06:08:31 INFO : - Path2 File is new - file1.txt 2024/05/06 06:08:31 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:31 INFO : Applying changes 2024/05/06 06:08:31 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:31 INFO : Checking potential conflicts... 2024/05/06 06:08:31 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: 1 differences found 2024/05/06 06:08:31 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: 1 errors while checking 2024/05/06 06:08:31 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:31 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:31 INFO : file1.txt: Winner cannot be determined as sizes are equal. Path1: 33, Path2: 33, Difference: 0 2024/05/06 06:08:31 INFO : file1.txt: A winner could not be determined. 2024/05/06 06:08:31 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/file1.txt.apple1 2024/05/06 06:08:31 INFO : file1.txt: Moved (server-side) to: file1.txt.apple1 2024/05/06 06:08:31 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/file1.txt.apple1 2024/05/06 06:08:31 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/file1.txt.apple2 2024/05/06 06:08:31 INFO : file1.txt: Moved (server-side) to: file1.txt.apple2 2024/05/06 06:08:31 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/file1.txt.apple2 2024/05/06 06:08:31 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:31 INFO : file1.txt.apple2: Copied (new) 2024/05/06 06:08:31 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:31 INFO : file1.txt.apple1: Copied (new) 2024/05/06 06:08:31 INFO : Updating listings 2024/05/06 06:08:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Bisync successful 2024/05/06 06:08:31 (25) : test different suffixes 2024/05/06 06:08:31 (26) : touch-glob 2003-07-23 /tmp/060813ko/datadir/test_resolve-pafuvig2/ file1R.txt 2024/05/06 06:08:31 (27) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/ file1.txt 2024/05/06 06:08:31 INFO : file1R.txt: Copied (new) to: file1.txt 2024/05/06 06:08:31 (28) : touch-glob 2003-07-23 /tmp/060813ko/datadir/test_resolve-pafuvig2/ file1L.txt 2024/05/06 06:08:31 (29) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/ file1.txt 2024/05/06 06:08:31 INFO : file1L.txt: Copied (new) to: file1.txt 2024/05/06 06:08:31 (30) : test bisync run with --conflict-resolve=older --conflict-loser=num --conflict-suffix=cloud,local 2024/05/06 06:08:31 (31) : bisync conflict-resolve=older conflict-loser=num conflict-suffix=cloud,local 2024/05/06 06:08:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:31 INFO : Path1 checking for diffs 2024/05/06 06:08:31 INFO : - Path1 File is new - file1.txt 2024/05/06 06:08:31 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:31 INFO : Path2 checking for diffs 2024/05/06 06:08:31 INFO : - Path2 File is new - file1.txt 2024/05/06 06:08:31 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:31 INFO : Applying changes 2024/05/06 06:08:31 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:31 INFO : Checking potential conflicts... 2024/05/06 06:08:31 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: 1 differences found 2024/05/06 06:08:31 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: 1 errors while checking 2024/05/06 06:08:31 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:31 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:31 INFO : file1.txt: Winner cannot be determined as times are equal. Path1: 2003-07-23 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 0s 2024/05/06 06:08:31 INFO : file1.txt: A winner could not be determined. 2024/05/06 06:08:31 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/file1.txt.cloud1 2024/05/06 06:08:31 INFO : file1.txt: Moved (server-side) to: file1.txt.cloud1 2024/05/06 06:08:31 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/file1.txt.cloud1 2024/05/06 06:08:31 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/file1.txt.local1 2024/05/06 06:08:31 INFO : file1.txt: Moved (server-side) to: file1.txt.local1 2024/05/06 06:08:31 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/file1.txt.local1 2024/05/06 06:08:31 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:31 INFO : file1.txt.local1: Copied (new) 2024/05/06 06:08:31 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:31 INFO : file1.txt.cloud1: Copied (new) 2024/05/06 06:08:31 INFO : Updating listings 2024/05/06 06:08:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Bisync successful 2024/05/06 06:08:31 (32) : test legacy 2024/05/06 06:08:31 (33) : touch-glob 2004-07-23 /tmp/060813ko/datadir/test_resolve-pafuvig2/ file1R.txt 2024/05/06 06:08:31 (34) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/ file1.txt 2024/05/06 06:08:31 INFO : file1R.txt: Copied (new) to: file1.txt 2024/05/06 06:08:31 (35) : touch-glob 2004-07-23 /tmp/060813ko/datadir/test_resolve-pafuvig2/ file1L.txt 2024/05/06 06:08:31 (36) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/ file1.txt 2024/05/06 06:08:31 INFO : file1L.txt: Copied (new) to: file1.txt 2024/05/06 06:08:31 (37) : test bisync run with --conflict-resolve=none --conflict-loser=pathname --conflict-suffix=.path 2024/05/06 06:08:31 (38) : bisync conflict-resolve=none conflict-loser=pathname conflict-suffix=.path 2024/05/06 06:08:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:31 INFO : Path1 checking for diffs 2024/05/06 06:08:31 INFO : - Path1 File is new - file1.txt 2024/05/06 06:08:31 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:31 INFO : Path2 checking for diffs 2024/05/06 06:08:31 INFO : - Path2 File is new - file1.txt 2024/05/06 06:08:31 INFO : Path2: 1 changes:  1 new,  0 modified,  0 deleted 2024/05/06 06:08:31 INFO : Applying changes 2024/05/06 06:08:31 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:31 INFO : Checking potential conflicts... 2024/05/06 06:08:31 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: 1 differences found 2024/05/06 06:08:31 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: 1 errors while checking 2024/05/06 06:08:31 INFO : Finished checking the potential conflicts. 1 differences found 2024/05/06 06:08:31 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:31 NOTICE: - Path1 Renaming Path1 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/file1.txt..path1 2024/05/06 06:08:31 INFO : file1.txt: Moved (server-side) to: file1.txt..path1 2024/05/06 06:08:31 NOTICE: - Path1 Queue copy to Path2 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/file1.txt..path1 2024/05/06 06:08:31 NOTICE: - Path2 Renaming Path2 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/file1.txt..path2 2024/05/06 06:08:31 INFO : file1.txt: Moved (server-side) to: file1.txt..path2 2024/05/06 06:08:31 NOTICE: - Path2 Queue copy to Path1 - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/file1.txt..path2 2024/05/06 06:08:31 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:31 INFO : file1.txt..path2: Copied (new) 2024/05/06 06:08:31 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:31 INFO : file1.txt..path1: Copied (new) 2024/05/06 06:08:31 INFO : Updating listings 2024/05/06 06:08:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Bisync successful 2024/05/06 06:08:31 (39) : test deletes on both sides with default suffix 2024/05/06 06:08:31 (40) : touch-glob 2005-01-02 /tmp/060813ko/datadir/test_resolve-pafuvig2/ file1R.txt 2024/05/06 06:08:31 (41) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/ file1.txt 2024/05/06 06:08:31 INFO : file1R.txt: Copied (new) to: file1.txt 2024/05/06 06:08:31 (42) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/ file2.txt 2024/05/06 06:08:31 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:31 (43) : touch-glob 2006-03-04 /tmp/060813ko/datadir/test_resolve-pafuvig2/ file1L.txt 2024/05/06 06:08:31 (44) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/ file1.txt 2024/05/06 06:08:31 INFO : file1L.txt: Copied (new) to: file1.txt 2024/05/06 06:08:31 (45) : copy-as /tmp/060813ko/datadir/test_resolve-pafuvig2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/ file2.txt 2024/05/06 06:08:31 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:31 (46) : test bisync run with --conflict-resolve=newer --conflict-loser=delete 2024/05/06 06:08:31 (47) : bisync conflict-resolve=newer conflict-loser=delete 2024/05/06 06:08:31 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:31 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:31 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:31 INFO : Path1 checking for diffs 2024/05/06 06:08:31 INFO : - Path1 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:31 INFO : - Path1 File is new - file1.txt 2024/05/06 06:08:31 INFO : Path1: 2 changes:  1 new,  1 modified,  0 deleted 2024/05/06 06:08:31 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:31 INFO : Path2 checking for diffs 2024/05/06 06:08:31 INFO : - Path2 File changed: size (larger), time (newer) - file2.txt 2024/05/06 06:08:31 INFO : - Path2 File is new - file1.txt 2024/05/06 06:08:31 INFO : Path2: 2 changes:  1 new,  1 modified,  0 deleted 2024/05/06 06:08:31 INFO : (Modified:  1 newer,  0 older,  1 larger,  0 smaller) 2024/05/06 06:08:31 INFO : Applying changes 2024/05/06 06:08:31 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:31 INFO : Checking potential conflicts... 2024/05/06 06:08:31 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: 2 differences found 2024/05/06 06:08:31 NOTICE: hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2: 2 errors while checking 2024/05/06 06:08:31 INFO : Finished checking the potential conflicts. 2 differences found 2024/05/06 06:08:31 NOTICE: - WARNING New or changed in both paths - file1.txt 2024/05/06 06:08:31 INFO : file1.txt: Path1 is newer. Path1: 2006-03-04 00:00:00 +0000 UTC, Path2: 2005-01-02 00:00:00 +0000 UTC, Difference: 10224h0m0s 2024/05/06 06:08:31 INFO : file1.txt: The winner is: Path1 2024/05/06 06:08:31 NOTICE: - Path2 Deleting Path2 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/file1.txt 2024/05/06 06:08:31 INFO : file1.txt: Deleted 2024/05/06 06:08:31 INFO : - Path1 Queue copy to Path2 - file1.txt 2024/05/06 06:08:31 NOTICE: - WARNING New or changed in both paths - file2.txt 2024/05/06 06:08:31 INFO : file2.txt: Path2 is newer. Path1: 2005-01-02 00:00:00 +0000 UTC, Path2: 2006-03-04 00:00:00 +0000 UTC, Difference: 10224h0m0s 2024/05/06 06:08:31 INFO : file2.txt: The winner is: Path2 2024/05/06 06:08:31 NOTICE: - Path1 Deleting Path1 copy - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/file2.txt 2024/05/06 06:08:31 INFO : file2.txt: Deleted 2024/05/06 06:08:31 INFO : - Path2 Queue copy to Path1 - file2.txt 2024/05/06 06:08:31 INFO : - Path2 Do queued copies to - Path1 2024/05/06 06:08:31 INFO : file2.txt: Copied (new) 2024/05/06 06:08:31 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:31 INFO : file1.txt: Copied (new) 2024/05/06 06:08:31 INFO : Updating listings 2024/05/06 06:08:31 INFO : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable) 2024/05/06 06:08:31 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resolve/path2/" 2024/05/06 06:08:31 INFO : Bisync successful bisync_test.go:555: TEST resolve PASSED === RUN TestBisyncRemoteRemote/resync 2024/05/06 06:08:31 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:31 DEBUG : path1: Making directory 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:31 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1" 2024/05/06 06:08:31 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:31 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:31 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1" 2024/05/06 06:08:31 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:31 DEBUG : path2: Making directory 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:31 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2" 2024/05/06 06:08:31 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:31 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:31 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:31 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:31 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2" 2024/05/06 06:08:31 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_resync-hukezex7" 2024/05/06 06:08:31 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : Local file system at /tmp/060813ko/initdir/test_resync-hukezex7: Waiting for checks to finish 2024/05/06 06:08:31 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:31 DEBUG : Local file system at /tmp/060813ko/initdir/test_resync-hukezex7: Waiting for transfers to finish 2024/05/06 06:08:31 DEBUG : file1.txt.vukesob1.partial: renamed to: file1.txt 2024/05/06 06:08:31 INFO : file1.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:31 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:31 DEBUG : file2.txt.yobuyit6.partial: renamed to: file2.txt 2024/05/06 06:08:31 INFO : file2.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:31 DEBUG : file3.txt.nokepit9.partial: renamed to: file3.txt 2024/05/06 06:08:31 INFO : file3.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : file4.txt.jatibig0.partial: renamed to: file4.txt 2024/05/06 06:08:31 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:31 INFO : file4.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : file5.txt.filolup8.partial: renamed to: file5.txt 2024/05/06 06:08:31 INFO : file5.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:31 DEBUG : file6.txt.xifosim3.partial: renamed to: file6.txt 2024/05/06 06:08:31 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:31 INFO : file6.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : file7.txt.ragageg7.partial: renamed to: file7.txt 2024/05/06 06:08:31 INFO : file7.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:31 DEBUG : RCLONE_TEST.yameqod3.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:31 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:31 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_resync-bawiwut7" 2024/05/06 06:08:31 DEBUG : fileA.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : fileB.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : Local file system at /tmp/060813ko/datadir/test_resync-bawiwut7: Waiting for checks to finish 2024/05/06 06:08:31 DEBUG : Local file system at /tmp/060813ko/datadir/test_resync-bawiwut7: Waiting for transfers to finish 2024/05/06 06:08:31 DEBUG : fileA.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:31 DEBUG : fileB.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:31 DEBUG : fileA.txt.zujizid7.partial: renamed to: fileA.txt 2024/05/06 06:08:31 INFO : fileA.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : fileB.txt.kayicig3.partial: renamed to: fileB.txt 2024/05/06 06:08:31 INFO : fileB.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1] 2024/05/06 06:08:31 ERROR : : error listing: directory not found 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2] 2024/05/06 06:08:31 ERROR : : error listing: directory not found 2024/05/06 06:08:31 checking initFs Local file system at /tmp/060813ko/initdir/test_resync-hukezex7 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1] 2024/05/06 06:08:31 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: Waiting for checks to finish 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/RCLONE_TEST] 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/file1.txt] 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/file2.txt] 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: Waiting for transfers to finish 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/file3.txt] 2024/05/06 06:08:31 INFO : file1.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/file4.txt] 2024/05/06 06:08:31 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/file5.txt] 2024/05/06 06:08:31 INFO : file2.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/file6.txt] 2024/05/06 06:08:31 INFO : file3.txt: Copied (new) 2024/05/06 06:08:31 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/file7.txt] 2024/05/06 06:08:31 INFO : file4.txt: Copied (new) 2024/05/06 06:08:32 INFO : file5.txt: Copied (new) 2024/05/06 06:08:32 INFO : file6.txt: Copied (new) 2024/05/06 06:08:32 INFO : file7.txt: Copied (new) 2024/05/06 06:08:32 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1] 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2] 2024/05/06 06:08:32 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/RCLONE_TEST] 2024/05/06 06:08:32 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/file1.txt] 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/file3.txt] 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: Waiting for checks to finish 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: Waiting for transfers to finish 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/file2.txt] 2024/05/06 06:08:32 INFO : file3.txt: Copied (new) 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/file4.txt] 2024/05/06 06:08:32 INFO : file1.txt: Copied (new) 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/file5.txt] 2024/05/06 06:08:32 INFO : file2.txt: Copied (new) 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/file6.txt] 2024/05/06 06:08:32 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/file7.txt] 2024/05/06 06:08:32 INFO : file4.txt: Copied (new) 2024/05/06 06:08:32 INFO : file5.txt: Copied (new) 2024/05/06 06:08:32 INFO : file6.txt: Copied (new) 2024/05/06 06:08:32 INFO : file7.txt: Copied (new) 2024/05/06 06:08:32 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2] 2024/05/06 06:08:32 (01) : test resync 2024/05/06 06:08:32 (02) : test 1. resync with empty path1, resulting in copying all content from path2. 2024/05/06 06:08:32 (03) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/ 2024/05/06 06:08:32 (04) : bisync resync 2024/05/06 06:08:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/" 2024/05/06 06:08:32 INFO : Copying Path2 files to Path1 2024/05/06 06:08:32 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:32 INFO : file2.txt: Copied (new) 2024/05/06 06:08:32 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:32 INFO : file3.txt: Copied (new) 2024/05/06 06:08:32 INFO : file1.txt: Copied (new) 2024/05/06 06:08:32 INFO : file4.txt: Copied (new) 2024/05/06 06:08:32 INFO : file5.txt: Copied (new) 2024/05/06 06:08:32 INFO : file6.txt: Copied (new) 2024/05/06 06:08:32 INFO : file7.txt: Copied (new) 2024/05/06 06:08:32 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:32 INFO : Resync updating listings 2024/05/06 06:08:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/" 2024/05/06 06:08:32 INFO : Bisync successful 2024/05/06 06:08:32 (05) : move-listings empty-path1 2024/05/06 06:08:32 (06) : test 2. resync with empty path2, resulting in synching all content to path2. 2024/05/06 06:08:32 (07) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/ 2024/05/06 06:08:32 (08) : bisync resync 2024/05/06 06:08:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/" 2024/05/06 06:08:32 INFO : Copying Path2 files to Path1 2024/05/06 06:08:32 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:32 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:32 INFO : file1.txt: Copied (new) 2024/05/06 06:08:32 INFO : file2.txt: Copied (new) 2024/05/06 06:08:32 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:32 INFO : file3.txt: Copied (new) 2024/05/06 06:08:32 INFO : file4.txt: Copied (new) 2024/05/06 06:08:32 INFO : file5.txt: Copied (new) 2024/05/06 06:08:32 INFO : file6.txt: Copied (new) 2024/05/06 06:08:32 INFO : file7.txt: Copied (new) 2024/05/06 06:08:32 INFO : Resync updating listings 2024/05/06 06:08:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/" 2024/05/06 06:08:32 INFO : Bisync successful 2024/05/06 06:08:32 (09) : move-listings empty-path2 2024/05/06 06:08:32 (10) : test 3. exercise all of the various file difference scenarios during a resync. 2024/05/06 06:08:32 (11) : touch-glob 2002-02-02 /tmp/060813ko/datadir/test_resync-bawiwut7/ fileA.txt 2024/05/06 06:08:32 (12) : touch-glob 1999-09-09 /tmp/060813ko/datadir/test_resync-bawiwut7/ fileB.txt 2024/05/06 06:08:32 (13) : test = file - path1 - path2 - expected action - who wins 2024/05/06 06:08:32 (14) : test - file1.txt - exists - missing - sync path1 > path2 - path1 2024/05/06 06:08:32 (15) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/file1.txt 2024/05/06 06:08:32 INFO : file1.txt: Deleted 2024/05/06 06:08:32 (16) : test - file2.txt - missing - exists - copy path2 > path1 - path2 2024/05/06 06:08:32 (17) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/file2.txt 2024/05/06 06:08:32 INFO : file2.txt: Deleted 2024/05/06 06:08:32 (18) : test - file3.txt - exists - newer date - sync path1 > path2 - path1 2024/05/06 06:08:32 (19) : copy-as /tmp/060813ko/datadir/test_resync-bawiwut7/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/ file3.txt 2024/05/06 06:08:32 INFO : fileA.txt: Copied (replaced existing) to: file3.txt 2024/05/06 06:08:32 (20) : test - file4.txt - missing - newer date - copy path2 > path1 - path2 2024/05/06 06:08:32 (21) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/file4.txt 2024/05/06 06:08:32 INFO : file4.txt: Deleted 2024/05/06 06:08:32 (22) : copy-as /tmp/060813ko/datadir/test_resync-bawiwut7/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/ file4.txt 2024/05/06 06:08:32 INFO : fileA.txt: Copied (replaced existing) to: file4.txt 2024/05/06 06:08:32 (23) : test - file5.txt - exists - older date - sync path1 > path2 - path1 2024/05/06 06:08:32 (24) : copy-as /tmp/060813ko/datadir/test_resync-bawiwut7/fileB.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/ file5.txt 2024/05/06 06:08:32 INFO : fileB.txt: Copied (replaced existing) to: file5.txt 2024/05/06 06:08:32 (25) : test - file6.txt - older date - newer date - sync path1 > path2 - path1 2024/05/06 06:08:32 (26) : copy-as /tmp/060813ko/datadir/test_resync-bawiwut7/fileB.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/ file6.txt 2024/05/06 06:08:32 INFO : fileB.txt: Copied (replaced existing) to: file6.txt 2024/05/06 06:08:32 (27) : copy-as /tmp/060813ko/datadir/test_resync-bawiwut7/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/ file6.txt 2024/05/06 06:08:32 INFO : fileA.txt: Copied (replaced existing) to: file6.txt 2024/05/06 06:08:32 (28) : test - file7.txt - exists - exists (same) - none - same 2024/05/06 06:08:32 (29) : test run bisync with resync 2024/05/06 06:08:32 (30) : bisync resync 2024/05/06 06:08:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/" 2024/05/06 06:08:32 INFO : Copying Path2 files to Path1 2024/05/06 06:08:32 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:32 INFO : file2.txt: Copied (new) 2024/05/06 06:08:32 INFO : file4.txt: Copied (new) 2024/05/06 06:08:32 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:32 INFO : file1.txt: Copied (new) 2024/05/06 06:08:32 INFO : file5.txt: Copied (replaced existing) 2024/05/06 06:08:32 INFO : file3.txt: Copied (replaced existing) 2024/05/06 06:08:32 INFO : file6.txt: Copied (replaced existing) 2024/05/06 06:08:32 INFO : Resync updating listings 2024/05/06 06:08:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/" 2024/05/06 06:08:32 INFO : Bisync successful 2024/05/06 06:08:32 (31) : copy-listings mixed-diffs 2024/05/06 06:08:32 (32) : test run normal bisync 2024/05/06 06:08:32 (33) : bisync 2024/05/06 06:08:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/" 2024/05/06 06:08:32 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:32 INFO : Path1 checking for diffs 2024/05/06 06:08:32 INFO : Path2 checking for diffs 2024/05/06 06:08:32 INFO : No changes found 2024/05/06 06:08:32 INFO : Updating listings 2024/05/06 06:08:32 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/" 2024/05/06 06:08:32 INFO : Bisync successful 2024/05/06 06:08:32 (34) : test 4. confirm critical error on normal sync of empty path. 2024/05/06 06:08:32 (35) : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/ 2024/05/06 06:08:32 (36) : bisync 2024/05/06 06:08:32 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:32 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:32 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync/path2/" 2024/05/06 06:08:32 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:32 INFO : Path1 checking for diffs 2024/05/06 06:08:32 INFO : Path2 checking for diffs 2024/05/06 06:08:32 ERROR : Empty current Path2 listing. Cannot sync to an empty directory: /tmp/060813ko/workdir/TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_resync_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_resync_path2.path2.lst-new 2024/05/06 06:08:32 ERROR : Bisync critical error: empty current Path2 listing: /tmp/060813ko/workdir/TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_resync_path1..TestHdfs_rclone-test-gisiqir9sihivew7fomireq5_060813ko_resync_path2.path2.lst-new 2024/05/06 06:08:32 ERROR : Bisync aborted. Must run --resync to recover. 2024/05/06 06:08:32 Bisync error: bisync aborted bisync_test.go:555: TEST resync PASSED === RUN TestBisyncRemoteRemote/resync_modes 2024/05/06 06:08:32 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:32 DEBUG : path1: Making directory 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:32 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1" 2024/05/06 06:08:32 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:32 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:32 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:32 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:32 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:32 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:32 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1" 2024/05/06 06:08:32 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:32 DEBUG : path2: Making directory 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:32 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2" 2024/05/06 06:08:32 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:32 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:32 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:32 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:32 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:32 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:32 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2" 2024/05/06 06:08:32 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_resync_modes-duwemet5" 2024/05/06 06:08:32 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:32 DEBUG : file1.txt.cunubiv1.partial: renamed to: file1.txt 2024/05/06 06:08:32 INFO : file1.txt: Copied (new) 2024/05/06 06:08:32 DEBUG : Local file system at /tmp/060813ko/initdir/test_resync_modes-duwemet5: Waiting for checks to finish 2024/05/06 06:08:32 DEBUG : Local file system at /tmp/060813ko/initdir/test_resync_modes-duwemet5: Waiting for transfers to finish 2024/05/06 06:08:32 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:32 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:32 DEBUG : RCLONE_TEST.vuveseb1.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:32 DEBUG : file2.txt.fizomix8.partial: renamed to: file2.txt 2024/05/06 06:08:32 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:32 INFO : file2.txt: Copied (new) 2024/05/06 06:08:32 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_resync_modes-fegesuc0" 2024/05/06 06:08:32 DEBUG : file1L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file1R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : Local file system at /tmp/060813ko/datadir/test_resync_modes-fegesuc0: Waiting for checks to finish 2024/05/06 06:08:32 DEBUG : Local file system at /tmp/060813ko/datadir/test_resync_modes-fegesuc0: Waiting for transfers to finish 2024/05/06 06:08:32 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK 2024/05/06 06:08:32 DEBUG : file1L.txt.nuwiyog7.partial: renamed to: file1L.txt 2024/05/06 06:08:32 INFO : file1L.txt: Copied (new) 2024/05/06 06:08:32 DEBUG : file1R.txt: md5 = 705bb3c0ef02925739e834ca98c099c3 OK 2024/05/06 06:08:32 DEBUG : file1R.txt.wuwubiw1.partial: renamed to: file1R.txt 2024/05/06 06:08:32 INFO : file1R.txt: Copied (new) 2024/05/06 06:08:32 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK 2024/05/06 06:08:32 DEBUG : file2.txt.budizaf0.partial: renamed to: file2.txt 2024/05/06 06:08:32 INFO : file2.txt: Copied (new) 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1] 2024/05/06 06:08:32 ERROR : : error listing: directory not found 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2] 2024/05/06 06:08:32 ERROR : : error listing: directory not found 2024/05/06 06:08:32 checking initFs Local file system at /tmp/060813ko/initdir/test_resync_modes-duwemet5 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1] 2024/05/06 06:08:32 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/RCLONE_TEST] 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/file1.txt] 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/file2.txt] 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1: Waiting for checks to finish 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1: Waiting for transfers to finish 2024/05/06 06:08:32 INFO : file1.txt: Copied (new) 2024/05/06 06:08:32 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:32 INFO : file2.txt: Copied (new) 2024/05/06 06:08:32 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1] 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2] 2024/05/06 06:08:32 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/file1.txt] 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2: Waiting for checks to finish 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2: Waiting for transfers to finish 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/RCLONE_TEST] 2024/05/06 06:08:32 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/file2.txt] 2024/05/06 06:08:33 INFO : file1.txt: Copied (new) 2024/05/06 06:08:33 INFO : file2.txt: Copied (new) 2024/05/06 06:08:33 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:33 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2] 2024/05/06 06:08:33 (01) : test resync-mode 2024/05/06 06:08:33 (02) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:33 (03) : touch-glob 2001-01-02 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1R.txt 2024/05/06 06:08:33 (04) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/ file1.txt 2024/05/06 06:08:33 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (05) : touch-glob 2001-03-04 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1L.txt 2024/05/06 06:08:33 (06) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/ file1.txt 2024/05/06 06:08:33 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (07) : test bisync run with --resync-mode=newer 2024/05/06 06:08:33 (08) : bisync resync resync-mode=newer 2024/05/06 06:08:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Copying Path2 files to Path1 2024/05/06 06:08:33 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:33 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:33 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:33 INFO : Resync updating listings 2024/05/06 06:08:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Bisync successful 2024/05/06 06:08:33 (09) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:33 (10) : touch-glob 2001-07-23 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1R.txt 2024/05/06 06:08:33 (11) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/ file1.txt 2024/05/06 06:08:33 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (12) : touch-glob 2001-08-26 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1L.txt 2024/05/06 06:08:33 (13) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/ file1.txt 2024/05/06 06:08:33 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (14) : test bisync run with --resync-mode=path2 2024/05/06 06:08:33 (15) : bisync resync resync-mode=path2 2024/05/06 06:08:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Copying Path2 files to Path1 2024/05/06 06:08:33 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:33 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:33 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:33 INFO : Resync updating listings 2024/05/06 06:08:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Bisync successful 2024/05/06 06:08:33 (16) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:33 (17) : touch-glob 2002-07-23 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1R.txt 2024/05/06 06:08:33 (18) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/ file1.txt 2024/05/06 06:08:33 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (19) : touch-glob 2002-08-26 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1L.txt 2024/05/06 06:08:33 (20) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/ file1.txt 2024/05/06 06:08:33 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (21) : test bisync run with --resync-mode=larger 2024/05/06 06:08:33 (22) : bisync resync resync-mode=larger 2024/05/06 06:08:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Copying Path2 files to Path1 2024/05/06 06:08:33 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:33 INFO : file1.txt: Path2 is larger. Path1: 33, Path2: 42, Difference: 9 2024/05/06 06:08:33 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:33 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:33 INFO : Resync updating listings 2024/05/06 06:08:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Bisync successful 2024/05/06 06:08:33 (23) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:33 (24) : touch-glob 2003-07-23 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1R.txt 2024/05/06 06:08:33 (25) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/ file1.txt 2024/05/06 06:08:33 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (26) : touch-glob 2003-09-04 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1L.txt 2024/05/06 06:08:33 (27) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/ file1.txt 2024/05/06 06:08:33 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (28) : test bisync run with --resync-mode=older 2024/05/06 06:08:33 (29) : bisync resync resync-mode=older 2024/05/06 06:08:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Copying Path2 files to Path1 2024/05/06 06:08:33 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:33 INFO : file1.txt: Path2 is older. Path1: 2003-09-04 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 1032h0m0s 2024/05/06 06:08:33 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:33 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:33 INFO : Resync updating listings 2024/05/06 06:08:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Bisync successful 2024/05/06 06:08:33 (30) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:33 (31) : touch-glob 2004-07-23 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1R.txt 2024/05/06 06:08:33 (32) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/ file1.txt 2024/05/06 06:08:33 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (33) : touch-glob 2004-07-23 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1L.txt 2024/05/06 06:08:33 (34) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/ file1.txt 2024/05/06 06:08:33 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (35) : test bisync run with --resync-mode=smaller 2024/05/06 06:08:33 (36) : bisync resync resync-mode=smaller 2024/05/06 06:08:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Copying Path2 files to Path1 2024/05/06 06:08:33 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:33 INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9 2024/05/06 06:08:33 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:33 INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9 2024/05/06 06:08:33 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:33 INFO : Resync updating listings 2024/05/06 06:08:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Bisync successful 2024/05/06 06:08:33 (37) : test changed on both paths and NOT identical - file1 (file1R, file1L) 2024/05/06 06:08:33 (38) : touch-glob 2005-01-02 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1R.txt 2024/05/06 06:08:33 (39) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/ file1.txt 2024/05/06 06:08:33 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (40) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/ file2.txt 2024/05/06 06:08:33 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:33 (41) : touch-glob 2006-03-04 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1L.txt 2024/05/06 06:08:33 (42) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/ file1.txt 2024/05/06 06:08:33 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (43) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/ file2.txt 2024/05/06 06:08:33 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:33 (44) : test bisync run with --resync-mode=path1 2024/05/06 06:08:33 (45) : bisync resync resync-mode=path1 2024/05/06 06:08:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Copying Path2 files to Path1 2024/05/06 06:08:33 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:33 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:33 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:33 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:33 INFO : Resync updating listings 2024/05/06 06:08:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Bisync successful 2024/05/06 06:08:33 (46) : test no winner 2024/05/06 06:08:33 (47) : touch-glob 2022-02-22 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1R.txt 2024/05/06 06:08:33 (48) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/ file1.txt 2024/05/06 06:08:33 INFO : file1R.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (49) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/ file2.txt 2024/05/06 06:08:33 INFO : file1R.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:33 (50) : touch-glob 2022-02-22 /tmp/060813ko/datadir/test_resync_modes-fegesuc0/ file1L.txt 2024/05/06 06:08:33 (51) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/ file1.txt 2024/05/06 06:08:33 INFO : file1L.txt: Copied (replaced existing) to: file1.txt 2024/05/06 06:08:33 (52) : copy-as /tmp/060813ko/datadir/test_resync_modes-fegesuc0/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/ file2.txt 2024/05/06 06:08:33 INFO : file1L.txt: Copied (replaced existing) to: file2.txt 2024/05/06 06:08:33 (53) : test bisync run with --resync-mode=newer 2024/05/06 06:08:33 (54) : bisync resync resync-mode=newer 2024/05/06 06:08:33 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:33 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:33 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Copying Path2 files to Path1 2024/05/06 06:08:33 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:33 INFO : file1.txt: Copied (replaced existing) 2024/05/06 06:08:33 INFO : file2.txt: Copied (replaced existing) 2024/05/06 06:08:33 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:33 INFO : Resync updating listings 2024/05/06 06:08:33 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/resync_modes/path2/" 2024/05/06 06:08:33 INFO : Bisync successful bisync_test.go:555: TEST resync_modes PASSED === RUN TestBisyncRemoteRemote/rmdirs 2024/05/06 06:08:33 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:33 DEBUG : path1: Making directory 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:33 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1" 2024/05/06 06:08:33 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:33 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:33 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:33 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:33 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:33 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:33 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1" 2024/05/06 06:08:33 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:33 DEBUG : path2: Making directory 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:33 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2" 2024/05/06 06:08:33 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:33 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:33 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:33 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:33 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:33 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:33 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2" 2024/05/06 06:08:33 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_rmdirs-gekapir3" 2024/05/06 06:08:33 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : subdir: Making directory with metadata 2024/05/06 06:08:33 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/05/06 06:08:33 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/05/06 06:08:33 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : Local file system at /tmp/060813ko/initdir/test_rmdirs-gekapir3: Waiting for checks to finish 2024/05/06 06:08:33 DEBUG : Local file system at /tmp/060813ko/initdir/test_rmdirs-gekapir3: Waiting for transfers to finish 2024/05/06 06:08:33 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:33 DEBUG : file1.copy1.txt.yevulap2.partial: renamed to: file1.copy1.txt 2024/05/06 06:08:33 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:33 DEBUG : file1.copy2.txt.tuhiduc0.partial: renamed to: file1.copy2.txt 2024/05/06 06:08:33 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:33 DEBUG : file1.copy4.txt.mukepop9.partial: renamed to: file1.copy4.txt 2024/05/06 06:08:33 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:33 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:33 DEBUG : file1.txt.duxotoh3.partial: renamed to: file1.txt 2024/05/06 06:08:33 INFO : file1.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:33 DEBUG : file1.copy5.txt.cajofux2.partial: renamed to: file1.copy5.txt 2024/05/06 06:08:33 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:33 DEBUG : file1.copy3.txt.zamenes6.partial: renamed to: file1.copy3.txt 2024/05/06 06:08:33 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:33 DEBUG : RCLONE_TEST.xuyupow3.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:33 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:33 DEBUG : subdir/file20.txt.dosiwok4.partial: renamed to: subdir/file20.txt 2024/05/06 06:08:33 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:33 INFO : subdir: Updated directory metadata 2024/05/06 06:08:33 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_rmdirs-fewuziy6" 2024/05/06 06:08:33 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : Local file system at /tmp/060813ko/datadir/test_rmdirs-fewuziy6: Waiting for checks to finish 2024/05/06 06:08:33 DEBUG : Local file system at /tmp/060813ko/datadir/test_rmdirs-fewuziy6: Waiting for transfers to finish 2024/05/06 06:08:33 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:33 DEBUG : file1.txt.jihokej2.partial: renamed to: file1.txt 2024/05/06 06:08:33 INFO : file1.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1] 2024/05/06 06:08:33 ERROR : : error listing: directory not found 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2] 2024/05/06 06:08:33 ERROR : : error listing: directory not found 2024/05/06 06:08:33 checking initFs Local file system at /tmp/060813ko/initdir/test_rmdirs-gekapir3 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1] 2024/05/06 06:08:33 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : subdir: Making directory 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/subdir] 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/RCLONE_TEST] 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/file1.copy2.txt] 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/file1.copy1.txt] 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/file1.copy3.txt] 2024/05/06 06:08:33 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: Waiting for checks to finish 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: Waiting for transfers to finish 2024/05/06 06:08:33 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/file1.copy4.txt] 2024/05/06 06:08:33 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/file1.copy5.txt] 2024/05/06 06:08:33 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/file1.txt] 2024/05/06 06:08:33 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/subdir/file20.txt] 2024/05/06 06:08:33 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:33 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:33 INFO : file1.txt: Copied (new) 2024/05/06 06:08:33 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:33 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1] 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/subdir] 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2] 2024/05/06 06:08:33 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : subdir: Making directory 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/RCLONE_TEST] 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/subdir] 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/file1.copy2.txt] 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/file1.copy3.txt] 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/file1.copy1.txt] 2024/05/06 06:08:33 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: Waiting for checks to finish 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: Waiting for transfers to finish 2024/05/06 06:08:33 INFO : file1.copy1.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/file1.copy4.txt] 2024/05/06 06:08:33 INFO : file1.copy2.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/file1.copy5.txt] 2024/05/06 06:08:33 INFO : file1.copy3.txt: Copied (new) 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/file1.txt] 2024/05/06 06:08:33 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/subdir/file20.txt] 2024/05/06 06:08:33 INFO : file1.copy4.txt: Copied (new) 2024/05/06 06:08:33 INFO : file1.copy5.txt: Copied (new) 2024/05/06 06:08:33 INFO : file1.txt: Copied (new) 2024/05/06 06:08:33 INFO : subdir/file20.txt: Copied (new) 2024/05/06 06:08:33 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2 2024/05/06 06:08:33 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2] 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/subdir] 2024/05/06 06:08:34 (01) : test rmdirs 2024/05/06 06:08:34 (02) : test initial bisync 2024/05/06 06:08:34 (03) : bisync resync 2024/05/06 06:08:34 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:34 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:34 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/" 2024/05/06 06:08:34 INFO : Copying Path2 files to Path1 2024/05/06 06:08:34 INFO : - Path2 Resync is copying files to - Path1 2024/05/06 06:08:34 INFO : - Path1 Resync is copying files to - Path2 2024/05/06 06:08:34 INFO : Resync updating listings 2024/05/06 06:08:34 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/" 2024/05/06 06:08:34 INFO : Bisync successful 2024/05/06 06:08:34 (04) : test 1. delete path1 subdir file 2024/05/06 06:08:34 (05) : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/subdir/file20.txt 2024/05/06 06:08:34 INFO : file20.txt: Deleted 2024/05/06 06:08:34 (06) : test 2. run bisync without remove-empty-dirs 2024/05/06 06:08:34 (07) : bisync 2024/05/06 06:08:34 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:34 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:34 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/" 2024/05/06 06:08:34 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:34 INFO : Path1 checking for diffs 2024/05/06 06:08:34 INFO : - Path1 File was deleted - subdir/file20.txt 2024/05/06 06:08:34 INFO : Path1: 1 changes:  0 new,  0 modified,  1 deleted 2024/05/06 06:08:34 INFO : Path2 checking for diffs 2024/05/06 06:08:34 INFO : Applying changes 2024/05/06 06:08:34 INFO : - Path2 Queue delete - TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/subdir/file20.txt 2024/05/06 06:08:34 INFO : - Path1 Do queued copies to - Path2 2024/05/06 06:08:34 INFO : subdir/file20.txt: Deleted 2024/05/06 06:08:34 INFO : Updating listings 2024/05/06 06:08:34 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/" 2024/05/06 06:08:34 INFO : Bisync successful 2024/05/06 06:08:34 (08) : test 3. confirm the subdir still exists on both paths 2024/05/06 06:08:34 (09) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/ 2024/05/06 06:08:34 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:34 (10) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/ 2024/05/06 06:08:34 subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2 2024/05/06 06:08:34 (11) : test 4. run bisync with remove-empty-dirs 2024/05/06 06:08:34 (12) : bisync remove-empty-dirs 2024/05/06 06:08:34 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/05/06 06:08:34 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/05/06 06:08:34 INFO : Synching Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/" 2024/05/06 06:08:34 INFO : Building Path1 and Path2 listings 2024/05/06 06:08:34 INFO : Path1 checking for diffs 2024/05/06 06:08:34 INFO : Path2 checking for diffs 2024/05/06 06:08:34 INFO : No changes found 2024/05/06 06:08:34 INFO : Updating listings 2024/05/06 06:08:34 INFO : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/" 2024/05/06 06:08:34 INFO : Removing empty directories 2024/05/06 06:08:34 INFO : subdir: Removing directory 2024/05/06 06:08:34 INFO : subdir: Removing directory 2024/05/06 06:08:34 INFO : Bisync successful 2024/05/06 06:08:34 (13) : test 5. confirm the subdir has been removed on both paths 2024/05/06 06:08:34 (14) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path1/ 2024/05/06 06:08:34 (15) : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-gisiqir9sihivew7fomireq5/060813ko/rmdirs/path2/ bisync_test.go:555: TEST rmdirs PASSED === RUN TestBisyncRemoteRemote/volatile 2024/05/06 06:08:34 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:34 DEBUG : path1: Making directory 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path1] 2024/05/06 06:08:34 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1" 2024/05/06 06:08:34 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:34 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:34 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:34 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:34 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:34 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:34 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1" 2024/05/06 06:08:34 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko" for canonical name "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko" 2024/05/06 06:08:34 DEBUG : path2: Making directory 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko: mkdir [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/path2] 2024/05/06 06:08:34 DEBUG : Creating backend with remote "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2" 2024/05/06 06:08:34 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE 2024/05/06 06:08:34 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:34 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:34 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name 2024/05/06 06:08:34 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE 2024/05/06 06:08:34 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME 2024/05/06 06:08:34 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2" 2024/05/06 06:08:34 DEBUG : Creating backend with remote "/tmp/060813ko/initdir/test_volatile-lapikuf0" 2024/05/06 06:08:34 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : Local file system at /tmp/060813ko/initdir/test_volatile-lapikuf0: Waiting for checks to finish 2024/05/06 06:08:34 DEBUG : Local file system at /tmp/060813ko/initdir/test_volatile-lapikuf0: Waiting for transfers to finish 2024/05/06 06:08:34 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:34 DEBUG : file1.txt.litaduq9.partial: renamed to: file1.txt 2024/05/06 06:08:34 INFO : file1.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:34 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/05/06 06:08:34 DEBUG : file3.txt.wabonew9.partial: renamed to: file3.txt 2024/05/06 06:08:34 INFO : file3.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : RCLONE_TEST.negixoz7.partial: renamed to: RCLONE_TEST 2024/05/06 06:08:34 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:34 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:34 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:34 DEBUG : file4.txt.bakupuq9.partial: renamed to: file4.txt 2024/05/06 06:08:34 DEBUG : file5.txt.jejagey3.partial: renamed to: file5.txt 2024/05/06 06:08:34 INFO : file5.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:34 INFO : file4.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file6.txt.pucipic2.partial: renamed to: file6.txt 2024/05/06 06:08:34 INFO : file6.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:34 DEBUG : file8.txt.cisilad5.partial: renamed to: file8.txt 2024/05/06 06:08:34 INFO : file8.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:34 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:34 DEBUG : file7.txt.yobeqij1.partial: renamed to: file7.txt 2024/05/06 06:08:34 INFO : file7.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file2.txt.liwucub8.partial: renamed to: file2.txt 2024/05/06 06:08:34 INFO : file2.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : Creating backend with remote "/tmp/060813ko/datadir/test_volatile-qujebuk6" 2024/05/06 06:08:34 DEBUG : dummy.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file10.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file11.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file5L.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file5R.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : dummy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/05/06 06:08:34 DEBUG : dummy.txt.vimibum7.partial: renamed to: dummy.txt 2024/05/06 06:08:34 INFO : dummy.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : Local file system at /tmp/060813ko/datadir/test_volatile-qujebuk6: Waiting for checks to finish 2024/05/06 06:08:34 DEBUG : Local file system at /tmp/060813ko/datadir/test_volatile-qujebuk6: Waiting for transfers to finish 2024/05/06 06:08:34 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:34 DEBUG : file1.txt.suyacav4.partial: renamed to: file1.txt 2024/05/06 06:08:34 INFO : file1.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:34 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:34 DEBUG : file10.txt.jivoqal3.partial: renamed to: file10.txt 2024/05/06 06:08:34 INFO : file10.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file11.txt.qupeyah9.partial: renamed to: file11.txt 2024/05/06 06:08:34 INFO : file11.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK 2024/05/06 06:08:34 DEBUG : file2.txt.ququzer7.partial: renamed to: file2.txt 2024/05/06 06:08:34 INFO : file2.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:34 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK 2024/05/06 06:08:34 DEBUG : file6.txt.gaqukaj7.partial: renamed to: file6.txt 2024/05/06 06:08:34 INFO : file6.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file5R.txt.gisemis4.partial: renamed to: file5R.txt 2024/05/06 06:08:34 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK 2024/05/06 06:08:34 INFO : file5R.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file5L.txt.bidojaz6.partial: renamed to: file5L.txt 2024/05/06 06:08:34 INFO : file5L.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/05/06 06:08:34 DEBUG : file7.txt.huzopur7.partial: renamed to: file7.txt 2024/05/06 06:08:34 INFO : file7.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1] 2024/05/06 06:08:34 ERROR : : error listing: directory not found 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2] 2024/05/06 06:08:34 ERROR : : error listing: directory not found 2024/05/06 06:08:34 checking initFs Local file system at /tmp/060813ko/initdir/test_volatile-lapikuf0 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1] 2024/05/06 06:08:34 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1/RCLONE_TEST] 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1/file1.txt] 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1/file3.txt] 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: Waiting for checks to finish 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: Waiting for transfers to finish 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1/file2.txt] 2024/05/06 06:08:34 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1/file4.txt] 2024/05/06 06:08:34 INFO : file1.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1/file5.txt] 2024/05/06 06:08:34 INFO : file2.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1/file6.txt] 2024/05/06 06:08:34 INFO : file3.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1/file7.txt] 2024/05/06 06:08:34 INFO : file4.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1/file8.txt] 2024/05/06 06:08:34 INFO : file5.txt: Copied (new) 2024/05/06 06:08:34 INFO : file6.txt: Copied (new) 2024/05/06 06:08:34 INFO : file7.txt: Copied (new) 2024/05/06 06:08:34 INFO : file8.txt: Copied (new) 2024/05/06 06:08:34 checking Path1 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path1] 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2] 2024/05/06 06:08:34 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2/RCLONE_TEST] 2024/05/06 06:08:34 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2/file1.txt] 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2/file3.txt] 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2/file2.txt] 2024/05/06 06:08:34 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : file8.txt: Need to transfer - File not found at Destination 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: Waiting for checks to finish 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: Waiting for transfers to finish 2024/05/06 06:08:34 INFO : file1.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2/file4.txt] 2024/05/06 06:08:34 INFO : file3.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2/file5.txt] 2024/05/06 06:08:34 INFO : file2.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2/file6.txt] 2024/05/06 06:08:34 INFO : RCLONE_TEST: Copied (new) 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2/file7.txt] 2024/05/06 06:08:34 INFO : file4.txt: Copied (new) 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: update [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2/file8.txt] 2024/05/06 06:08:34 INFO : file5.txt: Copied (new) 2024/05/06 06:08:34 INFO : file6.txt: Copied (new) 2024/05/06 06:08:34 INFO : file7.txt: Copied (new) 2024/05/06 06:08:34 INFO : file8.txt: Copied (new) 2024/05/06 06:08:34 checking path2 hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2: list [/rclone-test-gisiqir9sihivew7fomireq5/060813ko/volatile/path2] 2024/05/06 06:08:34 (01) : test volatile 2024/05/06 06:08:34 (02) : test initial bisync 2024/05/06 06:08:34 (03) : bisync resync bisync_test.go:923: skipping 'volatile' test on non-local as it requires uploading 100 files 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5: Purge remote 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-gisiqir9sihivew7fomireq5: purge [/rclone-test-gisiqir9sihivew7fomireq5] --- PASS: TestBisyncRemoteRemote (20.67s) --- PASS: TestBisyncRemoteRemote/all_changed (0.90s) --- SKIP: TestBisyncRemoteRemote/backupdir (0.37s) --- PASS: TestBisyncRemoteRemote/basic (0.51s) --- PASS: TestBisyncRemoteRemote/changes (0.86s) --- PASS: TestBisyncRemoteRemote/check_access (0.71s) --- PASS: TestBisyncRemoteRemote/check_access_filters (1.35s) --- PASS: TestBisyncRemoteRemote/check_filename (0.60s) --- PASS: TestBisyncRemoteRemote/check_sync (0.64s) --- PASS: TestBisyncRemoteRemote/compare_all (0.84s) --- PASS: TestBisyncRemoteRemote/createemptysrcdirs (0.86s) --- PASS: TestBisyncRemoteRemote/dry_run (0.94s) --- PASS: TestBisyncRemoteRemote/equal (0.39s) --- PASS: TestBisyncRemoteRemote/ext_paths (0.91s) --- PASS: TestBisyncRemoteRemote/extended_filenames (1.24s) --- PASS: TestBisyncRemoteRemote/filters (0.51s) --- PASS: TestBisyncRemoteRemote/filtersfile_checks (0.43s) --- PASS: TestBisyncRemoteRemote/ignorelistingchecksum (0.53s) --- PASS: TestBisyncRemoteRemote/max_delete_path1 (0.55s) --- PASS: TestBisyncRemoteRemote/max_delete_path2_force (0.58s) --- PASS: TestBisyncRemoteRemote/nomodtime (0.93s) --- PASS: TestBisyncRemoteRemote/normalization (1.54s) --- PASS: TestBisyncRemoteRemote/rclone_args (1.02s) --- PASS: TestBisyncRemoteRemote/resolve (0.78s) --- PASS: TestBisyncRemoteRemote/resync (1.06s) --- PASS: TestBisyncRemoteRemote/resync_modes (0.74s) --- PASS: TestBisyncRemoteRemote/rmdirs (0.49s) --- SKIP: TestBisyncRemoteRemote/volatile (0.37s) PASS 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-suvebas7kodujiw1rewipej6: Purge remote 2024/05/06 06:08:34 DEBUG : hdfs://127.0.0.1:8020/rclone-test-suvebas7kodujiw1rewipej6: purge [/rclone-test-suvebas7kodujiw1rewipej6] 2024/05/06 06:08:34 purge failed: directory not found "./bisync.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose" - Finished OK in 44.7406886s (try 1/5)